2024-05-17T03:57:41.556 INFO:root:teuthology version: 0.0.1.dev275+ga4b16c5 2024-05-17T03:57:41.556 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} --name pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314 -- /home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314/orig.config.yaml 2024-05-17T03:57:41.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-17T03:57:41.698 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314 branch: wip-pdonnell-testing-20240517.012458-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: pdonnell@redhat.com first_in_suite: false job_id: '7710314' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240517.012458-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 931809a9e5d295bd61984693cac44fe131ded4bc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 931809a9e5d295bd61984693cac44fe131ded4bc selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240517.012458-debug sha1: 931809a9e5d295bd61984693cac44fe131ded4bc owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1967 sha1: 931809a9e5d295bd61984693cac44fe131ded4bc sleep_before_teardown: 0 subset: 59/512 suite: fs suite_branch: wip-pdonnell-testing-20240517.012458-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_931809a9e5d295bd61984693cac44fe131ded4bc/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 931809a9e5d295bd61984693cac44fe131ded4bc syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAkIeqZ1Lq+daB3VrsbZWGFG0yv1p3lA/7jEN4fpSRsQ2tORlS7kVKCTHJS8TKhXfEIHIcG4tAJtoVCa5QZEhXg= smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM6yn5RL+r1O16cW28dKB5TWHXawrJIKtOenu0T7S4UXj6VUgotAElcjDcyz1EwxKBm1bmglO2DaBRTw6HsXMO0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: a4b16c58a5d7aa60dee491f6f096b7509e2f1269 timestamp: 2024-05-17_03:38:57 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-17T03:57:41.699 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_931809a9e5d295bd61984693cac44fe131ded4bc/qa; will attempt to use it 2024-05-17T03:57:41.699 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_931809a9e5d295bd61984693cac44fe131ded4bc/qa/tasks 2024-05-17T03:57:41.700 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-17T03:57:41.701 INFO:teuthology.task.internal:Checking packages... 2024-05-17T03:57:41.722 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '931809a9e5d295bd61984693cac44fe131ded4bc' 2024-05-17T03:57:41.722 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-17T03:57:41.722 INFO:teuthology.packaging:ref: None 2024-05-17T03:57:41.722 INFO:teuthology.packaging:tag: None 2024-05-17T03:57:41.723 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240517.012458-debug 2024-05-17T03:57:41.723 INFO:teuthology.packaging:sha1: 931809a9e5d295bd61984693cac44fe131ded4bc 2024-05-17T03:57:41.723 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240517.012458-debug 2024-05-17T03:57:41.945 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3794.g931809a9 2024-05-17T03:57:41.947 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-17T03:57:41.953 INFO:teuthology.task.internal:no buildpackages task found 2024-05-17T03:57:41.953 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-17T03:57:41.995 INFO:teuthology.task.internal:Saving configuration 2024-05-17T03:57:42.012 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-17T03:57:42.028 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-17T03:57:42.055 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-17 03:52:24.092500', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAkIeqZ1Lq+daB3VrsbZWGFG0yv1p3lA/7jEN4fpSRsQ2tORlS7kVKCTHJS8TKhXfEIHIcG4tAJtoVCa5QZEhXg='} 2024-05-17T03:57:42.081 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-17 03:52:24.091004', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM6yn5RL+r1O16cW28dKB5TWHXawrJIKtOenu0T7S4UXj6VUgotAElcjDcyz1EwxKBm1bmglO2DaBRTw6HsXMO0='} 2024-05-17T03:57:42.082 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-17T03:57:42.089 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-17T03:57:42.089 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-17T03:57:42.089 INFO:teuthology.run_tasks:Running task console_log... 2024-05-17T03:57:42.217 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2d0d407ac0>, signals=[15]) 2024-05-17T03:57:42.217 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-17T03:57:42.228 INFO:teuthology.task.internal:Opening connections... 2024-05-17T03:57:42.228 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2024-05-17T03:57:42.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-17T03:57:42.322 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2024-05-17T03:57:42.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-17T03:57:42.403 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-17T03:57:42.412 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-05-17T03:57:42.431 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-05-17T03:57:42.431 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-05-17T03:57:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2024-05-17T03:57:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9" 2024-05-17T03:57:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2024-05-17T03:57:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2024-05-17T03:57:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9" 2024-05-17T03:57:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9" 2024-05-17T03:57:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-17T03:57:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2024-05-17T03:57:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon" 2024-05-17T03:57:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-17T03:57:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2024-05-17T03:57:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-17T03:57:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-17T03:57:42.489 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-17T03:57:42.490 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-05-17T03:57:42.512 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-05-17T03:57:42.529 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-05-17T03:57:42.530 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-05-17T03:57:42.587 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2024-05-17T03:57:42.587 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2024-05-17T03:57:42.587 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2024-05-17T03:57:42.587 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2024-05-17T03:57:42.588 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2024-05-17T03:57:42.588 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2024-05-17T03:57:42.588 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-17T03:57:42.588 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-05-17T03:57:42.588 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2024-05-17T03:57:42.588 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-17T03:57:42.588 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2024-05-17T03:57:42.589 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-17T03:57:42.589 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-17T03:57:42.589 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-17T03:57:42.589 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-05-17T03:57:42.629 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-17T03:57:42.643 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-17T03:57:42.683 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-17T03:57:42.683 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2024-05-17T03:57:42.686 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2024-05-17T03:57:42.703 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-17T03:57:42.732 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-17T03:57:42.732 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2024-05-17T03:57:42.744 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2024-05-17T03:57:42.772 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-17T03:57:42.837 INFO:teuthology.run_tasks:Running task kernel... 2024-05-17T03:57:42.856 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-17T03:57:42.856 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-17T03:57:42.857 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-17T03:57:42.857 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-17T03:57:42.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T03:57:42.874 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-05-17T03:57:42.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T03:57:42.875 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-05-17T03:57:42.931 INFO:teuthology.orchestra.run.smithi131.stdout:5.14.0-437.el9.x86_64 2024-05-17T03:57:42.931 INFO:teuthology.task.kernel:Running kernel on smithi131: 5.14.0-437.el9.x86_64 2024-05-17T03:57:42.931 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum install -y kernel 2024-05-17T03:57:42.932 INFO:teuthology.orchestra.run.smithi150.stdout:5.14.0-437.el9.x86_64 2024-05-17T03:57:42.932 INFO:teuthology.task.kernel:Running kernel on smithi150: 5.14.0-437.el9.x86_64 2024-05-17T03:57:42.933 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum install -y kernel 2024-05-17T03:57:45.015 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.1 MB 00:00 2024-05-17T03:57:45.661 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - BaseOS 8.5 MB/s | 8.1 MB 00:00 2024-05-17T03:57:46.874 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-05-17T03:57:49.120 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 19 MB 00:02 2024-05-17T03:57:50.925 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-05-17T03:57:52.509 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 16 kB 00:00 2024-05-17T03:57:53.179 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-05-17T03:57:53.638 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:00 2024-05-17T03:57:54.946 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 16 kB 00:00 2024-05-17T03:57:55.892 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 26 MB/s | 21 MB 00:00 2024-05-17T03:57:58.786 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-05-17T03:58:00.767 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-17T03:58:00.768 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-17T03:58:00.860 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-05-17T03:58:00.865 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-05-17T03:58:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-05-17T03:58:00.866 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-05-17T03:58:00.866 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-05-17T03:58:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: kernel x86_64 5.14.0-446.el9 baseos 550 k 2024-05-17T03:58:00.866 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-05-17T03:58:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-core x86_64 5.14.0-446.el9 baseos 15 M 2024-05-17T03:58:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules x86_64 5.14.0-446.el9 baseos 34 M 2024-05-17T03:58:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules-core x86_64 5.14.0-446.el9 baseos 28 M 2024-05-17T03:58:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T03:58:00.867 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-05-17T03:58:00.867 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-05-17T03:58:00.867 INFO:teuthology.orchestra.run.smithi131.stdout:Install 4 Packages 2024-05-17T03:58:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T03:58:00.868 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 78 M 2024-05-17T03:58:00.868 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 123 M 2024-05-17T03:58:00.869 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-05-17T03:58:01.014 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-05-17T03:58:01.212 INFO:teuthology.orchestra.run.smithi131.stdout:(1/4): kernel-5.14.0-446.el9.x86_64.rpm 2.4 MB/s | 550 kB 00:00 2024-05-17T03:58:01.217 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:00:01 ago on Fri 17 May 2024 03:58:00 AM UTC. 2024-05-17T03:58:01.688 INFO:teuthology.orchestra.run.smithi131.stdout:(2/4): kernel-core-5.14.0-446.el9.x86_64.rpm 22 MB/s | 15 MB 00:00 2024-05-17T03:58:02.413 INFO:teuthology.orchestra.run.smithi131.stdout:(3/4): kernel-modules-5.14.0-446.el9.x86_64.rpm 24 MB/s | 34 MB 00:01 2024-05-17T03:58:02.713 INFO:teuthology.orchestra.run.smithi131.stdout:(4/4): kernel-modules-core-5.14.0-446.el9.x86_6 19 MB/s | 28 MB 00:01 2024-05-17T03:58:02.716 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-05-17T03:58:02.716 INFO:teuthology.orchestra.run.smithi131.stdout:Total 42 MB/s | 78 MB 00:01 2024-05-17T03:58:02.995 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-17T03:58:02.995 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-17T03:58:03.093 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-05-17T03:58:03.101 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-05-17T03:58:03.101 INFO:teuthology.orchestra.run.smithi150.stdout: Package Architecture Version Repository Size 2024-05-17T03:58:03.101 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-05-17T03:58:03.101 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-05-17T03:58:03.102 INFO:teuthology.orchestra.run.smithi150.stdout: kernel x86_64 5.14.0-446.el9 baseos 550 k 2024-05-17T03:58:03.102 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-05-17T03:58:03.102 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-core x86_64 5.14.0-446.el9 baseos 15 M 2024-05-17T03:58:03.102 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules x86_64 5.14.0-446.el9 baseos 34 M 2024-05-17T03:58:03.102 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules-core x86_64 5.14.0-446.el9 baseos 28 M 2024-05-17T03:58:03.102 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T03:58:03.102 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-05-17T03:58:03.102 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-05-17T03:58:03.102 INFO:teuthology.orchestra.run.smithi150.stdout:Install 4 Packages 2024-05-17T03:58:03.102 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T03:58:03.102 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 78 M 2024-05-17T03:58:03.103 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 123 M 2024-05-17T03:58:03.103 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-05-17T03:58:03.396 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-05-17T03:58:03.508 INFO:teuthology.orchestra.run.smithi150.stdout:(1/4): kernel-5.14.0-446.el9.x86_64.rpm 2.7 MB/s | 550 kB 00:00 2024-05-17T03:58:03.750 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-05-17T03:58:03.751 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-05-17T03:58:03.983 INFO:teuthology.orchestra.run.smithi150.stdout:(2/4): kernel-core-5.14.0-446.el9.x86_64.rpm 23 MB/s | 15 MB 00:00 2024-05-17T03:58:04.583 INFO:teuthology.orchestra.run.smithi150.stdout:(3/4): kernel-modules-core-5.14.0-446.el9.x86_6 26 MB/s | 28 MB 00:01 2024-05-17T03:58:04.690 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-05-17T03:58:04.691 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-05-17T03:58:04.941 INFO:teuthology.orchestra.run.smithi150.stdout:(4/4): kernel-modules-5.14.0-446.el9.x86_64.rpm 21 MB/s | 34 MB 00:01 2024-05-17T03:58:04.942 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-05-17T03:58:04.942 INFO:teuthology.orchestra.run.smithi150.stdout:Total 42 MB/s | 78 MB 00:01 2024-05-17T03:58:05.625 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-05-17T03:58:05.967 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-05-17T03:58:05.967 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-05-17T03:58:06.902 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-05-17T03:58:06.902 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-05-17T03:58:07.077 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-05-17T03:58:07.693 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-modules-core-5.14.0-446.el9.x86_64 1/4 2024-05-17T03:58:07.782 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-17T03:58:09.303 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-05-17T03:58:09.977 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-modules-core-5.14.0-446.el9.x86_64 1/4 2024-05-17T03:58:10.058 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-17T03:58:10.436 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-17T03:58:10.584 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-17T03:58:12.739 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-17T03:58:12.878 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-17T03:58:15.318 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-17T03:58:15.437 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-5.14.0-446.el9.x86_64 4/4 2024-05-17T03:58:17.623 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-17T03:58:17.672 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : kernel-5.14.0-446.el9.x86_64 4/4 2024-05-17T03:58:20.148 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-17T03:58:22.415 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-17T03:58:49.939 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 4/4 2024-05-17T03:58:49.977 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 4/4 2024-05-17T03:58:50.343 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-5.14.0-446.el9.x86_64 4/4 2024-05-17T03:58:50.343 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-5.14.0-446.el9.x86_64 1/4 2024-05-17T03:58:50.343 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-17T03:58:50.343 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-17T03:58:51.161 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-17T03:58:51.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T03:58:51.161 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-05-17T03:58:51.161 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-5.14.0-446.el9.x86_64 2024-05-17T03:58:51.161 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-core-5.14.0-446.el9.x86_64 2024-05-17T03:58:51.162 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules-5.14.0-446.el9.x86_64 2024-05-17T03:58:51.162 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules-core-5.14.0-446.el9.x86_64 2024-05-17T03:58:51.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T03:58:51.162 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-05-17T03:58:51.501 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q kernel | sort -rV | head -n 1 2024-05-17T03:58:51.613 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-17T03:58:51.613 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-17T03:58:51.614 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-446.el9.x86_64 2024-05-17T03:58:51.614 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-17T03:58:51.614 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-17T03:58:51.614 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-17T03:58:51.614 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi131.front.sepia.ceph.com, path=None, version=distro) 2024-05-17T03:58:51.614 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q kernel | sort -rV | head -n 1 2024-05-17T03:58:51.663 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-17T03:58:51.664 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-17T03:58:51.664 DEBUG:teuthology.orchestra.run.smithi131:> sudo rpm -qi grub2-tools 2024-05-17T03:58:51.694 INFO:teuthology.orchestra.run.smithi131.stdout:Name : grub2-tools 2024-05-17T03:58:51.694 INFO:teuthology.orchestra.run.smithi131.stdout:Epoch : 1 2024-05-17T03:58:51.694 INFO:teuthology.orchestra.run.smithi131.stdout:Version : 2.06 2024-05-17T03:58:51.694 INFO:teuthology.orchestra.run.smithi131.stdout:Release : 68.el9 2024-05-17T03:58:51.695 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: x86_64 2024-05-17T03:58:51.695 INFO:teuthology.orchestra.run.smithi131.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-17T03:58:51.695 INFO:teuthology.orchestra.run.smithi131.stdout:Group : Unspecified 2024-05-17T03:58:51.695 INFO:teuthology.orchestra.run.smithi131.stdout:Size : 8264254 2024-05-17T03:58:51.695 INFO:teuthology.orchestra.run.smithi131.stdout:License : GPLv3+ 2024-05-17T03:58:51.695 INFO:teuthology.orchestra.run.smithi131.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-17T03:58:51.695 INFO:teuthology.orchestra.run.smithi131.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-17T03:58:51.695 INFO:teuthology.orchestra.run.smithi131.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-17T03:58:51.695 INFO:teuthology.orchestra.run.smithi131.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-17T03:58:51.695 INFO:teuthology.orchestra.run.smithi131.stdout:Packager : builder@centos.org 2024-05-17T03:58:51.695 INFO:teuthology.orchestra.run.smithi131.stdout:Vendor : CentOS 2024-05-17T03:58:51.695 INFO:teuthology.orchestra.run.smithi131.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-17T03:58:51.695 INFO:teuthology.orchestra.run.smithi131.stdout:Summary : Support tools for GRUB. 2024-05-17T03:58:51.695 INFO:teuthology.orchestra.run.smithi131.stdout:Description : 2024-05-17T03:58:51.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T03:58:51.696 INFO:teuthology.orchestra.run.smithi131.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-17T03:58:51.696 INFO:teuthology.orchestra.run.smithi131.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-17T03:58:51.696 INFO:teuthology.orchestra.run.smithi131.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-17T03:58:51.696 INFO:teuthology.orchestra.run.smithi131.stdout:hardware devices. 2024-05-17T03:58:51.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T03:58:51.696 INFO:teuthology.orchestra.run.smithi131.stdout:This subpackage provides tools for support of all platforms. 2024-05-17T03:58:51.697 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-17T03:58:51.697 INFO:teuthology.task.kernel:Updating grub on smithi131 to boot 5.14.0-446.el9.x86_64 2024-05-17T03:58:51.697 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-17T03:58:51.910 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 4/4 2024-05-17T03:58:51.949 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 4/4 2024-05-17T03:58:52.300 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: kernel-5.14.0-446.el9.x86_64 4/4 2024-05-17T03:58:52.300 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-5.14.0-446.el9.x86_64 1/4 2024-05-17T03:58:52.300 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-17T03:58:52.300 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-17T03:58:52.317 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2024-05-17T03:58:53.125 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-17T03:58:53.125 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T03:58:53.125 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-05-17T03:58:53.125 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-5.14.0-446.el9.x86_64 2024-05-17T03:58:53.125 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-core-5.14.0-446.el9.x86_64 2024-05-17T03:58:53.125 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules-5.14.0-446.el9.x86_64 2024-05-17T03:58:53.125 INFO:teuthology.orchestra.run.smithi150.stdout: kernel-modules-core-5.14.0-446.el9.x86_64 2024-05-17T03:58:53.125 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T03:58:53.125 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-05-17T03:58:53.501 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q kernel | sort -rV | head -n 1 2024-05-17T03:58:53.568 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-17T03:58:53.568 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-17T03:58:53.568 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-446.el9.x86_64 2024-05-17T03:58:53.568 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-17T03:58:53.568 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-17T03:58:53.568 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-17T03:58:53.569 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=None, version=distro) 2024-05-17T03:58:53.569 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q kernel | sort -rV | head -n 1 2024-05-17T03:58:53.618 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-17T03:58:53.619 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-17T03:58:53.620 DEBUG:teuthology.orchestra.run.smithi150:> sudo rpm -qi grub2-tools 2024-05-17T03:58:53.662 INFO:teuthology.orchestra.run.smithi150.stdout:Name : grub2-tools 2024-05-17T03:58:53.662 INFO:teuthology.orchestra.run.smithi150.stdout:Epoch : 1 2024-05-17T03:58:53.662 INFO:teuthology.orchestra.run.smithi150.stdout:Version : 2.06 2024-05-17T03:58:53.662 INFO:teuthology.orchestra.run.smithi150.stdout:Release : 68.el9 2024-05-17T03:58:53.662 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: x86_64 2024-05-17T03:58:53.662 INFO:teuthology.orchestra.run.smithi150.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-17T03:58:53.662 INFO:teuthology.orchestra.run.smithi150.stdout:Group : Unspecified 2024-05-17T03:58:53.662 INFO:teuthology.orchestra.run.smithi150.stdout:Size : 8264254 2024-05-17T03:58:53.663 INFO:teuthology.orchestra.run.smithi150.stdout:License : GPLv3+ 2024-05-17T03:58:53.663 INFO:teuthology.orchestra.run.smithi150.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-17T03:58:53.663 INFO:teuthology.orchestra.run.smithi150.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-17T03:58:53.663 INFO:teuthology.orchestra.run.smithi150.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-17T03:58:53.663 INFO:teuthology.orchestra.run.smithi150.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-17T03:58:53.663 INFO:teuthology.orchestra.run.smithi150.stdout:Packager : builder@centos.org 2024-05-17T03:58:53.663 INFO:teuthology.orchestra.run.smithi150.stdout:Vendor : CentOS 2024-05-17T03:58:53.663 INFO:teuthology.orchestra.run.smithi150.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-17T03:58:53.663 INFO:teuthology.orchestra.run.smithi150.stdout:Summary : Support tools for GRUB. 2024-05-17T03:58:53.663 INFO:teuthology.orchestra.run.smithi150.stdout:Description : 2024-05-17T03:58:53.663 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T03:58:53.663 INFO:teuthology.orchestra.run.smithi150.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-17T03:58:53.663 INFO:teuthology.orchestra.run.smithi150.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-17T03:58:53.663 INFO:teuthology.orchestra.run.smithi150.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-17T03:58:53.663 INFO:teuthology.orchestra.run.smithi150.stdout:hardware devices. 2024-05-17T03:58:53.664 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T03:58:53.664 INFO:teuthology.orchestra.run.smithi150.stdout:This subpackage provides tools for support of all platforms. 2024-05-17T03:58:53.664 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-17T03:58:53.664 INFO:teuthology.task.kernel:Updating grub on smithi150 to boot 5.14.0-446.el9.x86_64 2024-05-17T03:58:53.665 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-17T03:58:53.714 INFO:teuthology.orchestra.run.smithi131.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-17T03:58:53.746 INFO:teuthology.orchestra.run.smithi131.stderr:done 2024-05-17T03:58:53.749 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-05-17T03:58:53.764 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.f4jCZc8uKe 2024-05-17T03:58:53.764 DEBUG:teuthology.orchestra.run.smithi131:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.f4jCZc8uKe 2024-05-17T03:58:53.832 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.f4jCZc8uKe 2024-05-17T03:58:53.968 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.f4jCZc8uKe is 6KB 2024-05-17T03:58:54.017 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.f4jCZc8uKe 2024-05-17T03:58:54.031 DEBUG:teuthology.orchestra.run.smithi131:> sudo /bin/ls /boot/loader/entries || true 2024-05-17T03:58:54.092 INFO:teuthology.orchestra.run.smithi131.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-17T03:58:54.093 INFO:teuthology.orchestra.run.smithi131.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-17T03:58:54.093 INFO:teuthology.orchestra.run.smithi131.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-17T03:58:54.093 INFO:teuthology.orchestra.run.smithi131.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64.conf 2024-05-17T03:58:54.094 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64 2024-05-17T03:58:54.244 DEBUG:teuthology.orchestra.run.smithi131:> sudo shutdown -r now 2024-05-17T03:58:54.250 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2024-05-17T03:58:55.697 INFO:teuthology.orchestra.run.smithi150.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-17T03:58:55.718 INFO:teuthology.orchestra.run.smithi150.stderr:done 2024-05-17T03:58:55.721 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-05-17T03:58:55.738 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.D3KlBNUFkj 2024-05-17T03:58:55.738 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.D3KlBNUFkj 2024-05-17T03:58:55.803 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.D3KlBNUFkj 2024-05-17T03:58:55.938 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.D3KlBNUFkj is 6KB 2024-05-17T03:58:55.988 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.D3KlBNUFkj 2024-05-17T03:58:56.002 DEBUG:teuthology.orchestra.run.smithi150:> sudo /bin/ls /boot/loader/entries || true 2024-05-17T03:58:56.064 INFO:teuthology.orchestra.run.smithi150.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-17T03:58:56.064 INFO:teuthology.orchestra.run.smithi150.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-17T03:58:56.064 INFO:teuthology.orchestra.run.smithi150.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-17T03:58:56.064 INFO:teuthology.orchestra.run.smithi150.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64.conf 2024-05-17T03:58:56.065 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64 2024-05-17T03:58:56.235 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2024-05-17T03:59:24.274 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-17T03:59:24.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-05-17T03:59:24.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-17T03:59:26.238 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-17T03:59:26.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-05-17T03:59:26.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-17T03:59:42.623 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-05-17T03:59:44.674 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-05-17T03:59:51.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-05-17T03:59:51.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-17T03:59:53.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-05-17T03:59:53.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-17T03:59:54.693 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-05-17T03:59:56.734 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-05-17T04:00:06.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-05-17T04:00:06.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-17T04:00:08.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-05-17T04:00:08.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-17T04:00:38.504 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-05-17T04:00:38.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-05-17T04:00:38.873 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-446.el9.x86_64"... 2024-05-17T04:00:38.874 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-05-17T04:00:38.889 INFO:teuthology.orchestra.run.smithi131.stdout:5.14.0-446.el9.x86_64 2024-05-17T04:00:38.889 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-446.el9.x86_64 vs 5.14.0-446.el9.x86_64 2024-05-17T04:00:38.889 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-17T04:00:38.889 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-17T04:00:39.891 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-17T04:00:39.891 DEBUG:teuthology.orchestra.run.smithi131:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-17T04:00:40.019 INFO:teuthology.orchestra.run.smithi131.stdout:ttyS1 2024-05-17T04:00:40.054 DEBUG:teuthology.parallel:result is None 2024-05-17T04:01:08.741 DEBUG:teuthology.orchestra.remote:timed out 2024-05-17T04:01:23.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-05-17T04:01:23.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-17T04:01:24.206 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-05-17T04:01:24.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-05-17T04:01:24.570 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-446.el9.x86_64"... 2024-05-17T04:01:24.570 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-05-17T04:01:24.587 INFO:teuthology.orchestra.run.smithi150.stdout:5.14.0-446.el9.x86_64 2024-05-17T04:01:24.587 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-446.el9.x86_64 vs 5.14.0-446.el9.x86_64 2024-05-17T04:01:24.587 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-17T04:01:24.587 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-17T04:01:25.588 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-17T04:01:25.589 DEBUG:teuthology.orchestra.run.smithi150:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-17T04:01:25.654 INFO:teuthology.orchestra.run.smithi150.stdout:ttyS1 2024-05-17T04:01:25.686 DEBUG:teuthology.parallel:result is None 2024-05-17T04:01:25.687 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-17T04:01:25.694 INFO:teuthology.task.internal:Creating test directory... 2024-05-17T04:01:25.695 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-17T04:01:25.697 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-17T04:01:25.716 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-17T04:01:25.722 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-17T04:01:25.773 INFO:teuthology.task.internal:Creating archive directory... 2024-05-17T04:01:25.774 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-17T04:01:25.777 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-17T04:01:25.867 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-17T04:01:25.875 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-17T04:01:25.875 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-17T04:01:25.878 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-17T04:01:25.916 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-17T04:01:25.917 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-17T04:01:25.927 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-17T04:01:25.927 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-17T04:01:25.929 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-17T04:01:25.936 INFO:teuthology.task.internal:Configuring sudo... 2024-05-17T04:01:25.937 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-17T04:01:25.972 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-17T04:01:26.000 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-17T04:01:26.009 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-17T04:01:26.009 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-17T04:01:26.041 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-17T04:01:26.057 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-17T04:01:26.141 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-17T04:01:26.185 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-17T04:01:26.270 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-17T04:01:26.311 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:01:26.311 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-17T04:01:26.377 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-17T04:01:26.422 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-17T04:01:26.471 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-17T04:01:26.550 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-17T04:01:26.600 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:01:26.600 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-17T04:01:26.667 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2024-05-17T04:01:26.669 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2024-05-17T04:01:26.719 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-17T04:01:26.750 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-17T04:01:27.141 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-17T04:01:27.150 INFO:teuthology.task.internal:Starting timer... 2024-05-17T04:01:27.150 INFO:teuthology.run_tasks:Running task pcp... 2024-05-17T04:01:27.195 INFO:teuthology.run_tasks:Running task selinux... 2024-05-17T04:01:27.231 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-17T04:01:27.232 DEBUG:teuthology.orchestra.run.smithi131:> sudo service auditd rotate 2024-05-17T04:01:27.295 INFO:teuthology.orchestra.run.smithi131.stdout:Rotating logs: 2024-05-17T04:01:27.297 DEBUG:teuthology.orchestra.run.smithi150:> sudo service auditd rotate 2024-05-17T04:01:27.374 INFO:teuthology.orchestra.run.smithi150.stdout:Rotating logs: 2024-05-17T04:01:27.376 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-17T04:01:27.376 DEBUG:teuthology.orchestra.run.smithi131:> /usr/sbin/getenforce 2024-05-17T04:01:27.406 INFO:teuthology.orchestra.run.smithi131.stdout:Permissive 2024-05-17T04:01:27.407 DEBUG:teuthology.orchestra.run.smithi150:> /usr/sbin/getenforce 2024-05-17T04:01:27.439 INFO:teuthology.orchestra.run.smithi150.stdout:Permissive 2024-05-17T04:01:27.439 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi131.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi150.front.sepia.ceph.com': 'permissive'} 2024-05-17T04:01:27.440 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-17T04:01:27.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T04:01:27.478 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-17T04:01:27.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T04:01:27.508 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-17T04:01:27.509 DEBUG:teuthology.orchestra.run.smithi131:> sudo /usr/sbin/setenforce permissive 2024-05-17T04:01:27.553 DEBUG:teuthology.orchestra.run.smithi150:> sudo /usr/sbin/setenforce permissive 2024-05-17T04:01:27.584 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-17T04:01:27.598 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-17T04:01:27.603 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-17T04:01:27.741 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-17T04:01:27.753 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-17T04:01:27.753 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi131.front.sepia.ceph.com,smithi150.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-17T04:06:03.769 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi131.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com')] 2024-05-17T04:06:03.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-05-17T04:06:03.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-17T04:06:03.847 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-05-17T04:06:03.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-05-17T04:06:03.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-05-17T04:06:03.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-17T04:06:04.017 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-05-17T04:06:04.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-05-17T04:06:04.100 INFO:teuthology.run_tasks:Running task clock... 2024-05-17T04:06:04.111 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-17T04:06:04.111 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-17T04:06:04.112 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-17T04:06:04.115 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-17T04:06:04.115 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-17T04:06:04.141 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-17T04:06:04.155 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-17T04:06:04.171 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-17T04:06:04.179 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: ntpd: command not found 2024-05-17T04:06:04.186 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-17T04:06:04.189 INFO:teuthology.orchestra.run.smithi131.stdout:506 Cannot talk to daemon 2024-05-17T04:06:04.203 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-17T04:06:04.211 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: ntpd: command not found 2024-05-17T04:06:04.217 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-17T04:06:04.222 INFO:teuthology.orchestra.run.smithi150.stdout:506 Cannot talk to daemon 2024-05-17T04:06:04.237 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-17T04:06:04.251 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-17T04:06:04.273 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2024-05-17T04:06:04.274 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-17T04:06:04.274 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-05-17T04:06:04.274 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-17T04:06:04.274 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-17T04:06:04.274 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-17T04:06:04.274 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-17T04:06:04.306 INFO:teuthology.orchestra.run.smithi150.stderr:bash: line 1: ntpq: command not found 2024-05-17T04:06:04.309 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-17T04:06:04.310 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-05-17T04:06:04.310 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-17T04:06:04.310 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-17T04:06:04.310 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-17T04:06:04.310 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-17T04:06:04.311 INFO:teuthology.run_tasks:Running task install... 2024-05-17T04:06:04.319 DEBUG:teuthology.task.install:project ceph 2024-05-17T04:06:04.319 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '931809a9e5d295bd61984693cac44fe131ded4bc'}} 2024-05-17T04:06:04.320 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '931809a9e5d295bd61984693cac44fe131ded4bc'} 2024-05-17T04:06:04.320 INFO:teuthology.task.install:Using flavor: default 2024-05-17T04:06:04.325 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-17T04:06:04.325 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-17T04:06:04.326 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '931809a9e5d295bd61984693cac44fe131ded4bc', 'tag': None, 'wait_for_package': False} 2024-05-17T04:06:04.326 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=931809a9e5d295bd61984693cac44fe131ded4bc 2024-05-17T04:06:04.328 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '931809a9e5d295bd61984693cac44fe131ded4bc', 'tag': None, 'wait_for_package': False} 2024-05-17T04:06:04.328 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=931809a9e5d295bd61984693cac44fe131ded4bc 2024-05-17T04:06:04.478 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.012458-debug/931809a9e5d295bd61984693cac44fe131ded4bc/centos/9/flavors/default/ 2024-05-17T04:06:04.479 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3794.g931809a9 2024-05-17T04:06:04.487 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.012458-debug/931809a9e5d295bd61984693cac44fe131ded4bc/centos/9/flavors/default/ 2024-05-17T04:06:04.487 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3794.g931809a9 2024-05-17T04:06:04.597 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.012458-debug/931809a9e5d295bd61984693cac44fe131ded4bc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.012458-debug/931809a9e5d295bd61984693cac44fe131ded4bc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.012458-debug/931809a9e5d295bd61984693cac44fe131ded4bc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-17T04:06:04.597 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:06:04.597 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-17T04:06:04.623 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-17T04:06:04.623 DEBUG:teuthology.orchestra.run.smithi150:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/931809a9e5d295bd61984693cac44fe131ded4bc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-17T04:06:04.646 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.012458-debug/931809a9e5d295bd61984693cac44fe131ded4bc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.012458-debug/931809a9e5d295bd61984693cac44fe131ded4bc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.012458-debug/931809a9e5d295bd61984693cac44fe131ded4bc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-17T04:06:04.647 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:06:04.647 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-17T04:06:04.673 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-17T04:06:04.673 DEBUG:teuthology.orchestra.run.smithi131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/931809a9e5d295bd61984693cac44fe131ded4bc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-17T04:06:04.689 DEBUG:teuthology.orchestra.run.smithi150:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-17T04:06:04.739 DEBUG:teuthology.orchestra.run.smithi131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-17T04:06:04.765 DEBUG:teuthology.orchestra.run.smithi150:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-17T04:06:04.814 DEBUG:teuthology.orchestra.run.smithi131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-17T04:06:04.829 INFO:teuthology.orchestra.run.smithi150.stdout:check_obsoletes = 1 2024-05-17T04:06:04.830 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum clean all 2024-05-17T04:06:04.879 INFO:teuthology.orchestra.run.smithi131.stdout:check_obsoletes = 1 2024-05-17T04:06:04.880 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum clean all 2024-05-17T04:06:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:57 files removed 2024-05-17T04:06:05.104 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-17T04:06:05.107 INFO:teuthology.orchestra.run.smithi131.stdout:57 files removed 2024-05-17T04:06:05.136 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-17T04:06:05.787 INFO:teuthology.orchestra.run.smithi131.stdout:ceph packages for x86_64 224 kB/s | 83 kB 00:00 2024-05-17T04:06:05.853 INFO:teuthology.orchestra.run.smithi150.stdout:ceph packages for x86_64 176 kB/s | 83 kB 00:00 2024-05-17T04:06:06.279 INFO:teuthology.orchestra.run.smithi131.stdout:ceph noarch packages 27 kB/s | 12 kB 00:00 2024-05-17T04:06:06.328 INFO:teuthology.orchestra.run.smithi150.stdout:ceph noarch packages 28 kB/s | 12 kB 00:00 2024-05-17T04:06:06.646 INFO:teuthology.orchestra.run.smithi150.stdout:ceph source packages 7.0 kB/s | 1.9 kB 00:00 2024-05-17T04:06:06.654 INFO:teuthology.orchestra.run.smithi131.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-05-17T04:06:07.397 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-05-17T04:06:09.389 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-05-17T04:06:09.970 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 8.1 MB 00:03 2024-05-17T04:06:11.713 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - AppStream 30 MB/s | 19 MB 00:00 2024-05-17T04:06:13.990 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 6.2 MB 00:00 2024-05-17T04:06:15.550 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 16 kB 00:00 2024-05-17T04:06:16.023 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.2 MB 00:00 2024-05-17T04:06:17.824 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-05-17T04:06:25.783 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 2.7 MB/s | 21 MB 00:07 2024-05-17T04:06:30.975 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-05-17T04:06:33.367 INFO:teuthology.orchestra.run.smithi150.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-17T04:06:33.368 INFO:teuthology.orchestra.run.smithi150.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-17T04:06:33.378 INFO:teuthology.orchestra.run.smithi150.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-17T04:06:33.379 INFO:teuthology.orchestra.run.smithi150.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-17T04:06:33.380 INFO:teuthology.orchestra.run.smithi150.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-17T04:06:33.381 INFO:teuthology.orchestra.run.smithi150.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-17T04:06:33.382 INFO:teuthology.orchestra.run.smithi150.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-17T04:06:33.385 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-17T04:06:33.385 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-17T04:06:33.446 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-05-17T04:06:33.456 INFO:teuthology.orchestra.run.smithi150.stdout:======================================================================================= 2024-05-17T04:06:33.457 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-05-17T04:06:33.457 INFO:teuthology.orchestra.run.smithi150.stdout:======================================================================================= 2024-05-17T04:06:33.457 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-05-17T04:06:33.457 INFO:teuthology.orchestra.run.smithi150.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-17T04:06:33.457 INFO:teuthology.orchestra.run.smithi150.stdout: ceph x86_64 2:19.0.0-3794.g931809a9.el9 ceph 6.6 k 2024-05-17T04:06:33.457 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base x86_64 2:19.0.0-3794.g931809a9.el9 ceph 5.4 M 2024-05-17T04:06:33.457 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse x86_64 2:19.0.0-3794.g931809a9.el9 ceph 866 k 2024-05-17T04:06:33.457 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3794.g931809a9.el9 ceph 147 k 2024-05-17T04:06:33.457 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr x86_64 2:19.0.0-3794.g931809a9.el9 ceph 1.5 M 2024-05-17T04:06:33.457 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 143 k 2024-05-17T04:06:33.457 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 3.5 M 2024-05-17T04:06:33.457 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 7.4 M 2024-05-17T04:06:33.458 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 49 k 2024-05-17T04:06:33.458 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw x86_64 2:19.0.0-3794.g931809a9.el9 ceph 10 M 2024-05-17T04:06:33.458 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test x86_64 2:19.0.0-3794.g931809a9.el9 ceph 43 M 2024-05-17T04:06:33.458 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 273 k 2024-05-17T04:06:33.458 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 763 k 2024-05-17T04:06:33.458 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror x86_64 2:19.0.0-3794.g931809a9.el9 ceph 227 k 2024-05-17T04:06:33.458 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-shell x86_64 2:19.0.0-3794.g931809a9.el9 ceph 27 k 2024-05-17T04:06:33.458 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 18 k 2024-05-17T04:06:33.458 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-17T04:06:33.458 INFO:teuthology.orchestra.run.smithi150.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-17T04:06:33.458 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-17T04:06:33.459 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel x86_64 2:19.0.0-3794.g931809a9.el9 ceph 32 k 2024-05-17T04:06:33.459 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 x86_64 2:19.0.0-3794.g931809a9.el9 ceph 759 k 2024-05-17T04:06:33.459 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel x86_64 2:19.0.0-3794.g931809a9.el9 ceph 127 k 2024-05-17T04:06:33.459 INFO:teuthology.orchestra.run.smithi150.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-17T04:06:33.459 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-17T04:06:33.459 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-17T04:06:33.459 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-17T04:06:33.459 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-17T04:06:33.459 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-17T04:06:33.459 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs x86_64 2:19.0.0-3794.g931809a9.el9 ceph 162 k 2024-05-17T04:06:33.459 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados x86_64 2:19.0.0-3794.g931809a9.el9 ceph 321 k 2024-05-17T04:06:33.459 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd x86_64 2:19.0.0-3794.g931809a9.el9 ceph 300 k 2024-05-17T04:06:33.460 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw x86_64 2:19.0.0-3794.g931809a9.el9 ceph 99 k 2024-05-17T04:06:33.460 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse x86_64 2:19.0.0-3794.g931809a9.el9 ceph 86 k 2024-05-17T04:06:33.460 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror x86_64 2:19.0.0-3794.g931809a9.el9 ceph 3.0 M 2024-05-17T04:06:33.460 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd x86_64 2:19.0.0-3794.g931809a9.el9 ceph 169 k 2024-05-17T04:06:33.460 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-17T04:06:33.460 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2024-05-17T04:06:33.460 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-17T04:06:33.460 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-17T04:06:33.460 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-17T04:06:33.460 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-17T04:06:33.460 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 x86_64 2:19.0.0-3794.g931809a9.el9 ceph 3.3 M 2024-05-17T04:06:33.460 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1 x86_64 2:19.0.0-3794.g931809a9.el9 ceph 3.1 M 2024-05-17T04:06:33.460 INFO:teuthology.orchestra.run.smithi150.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-17T04:06:33.461 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-17T04:06:33.461 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-05-17T04:06:33.461 INFO:teuthology.orchestra.run.smithi150.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-17T04:06:33.461 INFO:teuthology.orchestra.run.smithi150.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-17T04:06:33.461 INFO:teuthology.orchestra.run.smithi150.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-17T04:06:33.461 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common x86_64 2:19.0.0-3794.g931809a9.el9 ceph 20 M 2024-05-17T04:06:33.461 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 34 k 2024-05-17T04:06:33.461 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds x86_64 2:19.0.0-3794.g931809a9.el9 ceph 2.3 M 2024-05-17T04:06:33.461 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 274 k 2024-05-17T04:06:33.461 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon x86_64 2:19.0.0-3794.g931809a9.el9 ceph 4.9 M 2024-05-17T04:06:33.461 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd x86_64 2:19.0.0-3794.g931809a9.el9 ceph 18 M 2024-05-17T04:06:33.462 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 16 k 2024-05-17T04:06:33.462 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux x86_64 2:19.0.0-3794.g931809a9.el9 ceph 25 k 2024-05-17T04:06:33.462 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-17T04:06:33.462 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-17T04:06:33.462 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-17T04:06:33.462 INFO:teuthology.orchestra.run.smithi150.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-17T04:06:33.462 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-17T04:06:33.462 INFO:teuthology.orchestra.run.smithi150.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-17T04:06:33.462 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-17T04:06:33.462 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-17T04:06:33.462 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite x86_64 2:19.0.0-3794.g931809a9.el9 ceph 158 k 2024-05-17T04:06:33.462 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-17T04:06:33.463 INFO:teuthology.orchestra.run.smithi150.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-17T04:06:33.463 INFO:teuthology.orchestra.run.smithi150.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-17T04:06:33.463 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-17T04:06:33.463 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-17T04:06:33.463 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 x86_64 2:19.0.0-3794.g931809a9.el9 ceph 501 k 2024-05-17T04:06:33.463 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-17T04:06:33.463 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 x86_64 2:19.0.0-3794.g931809a9.el9 ceph 5.2 M 2024-05-17T04:06:33.463 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-17T04:06:33.463 INFO:teuthology.orchestra.run.smithi150.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-17T04:06:33.463 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-17T04:06:33.463 INFO:teuthology.orchestra.run.smithi150.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-17T04:06:33.463 INFO:teuthology.orchestra.run.smithi150.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-17T04:06:33.464 INFO:teuthology.orchestra.run.smithi150.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-17T04:06:33.464 INFO:teuthology.orchestra.run.smithi150.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-17T04:06:33.464 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-17T04:06:33.464 INFO:teuthology.orchestra.run.smithi150.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-17T04:06:33.464 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-17T04:06:33.464 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-17T04:06:33.464 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-17T04:06:33.464 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-17T04:06:33.464 INFO:teuthology.orchestra.run.smithi150.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-17T04:06:33.464 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-17T04:06:33.464 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-17T04:06:33.464 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-17T04:06:33.464 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse x86_64 2:19.0.0-3794.g931809a9.el9 ceph 45 k 2024-05-17T04:06:33.465 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common x86_64 2:19.0.0-3794.g931809a9.el9 ceph 136 k 2024-05-17T04:06:33.465 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-17T04:06:33.465 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-17T04:06:33.465 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-17T04:06:33.465 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-17T04:06:33.465 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-17T04:06:33.465 INFO:teuthology.orchestra.run.smithi150.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-17T04:06:33.465 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-17T04:06:33.465 INFO:teuthology.orchestra.run.smithi150.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-17T04:06:33.465 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-17T04:06:33.465 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-17T04:06:33.465 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-17T04:06:33.466 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-17T04:06:33.466 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-17T04:06:33.466 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-17T04:06:33.466 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-17T04:06:33.466 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-17T04:06:33.466 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-17T04:06:33.466 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-17T04:06:33.466 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-17T04:06:33.466 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-17T04:06:33.466 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-17T04:06:33.466 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-17T04:06:33.466 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-17T04:06:33.467 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-17T04:06:33.467 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-17T04:06:33.467 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-17T04:06:33.467 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-17T04:06:33.467 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-17T04:06:33.467 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-17T04:06:33.467 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-17T04:06:33.467 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-17T04:06:33.467 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-17T04:06:33.467 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-17T04:06:33.467 INFO:teuthology.orchestra.run.smithi150.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-17T04:06:33.467 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-17T04:06:33.468 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-17T04:06:33.468 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-17T04:06:33.468 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-17T04:06:33.468 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-17T04:06:33.468 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-17T04:06:33.468 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-17T04:06:33.468 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-17T04:06:33.468 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-17T04:06:33.468 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-17T04:06:33.468 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-17T04:06:33.468 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-17T04:06:33.468 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-17T04:06:33.469 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-17T04:06:33.469 INFO:teuthology.orchestra.run.smithi150.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-17T04:06:33.469 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-17T04:06:33.469 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-17T04:06:33.469 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-17T04:06:33.469 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-17T04:06:33.469 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-17T04:06:33.469 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-17T04:06:33.469 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-17T04:06:33.469 INFO:teuthology.orchestra.run.smithi150.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-17T04:06:33.469 INFO:teuthology.orchestra.run.smithi150.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-17T04:06:33.469 INFO:teuthology.orchestra.run.smithi150.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-17T04:06:33.470 INFO:teuthology.orchestra.run.smithi150.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-17T04:06:33.470 INFO:teuthology.orchestra.run.smithi150.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-17T04:06:33.470 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-17T04:06:33.470 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-17T04:06:33.470 INFO:teuthology.orchestra.run.smithi150.stdout:Installing weak dependencies: 2024-05-17T04:06:33.470 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-17T04:06:33.470 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:06:33.470 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-05-17T04:06:33.470 INFO:teuthology.orchestra.run.smithi150.stdout:======================================================================================= 2024-05-17T04:06:33.470 INFO:teuthology.orchestra.run.smithi150.stdout:Install 148 Packages 2024-05-17T04:06:33.470 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 8 Packages 2024-05-17T04:06:33.471 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:06:33.471 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 219 M 2024-05-17T04:06:33.472 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-05-17T04:06:34.109 INFO:teuthology.orchestra.run.smithi150.stdout:(1/156): ceph-19.0.0-3794.g931809a9.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-05-17T04:06:34.418 INFO:teuthology.orchestra.run.smithi150.stdout:(2/156): ceph-fuse-19.0.0-3794.g931809a9.el9.x8 2.7 MB/s | 866 kB 00:00 2024-05-17T04:06:34.427 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:18 2024-05-17T04:06:34.510 INFO:teuthology.orchestra.run.smithi150.stdout:(3/156): ceph-base-19.0.0-3794.g931809a9.el9.x8 8.5 MB/s | 5.4 MB 00:00 2024-05-17T04:06:34.534 INFO:teuthology.orchestra.run.smithi150.stdout:(4/156): ceph-immutable-object-cache-19.0.0-379 1.2 MB/s | 147 kB 00:00 2024-05-17T04:06:34.719 INFO:teuthology.orchestra.run.smithi150.stdout:(5/156): ceph-mds-19.0.0-3794.g931809a9.el9.x86 11 MB/s | 2.3 MB 00:00 2024-05-17T04:06:34.819 INFO:teuthology.orchestra.run.smithi150.stdout:(6/156): ceph-mgr-19.0.0-3794.g931809a9.el9.x86 5.3 MB/s | 1.5 MB 00:00 2024-05-17T04:06:35.136 INFO:teuthology.orchestra.run.smithi150.stdout:(7/156): ceph-mon-19.0.0-3794.g931809a9.el9.x86 12 MB/s | 4.9 MB 00:00 2024-05-17T04:06:36.003 INFO:teuthology.orchestra.run.smithi150.stdout:(8/156): ceph-radosgw-19.0.0-3794.g931809a9.el9 12 MB/s | 10 MB 00:00 2024-05-17T04:06:36.078 INFO:teuthology.orchestra.run.smithi150.stdout:(9/156): ceph-selinux-19.0.0-3794.g931809a9.el9 336 kB/s | 25 kB 00:00 2024-05-17T04:06:36.554 INFO:teuthology.orchestra.run.smithi150.stdout:(10/156): ceph-common-19.0.0-3794.g931809a9.el9 7.3 MB/s | 20 MB 00:02 2024-05-17T04:06:36.629 INFO:teuthology.orchestra.run.smithi150.stdout:(11/156): cephfs-mirror-19.0.0-3794.g931809a9.e 3.0 MB/s | 227 kB 00:00 2024-05-17T04:06:36.704 INFO:teuthology.orchestra.run.smithi150.stdout:(12/156): cephfs-shell-19.0.0-3794.g931809a9.el 361 kB/s | 27 kB 00:00 2024-05-17T04:06:36.788 INFO:teuthology.orchestra.run.smithi150.stdout:(13/156): libcephfs-devel-19.0.0-3794.g931809a9 380 kB/s | 32 kB 00:00 2024-05-17T04:06:36.963 INFO:teuthology.orchestra.run.smithi150.stdout:(14/156): libcephfs2-19.0.0-3794.g931809a9.el9. 4.2 MB/s | 759 kB 00:00 2024-05-17T04:06:37.055 INFO:teuthology.orchestra.run.smithi150.stdout:(15/156): libcephsqlite-19.0.0-3794.g931809a9.e 1.7 MB/s | 158 kB 00:00 2024-05-17T04:06:37.147 INFO:teuthology.orchestra.run.smithi150.stdout:(16/156): librados-devel-19.0.0-3794.g931809a9. 1.4 MB/s | 127 kB 00:00 2024-05-17T04:06:37.263 INFO:teuthology.orchestra.run.smithi150.stdout:(17/156): libradosstriper1-19.0.0-3794.g931809a 4.2 MB/s | 501 kB 00:00 2024-05-17T04:06:37.456 INFO:teuthology.orchestra.run.smithi150.stdout:(18/156): ceph-osd-19.0.0-3794.g931809a9.el9.x8 6.7 MB/s | 18 MB 00:02 2024-05-17T04:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout:(19/156): python3-ceph-argparse-19.0.0-3794.g93 493 kB/s | 45 kB 00:00 2024-05-17T04:06:37.640 INFO:teuthology.orchestra.run.smithi150.stdout:(20/156): python3-ceph-common-19.0.0-3794.g9318 1.4 MB/s | 136 kB 00:00 2024-05-17T04:06:37.740 INFO:teuthology.orchestra.run.smithi150.stdout:(21/156): python3-cephfs-19.0.0-3794.g931809a9. 1.6 MB/s | 162 kB 00:00 2024-05-17T04:06:37.840 INFO:teuthology.orchestra.run.smithi150.stdout:(22/156): python3-rados-19.0.0-3794.g931809a9.e 3.1 MB/s | 321 kB 00:00 2024-05-17T04:06:37.907 INFO:teuthology.orchestra.run.smithi150.stdout:(23/156): librgw2-19.0.0-3794.g931809a9.el9.x86 8.0 MB/s | 5.2 MB 00:00 2024-05-17T04:06:37.932 INFO:teuthology.orchestra.run.smithi150.stdout:(24/156): python3-rbd-19.0.0-3794.g931809a9.el9 3.2 MB/s | 300 kB 00:00 2024-05-17T04:06:37.974 INFO:teuthology.orchestra.run.smithi150.stdout:(25/156): python3-rgw-19.0.0-3794.g931809a9.el9 1.5 MB/s | 99 kB 00:00 2024-05-17T04:06:38.016 INFO:teuthology.orchestra.run.smithi150.stdout:(26/156): rbd-fuse-19.0.0-3794.g931809a9.el9.x8 1.0 MB/s | 86 kB 00:00 2024-05-17T04:06:38.125 INFO:teuthology.orchestra.run.smithi150.stdout:(27/156): rbd-nbd-19.0.0-3794.g931809a9.el9.x86 1.5 MB/s | 169 kB 00:00 2024-05-17T04:06:38.217 INFO:teuthology.orchestra.run.smithi150.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3794.g 374 kB/s | 34 kB 00:00 2024-05-17T04:06:38.317 INFO:teuthology.orchestra.run.smithi150.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3794.g931809a 1.4 MB/s | 143 kB 00:00 2024-05-17T04:06:38.367 INFO:teuthology.orchestra.run.smithi150.stdout:(30/156): rbd-mirror-19.0.0-3794.g931809a9.el9. 7.7 MB/s | 3.0 MB 00:00 2024-05-17T04:06:38.868 INFO:teuthology.orchestra.run.smithi150.stdout:(31/156): ceph-test-19.0.0-3794.g931809a9.el9.x 15 MB/s | 43 MB 00:02 2024-05-17T04:06:38.951 INFO:teuthology.orchestra.run.smithi150.stdout:(32/156): ceph-mgr-dashboard-19.0.0-3794.g93180 5.6 MB/s | 3.5 MB 00:00 2024-05-17T04:06:38.976 INFO:teuthology.orchestra.run.smithi150.stdout:(33/156): ceph-mgr-modules-core-19.0.0-3794.g93 2.5 MB/s | 274 kB 00:00 2024-05-17T04:06:39.010 INFO:teuthology.orchestra.run.smithi150.stdout:(34/156): ceph-mgr-rook-19.0.0-3794.g931809a9.e 844 kB/s | 49 kB 00:00 2024-05-17T04:06:39.027 INFO:teuthology.orchestra.run.smithi150.stdout:(35/156): ceph-prometheus-alerts-19.0.0-3794.g9 327 kB/s | 16 kB 00:00 2024-05-17T04:06:39.069 INFO:teuthology.orchestra.run.smithi150.stdout:(36/156): ceph-volume-19.0.0-3794.g931809a9.el9 4.6 MB/s | 273 kB 00:00 2024-05-17T04:06:39.161 INFO:teuthology.orchestra.run.smithi150.stdout:(37/156): ceph-mgr-diskprediction-local-19.0.0- 9.3 MB/s | 7.4 MB 00:00 2024-05-17T04:06:39.178 INFO:teuthology.orchestra.run.smithi150.stdout:(38/156): cephfs-top-19.0.0-3794.g931809a9.el9. 168 kB/s | 18 kB 00:00 2024-05-17T04:06:39.228 INFO:teuthology.orchestra.run.smithi150.stdout:(39/156): cephadm-19.0.0-3794.g931809a9.el9.noa 3.7 MB/s | 763 kB 00:00 2024-05-17T04:06:39.320 INFO:teuthology.orchestra.run.smithi150.stdout:(40/156): fuse-2.9.9-15.el9.x86_64.rpm 506 kB/s | 80 kB 00:00 2024-05-17T04:06:39.354 INFO:teuthology.orchestra.run.smithi150.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-05-17T04:06:39.396 INFO:teuthology.orchestra.run.smithi150.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-05-17T04:06:39.430 INFO:teuthology.orchestra.run.smithi150.stdout:(43/156): libgfortran-11.4.1-3.el9.x86_64.rpm 3.1 MB/s | 803 kB 00:00 2024-05-17T04:06:39.455 INFO:teuthology.orchestra.run.smithi150.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-05-17T04:06:39.480 INFO:teuthology.orchestra.run.smithi150.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-05-17T04:06:39.505 INFO:teuthology.orchestra.run.smithi150.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-05-17T04:06:39.531 INFO:teuthology.orchestra.run.smithi150.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-05-17T04:06:39.573 INFO:teuthology.orchestra.run.smithi150.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.6 MB/s | 1.2 MB 00:00 2024-05-17T04:06:39.665 INFO:teuthology.orchestra.run.smithi150.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 4.2 MB/s | 689 kB 00:00 2024-05-17T04:06:39.683 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-05-17T04:06:39.690 INFO:teuthology.orchestra.run.smithi150.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 915 kB/s | 107 kB 00:00 2024-05-17T04:06:39.732 INFO:teuthology.orchestra.run.smithi150.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 4.6 MB/s | 943 kB 00:00 2024-05-17T04:06:39.749 INFO:teuthology.orchestra.run.smithi150.stdout:(52/156): elfutils-libelf-devel-0.190-2.el9.x86 257 kB/s | 21 kB 00:00 2024-05-17T04:06:39.782 INFO:teuthology.orchestra.run.smithi150.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 655 kB/s | 33 kB 00:00 2024-05-17T04:06:39.808 INFO:teuthology.orchestra.run.smithi150.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-05-17T04:06:39.850 INFO:teuthology.orchestra.run.smithi150.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-05-17T04:06:39.866 INFO:teuthology.orchestra.run.smithi150.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-05-17T04:06:39.959 INFO:teuthology.orchestra.run.smithi150.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 494 kB/s | 45 kB 00:00 2024-05-17T04:06:39.984 INFO:teuthology.orchestra.run.smithi150.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-05-17T04:06:40.034 INFO:teuthology.orchestra.run.smithi150.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-05-17T04:06:40.084 INFO:teuthology.orchestra.run.smithi150.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 510 kB/s | 25 kB 00:00 2024-05-17T04:06:40.118 INFO:teuthology.orchestra.run.smithi150.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-05-17T04:06:40.168 INFO:teuthology.orchestra.run.smithi150.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 3.1 MB/s | 582 kB 00:00 2024-05-17T04:06:40.185 INFO:teuthology.orchestra.run.smithi150.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-05-17T04:06:40.236 INFO:teuthology.orchestra.run.smithi150.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-05-17T04:06:40.253 INFO:teuthology.orchestra.run.smithi150.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 528 kB/s | 35 kB 00:00 2024-05-17T04:06:40.278 INFO:teuthology.orchestra.run.smithi150.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-17T04:06:40.453 INFO:teuthology.orchestra.run.smithi150.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 9.1 MB/s | 1.6 MB 00:00 2024-05-17T04:06:40.579 INFO:teuthology.orchestra.run.smithi150.stdout:(68/156): openblas-openmp-0.3.21-2.el9.x86_64.r 14 MB/s | 4.7 MB 00:00 2024-05-17T04:06:40.637 INFO:teuthology.orchestra.run.smithi150.stdout:(69/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-05-17T04:06:40.696 INFO:teuthology.orchestra.run.smithi150.stdout:(70/156): postgresql-contrib-13.14-1.el9.x86_64 3.7 MB/s | 911 kB 00:00 2024-05-17T04:06:40.730 INFO:teuthology.orchestra.run.smithi150.stdout:(71/156): postgresql-private-libs-13.14-1.el9.x 885 kB/s | 133 kB 00:00 2024-05-17T04:06:40.796 INFO:teuthology.orchestra.run.smithi150.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-17T04:06:40.855 INFO:teuthology.orchestra.run.smithi150.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.4 MB/s | 1.0 MB 00:00 2024-05-17T04:06:40.939 INFO:teuthology.orchestra.run.smithi150.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-05-17T04:06:41.022 INFO:teuthology.orchestra.run.smithi150.stdout:(75/156): postgresql-server-13.14-1.el9.x86_64. 15 MB/s | 5.8 MB 00:00 2024-05-17T04:06:41.073 INFO:teuthology.orchestra.run.smithi150.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-05-17T04:06:41.106 INFO:teuthology.orchestra.run.smithi150.stdout:(77/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.4 MB/s | 248 kB 00:00 2024-05-17T04:06:41.148 INFO:teuthology.orchestra.run.smithi150.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 254 kB/s | 19 kB 00:00 2024-05-17T04:06:41.198 INFO:teuthology.orchestra.run.smithi150.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-05-17T04:06:41.224 INFO:teuthology.orchestra.run.smithi150.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-05-17T04:06:41.299 INFO:teuthology.orchestra.run.smithi150.stdout:(81/156): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-05-17T04:06:41.366 INFO:teuthology.orchestra.run.smithi150.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 250 kB 00:00 2024-05-17T04:06:41.391 INFO:teuthology.orchestra.run.smithi150.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-05-17T04:06:41.450 INFO:teuthology.orchestra.run.smithi150.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 923 kB/s | 77 kB 00:00 2024-05-17T04:06:41.475 INFO:teuthology.orchestra.run.smithi150.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 507 kB/s | 42 kB 00:00 2024-05-17T04:06:41.600 INFO:teuthology.orchestra.run.smithi150.stdout:(86/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-05-17T04:06:41.626 INFO:teuthology.orchestra.run.smithi150.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-05-17T04:06:41.651 INFO:teuthology.orchestra.run.smithi150.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 1.3 MB/s | 269 kB 00:00 2024-05-17T04:06:41.693 INFO:teuthology.orchestra.run.smithi150.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 764 kB/s | 51 kB 00:00 2024-05-17T04:06:41.710 INFO:teuthology.orchestra.run.smithi150.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 915 kB/s | 54 kB 00:00 2024-05-17T04:06:41.735 INFO:teuthology.orchestra.run.smithi150.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-05-17T04:06:41.777 INFO:teuthology.orchestra.run.smithi150.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 623 kB/s | 42 kB 00:00 2024-05-17T04:06:41.794 INFO:teuthology.orchestra.run.smithi150.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-05-17T04:06:41.845 INFO:teuthology.orchestra.run.smithi150.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-05-17T04:06:41.870 INFO:teuthology.orchestra.run.smithi150.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-05-17T04:06:41.912 INFO:teuthology.orchestra.run.smithi150.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-05-17T04:06:41.954 INFO:teuthology.orchestra.run.smithi150.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 305 kB 00:00 2024-05-17T04:06:41.967 INFO:teuthology.orchestra.run.smithi131.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-17T04:06:41.968 INFO:teuthology.orchestra.run.smithi131.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-17T04:06:41.971 INFO:teuthology.orchestra.run.smithi150.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-05-17T04:06:41.979 INFO:teuthology.orchestra.run.smithi131.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-17T04:06:41.979 INFO:teuthology.orchestra.run.smithi131.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-17T04:06:41.980 INFO:teuthology.orchestra.run.smithi131.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-17T04:06:41.981 INFO:teuthology.orchestra.run.smithi131.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-17T04:06:41.983 INFO:teuthology.orchestra.run.smithi131.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-17T04:06:41.985 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-17T04:06:41.986 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-17T04:06:42.038 INFO:teuthology.orchestra.run.smithi150.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-05-17T04:06:42.046 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-05-17T04:06:42.055 INFO:teuthology.orchestra.run.smithi150.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 763 kB/s | 64 kB 00:00 2024-05-17T04:06:42.061 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================= 2024-05-17T04:06:42.062 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-05-17T04:06:42.062 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================= 2024-05-17T04:06:42.062 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-05-17T04:06:42.062 INFO:teuthology.orchestra.run.smithi131.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-17T04:06:42.062 INFO:teuthology.orchestra.run.smithi131.stdout: ceph x86_64 2:19.0.0-3794.g931809a9.el9 ceph 6.6 k 2024-05-17T04:06:42.062 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base x86_64 2:19.0.0-3794.g931809a9.el9 ceph 5.4 M 2024-05-17T04:06:42.062 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse x86_64 2:19.0.0-3794.g931809a9.el9 ceph 866 k 2024-05-17T04:06:42.062 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3794.g931809a9.el9 ceph 147 k 2024-05-17T04:06:42.062 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr x86_64 2:19.0.0-3794.g931809a9.el9 ceph 1.5 M 2024-05-17T04:06:42.062 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 143 k 2024-05-17T04:06:42.063 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 3.5 M 2024-05-17T04:06:42.063 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 7.4 M 2024-05-17T04:06:42.063 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 49 k 2024-05-17T04:06:42.063 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw x86_64 2:19.0.0-3794.g931809a9.el9 ceph 10 M 2024-05-17T04:06:42.063 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test x86_64 2:19.0.0-3794.g931809a9.el9 ceph 43 M 2024-05-17T04:06:42.063 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 273 k 2024-05-17T04:06:42.063 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 763 k 2024-05-17T04:06:42.063 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror x86_64 2:19.0.0-3794.g931809a9.el9 ceph 227 k 2024-05-17T04:06:42.063 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-shell x86_64 2:19.0.0-3794.g931809a9.el9 ceph 27 k 2024-05-17T04:06:42.063 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 18 k 2024-05-17T04:06:42.063 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-17T04:06:42.063 INFO:teuthology.orchestra.run.smithi131.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-17T04:06:42.063 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-17T04:06:42.063 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel x86_64 2:19.0.0-3794.g931809a9.el9 ceph 32 k 2024-05-17T04:06:42.064 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2 x86_64 2:19.0.0-3794.g931809a9.el9 ceph 759 k 2024-05-17T04:06:42.064 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel x86_64 2:19.0.0-3794.g931809a9.el9 ceph 127 k 2024-05-17T04:06:42.064 INFO:teuthology.orchestra.run.smithi131.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-17T04:06:42.064 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-17T04:06:42.064 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-17T04:06:42.064 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-17T04:06:42.064 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-17T04:06:42.064 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-17T04:06:42.064 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs x86_64 2:19.0.0-3794.g931809a9.el9 ceph 162 k 2024-05-17T04:06:42.064 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados x86_64 2:19.0.0-3794.g931809a9.el9 ceph 321 k 2024-05-17T04:06:42.064 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd x86_64 2:19.0.0-3794.g931809a9.el9 ceph 300 k 2024-05-17T04:06:42.064 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw x86_64 2:19.0.0-3794.g931809a9.el9 ceph 99 k 2024-05-17T04:06:42.064 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse x86_64 2:19.0.0-3794.g931809a9.el9 ceph 86 k 2024-05-17T04:06:42.065 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror x86_64 2:19.0.0-3794.g931809a9.el9 ceph 3.0 M 2024-05-17T04:06:42.065 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd x86_64 2:19.0.0-3794.g931809a9.el9 ceph 169 k 2024-05-17T04:06:42.065 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-17T04:06:42.065 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2024-05-17T04:06:42.065 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-17T04:06:42.065 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-17T04:06:42.065 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-17T04:06:42.065 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-17T04:06:42.065 INFO:teuthology.orchestra.run.smithi131.stdout: librados2 x86_64 2:19.0.0-3794.g931809a9.el9 ceph 3.3 M 2024-05-17T04:06:42.065 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1 x86_64 2:19.0.0-3794.g931809a9.el9 ceph 3.1 M 2024-05-17T04:06:42.065 INFO:teuthology.orchestra.run.smithi131.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-17T04:06:42.065 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-17T04:06:42.065 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-05-17T04:06:42.066 INFO:teuthology.orchestra.run.smithi131.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-17T04:06:42.066 INFO:teuthology.orchestra.run.smithi131.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-17T04:06:42.066 INFO:teuthology.orchestra.run.smithi131.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-17T04:06:42.066 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common x86_64 2:19.0.0-3794.g931809a9.el9 ceph 20 M 2024-05-17T04:06:42.066 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 34 k 2024-05-17T04:06:42.066 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds x86_64 2:19.0.0-3794.g931809a9.el9 ceph 2.3 M 2024-05-17T04:06:42.066 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 274 k 2024-05-17T04:06:42.066 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon x86_64 2:19.0.0-3794.g931809a9.el9 ceph 4.9 M 2024-05-17T04:06:42.066 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd x86_64 2:19.0.0-3794.g931809a9.el9 ceph 18 M 2024-05-17T04:06:42.066 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3794.g931809a9.el9 ceph-noarch 16 k 2024-05-17T04:06:42.066 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux x86_64 2:19.0.0-3794.g931809a9.el9 ceph 25 k 2024-05-17T04:06:42.067 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-17T04:06:42.067 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-17T04:06:42.067 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-17T04:06:42.067 INFO:teuthology.orchestra.run.smithi131.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-17T04:06:42.067 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-17T04:06:42.067 INFO:teuthology.orchestra.run.smithi131.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-17T04:06:42.067 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-17T04:06:42.067 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-17T04:06:42.067 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite x86_64 2:19.0.0-3794.g931809a9.el9 ceph 158 k 2024-05-17T04:06:42.067 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-17T04:06:42.067 INFO:teuthology.orchestra.run.smithi131.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-17T04:06:42.067 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-17T04:06:42.068 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-17T04:06:42.068 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-17T04:06:42.068 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 x86_64 2:19.0.0-3794.g931809a9.el9 ceph 501 k 2024-05-17T04:06:42.068 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-17T04:06:42.068 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2 x86_64 2:19.0.0-3794.g931809a9.el9 ceph 5.2 M 2024-05-17T04:06:42.068 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-17T04:06:42.068 INFO:teuthology.orchestra.run.smithi131.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-17T04:06:42.068 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-17T04:06:42.068 INFO:teuthology.orchestra.run.smithi131.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-17T04:06:42.068 INFO:teuthology.orchestra.run.smithi131.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-17T04:06:42.068 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-17T04:06:42.068 INFO:teuthology.orchestra.run.smithi131.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-17T04:06:42.069 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-17T04:06:42.069 INFO:teuthology.orchestra.run.smithi131.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-17T04:06:42.069 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-17T04:06:42.069 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-17T04:06:42.069 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-17T04:06:42.069 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-17T04:06:42.069 INFO:teuthology.orchestra.run.smithi131.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-17T04:06:42.069 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-17T04:06:42.069 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-17T04:06:42.069 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-17T04:06:42.069 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse x86_64 2:19.0.0-3794.g931809a9.el9 ceph 45 k 2024-05-17T04:06:42.069 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common x86_64 2:19.0.0-3794.g931809a9.el9 ceph 136 k 2024-05-17T04:06:42.069 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-17T04:06:42.070 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-17T04:06:42.070 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-17T04:06:42.070 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-17T04:06:42.070 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-17T04:06:42.070 INFO:teuthology.orchestra.run.smithi131.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-17T04:06:42.070 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-17T04:06:42.070 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-17T04:06:42.070 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-17T04:06:42.070 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-17T04:06:42.070 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-17T04:06:42.070 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-17T04:06:42.071 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-17T04:06:42.071 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-17T04:06:42.071 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-17T04:06:42.071 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-17T04:06:42.071 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-17T04:06:42.071 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-17T04:06:42.071 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-17T04:06:42.071 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-17T04:06:42.071 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-17T04:06:42.071 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-17T04:06:42.071 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-17T04:06:42.072 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-17T04:06:42.072 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-17T04:06:42.072 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-17T04:06:42.072 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-17T04:06:42.072 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-17T04:06:42.072 INFO:teuthology.orchestra.run.smithi131.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-17T04:06:42.072 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-17T04:06:42.072 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-17T04:06:42.072 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-17T04:06:42.072 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-17T04:06:42.072 INFO:teuthology.orchestra.run.smithi131.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-17T04:06:42.072 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-17T04:06:42.072 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-17T04:06:42.073 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-17T04:06:42.073 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-17T04:06:42.073 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-17T04:06:42.073 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-17T04:06:42.073 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-17T04:06:42.073 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-17T04:06:42.073 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-17T04:06:42.073 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-17T04:06:42.073 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-17T04:06:42.073 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-17T04:06:42.073 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-17T04:06:42.073 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-17T04:06:42.073 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-17T04:06:42.073 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-17T04:06:42.074 INFO:teuthology.orchestra.run.smithi131.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-17T04:06:42.074 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-17T04:06:42.074 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-17T04:06:42.074 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-17T04:06:42.074 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-17T04:06:42.074 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-17T04:06:42.074 INFO:teuthology.orchestra.run.smithi131.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-17T04:06:42.074 INFO:teuthology.orchestra.run.smithi131.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-17T04:06:42.074 INFO:teuthology.orchestra.run.smithi131.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-17T04:06:42.074 INFO:teuthology.orchestra.run.smithi131.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-17T04:06:42.074 INFO:teuthology.orchestra.run.smithi131.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-17T04:06:42.074 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-17T04:06:42.074 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-17T04:06:42.075 INFO:teuthology.orchestra.run.smithi131.stdout:Installing weak dependencies: 2024-05-17T04:06:42.075 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-17T04:06:42.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:06:42.075 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-05-17T04:06:42.075 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================= 2024-05-17T04:06:42.075 INFO:teuthology.orchestra.run.smithi131.stdout:Install 148 Packages 2024-05-17T04:06:42.075 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 8 Packages 2024-05-17T04:06:42.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:06:42.076 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 219 M 2024-05-17T04:06:42.076 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-05-17T04:06:42.097 INFO:teuthology.orchestra.run.smithi150.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 762 kB/s | 45 kB 00:00 2024-05-17T04:06:42.139 INFO:teuthology.orchestra.run.smithi150.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 266 kB/s | 22 kB 00:00 2024-05-17T04:06:42.306 INFO:teuthology.orchestra.run.smithi150.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.0 MB/s | 863 kB 00:00 2024-05-17T04:06:42.473 INFO:teuthology.orchestra.run.smithi150.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-05-17T04:06:42.743 INFO:teuthology.orchestra.run.smithi131.stdout:(1/156): ceph-19.0.0-3794.g931809a9.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-05-17T04:06:43.043 INFO:teuthology.orchestra.run.smithi131.stdout:(2/156): ceph-fuse-19.0.0-3794.g931809a9.el9.x8 2.8 MB/s | 866 kB 00:00 2024-05-17T04:06:43.127 INFO:teuthology.orchestra.run.smithi131.stdout:(3/156): ceph-immutable-object-cache-19.0.0-379 1.7 MB/s | 147 kB 00:00 2024-05-17T04:06:43.218 INFO:teuthology.orchestra.run.smithi131.stdout:(4/156): ceph-base-19.0.0-3794.g931809a9.el9.x8 7.6 MB/s | 5.4 MB 00:00 2024-05-17T04:06:43.402 INFO:teuthology.orchestra.run.smithi131.stdout:(5/156): ceph-mgr-19.0.0-3794.g931809a9.el9.x86 8.2 MB/s | 1.5 MB 00:00 2024-05-17T04:06:43.582 INFO:teuthology.orchestra.run.smithi150.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 18 kB/s | 19 kB 00:01 2024-05-17T04:06:43.619 INFO:teuthology.orchestra.run.smithi131.stdout:(6/156): ceph-mds-19.0.0-3794.g931809a9.el9.x86 4.6 MB/s | 2.3 MB 00:00 2024-05-17T04:06:43.749 INFO:teuthology.orchestra.run.smithi150.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 340 kB/s | 548 kB 00:01 2024-05-17T04:06:43.775 INFO:teuthology.orchestra.run.smithi150.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 210 kB/s | 309 kB 00:01 2024-05-17T04:06:43.928 INFO:teuthology.orchestra.run.smithi131.stdout:(7/156): ceph-mon-19.0.0-3794.g931809a9.el9.x86 9.3 MB/s | 4.9 MB 00:00 2024-05-17T04:06:44.328 INFO:teuthology.orchestra.run.smithi131.stdout:(8/156): ceph-common-19.0.0-3794.g931809a9.el9. 11 MB/s | 20 MB 00:01 2024-05-17T04:06:44.387 INFO:teuthology.orchestra.run.smithi131.stdout:(9/156): ceph-selinux-19.0.0-3794.g931809a9.el9 433 kB/s | 25 kB 00:00 2024-05-17T04:06:44.845 INFO:teuthology.orchestra.run.smithi131.stdout:(10/156): ceph-radosgw-19.0.0-3794.g931809a9.el 11 MB/s | 10 MB 00:00 2024-05-17T04:06:44.981 INFO:teuthology.orchestra.run.smithi131.stdout:(11/156): cephfs-mirror-19.0.0-3794.g931809a9.e 1.6 MB/s | 227 kB 00:00 2024-05-17T04:06:45.046 INFO:teuthology.orchestra.run.smithi131.stdout:(12/156): cephfs-shell-19.0.0-3794.g931809a9.el 418 kB/s | 27 kB 00:00 2024-05-17T04:06:45.107 INFO:teuthology.orchestra.run.smithi131.stdout:(13/156): libcephfs-devel-19.0.0-3794.g931809a9 544 kB/s | 32 kB 00:00 2024-05-17T04:06:45.222 INFO:teuthology.orchestra.run.smithi131.stdout:(14/156): libcephfs2-19.0.0-3794.g931809a9.el9. 6.4 MB/s | 759 kB 00:00 2024-05-17T04:06:45.297 INFO:teuthology.orchestra.run.smithi131.stdout:(15/156): libcephsqlite-19.0.0-3794.g931809a9.e 2.1 MB/s | 158 kB 00:00 2024-05-17T04:06:45.364 INFO:teuthology.orchestra.run.smithi131.stdout:(16/156): librados-devel-19.0.0-3794.g931809a9. 1.9 MB/s | 127 kB 00:00 2024-05-17T04:06:45.448 INFO:teuthology.orchestra.run.smithi131.stdout:(17/156): libradosstriper1-19.0.0-3794.g931809a 5.9 MB/s | 501 kB 00:00 2024-05-17T04:06:45.852 INFO:teuthology.orchestra.run.smithi150.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 12 kB/s | 26 kB 00:02 2024-05-17T04:06:45.877 INFO:teuthology.orchestra.run.smithi150.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 23 kB/s | 49 kB 00:02 2024-05-17T04:06:46.144 INFO:teuthology.orchestra.run.smithi150.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 232 kB/s | 67 kB 00:00 2024-05-17T04:06:46.164 INFO:teuthology.orchestra.run.smithi131.stdout:(18/156): librgw2-19.0.0-3794.g931809a9.el9.x86 7.2 MB/s | 5.2 MB 00:00 2024-05-17T04:06:46.215 INFO:teuthology.orchestra.run.smithi131.stdout:(19/156): python3-ceph-argparse-19.0.0-3794.g93 901 kB/s | 45 kB 00:00 2024-05-17T04:06:46.432 INFO:teuthology.orchestra.run.smithi131.stdout:(20/156): ceph-osd-19.0.0-3794.g931809a9.el9.x8 6.3 MB/s | 18 MB 00:02 2024-05-17T04:06:46.457 INFO:teuthology.orchestra.run.smithi131.stdout:(21/156): python3-ceph-common-19.0.0-3794.g9318 560 kB/s | 136 kB 00:00 2024-05-17T04:06:46.500 INFO:teuthology.orchestra.run.smithi131.stdout:(22/156): python3-cephfs-19.0.0-3794.g931809a9. 2.4 MB/s | 162 kB 00:00 2024-05-17T04:06:46.525 INFO:teuthology.orchestra.run.smithi131.stdout:(23/156): python3-rados-19.0.0-3794.g931809a9.e 4.7 MB/s | 321 kB 00:00 2024-05-17T04:06:46.583 INFO:teuthology.orchestra.run.smithi131.stdout:(24/156): python3-rbd-19.0.0-3794.g931809a9.el9 3.5 MB/s | 300 kB 00:00 2024-05-17T04:06:46.625 INFO:teuthology.orchestra.run.smithi131.stdout:(25/156): python3-rgw-19.0.0-3794.g931809a9.el9 989 kB/s | 99 kB 00:00 2024-05-17T04:06:46.650 INFO:teuthology.orchestra.run.smithi131.stdout:(26/156): rbd-fuse-19.0.0-3794.g931809a9.el9.x8 1.3 MB/s | 86 kB 00:00 2024-05-17T04:06:46.743 INFO:teuthology.orchestra.run.smithi131.stdout:(27/156): rbd-nbd-19.0.0-3794.g931809a9.el9.x86 1.8 MB/s | 169 kB 00:00 2024-05-17T04:06:46.835 INFO:teuthology.orchestra.run.smithi131.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3794.g 374 kB/s | 34 kB 00:00 2024-05-17T04:06:46.935 INFO:teuthology.orchestra.run.smithi131.stdout:(29/156): rbd-mirror-19.0.0-3794.g931809a9.el9. 9.8 MB/s | 3.0 MB 00:00 2024-05-17T04:06:46.952 INFO:teuthology.orchestra.run.smithi131.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3794.g931809a 1.2 MB/s | 143 kB 00:00 2024-05-17T04:06:47.311 INFO:teuthology.orchestra.run.smithi131.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3794.g93180 9.4 MB/s | 3.5 MB 00:00 2024-05-17T04:06:47.728 INFO:teuthology.orchestra.run.smithi131.stdout:(32/156): ceph-test-19.0.0-3794.g931809a9.el9.x 13 MB/s | 43 MB 00:03 2024-05-17T04:06:47.753 INFO:teuthology.orchestra.run.smithi131.stdout:(33/156): ceph-mgr-modules-core-19.0.0-3794.g93 621 kB/s | 274 kB 00:00 2024-05-17T04:06:47.770 INFO:teuthology.orchestra.run.smithi131.stdout:(34/156): ceph-mgr-rook-19.0.0-3794.g931809a9.e 1.2 MB/s | 49 kB 00:00 2024-05-17T04:06:47.787 INFO:teuthology.orchestra.run.smithi131.stdout:(35/156): ceph-prometheus-alerts-19.0.0-3794.g9 490 kB/s | 16 kB 00:00 2024-05-17T04:06:47.829 INFO:teuthology.orchestra.run.smithi131.stdout:(36/156): ceph-volume-19.0.0-3794.g931809a9.el9 4.6 MB/s | 273 kB 00:00 2024-05-17T04:06:47.904 INFO:teuthology.orchestra.run.smithi131.stdout:(37/156): cephadm-19.0.0-3794.g931809a9.el9.noa 6.4 MB/s | 763 kB 00:00 2024-05-17T04:06:47.921 INFO:teuthology.orchestra.run.smithi131.stdout:(38/156): cephfs-top-19.0.0-3794.g931809a9.el9. 199 kB/s | 18 kB 00:00 2024-05-17T04:06:48.071 INFO:teuthology.orchestra.run.smithi131.stdout:(39/156): ceph-mgr-diskprediction-local-19.0.0- 6.6 MB/s | 7.4 MB 00:01 2024-05-17T04:06:48.114 INFO:teuthology.orchestra.run.smithi131.stdout:(40/156): fuse-2.9.9-15.el9.x86_64.rpm 384 kB/s | 80 kB 00:00 2024-05-17T04:06:48.205 INFO:teuthology.orchestra.run.smithi131.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-05-17T04:06:48.231 INFO:teuthology.orchestra.run.smithi131.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-05-17T04:06:48.273 INFO:teuthology.orchestra.run.smithi131.stdout:(43/156): libquadmath-11.4.1-3.el9.x86_64.rpm 973 kB/s | 195 kB 00:00 2024-05-17T04:06:48.290 INFO:teuthology.orchestra.run.smithi131.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-05-17T04:06:48.323 INFO:teuthology.orchestra.run.smithi131.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-05-17T04:06:48.357 INFO:teuthology.orchestra.run.smithi131.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-05-17T04:06:48.382 INFO:teuthology.orchestra.run.smithi131.stdout:(47/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-05-17T04:06:48.408 INFO:teuthology.orchestra.run.smithi131.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-05-17T04:06:48.600 INFO:teuthology.orchestra.run.smithi131.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 558 kB/s | 107 kB 00:00 2024-05-17T04:06:48.650 INFO:teuthology.orchestra.run.smithi131.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 430 kB/s | 21 kB 00:00 2024-05-17T04:06:48.700 INFO:teuthology.orchestra.run.smithi131.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-05-17T04:06:48.726 INFO:teuthology.orchestra.run.smithi131.stdout:(52/156): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-05-17T04:06:48.751 INFO:teuthology.orchestra.run.smithi131.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-05-17T04:06:48.768 INFO:teuthology.orchestra.run.smithi131.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 487 kB/s | 33 kB 00:00 2024-05-17T04:06:48.801 INFO:teuthology.orchestra.run.smithi131.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-05-17T04:06:48.835 INFO:teuthology.orchestra.run.smithi131.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-05-17T04:06:48.878 INFO:teuthology.orchestra.run.smithi131.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-05-17T04:06:48.894 INFO:teuthology.orchestra.run.smithi131.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-05-17T04:06:48.895 INFO:teuthology.orchestra.run.smithi150.stdout:(111/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 305 kB/s | 839 kB 00:02 2024-05-17T04:06:48.920 INFO:teuthology.orchestra.run.smithi150.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 50 kB/s | 151 kB 00:03 2024-05-17T04:06:48.945 INFO:teuthology.orchestra.run.smithi131.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-05-17T04:06:48.978 INFO:teuthology.orchestra.run.smithi131.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 582 kB 00:00 2024-05-17T04:06:48.986 INFO:teuthology.orchestra.run.smithi150.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 836 kB/s | 4.4 MB 00:05 2024-05-17T04:06:48.995 INFO:teuthology.orchestra.run.smithi131.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 506 kB/s | 25 kB 00:00 2024-05-17T04:06:49.003 INFO:teuthology.orchestra.run.smithi150.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 520 kB/s | 43 kB 00:00 2024-05-17T04:06:49.029 INFO:teuthology.orchestra.run.smithi131.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-05-17T04:06:49.037 INFO:teuthology.orchestra.run.smithi150.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-05-17T04:06:49.046 INFO:teuthology.orchestra.run.smithi131.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 704 kB/s | 47 kB 00:00 2024-05-17T04:06:49.080 INFO:teuthology.orchestra.run.smithi131.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-05-17T04:06:49.096 INFO:teuthology.orchestra.run.smithi131.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 702 kB/s | 35 kB 00:00 2024-05-17T04:06:49.122 INFO:teuthology.orchestra.run.smithi131.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-05-17T04:06:49.330 INFO:teuthology.orchestra.run.smithi131.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 19 MB/s | 4.7 MB 00:00 2024-05-17T04:06:49.414 INFO:teuthology.orchestra.run.smithi131.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-05-17T04:06:49.456 INFO:teuthology.orchestra.run.smithi131.stdout:(69/156): postgresql-13.14-1.el9.x86_64.rpm 4.8 MB/s | 1.6 MB 00:00 2024-05-17T04:06:49.481 INFO:teuthology.orchestra.run.smithi131.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-05-17T04:06:49.523 INFO:teuthology.orchestra.run.smithi131.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 4.6 MB/s | 911 kB 00:00 2024-05-17T04:06:49.562 INFO:teuthology.orchestra.run.smithi150.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 56 kB/s | 32 kB 00:00 2024-05-17T04:06:49.565 INFO:teuthology.orchestra.run.smithi131.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-05-17T04:06:49.591 INFO:teuthology.orchestra.run.smithi131.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-17T04:06:49.649 INFO:teuthology.orchestra.run.smithi131.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-05-17T04:06:49.679 INFO:teuthology.orchestra.run.smithi150.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 267 kB/s | 172 kB 00:00 2024-05-17T04:06:49.704 INFO:teuthology.orchestra.run.smithi150.stdout:(118/156): python3-certifi-2021.10.8-2.el9.noar 21 kB/s | 15 kB 00:00 2024-05-17T04:06:49.733 INFO:teuthology.orchestra.run.smithi131.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-05-17T04:06:49.817 INFO:teuthology.orchestra.run.smithi131.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 6.0 MB 00:00 2024-05-17T04:06:49.851 INFO:teuthology.orchestra.run.smithi131.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-05-17T04:06:49.876 INFO:teuthology.orchestra.run.smithi131.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-05-17T04:06:49.909 INFO:teuthology.orchestra.run.smithi131.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-05-17T04:06:49.926 INFO:teuthology.orchestra.run.smithi131.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 688 kB/s | 35 kB 00:00 2024-05-17T04:06:50.002 INFO:teuthology.orchestra.run.smithi131.stdout:(81/156): postgresql-server-13.14-1.el9.x86_64. 11 MB/s | 5.8 MB 00:00 2024-05-17T04:06:50.088 INFO:teuthology.orchestra.run.smithi131.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-05-17T04:06:50.136 INFO:teuthology.orchestra.run.smithi131.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-05-17T04:06:50.161 INFO:teuthology.orchestra.run.smithi131.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-05-17T04:06:50.186 INFO:teuthology.orchestra.run.smithi131.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-05-17T04:06:50.220 INFO:teuthology.orchestra.run.smithi131.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-05-17T04:06:50.245 INFO:teuthology.orchestra.run.smithi131.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-05-17T04:06:50.312 INFO:teuthology.orchestra.run.smithi131.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-05-17T04:06:50.329 INFO:teuthology.orchestra.run.smithi131.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 610 kB/s | 51 kB 00:00 2024-05-17T04:06:50.354 INFO:teuthology.orchestra.run.smithi131.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-05-17T04:06:50.372 INFO:teuthology.orchestra.run.smithi131.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 915 kB/s | 54 kB 00:00 2024-05-17T04:06:50.406 INFO:teuthology.orchestra.run.smithi131.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-05-17T04:06:50.422 INFO:teuthology.orchestra.run.smithi131.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 877 kB/s | 44 kB 00:00 2024-05-17T04:06:50.464 INFO:teuthology.orchestra.run.smithi131.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-05-17T04:06:50.489 INFO:teuthology.orchestra.run.smithi131.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 536 kB/s | 36 kB 00:00 2024-05-17T04:06:50.523 INFO:teuthology.orchestra.run.smithi131.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-05-17T04:06:50.557 INFO:teuthology.orchestra.run.smithi131.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-05-17T04:06:50.582 INFO:teuthology.orchestra.run.smithi131.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 982 kB/s | 58 kB 00:00 2024-05-17T04:06:50.616 INFO:teuthology.orchestra.run.smithi131.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-05-17T04:06:50.642 INFO:teuthology.orchestra.run.smithi131.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-17T04:06:50.675 INFO:teuthology.orchestra.run.smithi131.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 764 kB/s | 45 kB 00:00 2024-05-17T04:06:50.750 INFO:teuthology.orchestra.run.smithi131.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-05-17T04:06:50.763 INFO:teuthology.orchestra.run.smithi150.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 299 kB/s | 358 kB 00:01 2024-05-17T04:06:51.093 INFO:teuthology.orchestra.run.smithi131.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-05-17T04:06:51.126 INFO:teuthology.orchestra.run.smithi131.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-05-17T04:06:51.285 INFO:teuthology.orchestra.run.smithi131.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 123 kB/s | 19 kB 00:00 2024-05-17T04:06:51.427 INFO:teuthology.orchestra.run.smithi131.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 811 kB/s | 548 kB 00:00 2024-05-17T04:06:51.763 INFO:teuthology.orchestra.run.smithi150.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 17 kB/s | 35 kB 00:02 2024-05-17T04:06:51.805 INFO:teuthology.orchestra.run.smithi150.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 143 kB/s | 303 kB 00:02 2024-05-17T04:06:52.435 INFO:teuthology.orchestra.run.smithi131.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 26 kB/s | 26 kB 00:01 2024-05-17T04:06:52.814 INFO:teuthology.orchestra.run.smithi150.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 100 kB/s | 206 kB 00:02 2024-05-17T04:06:52.847 INFO:teuthology.orchestra.run.smithi150.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 139 kB/s | 144 kB 00:01 2024-05-17T04:06:52.911 INFO:teuthology.orchestra.run.smithi131.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 2.7 MB/s | 4.4 MB 00:01 2024-05-17T04:06:52.936 INFO:teuthology.orchestra.run.smithi131.stdout:(109/156): gperftools-libs-2.9.1-2.el9.x86_64.r 168 kB/s | 309 kB 00:01 2024-05-17T04:06:52.952 INFO:teuthology.orchestra.run.smithi131.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 94 kB/s | 49 kB 00:00 2024-05-17T04:06:53.078 INFO:teuthology.orchestra.run.smithi131.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 404 kB/s | 67 kB 00:00 2024-05-17T04:06:53.228 INFO:teuthology.orchestra.run.smithi131.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 550 kB/s | 151 kB 00:00 2024-05-17T04:06:53.881 INFO:teuthology.orchestra.run.smithi150.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 10 kB/s | 11 kB 00:01 2024-05-17T04:06:53.915 INFO:teuthology.orchestra.run.smithi150.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 17 kB/s | 18 kB 00:01 2024-05-17T04:06:53.956 INFO:teuthology.orchestra.run.smithi150.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 309 kB/s | 23 kB 00:00 2024-05-17T04:06:53.990 INFO:teuthology.orchestra.run.smithi150.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 259 kB/s | 19 kB 00:00 2024-05-17T04:06:54.337 INFO:teuthology.orchestra.run.smithi131.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 606 kB/s | 839 kB 00:01 2024-05-17T04:06:54.566 INFO:teuthology.orchestra.run.smithi150.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 32 kB/s | 20 kB 00:00 2024-05-17T04:06:54.620 INFO:teuthology.orchestra.run.smithi131.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 355 kB/s | 548 kB 00:01 2024-05-17T04:06:54.679 INFO:teuthology.orchestra.run.smithi131.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 30 kB/s | 43 kB 00:01 2024-05-17T04:06:54.754 INFO:teuthology.orchestra.run.smithi131.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 77 kB/s | 32 kB 00:00 2024-05-17T04:06:54.757 INFO:teuthology.orchestra.run.smithi150.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 697 kB/s | 2.0 MB 00:02 2024-05-17T04:06:54.780 INFO:teuthology.orchestra.run.smithi131.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 94 kB/s | 15 kB 00:00 2024-05-17T04:06:54.782 INFO:teuthology.orchestra.run.smithi150.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 214 kB/s | 46 kB 00:00 2024-05-17T04:06:54.841 INFO:teuthology.orchestra.run.smithi150.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 1.2 MB/s | 1.0 MB 00:00 2024-05-17T04:06:54.866 INFO:teuthology.orchestra.run.smithi150.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 725 kB/s | 79 kB 00:00 2024-05-17T04:06:54.888 INFO:teuthology.orchestra.run.smithi131.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 822 kB/s | 172 kB 00:00 2024-05-17T04:06:54.892 INFO:teuthology.orchestra.run.smithi150.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 529 kB/s | 58 kB 00:00 2024-05-17T04:06:54.950 INFO:teuthology.orchestra.run.smithi150.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-05-17T04:06:54.976 INFO:teuthology.orchestra.run.smithi150.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-05-17T04:06:55.009 INFO:teuthology.orchestra.run.smithi150.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 767 kB/s | 90 kB 00:00 2024-05-17T04:06:55.060 INFO:teuthology.orchestra.run.smithi150.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 368 kB/s | 31 kB 00:00 2024-05-17T04:06:55.085 INFO:teuthology.orchestra.run.smithi150.stdout:(138/156): python3-pyperclip-1.8.2-2.el9.noarch 210 kB/s | 28 kB 00:00 2024-05-17T04:06:55.135 INFO:teuthology.orchestra.run.smithi150.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-05-17T04:06:55.152 INFO:teuthology.orchestra.run.smithi150.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 639 kB/s | 59 kB 00:00 2024-05-17T04:06:55.169 INFO:teuthology.orchestra.run.smithi150.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 426 kB/s | 36 kB 00:00 2024-05-17T04:06:55.219 INFO:teuthology.orchestra.run.smithi150.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 610 kB/s | 51 kB 00:00 2024-05-17T04:06:55.253 INFO:teuthology.orchestra.run.smithi150.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-05-17T04:06:55.270 INFO:teuthology.orchestra.run.smithi150.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 891 kB/s | 90 kB 00:00 2024-05-17T04:06:55.305 INFO:teuthology.orchestra.run.smithi131.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 651 kB/s | 358 kB 00:00 2024-05-17T04:06:55.354 INFO:teuthology.orchestra.run.smithi150.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-05-17T04:06:55.371 INFO:teuthology.orchestra.run.smithi150.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 170 kB/s | 20 kB 00:00 2024-05-17T04:06:55.396 INFO:teuthology.orchestra.run.smithi150.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-05-17T04:06:55.480 INFO:teuthology.orchestra.run.smithi131.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 433 kB/s | 303 kB 00:00 2024-05-17T04:06:55.504 INFO:teuthology.orchestra.run.smithi150.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-17T04:06:55.514 INFO:teuthology.orchestra.run.smithi131.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 56 kB/s | 35 kB 00:00 2024-05-17T04:06:55.606 INFO:teuthology.orchestra.run.smithi131.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 684 kB/s | 206 kB 00:00 2024-05-17T04:06:55.688 INFO:teuthology.orchestra.run.smithi150.stdout:(149/156): NetworkManager-1.47.90-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-05-17T04:06:55.738 INFO:teuthology.orchestra.run.smithi150.stdout:(150/156): librbd1-19.0.0-3794.g931809a9.el9.x8 9.0 MB/s | 3.1 MB 00:00 2024-05-17T04:06:55.788 INFO:teuthology.orchestra.run.smithi150.stdout:(151/156): NetworkManager-libnm-1.47.90-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-05-17T04:06:55.814 INFO:teuthology.orchestra.run.smithi150.stdout:(152/156): NetworkManager-team-1.47.90-1.el9.x8 553 kB/s | 41 kB 00:00 2024-05-17T04:06:55.848 INFO:teuthology.orchestra.run.smithi150.stdout:(153/156): NetworkManager-tui-1.47.90-1.el9.x86 4.1 MB/s | 248 kB 00:00 2024-05-17T04:06:55.923 INFO:teuthology.orchestra.run.smithi150.stdout:(154/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-05-17T04:06:55.990 INFO:teuthology.orchestra.run.smithi150.stdout:(155/156): librados2-19.0.0-3794.g931809a9.el9. 5.4 MB/s | 3.3 MB 00:00 2024-05-17T04:06:56.023 INFO:teuthology.orchestra.run.smithi150.stdout:(156/156): openssl-3.2.1-1.el9.x86_64.rpm 6.5 MB/s | 1.3 MB 00:00 2024-05-17T04:06:56.030 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-05-17T04:06:56.030 INFO:teuthology.orchestra.run.smithi150.stdout:Total 9.7 MB/s | 219 MB 00:22 2024-05-17T04:06:57.231 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-05-17T04:06:57.239 INFO:teuthology.orchestra.run.smithi131.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 1.2 MB/s | 2.0 MB 00:01 2024-05-17T04:06:57.273 INFO:teuthology.orchestra.run.smithi131.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 82 kB/s | 144 kB 00:01 2024-05-17T04:06:57.298 INFO:teuthology.orchestra.run.smithi131.stdout:(125/156): python3-jaraco-8.2.1-3.el9.noarch.rp 6.3 kB/s | 11 kB 00:01 2024-05-17T04:06:57.324 INFO:teuthology.orchestra.run.smithi131.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-05-17T04:06:57.384 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-05-17T04:06:57.384 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-05-17T04:06:58.941 INFO:teuthology.orchestra.run.smithi131.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 14 kB/s | 23 kB 00:01 2024-05-17T04:06:58.966 INFO:teuthology.orchestra.run.smithi131.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 12 kB/s | 19 kB 00:01 2024-05-17T04:06:58.991 INFO:teuthology.orchestra.run.smithi131.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 12 kB/s | 20 kB 00:01 2024-05-17T04:06:59.585 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-05-17T04:06:59.586 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-05-17T04:07:00.950 INFO:teuthology.orchestra.run.smithi131.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 520 kB/s | 1.0 MB 00:02 2024-05-17T04:07:01.233 INFO:teuthology.orchestra.run.smithi131.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 21 kB/s | 46 kB 00:02 2024-05-17T04:07:01.325 INFO:teuthology.orchestra.run.smithi131.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 34 kB/s | 79 kB 00:02 2024-05-17T04:07:01.450 INFO:teuthology.orchestra.run.smithi131.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 115 kB/s | 58 kB 00:00 2024-05-17T04:07:01.625 INFO:teuthology.orchestra.run.smithi131.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 694 kB/s | 272 kB 00:00 2024-05-17T04:07:01.651 INFO:teuthology.orchestra.run.smithi131.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 50 kB/s | 16 kB 00:00 2024-05-17T04:07:01.693 INFO:teuthology.orchestra.run.smithi131.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 371 kB/s | 90 kB 00:00 2024-05-17T04:07:01.718 INFO:teuthology.orchestra.run.smithi131.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 423 kB/s | 28 kB 00:00 2024-05-17T04:07:01.743 INFO:teuthology.orchestra.run.smithi131.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-05-17T04:07:01.852 INFO:teuthology.orchestra.run.smithi131.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-05-17T04:07:01.902 INFO:teuthology.orchestra.run.smithi131.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 373 kB/s | 59 kB 00:00 2024-05-17T04:07:01.927 INFO:teuthology.orchestra.run.smithi131.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 195 kB/s | 36 kB 00:00 2024-05-17T04:07:01.969 INFO:teuthology.orchestra.run.smithi131.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 435 kB/s | 51 kB 00:00 2024-05-17T04:07:02.136 INFO:teuthology.orchestra.run.smithi131.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 983 kB/s | 230 kB 00:00 2024-05-17T04:07:02.412 INFO:teuthology.orchestra.run.smithi131.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 185 kB/s | 90 kB 00:00 2024-05-17T04:07:02.603 INFO:teuthology.orchestra.run.smithi131.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 674 kB/s | 427 kB 00:00 2024-05-17T04:07:02.629 INFO:teuthology.orchestra.run.smithi131.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 41 kB/s | 20 kB 00:00 2024-05-17T04:07:02.654 INFO:teuthology.orchestra.run.smithi131.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 792 kB/s | 192 kB 00:00 2024-05-17T04:07:03.163 INFO:teuthology.orchestra.run.smithi131.stdout:(148/156): librbd1-19.0.0-3794.g931809a9.el9.x8 6.1 MB/s | 3.1 MB 00:00 2024-05-17T04:07:03.321 INFO:teuthology.orchestra.run.smithi131.stdout:(149/156): thrift-0.15.0-2.el9.x86_64.rpm 2.2 MB/s | 1.6 MB 00:00 2024-05-17T04:07:03.388 INFO:teuthology.orchestra.run.smithi131.stdout:(150/156): NetworkManager-1.47.90-1.el9.x86_64. 10 MB/s | 2.3 MB 00:00 2024-05-17T04:07:03.455 INFO:teuthology.orchestra.run.smithi131.stdout:(151/156): NetworkManager-team-1.47.90-1.el9.x8 623 kB/s | 41 kB 00:00 2024-05-17T04:07:03.506 INFO:teuthology.orchestra.run.smithi131.stdout:(152/156): NetworkManager-tui-1.47.90-1.el9.x86 4.8 MB/s | 248 kB 00:00 2024-05-17T04:07:03.540 INFO:teuthology.orchestra.run.smithi131.stdout:(153/156): NetworkManager-libnm-1.47.90-1.el9.x 8.3 MB/s | 1.8 MB 00:00 2024-05-17T04:07:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-05-17T04:07:03.665 INFO:teuthology.orchestra.run.smithi131.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-05-17T04:07:03.790 INFO:teuthology.orchestra.run.smithi131.stdout:(156/156): librados2-19.0.0-3794.g931809a9.el9. 2.9 MB/s | 3.3 MB 00:01 2024-05-17T04:07:03.793 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-05-17T04:07:03.794 INFO:teuthology.orchestra.run.smithi131.stdout:Total 10 MB/s | 219 MB 00:21 2024-05-17T04:07:05.060 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-05-17T04:07:05.209 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-05-17T04:07:05.209 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-05-17T04:07:06.068 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-05-17T04:07:06.161 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-17T04:07:06.211 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-17T04:07:06.284 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-17T04:07:06.320 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-17T04:07:06.346 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-17T04:07:06.391 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-17T04:07:06.743 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-17T04:07:06.855 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librados2-2:19.0.0-3794.g931809a9.el9.x86_64 8/164 2024-05-17T04:07:06.982 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:19.0.0-3794.g931809a9.el9.x86_64 8/164 2024-05-17T04:07:07.014 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs2-2:19.0.0-3794.g931809a9.el9.x86_64 9/164 2024-05-17T04:07:07.107 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs2-2:19.0.0-3794.g931809a9.el9.x86_64 9/164 2024-05-17T04:07:07.135 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rados-2:19.0.0-3794.g931809a9.el9.x86_64 10/164 2024-05-17T04:07:07.299 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-05-17T04:07:07.299 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-05-17T04:07:07.308 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-17T04:07:07.367 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-17T04:07:07.402 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephsqlite-2:19.0.0-3794.g931809a9.el9.x86_64 13/164 2024-05-17T04:07:07.507 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3794.g931809a9.el9.x86_64 13/164 2024-05-17T04:07:07.528 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libradosstriper1-2:19.0.0-3794.g931809a9.el9.x86 14/164 2024-05-17T04:07:07.575 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3794.g931809a9.el9.x86 14/164 2024-05-17T04:07:07.588 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-17T04:07:07.611 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-17T04:07:07.806 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-17T04:07:07.983 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-17T04:07:08.118 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-17T04:07:08.179 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-17T04:07:08.268 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-17T04:07:08.355 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-17T04:07:08.549 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-17T04:07:08.666 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-17T04:07:08.701 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-17T04:07:08.752 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-17T04:07:08.816 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-17T04:07:08.852 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-17T04:07:08.894 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-17T04:07:08.928 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-17T04:07:08.955 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-17T04:07:09.024 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-17T04:07:09.077 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-17T04:07:09.108 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-17T04:07:09.151 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-17T04:07:09.228 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-17T04:07:09.262 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-common-2:19.0.0-3794.g931809a9.el9. 32/164 2024-05-17T04:07:09.306 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-argparse-2:19.0.0-3794.g931809a9.el 33/164 2024-05-17T04:07:09.334 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cephfs-2:19.0.0-3794.g931809a9.el9.x86_6 34/164 2024-05-17T04:07:09.404 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-17T04:07:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : luarocks-3.9.2-5.el9.noarch 36/164 2024-05-17T04:07:09.524 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-17T04:07:09.657 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-17T04:07:09.711 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-17T04:07:10.230 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-17T04:07:10.305 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-17T04:07:10.334 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-17T04:07:10.378 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-17T04:07:10.407 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librados-devel-2:19.0.0-3794.g931809a9.el9.x86_6 44/164 2024-05-17T04:07:10.460 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-17T04:07:10.626 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-17T04:07:10.685 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-17T04:07:10.776 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-17T04:07:10.841 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-17T04:07:10.913 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-17T04:07:10.953 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-17T04:07:10.990 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-17T04:07:11.036 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-17T04:07:11.072 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-17T04:07:11.115 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-17T04:07:11.157 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-17T04:07:11.294 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-17T04:07:11.338 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-17T04:07:11.368 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-17T04:07:11.410 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-17T04:07:11.504 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-17T04:07:11.535 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-17T04:07:11.577 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-17T04:07:11.609 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-17T04:07:11.633 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-17T04:07:11.727 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-17T04:07:11.853 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-17T04:07:11.901 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-17T04:07:11.935 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-17T04:07:11.970 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-17T04:07:12.009 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-17T04:07:12.040 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-17T04:07:12.070 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-17T04:07:12.105 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-17T04:07:12.138 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-17T04:07:12.179 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-17T04:07:12.214 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-17T04:07:12.293 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-17T04:07:12.354 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-17T04:07:12.392 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-17T04:07:12.440 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-17T04:07:12.538 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-17T04:07:12.594 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-17T04:07:13.324 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-17T04:07:13.374 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-17T04:07:13.408 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-17T04:07:13.507 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-17T04:07:13.557 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-17T04:07:13.581 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-05-17T04:07:13.645 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-17T04:07:13.693 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-17T04:07:13.704 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-17T04:07:13.741 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-17T04:07:13.813 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-17T04:07:13.846 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-17T04:07:13.871 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-17T04:07:13.872 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-17T04:07:13.908 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-17T04:07:13.922 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-17T04:07:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-17T04:07:14.262 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-17T04:07:14.381 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librados2-2:19.0.0-3794.g931809a9.el9.x86_64 8/164 2024-05-17T04:07:14.507 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:19.0.0-3794.g931809a9.el9.x86_64 8/164 2024-05-17T04:07:14.540 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs2-2:19.0.0-3794.g931809a9.el9.x86_64 9/164 2024-05-17T04:07:14.617 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs2-2:19.0.0-3794.g931809a9.el9.x86_64 9/164 2024-05-17T04:07:14.645 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-17T04:07:14.645 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rados-2:19.0.0-3794.g931809a9.el9.x86_64 10/164 2024-05-17T04:07:14.765 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-17T04:07:14.827 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-17T04:07:14.885 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-17T04:07:14.912 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephsqlite-2:19.0.0-3794.g931809a9.el9.x86_64 13/164 2024-05-17T04:07:15.028 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3794.g931809a9.el9.x86_64 13/164 2024-05-17T04:07:15.055 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libradosstriper1-2:19.0.0-3794.g931809a9.el9.x86 14/164 2024-05-17T04:07:15.118 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3794.g931809a9.el9.x86 14/164 2024-05-17T04:07:15.140 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-17T04:07:15.160 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-17T04:07:15.317 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-17T04:07:15.500 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-17T04:07:15.654 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-17T04:07:15.715 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-17T04:07:15.823 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-17T04:07:15.908 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-17T04:07:16.041 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-17T04:07:16.110 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-17T04:07:16.138 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-17T04:07:16.166 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-17T04:07:16.200 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-17T04:07:16.230 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-17T04:07:16.263 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-17T04:07:16.297 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-17T04:07:16.360 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-17T04:07:16.396 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-17T04:07:16.439 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-17T04:07:16.473 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-17T04:07:16.500 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-17T04:07:16.518 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-17T04:07:16.562 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librbd1-2:19.0.0-3794.g931809a9.el9.x86_64 101/164 2024-05-17T04:07:16.567 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-17T04:07:16.622 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-17T04:07:16.654 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-17T04:07:16.662 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:19.0.0-3794.g931809a9.el9.x86_64 101/164 2024-05-17T04:07:16.688 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-17T04:07:16.692 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rbd-2:19.0.0-3794.g931809a9.el9.x86_64 102/164 2024-05-17T04:07:16.733 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-17T04:07:16.764 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-17T04:07:16.799 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-common-2:19.0.0-3794.g931809a9.el9. 32/164 2024-05-17T04:07:16.834 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-argparse-2:19.0.0-3794.g931809a9.el 33/164 2024-05-17T04:07:16.863 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cephfs-2:19.0.0-3794.g931809a9.el9.x86_6 34/164 2024-05-17T04:07:16.932 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-17T04:07:16.978 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : luarocks-3.9.2-5.el9.noarch 36/164 2024-05-17T04:07:17.051 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-17T04:07:17.183 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-17T04:07:17.218 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-17T04:07:17.230 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-17T04:07:17.249 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librgw2-2:19.0.0-3794.g931809a9.el9.x86_64 105/164 2024-05-17T04:07:17.321 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librgw2-2:19.0.0-3794.g931809a9.el9.x86_64 105/164 2024-05-17T04:07:17.351 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rgw-2:19.0.0-3794.g931809a9.el9.x86_64 106/164 2024-05-17T04:07:17.743 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-17T04:07:17.826 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-17T04:07:17.856 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-17T04:07:17.899 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-17T04:07:17.937 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librados-devel-2:19.0.0-3794.g931809a9.el9.x86_6 44/164 2024-05-17T04:07:17.979 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-17T04:07:18.144 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-17T04:07:18.200 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-17T04:07:18.291 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-17T04:07:18.355 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-17T04:07:18.419 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-17T04:07:18.451 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-17T04:07:18.488 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-17T04:07:18.534 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-17T04:07:18.571 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-17T04:07:18.613 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-17T04:07:18.655 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-17T04:07:18.790 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-17T04:07:18.836 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-17T04:07:18.866 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-17T04:07:18.907 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-17T04:07:19.001 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-17T04:07:19.042 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-17T04:07:19.083 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-17T04:07:19.115 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-17T04:07:19.140 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-17T04:07:19.223 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-17T04:07:19.348 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-17T04:07:19.380 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-17T04:07:19.409 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-17T04:07:19.443 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-17T04:07:19.498 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-17T04:07:19.530 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-17T04:07:19.560 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-17T04:07:19.594 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-17T04:07:19.628 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-17T04:07:19.688 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-17T04:07:19.692 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:19.0.0-3794.g931809a9.el9.x86_64 107/164 2024-05-17T04:07:19.720 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-17T04:07:19.732 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-common-2:19.0.0-3794.g931809a9.el9.x86_64 107/164 2024-05-17T04:07:19.806 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-17T04:07:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-17T04:07:19.891 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-17T04:07:19.937 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-17T04:07:20.034 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-17T04:07:20.083 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-17T04:07:20.294 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:19.0.0-3794.g931809a9.el9.x86_64 107/164 2024-05-17T04:07:20.327 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-base-2:19.0.0-3794.g931809a9.el9.x86_64 108/164 2024-05-17T04:07:20.418 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-base-2:19.0.0-3794.g931809a9.el9.x86_64 108/164 2024-05-17T04:07:20.418 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-17T04:07:20.418 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-17T04:07:20.418 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:07:20.445 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-selinux-2:19.0.0-3794.g931809a9.el9.x86_64 109/164 2024-05-17T04:07:20.795 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-17T04:07:20.855 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-17T04:07:20.889 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-17T04:07:20.986 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-17T04:07:21.038 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-17T04:07:21.117 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-17T04:07:21.158 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-17T04:07:21.327 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-17T04:07:21.364 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-17T04:07:21.442 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-17T04:07:22.080 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-17T04:07:22.193 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-17T04:07:23.427 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-17T04:07:23.534 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-17T04:07:23.561 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-17T04:07:23.595 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-17T04:07:23.911 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-17T04:07:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librbd1-2:19.0.0-3794.g931809a9.el9.x86_64 101/164 2024-05-17T04:07:24.056 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:19.0.0-3794.g931809a9.el9.x86_64 101/164 2024-05-17T04:07:24.079 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rbd-2:19.0.0-3794.g931809a9.el9.x86_64 102/164 2024-05-17T04:07:24.121 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-17T04:07:24.614 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-17T04:07:24.645 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librgw2-2:19.0.0-3794.g931809a9.el9.x86_64 105/164 2024-05-17T04:07:24.716 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librgw2-2:19.0.0-3794.g931809a9.el9.x86_64 105/164 2024-05-17T04:07:24.746 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rgw-2:19.0.0-3794.g931809a9.el9.x86_64 106/164 2024-05-17T04:07:26.992 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:19.0.0-3794.g931809a9.el9.x86_64 107/164 2024-05-17T04:07:27.026 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-common-2:19.0.0-3794.g931809a9.el9.x86_64 107/164 2024-05-17T04:07:27.597 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:19.0.0-3794.g931809a9.el9.x86_64 107/164 2024-05-17T04:07:27.637 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-base-2:19.0.0-3794.g931809a9.el9.x86_64 108/164 2024-05-17T04:07:27.732 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-base-2:19.0.0-3794.g931809a9.el9.x86_64 108/164 2024-05-17T04:07:27.732 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-17T04:07:27.732 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-17T04:07:27.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:07:27.763 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-selinux-2:19.0.0-3794.g931809a9.el9.x86_64 109/164 2024-05-17T04:07:31.965 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3794.g931809a9.el9.x86_64 109/164 2024-05-17T04:07:31.966 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /sys 2024-05-17T04:07:31.966 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /proc 2024-05-17T04:07:31.966 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /mnt 2024-05-17T04:07:31.966 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /var/tmp 2024-05-17T04:07:31.966 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /home 2024-05-17T04:07:31.966 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /root 2024-05-17T04:07:31.966 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /tmp 2024-05-17T04:07:31.966 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:07:32.142 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-volume-2:19.0.0-3794.g931809a9.el9.noarch 110/164 2024-05-17T04:07:32.158 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-volume-2:19.0.0-3794.g931809a9.el9.noarch 110/164 2024-05-17T04:07:32.158 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:32.158 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-17T04:07:32.158 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:07:33.761 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-osd-2:19.0.0-3794.g931809a9.el9.x86_64 111/164 2024-05-17T04:07:33.789 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-osd-2:19.0.0-3794.g931809a9.el9.x86_64 111/164 2024-05-17T04:07:33.789 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:33.789 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-17T04:07:33.789 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-17T04:07:33.789 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-17T04:07:33.789 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:07:34.012 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mds-2:19.0.0-3794.g931809a9.el9.x86_64 112/164 2024-05-17T04:07:34.036 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mds-2:19.0.0-3794.g931809a9.el9.x86_64 112/164 2024-05-17T04:07:34.036 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:34.036 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-17T04:07:34.037 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-17T04:07:34.037 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-17T04:07:34.037 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:07:34.505 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mon-2:19.0.0-3794.g931809a9.el9.x86_64 113/164 2024-05-17T04:07:34.528 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mon-2:19.0.0-3794.g931809a9.el9.x86_64 113/164 2024-05-17T04:07:34.528 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:34.528 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-17T04:07:34.529 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-17T04:07:34.529 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-17T04:07:34.529 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:07:34.652 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-17T04:07:34.709 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-17T04:07:34.763 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-17T04:07:34.951 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-17T04:07:34.997 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-17T04:07:35.076 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-17T04:07:35.165 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-17T04:07:35.318 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-17T04:07:35.356 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-17T04:07:35.388 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-17T04:07:35.415 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-17T04:07:35.911 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:19.0.0-3794.g931809a9.el9.noarch 125/164 2024-05-17T04:07:35.939 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephadm-2:19.0.0-3794.g931809a9.el9.noarch 125/164 2024-05-17T04:07:35.971 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3794.g931809a9.e 126/164 2024-05-17T04:07:36.033 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3794.g931809a9. 127/164 2024-05-17T04:07:36.062 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3794.g931809a9.el9.noa 128/164 2024-05-17T04:07:37.115 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3794.g931809a9.el9.noa 128/164 2024-05-17T04:07:37.156 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3794.g931809a9.el9.n 129/164 2024-05-17T04:07:38.131 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3794.g931809a9.el9.n 129/164 2024-05-17T04:07:38.156 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3794.g931 130/164 2024-05-17T04:07:38.268 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3794.g931 130/164 2024-05-17T04:07:38.436 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3794.g931809a9.el 131/164 2024-05-17T04:07:38.458 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-2:19.0.0-3794.g931809a9.el9.x86_64 132/164 2024-05-17T04:07:38.482 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3794.g931809a9.el9.x86_64 132/164 2024-05-17T04:07:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-17T04:07:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-17T04:07:38.482 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-17T04:07:38.483 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:07:38.526 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-rook-2:19.0.0-3794.g931809a9.el9.noarch 133/164 2024-05-17T04:07:38.537 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3794.g931809a9.el9.noarch 133/164 2024-05-17T04:07:38.627 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-2:19.0.0-3794.g931809a9.el9.x86_64 134/164 2024-05-17T04:07:38.685 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-fuse-2:19.0.0-3794.g931809a9.el9.x86_64 135/164 2024-05-17T04:07:39.625 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3794.g931809a9.el9.x86_64 109/164 2024-05-17T04:07:39.625 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /sys 2024-05-17T04:07:39.625 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /proc 2024-05-17T04:07:39.625 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /mnt 2024-05-17T04:07:39.625 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /var/tmp 2024-05-17T04:07:39.625 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /home 2024-05-17T04:07:39.626 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /root 2024-05-17T04:07:39.626 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /tmp 2024-05-17T04:07:39.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:07:39.651 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-17T04:07:39.678 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-radosgw-2:19.0.0-3794.g931809a9.el9.x86_64 137/164 2024-05-17T04:07:39.701 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3794.g931809a9.el9.x86_64 137/164 2024-05-17T04:07:39.701 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:39.701 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-17T04:07:39.702 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-17T04:07:39.702 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-17T04:07:39.702 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:07:39.745 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3794.g93180 138/164 2024-05-17T04:07:39.768 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3794.g93180 138/164 2024-05-17T04:07:39.768 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:39.769 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-17T04:07:39.769 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:07:39.810 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-volume-2:19.0.0-3794.g931809a9.el9.noarch 110/164 2024-05-17T04:07:39.829 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-volume-2:19.0.0-3794.g931809a9.el9.noarch 110/164 2024-05-17T04:07:39.829 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:39.829 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-17T04:07:39.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:07:39.830 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 139/164 2024-05-17T04:07:39.853 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 139/164 2024-05-17T04:07:39.853 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:39.853 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-17T04:07:39.853 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-17T04:07:39.853 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-17T04:07:39.853 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:07:40.163 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 140/164 2024-05-17T04:07:40.186 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 140/164 2024-05-17T04:07:40.187 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:40.187 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-17T04:07:40.187 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-17T04:07:40.187 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-17T04:07:40.187 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:07:41.396 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-osd-2:19.0.0-3794.g931809a9.el9.x86_64 111/164 2024-05-17T04:07:41.423 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-osd-2:19.0.0-3794.g931809a9.el9.x86_64 111/164 2024-05-17T04:07:41.423 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:41.423 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-17T04:07:41.423 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-17T04:07:41.423 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-17T04:07:41.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:07:41.655 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mds-2:19.0.0-3794.g931809a9.el9.x86_64 112/164 2024-05-17T04:07:41.679 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mds-2:19.0.0-3794.g931809a9.el9.x86_64 112/164 2024-05-17T04:07:41.679 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:41.679 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-17T04:07:41.679 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-17T04:07:41.679 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-17T04:07:41.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:07:42.139 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mon-2:19.0.0-3794.g931809a9.el9.x86_64 113/164 2024-05-17T04:07:42.162 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mon-2:19.0.0-3794.g931809a9.el9.x86_64 113/164 2024-05-17T04:07:42.163 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:42.163 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-17T04:07:42.163 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-17T04:07:42.163 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-17T04:07:42.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:07:42.269 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-17T04:07:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-17T04:07:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-17T04:07:42.556 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-17T04:07:42.606 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-17T04:07:42.714 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-17T04:07:42.805 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-17T04:07:42.942 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-17T04:07:42.982 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-17T04:07:43.013 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-17T04:07:43.042 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-17T04:07:43.489 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:19.0.0-3794.g931809a9.el9.noarch 125/164 2024-05-17T04:07:43.515 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephadm-2:19.0.0-3794.g931809a9.el9.noarch 125/164 2024-05-17T04:07:43.547 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3794.g931809a9.e 126/164 2024-05-17T04:07:43.609 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3794.g931809a9. 127/164 2024-05-17T04:07:43.637 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3794.g931809a9.el9.noa 128/164 2024-05-17T04:07:44.592 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-test-2:19.0.0-3794.g931809a9.el9.x86_64 141/164 2024-05-17T04:07:44.642 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-fuse-2:19.0.0-3794.g931809a9.el9.x86_64 142/164 2024-05-17T04:07:44.683 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-nbd-2:19.0.0-3794.g931809a9.el9.x86_64 143/164 2024-05-17T04:07:44.691 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3794.g931809a9.el9.noa 128/164 2024-05-17T04:07:44.715 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-17T04:07:44.730 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3794.g931809a9.el9.n 129/164 2024-05-17T04:07:44.742 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-17T04:07:44.941 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-shell-2:19.0.0-3794.g931809a9.el9.x86_64 146/164 2024-05-17T04:07:44.999 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-17T04:07:45.029 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs-devel-2:19.0.0-3794.g931809a9.el9.x86_ 148/164 2024-05-17T04:07:45.059 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-17T04:07:45.122 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-17T04:07:45.699 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-17T04:07:45.702 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3794.g931809a9.el9.n 129/164 2024-05-17T04:07:45.731 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3794.g931 130/164 2024-05-17T04:07:45.736 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-17T04:07:45.757 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-17T04:07:45.842 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3794.g931 130/164 2024-05-17T04:07:46.007 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3794.g931809a9.el 131/164 2024-05-17T04:07:46.033 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-2:19.0.0-3794.g931809a9.el9.x86_64 132/164 2024-05-17T04:07:46.057 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3794.g931809a9.el9.x86_64 132/164 2024-05-17T04:07:46.058 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:46.058 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-17T04:07:46.058 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-17T04:07:46.058 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-17T04:07:46.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:07:46.109 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-rook-2:19.0.0-3794.g931809a9.el9.noarch 133/164 2024-05-17T04:07:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3794.g931809a9.el9.noarch 133/164 2024-05-17T04:07:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-2:19.0.0-3794.g931809a9.el9.x86_64 134/164 2024-05-17T04:07:46.270 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-fuse-2:19.0.0-3794.g931809a9.el9.x86_64 135/164 2024-05-17T04:07:46.613 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-top-2:19.0.0-3794.g931809a9.el9.noarch 152/164 2024-05-17T04:07:46.716 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-17T04:07:46.763 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-17T04:07:46.853 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-17T04:07:46.886 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-17T04:07:46.911 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-17T04:07:46.912 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-17T04:07:46.996 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-17T04:07:47.037 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-17T04:07:47.037 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-17T04:07:47.122 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-17T04:07:47.147 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-17T04:07:47.154 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-17T04:07:47.154 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-17T04:07:47.223 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-17T04:07:47.261 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-radosgw-2:19.0.0-3794.g931809a9.el9.x86_64 137/164 2024-05-17T04:07:47.285 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3794.g931809a9.el9.x86_64 137/164 2024-05-17T04:07:47.285 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:47.285 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-17T04:07:47.285 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-17T04:07:47.285 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-17T04:07:47.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:07:47.328 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3794.g93180 138/164 2024-05-17T04:07:47.332 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-17T04:07:47.333 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-17T04:07:47.351 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3794.g93180 138/164 2024-05-17T04:07:47.351 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:47.352 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-17T04:07:47.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:07:47.404 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 139/164 2024-05-17T04:07:47.409 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-17T04:07:47.427 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 139/164 2024-05-17T04:07:47.428 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:47.428 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-17T04:07:47.428 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-17T04:07:47.428 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-17T04:07:47.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:07:47.482 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-17T04:07:47.738 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 140/164 2024-05-17T04:07:47.762 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 140/164 2024-05-17T04:07:47.762 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-17T04:07:47.762 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-17T04:07:47.762 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-17T04:07:47.762 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-17T04:07:47.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:07:52.269 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-test-2:19.0.0-3794.g931809a9.el9.x86_64 141/164 2024-05-17T04:07:52.317 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-fuse-2:19.0.0-3794.g931809a9.el9.x86_64 142/164 2024-05-17T04:07:52.362 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-nbd-2:19.0.0-3794.g931809a9.el9.x86_64 143/164 2024-05-17T04:07:52.389 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-17T04:07:52.416 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-17T04:07:52.599 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-shell-2:19.0.0-3794.g931809a9.el9.x86_64 146/164 2024-05-17T04:07:52.646 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-17T04:07:52.676 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs-devel-2:19.0.0-3794.g931809a9.el9.x86_ 148/164 2024-05-17T04:07:52.706 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-17T04:07:52.759 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-17T04:07:53.247 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-17T04:07:53.247 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-2:19.0.0-3794.g931809a9.el9.x86_64 1/164 2024-05-17T04:07:53.247 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-base-2:19.0.0-3794.g931809a9.el9.x86_64 2/164 2024-05-17T04:07:53.247 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-common-2:19.0.0-3794.g931809a9.el9.x86_64 3/164 2024-05-17T04:07:53.247 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-fuse-2:19.0.0-3794.g931809a9.el9.x86_64 4/164 2024-05-17T04:07:53.247 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3794.g93180 5/164 2024-05-17T04:07:53.247 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mds-2:19.0.0-3794.g931809a9.el9.x86_64 6/164 2024-05-17T04:07:53.247 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-2:19.0.0-3794.g931809a9.el9.x86_64 7/164 2024-05-17T04:07:53.247 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mon-2:19.0.0-3794.g931809a9.el9.x86_64 8/164 2024-05-17T04:07:53.247 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-osd-2:19.0.0-3794.g931809a9.el9.x86_64 9/164 2024-05-17T04:07:53.248 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-radosgw-2:19.0.0-3794.g931809a9.el9.x86_64 10/164 2024-05-17T04:07:53.248 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-selinux-2:19.0.0-3794.g931809a9.el9.x86_64 11/164 2024-05-17T04:07:53.248 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-test-2:19.0.0-3794.g931809a9.el9.x86_64 12/164 2024-05-17T04:07:53.248 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 13/164 2024-05-17T04:07:53.248 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-shell-2:19.0.0-3794.g931809a9.el9.x86_64 14/164 2024-05-17T04:07:53.248 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs-devel-2:19.0.0-3794.g931809a9.el9.x86_ 15/164 2024-05-17T04:07:53.248 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs2-2:19.0.0-3794.g931809a9.el9.x86_64 16/164 2024-05-17T04:07:53.248 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephsqlite-2:19.0.0-3794.g931809a9.el9.x86_64 17/164 2024-05-17T04:07:53.248 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados-devel-2:19.0.0-3794.g931809a9.el9.x86_6 18/164 2024-05-17T04:07:53.248 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libradosstriper1-2:19.0.0-3794.g931809a9.el9.x86 19/164 2024-05-17T04:07:53.248 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librgw2-2:19.0.0-3794.g931809a9.el9.x86_64 20/164 2024-05-17T04:07:53.249 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3794.g931809a9.el 21/164 2024-05-17T04:07:53.249 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-common-2:19.0.0-3794.g931809a9.el9. 22/164 2024-05-17T04:07:53.249 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cephfs-2:19.0.0-3794.g931809a9.el9.x86_6 23/164 2024-05-17T04:07:53.249 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rados-2:19.0.0-3794.g931809a9.el9.x86_64 24/164 2024-05-17T04:07:53.249 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rbd-2:19.0.0-3794.g931809a9.el9.x86_64 25/164 2024-05-17T04:07:53.249 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rgw-2:19.0.0-3794.g931809a9.el9.x86_64 26/164 2024-05-17T04:07:53.249 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-fuse-2:19.0.0-3794.g931809a9.el9.x86_64 27/164 2024-05-17T04:07:53.264 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 28/164 2024-05-17T04:07:53.264 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-nbd-2:19.0.0-3794.g931809a9.el9.x86_64 29/164 2024-05-17T04:07:53.264 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3794.g931809a9. 30/164 2024-05-17T04:07:53.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3794.g931809a9.el9.noa 31/164 2024-05-17T04:07:53.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3794.g931809a9.el9.n 32/164 2024-05-17T04:07:53.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3794.g931 33/164 2024-05-17T04:07:53.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3794.g931809a9.el 34/164 2024-05-17T04:07:53.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3794.g931809a9.el9.noarch 35/164 2024-05-17T04:07:53.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3794.g931809a9.e 36/164 2024-05-17T04:07:53.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-volume-2:19.0.0-3794.g931809a9.el9.noarch 37/164 2024-05-17T04:07:53.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephadm-2:19.0.0-3794.g931809a9.el9.noarch 38/164 2024-05-17T04:07:53.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-top-2:19.0.0-3794.g931809a9.el9.noarch 39/164 2024-05-17T04:07:53.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-17T04:07:53.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-17T04:07:53.265 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-17T04:07:53.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-17T04:07:53.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-17T04:07:53.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-17T04:07:53.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-17T04:07:53.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-17T04:07:53.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-17T04:07:53.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-17T04:07:53.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-17T04:07:53.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-17T04:07:53.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-17T04:07:53.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-17T04:07:53.266 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-17T04:07:53.267 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-17T04:07:53.267 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-17T04:07:53.267 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-17T04:07:53.267 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-17T04:07:53.267 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-17T04:07:53.267 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-17T04:07:53.267 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-17T04:07:53.267 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-17T04:07:53.267 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-17T04:07:53.267 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-17T04:07:53.267 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-17T04:07:53.267 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-17T04:07:53.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-17T04:07:53.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-17T04:07:53.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-17T04:07:53.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-17T04:07:53.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-17T04:07:53.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-17T04:07:53.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-17T04:07:53.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-17T04:07:53.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-17T04:07:53.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-17T04:07:53.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-17T04:07:53.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-17T04:07:53.268 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-17T04:07:53.269 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-17T04:07:53.269 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-17T04:07:53.269 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-17T04:07:53.269 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-17T04:07:53.269 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-17T04:07:53.269 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-17T04:07:53.269 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-17T04:07:53.269 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-17T04:07:53.269 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-17T04:07:53.269 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-17T04:07:53.269 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-17T04:07:53.269 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-17T04:07:53.269 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-17T04:07:53.270 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-17T04:07:53.270 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-17T04:07:53.270 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-17T04:07:53.270 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-17T04:07:53.270 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-17T04:07:53.270 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-17T04:07:53.270 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-17T04:07:53.270 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-17T04:07:53.270 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-17T04:07:53.270 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-17T04:07:53.270 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-17T04:07:53.270 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-17T04:07:53.271 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-17T04:07:53.271 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-17T04:07:53.271 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-17T04:07:53.271 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-17T04:07:53.271 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-17T04:07:53.271 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-17T04:07:53.271 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-17T04:07:53.271 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 112/164 2024-05-17T04:07:53.271 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-17T04:07:53.271 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-17T04:07:53.271 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-17T04:07:53.271 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-17T04:07:53.271 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-17T04:07:53.271 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-17T04:07:53.272 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-17T04:07:53.272 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-17T04:07:53.272 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-17T04:07:53.272 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-17T04:07:53.272 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-17T04:07:53.272 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-17T04:07:53.272 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-17T04:07:53.272 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-17T04:07:53.272 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-17T04:07:53.272 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-17T04:07:53.272 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-17T04:07:53.273 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-17T04:07:53.273 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-17T04:07:53.273 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-17T04:07:53.273 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-17T04:07:53.273 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-17T04:07:53.273 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-17T04:07:53.273 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-17T04:07:53.273 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-17T04:07:53.273 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-17T04:07:53.273 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-17T04:07:53.273 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-17T04:07:53.273 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-17T04:07:53.273 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-17T04:07:53.274 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-17T04:07:53.274 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-17T04:07:53.274 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-17T04:07:53.274 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-17T04:07:53.274 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-17T04:07:53.274 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-17T04:07:53.274 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:19.0.0-3794.g931809a9.el9.x86_64 149/164 2024-05-17T04:07:53.274 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-17T04:07:53.274 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:19.0.0-3794.g931809a9.el9.x86_64 151/164 2024-05-17T04:07:53.274 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-17T04:07:53.274 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-17T04:07:53.274 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-17T04:07:53.275 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-17T04:07:53.275 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-17T04:07:53.275 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-17T04:07:53.275 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-17T04:07:53.275 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-17T04:07:53.275 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-17T04:07:53.275 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-17T04:07:53.275 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-17T04:07:53.275 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-17T04:07:53.365 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-17T04:07:53.412 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-17T04:07:53.433 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-17T04:07:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-top-2:19.0.0-3794.g931809a9.el9.noarch 152/164 2024-05-17T04:07:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-17T04:07:54.396 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-17T04:07:54.483 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-17T04:07:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-17T04:07:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-17T04:07:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-17T04:07:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-17T04:07:54.647 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-17T04:07:54.647 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-17T04:07:54.740 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-17T04:07:54.765 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-17T04:07:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-17T04:07:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-17T04:07:54.951 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-17T04:07:54.951 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-17T04:07:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-17T04:07:55.100 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-17T04:07:55.852 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-17T04:07:55.852 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:07:55.852 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2024-05-17T04:07:55.852 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-17T04:07:55.852 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-17T04:07:55.852 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-17T04:07:55.852 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-17T04:07:55.852 INFO:teuthology.orchestra.run.smithi150.stdout: librados2-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.852 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.852 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-17T04:07:55.852 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-17T04:07:55.852 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-05-17T04:07:55.853 INFO:teuthology.orchestra.run.smithi150.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-17T04:07:55.853 INFO:teuthology.orchestra.run.smithi150.stdout: automake-1.16.2-8.el9.noarch 2024-05-17T04:07:55.853 INFO:teuthology.orchestra.run.smithi150.stdout: bison-3.7.4-5.el9.x86_64 2024-05-17T04:07:55.853 INFO:teuthology.orchestra.run.smithi150.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-17T04:07:55.853 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.853 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.853 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.853 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.853 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:07:55.853 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.853 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.853 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.853 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:07:55.854 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:07:55.854 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:07:55.854 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:07:55.854 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:07:55.854 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.854 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.854 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:07:55.854 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.854 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.854 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.854 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:07:55.854 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:07:55.855 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.855 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-shell-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.855 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:07:55.855 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-17T04:07:55.855 INFO:teuthology.orchestra.run.smithi150.stdout: flex-2.6.4-9.el9.x86_64 2024-05-17T04:07:55.855 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-17T04:07:55.855 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-17T04:07:55.855 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-17T04:07:55.855 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-17T04:07:55.855 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-17T04:07:55.855 INFO:teuthology.orchestra.run.smithi150.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-17T04:07:55.855 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-17T04:07:55.855 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-17T04:07:55.856 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-17T04:07:55.856 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.856 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.856 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.856 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-17T04:07:55.856 INFO:teuthology.orchestra.run.smithi150.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-17T04:07:55.856 INFO:teuthology.orchestra.run.smithi150.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-17T04:07:55.856 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-17T04:07:55.856 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-17T04:07:55.856 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.856 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.856 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-17T04:07:55.856 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.857 INFO:teuthology.orchestra.run.smithi150.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-17T04:07:55.857 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-17T04:07:55.857 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-17T04:07:55.857 INFO:teuthology.orchestra.run.smithi150.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-17T04:07:55.857 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-17T04:07:55.857 INFO:teuthology.orchestra.run.smithi150.stdout: lua-5.4.4-4.el9.x86_64 2024-05-17T04:07:55.857 INFO:teuthology.orchestra.run.smithi150.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-17T04:07:55.857 INFO:teuthology.orchestra.run.smithi150.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-17T04:07:55.857 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-17T04:07:55.857 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-17T04:07:55.857 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-17T04:07:55.857 INFO:teuthology.orchestra.run.smithi150.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-17T04:07:55.857 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-13.14-1.el9.x86_64 2024-05-17T04:07:55.858 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-17T04:07:55.858 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-17T04:07:55.858 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-17T04:07:55.858 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-17T04:07:55.858 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-17T04:07:55.858 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-17T04:07:55.858 INFO:teuthology.orchestra.run.smithi150.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-17T04:07:55.858 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-17T04:07:55.858 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-17T04:07:55.858 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-17T04:07:55.858 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.858 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.858 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.859 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-17T04:07:55.859 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-17T04:07:55.859 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-17T04:07:55.859 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-17T04:07:55.859 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-17T04:07:55.859 INFO:teuthology.orchestra.run.smithi150.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-17T04:07:55.859 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-17T04:07:55.859 INFO:teuthology.orchestra.run.smithi150.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-17T04:07:55.859 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-17T04:07:55.859 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-17T04:07:55.859 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-17T04:07:55.859 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-17T04:07:55.859 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-17T04:07:55.860 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-17T04:07:55.860 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-17T04:07:55.860 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-17T04:07:55.860 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-17T04:07:55.860 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-17T04:07:55.860 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-17T04:07:55.860 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-17T04:07:55.860 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-17T04:07:55.860 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-17T04:07:55.860 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-17T04:07:55.860 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-17T04:07:55.860 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-17T04:07:55.860 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-17T04:07:55.861 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-17T04:07:55.861 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-17T04:07:55.861 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-17T04:07:55.861 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-17T04:07:55.861 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ply-3.11-14.el9.noarch 2024-05-17T04:07:55.861 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-17T04:07:55.861 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-17T04:07:55.861 INFO:teuthology.orchestra.run.smithi150.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-17T04:07:55.861 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-17T04:07:55.861 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-17T04:07:55.861 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-17T04:07:55.861 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-17T04:07:55.861 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-17T04:07:55.862 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-17T04:07:55.862 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.862 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.862 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-17T04:07:55.862 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-17T04:07:55.862 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-17T04:07:55.862 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.862 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-17T04:07:55.862 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-17T04:07:55.862 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-17T04:07:55.862 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-17T04:07:55.862 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-17T04:07:55.862 INFO:teuthology.orchestra.run.smithi150.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-17T04:07:55.862 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-17T04:07:55.863 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-17T04:07:55.863 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-17T04:07:55.863 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-17T04:07:55.863 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-17T04:07:55.863 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-17T04:07:55.863 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-17T04:07:55.863 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-17T04:07:55.863 INFO:teuthology.orchestra.run.smithi150.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-17T04:07:55.863 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.863 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.863 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:07:55.863 INFO:teuthology.orchestra.run.smithi150.stdout: re2-1:20211101-3.el9.x86_64 2024-05-17T04:07:55.863 INFO:teuthology.orchestra.run.smithi150.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-17T04:07:55.863 INFO:teuthology.orchestra.run.smithi150.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-17T04:07:55.864 INFO:teuthology.orchestra.run.smithi150.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-17T04:07:55.864 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-17T04:07:55.864 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-17T04:07:55.864 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-17T04:07:55.864 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:07:55.864 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-05-17T04:07:56.290 DEBUG:teuthology.parallel:result is None 2024-05-17T04:08:00.914 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-17T04:08:00.914 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-2:19.0.0-3794.g931809a9.el9.x86_64 1/164 2024-05-17T04:08:00.914 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-base-2:19.0.0-3794.g931809a9.el9.x86_64 2/164 2024-05-17T04:08:00.914 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-common-2:19.0.0-3794.g931809a9.el9.x86_64 3/164 2024-05-17T04:08:00.914 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-fuse-2:19.0.0-3794.g931809a9.el9.x86_64 4/164 2024-05-17T04:08:00.914 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3794.g93180 5/164 2024-05-17T04:08:00.914 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mds-2:19.0.0-3794.g931809a9.el9.x86_64 6/164 2024-05-17T04:08:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-2:19.0.0-3794.g931809a9.el9.x86_64 7/164 2024-05-17T04:08:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mon-2:19.0.0-3794.g931809a9.el9.x86_64 8/164 2024-05-17T04:08:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-osd-2:19.0.0-3794.g931809a9.el9.x86_64 9/164 2024-05-17T04:08:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-radosgw-2:19.0.0-3794.g931809a9.el9.x86_64 10/164 2024-05-17T04:08:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-selinux-2:19.0.0-3794.g931809a9.el9.x86_64 11/164 2024-05-17T04:08:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-test-2:19.0.0-3794.g931809a9.el9.x86_64 12/164 2024-05-17T04:08:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 13/164 2024-05-17T04:08:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-shell-2:19.0.0-3794.g931809a9.el9.x86_64 14/164 2024-05-17T04:08:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs-devel-2:19.0.0-3794.g931809a9.el9.x86_ 15/164 2024-05-17T04:08:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs2-2:19.0.0-3794.g931809a9.el9.x86_64 16/164 2024-05-17T04:08:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephsqlite-2:19.0.0-3794.g931809a9.el9.x86_64 17/164 2024-05-17T04:08:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados-devel-2:19.0.0-3794.g931809a9.el9.x86_6 18/164 2024-05-17T04:08:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libradosstriper1-2:19.0.0-3794.g931809a9.el9.x86 19/164 2024-05-17T04:08:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librgw2-2:19.0.0-3794.g931809a9.el9.x86_64 20/164 2024-05-17T04:08:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3794.g931809a9.el 21/164 2024-05-17T04:08:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-common-2:19.0.0-3794.g931809a9.el9. 22/164 2024-05-17T04:08:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cephfs-2:19.0.0-3794.g931809a9.el9.x86_6 23/164 2024-05-17T04:08:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rados-2:19.0.0-3794.g931809a9.el9.x86_64 24/164 2024-05-17T04:08:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rbd-2:19.0.0-3794.g931809a9.el9.x86_64 25/164 2024-05-17T04:08:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rgw-2:19.0.0-3794.g931809a9.el9.x86_64 26/164 2024-05-17T04:08:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-fuse-2:19.0.0-3794.g931809a9.el9.x86_64 27/164 2024-05-17T04:08:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 28/164 2024-05-17T04:08:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-nbd-2:19.0.0-3794.g931809a9.el9.x86_64 29/164 2024-05-17T04:08:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3794.g931809a9. 30/164 2024-05-17T04:08:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3794.g931809a9.el9.noa 31/164 2024-05-17T04:08:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3794.g931809a9.el9.n 32/164 2024-05-17T04:08:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3794.g931 33/164 2024-05-17T04:08:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3794.g931809a9.el 34/164 2024-05-17T04:08:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3794.g931809a9.el9.noarch 35/164 2024-05-17T04:08:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3794.g931809a9.e 36/164 2024-05-17T04:08:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-volume-2:19.0.0-3794.g931809a9.el9.noarch 37/164 2024-05-17T04:08:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephadm-2:19.0.0-3794.g931809a9.el9.noarch 38/164 2024-05-17T04:08:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-top-2:19.0.0-3794.g931809a9.el9.noarch 39/164 2024-05-17T04:08:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-17T04:08:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-17T04:08:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-17T04:08:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-17T04:08:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-17T04:08:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-17T04:08:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-17T04:08:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-17T04:08:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-17T04:08:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-17T04:08:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-17T04:08:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-17T04:08:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-17T04:08:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-17T04:08:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-17T04:08:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-17T04:08:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-17T04:08:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-17T04:08:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-17T04:08:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-17T04:08:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-17T04:08:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-17T04:08:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-17T04:08:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-17T04:08:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-17T04:08:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-17T04:08:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-17T04:08:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-17T04:08:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-17T04:08:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-17T04:08:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-17T04:08:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-17T04:08:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-17T04:08:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-17T04:08:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-17T04:08:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-17T04:08:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-17T04:08:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-17T04:08:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-17T04:08:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-17T04:08:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-17T04:08:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-17T04:08:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-17T04:08:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-17T04:08:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-17T04:08:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-17T04:08:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-17T04:08:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-17T04:08:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-17T04:08:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-17T04:08:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-17T04:08:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-17T04:08:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-17T04:08:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-17T04:08:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-17T04:08:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-17T04:08:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-17T04:08:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-17T04:08:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-17T04:08:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-17T04:08:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-17T04:08:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-17T04:08:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-17T04:08:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-17T04:08:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-17T04:08:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-17T04:08:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-17T04:08:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-17T04:08:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-17T04:08:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-17T04:08:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-17T04:08:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-17T04:08:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 112/164 2024-05-17T04:08:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-17T04:08:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-17T04:08:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-17T04:08:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-17T04:08:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-17T04:08:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-17T04:08:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-17T04:08:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-17T04:08:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-17T04:08:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-17T04:08:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-17T04:08:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-17T04:08:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-17T04:08:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-17T04:08:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-17T04:08:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-17T04:08:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-17T04:08:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-17T04:08:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-17T04:08:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-17T04:08:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-17T04:08:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-17T04:08:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-17T04:08:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-17T04:08:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-17T04:08:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-17T04:08:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-17T04:08:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-17T04:08:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-17T04:08:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-17T04:08:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-17T04:08:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-17T04:08:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-17T04:08:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-17T04:08:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-17T04:08:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-17T04:08:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:19.0.0-3794.g931809a9.el9.x86_64 149/164 2024-05-17T04:08:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-17T04:08:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:19.0.0-3794.g931809a9.el9.x86_64 151/164 2024-05-17T04:08:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-17T04:08:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-17T04:08:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-17T04:08:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-17T04:08:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-17T04:08:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-17T04:08:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-17T04:08:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-17T04:08:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-17T04:08:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-17T04:08:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-17T04:08:00.941 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-17T04:08:03.599 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-17T04:08:03.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:03.599 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2024-05-17T04:08:03.599 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-17T04:08:03.599 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-17T04:08:03.599 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-17T04:08:03.600 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-17T04:08:03.600 INFO:teuthology.orchestra.run.smithi131.stdout: librados2-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.600 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.600 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-17T04:08:03.600 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-17T04:08:03.600 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-05-17T04:08:03.600 INFO:teuthology.orchestra.run.smithi131.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-17T04:08:03.600 INFO:teuthology.orchestra.run.smithi131.stdout: automake-1.16.2-8.el9.noarch 2024-05-17T04:08:03.600 INFO:teuthology.orchestra.run.smithi131.stdout: bison-3.7.4-5.el9.x86_64 2024-05-17T04:08:03.600 INFO:teuthology.orchestra.run.smithi131.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-17T04:08:03.600 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.600 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.600 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.601 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.601 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:08:03.601 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.601 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.601 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.601 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:08:03.601 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:08:03.601 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:08:03.601 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:08:03.601 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:08:03.601 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.601 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.601 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:08:03.602 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.602 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.602 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.602 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:08:03.602 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:08:03.602 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.602 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-shell-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.602 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top-2:19.0.0-3794.g931809a9.el9.noarch 2024-05-17T04:08:03.602 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-17T04:08:03.602 INFO:teuthology.orchestra.run.smithi131.stdout: flex-2.6.4-9.el9.x86_64 2024-05-17T04:08:03.602 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-17T04:08:03.602 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-17T04:08:03.602 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-17T04:08:03.603 INFO:teuthology.orchestra.run.smithi131.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-17T04:08:03.603 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-17T04:08:03.603 INFO:teuthology.orchestra.run.smithi131.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-17T04:08:03.603 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-17T04:08:03.603 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-17T04:08:03.603 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-17T04:08:03.603 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.603 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.603 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.603 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-17T04:08:03.603 INFO:teuthology.orchestra.run.smithi131.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-17T04:08:03.603 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-17T04:08:03.603 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-17T04:08:03.604 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-17T04:08:03.604 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.604 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.604 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-17T04:08:03.604 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.604 INFO:teuthology.orchestra.run.smithi131.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-17T04:08:03.604 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-17T04:08:03.604 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-17T04:08:03.604 INFO:teuthology.orchestra.run.smithi131.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-17T04:08:03.604 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-17T04:08:03.604 INFO:teuthology.orchestra.run.smithi131.stdout: lua-5.4.4-4.el9.x86_64 2024-05-17T04:08:03.604 INFO:teuthology.orchestra.run.smithi131.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-17T04:08:03.604 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-17T04:08:03.605 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-17T04:08:03.605 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-17T04:08:03.605 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-17T04:08:03.605 INFO:teuthology.orchestra.run.smithi131.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-17T04:08:03.605 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-13.14-1.el9.x86_64 2024-05-17T04:08:03.605 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-17T04:08:03.605 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-17T04:08:03.605 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-17T04:08:03.605 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-17T04:08:03.605 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-17T04:08:03.605 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-17T04:08:03.605 INFO:teuthology.orchestra.run.smithi131.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-17T04:08:03.605 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-17T04:08:03.605 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-17T04:08:03.606 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-17T04:08:03.606 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.606 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.606 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.606 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-17T04:08:03.606 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-17T04:08:03.606 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-17T04:08:03.606 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-17T04:08:03.606 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-17T04:08:03.606 INFO:teuthology.orchestra.run.smithi131.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-17T04:08:03.606 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-17T04:08:03.606 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-17T04:08:03.606 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-17T04:08:03.607 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-17T04:08:03.607 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-17T04:08:03.607 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-17T04:08:03.607 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-17T04:08:03.607 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-17T04:08:03.607 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-17T04:08:03.607 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-17T04:08:03.607 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-17T04:08:03.607 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-17T04:08:03.607 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-17T04:08:03.607 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-17T04:08:03.607 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-17T04:08:03.607 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-17T04:08:03.608 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-17T04:08:03.608 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-17T04:08:03.608 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-17T04:08:03.608 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-17T04:08:03.608 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-17T04:08:03.608 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-17T04:08:03.608 INFO:teuthology.orchestra.run.smithi131.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-17T04:08:03.608 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-17T04:08:03.608 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply-3.11-14.el9.noarch 2024-05-17T04:08:03.608 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-17T04:08:03.608 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-17T04:08:03.608 INFO:teuthology.orchestra.run.smithi131.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-17T04:08:03.608 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-17T04:08:03.608 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-17T04:08:03.609 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-17T04:08:03.609 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-17T04:08:03.609 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-17T04:08:03.609 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-17T04:08:03.609 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.609 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.609 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-17T04:08:03.609 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-17T04:08:03.609 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-17T04:08:03.609 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.609 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-17T04:08:03.609 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-17T04:08:03.609 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-17T04:08:03.610 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-17T04:08:03.610 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-17T04:08:03.610 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-17T04:08:03.610 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-17T04:08:03.610 INFO:teuthology.orchestra.run.smithi131.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-17T04:08:03.610 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-17T04:08:03.610 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-17T04:08:03.610 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-17T04:08:03.610 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-17T04:08:03.610 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-17T04:08:03.610 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-17T04:08:03.610 INFO:teuthology.orchestra.run.smithi131.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-17T04:08:03.610 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.611 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.611 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd-2:19.0.0-3794.g931809a9.el9.x86_64 2024-05-17T04:08:03.611 INFO:teuthology.orchestra.run.smithi131.stdout: re2-1:20211101-3.el9.x86_64 2024-05-17T04:08:03.611 INFO:teuthology.orchestra.run.smithi131.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-17T04:08:03.611 INFO:teuthology.orchestra.run.smithi131.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-17T04:08:03.611 INFO:teuthology.orchestra.run.smithi131.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-17T04:08:03.611 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-17T04:08:03.611 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-17T04:08:03.612 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-17T04:08:03.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:03.612 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-05-17T04:08:04.052 DEBUG:teuthology.parallel:result is None 2024-05-17T04:08:04.053 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=931809a9e5d295bd61984693cac44fe131ded4bc 2024-05-17T04:08:04.283 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-17T04:08:04.306 INFO:teuthology.orchestra.run.smithi131.stdout:19.0.0-3794.g931809a9.el9 2024-05-17T04:08:04.307 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3794.g931809a9.el9 2024-05-17T04:08:04.307 INFO:teuthology.task.install:The correct ceph version 19.0.0-3794.g931809a9 is installed. 2024-05-17T04:08:04.310 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=931809a9e5d295bd61984693cac44fe131ded4bc 2024-05-17T04:08:04.549 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-17T04:08:04.576 INFO:teuthology.orchestra.run.smithi150.stdout:19.0.0-3794.g931809a9.el9 2024-05-17T04:08:04.576 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3794.g931809a9.el9 2024-05-17T04:08:04.577 INFO:teuthology.task.install:The correct ceph version 19.0.0-3794.g931809a9 is installed. 2024-05-17T04:08:04.578 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-17T04:08:04.578 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:04.579 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-17T04:08:04.608 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:04.609 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-17T04:08:04.648 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-17T04:08:04.649 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:04.649 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2024-05-17T04:08:04.675 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-17T04:08:04.741 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:04.741 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2024-05-17T04:08:04.769 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-17T04:08:04.837 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-17T04:08:04.837 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:04.837 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-17T04:08:04.864 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-17T04:08:04.929 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:04.929 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-17T04:08:04.956 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-17T04:08:05.023 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-17T04:08:05.023 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:05.023 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2024-05-17T04:08:05.048 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-17T04:08:05.114 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:05.114 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2024-05-17T04:08:05.140 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-17T04:08:05.207 INFO:teuthology.run_tasks:Running task ceph... 2024-05-17T04:08:05.285 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-17T04:08:05.285 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /var/log/ceph 2024-05-17T04:08:05.288 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2024-05-17T04:08:05.313 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-17T04:08:05.313 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-17T04:08:05.352 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-17T04:08:05.377 INFO:tasks.ceph:Creating extra log directories... 2024-05-17T04:08:05.378 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-17T04:08:05.416 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-17T04:08:05.448 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-17T04:08:05.448 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-17T04:08:05.448 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-17T04:08:05.448 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:05.449 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-17T04:08:05.494 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-17T04:08:05.605 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-17T04:08:05.629 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:05.629 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-17T04:08:05.645 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-17T04:08:05.755 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-17T04:08:05.785 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-17T04:08:05.785 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-17T04:08:05.785 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314', 'branch': 'wip-pdonnell-testing-20240517.012458-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7710314', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240517.012458-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '931809a9e5d295bd61984693cac44fe131ded4bc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '931809a9e5d295bd61984693cac44fe131ded4bc'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240517.012458-debug', 'sha1': '931809a9e5d295bd61984693cac44fe131ded4bc'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 85, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1967, 'sha1': '931809a9e5d295bd61984693cac44fe131ded4bc', 'sleep_before_teardown': 0, 'subset': '59/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240517.012458-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_931809a9e5d295bd61984693cac44fe131ded4bc/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '931809a9e5d295bd61984693cac44fe131ded4bc', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi131.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAkIeqZ1Lq+daB3VrsbZWGFG0yv1p3lA/7jEN4fpSRsQ2tORlS7kVKCTHJS8TKhXfEIHIcG4tAJtoVCa5QZEhXg=', 'smithi150.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM6yn5RL+r1O16cW28dKB5TWHXawrJIKtOenu0T7S4UXj6VUgotAElcjDcyz1EwxKBm1bmglO2DaBRTw6HsXMO0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '931809a9e5d295bd61984693cac44fe131ded4bc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '931809a9e5d295bd61984693cac44fe131ded4bc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'a4b16c58a5d7aa60dee491f6f096b7509e2f1269', 'timestamp': '2024-05-17_03:38:57', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-17T04:08:05.786 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-17T04:08:05.788 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-17T04:08:05.835 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/run/ceph 2024-05-17T04:08:05.844 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2024-05-17T04:08:05.900 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:05.901 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2024-05-17T04:08:05.922 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-17T04:08:05.923 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2024-05-17T04:08:05.979 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-17T04:08:05.980 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-17T04:08:05.980 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-17T04:08:05.980 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-17T04:08:05.980 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-05-17T04:08:05.980 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-05-17 04:07:55.461379877 +0000 2024-05-17T04:08:05.980 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-05-17 04:05:08.454866910 +0000 2024-05-17T04:08:05.980 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-05-17 04:05:08.454866910 +0000 2024-05-17T04:08:05.980 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-05-17 04:05:08.454866910 +0000 2024-05-17T04:08:05.980 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-17T04:08:06.043 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-05-17T04:08:06.043 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-05-17T04:08:06.043 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000208214 s, 2.5 MB/s 2024-05-17T04:08:06.044 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-17T04:08:06.101 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2024-05-17T04:08:06.156 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-17T04:08:06.156 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-17T04:08:06.156 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-17T04:08:06.156 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-17T04:08:06.156 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-05-17T04:08:06.156 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-05-17 04:07:55.462379856 +0000 2024-05-17T04:08:06.156 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-05-17 04:05:08.782859933 +0000 2024-05-17T04:08:06.156 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-05-17 04:05:08.782859933 +0000 2024-05-17T04:08:06.156 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-05-17 04:05:08.782859933 +0000 2024-05-17T04:08:06.157 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-17T04:08:06.219 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-05-17T04:08:06.219 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-05-17T04:08:06.219 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000221445 s, 2.3 MB/s 2024-05-17T04:08:06.220 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-17T04:08:06.277 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2024-05-17T04:08:06.332 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-17T04:08:06.332 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-17T04:08:06.332 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-17T04:08:06.332 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-17T04:08:06.332 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-05-17T04:08:06.332 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-05-17 04:07:55.462379856 +0000 2024-05-17T04:08:06.332 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-05-17 04:05:09.113852893 +0000 2024-05-17T04:08:06.332 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-05-17 04:05:09.113852893 +0000 2024-05-17T04:08:06.332 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-05-17 04:05:09.113852893 +0000 2024-05-17T04:08:06.333 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-17T04:08:06.395 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-05-17T04:08:06.395 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-05-17T04:08:06.396 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000216896 s, 2.4 MB/s 2024-05-17T04:08:06.397 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-17T04:08:06.453 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2024-05-17T04:08:06.508 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-17T04:08:06.508 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-17T04:08:06.508 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-17T04:08:06.508 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-17T04:08:06.508 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-05-17T04:08:06.509 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-05-17 04:07:55.463379836 +0000 2024-05-17T04:08:06.509 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-05-17 04:05:09.466845385 +0000 2024-05-17T04:08:06.509 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-05-17 04:05:09.466845385 +0000 2024-05-17T04:08:06.509 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-05-17 04:05:09.466845385 +0000 2024-05-17T04:08:06.509 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-17T04:08:06.572 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-05-17T04:08:06.572 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-05-17T04:08:06.572 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000198749 s, 2.6 MB/s 2024-05-17T04:08:06.573 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-17T04:08:06.629 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-17T04:08:06.629 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:06.629 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2024-05-17T04:08:06.647 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-17T04:08:06.648 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2024-05-17T04:08:06.705 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-17T04:08:06.705 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-17T04:08:06.705 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-17T04:08:06.705 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-17T04:08:06.705 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-05-17T04:08:06.706 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-05-17 04:07:47.833246475 +0000 2024-05-17T04:08:06.706 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-05-17 04:05:08.473985126 +0000 2024-05-17T04:08:06.706 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-05-17 04:05:08.473985126 +0000 2024-05-17T04:08:06.706 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-05-17 04:05:08.473985126 +0000 2024-05-17T04:08:06.706 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-17T04:08:06.770 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-05-17T04:08:06.770 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-05-17T04:08:06.771 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000213643 s, 2.4 MB/s 2024-05-17T04:08:06.772 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-17T04:08:06.830 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2024-05-17T04:08:06.886 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-17T04:08:06.886 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-17T04:08:06.886 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-17T04:08:06.886 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-17T04:08:06.887 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-05-17T04:08:06.887 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-05-17 04:07:47.833246475 +0000 2024-05-17T04:08:06.887 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-05-17 04:05:08.796978847 +0000 2024-05-17T04:08:06.887 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-05-17 04:05:08.796978847 +0000 2024-05-17T04:08:06.887 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-05-17 04:05:08.796978847 +0000 2024-05-17T04:08:06.887 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-17T04:08:06.951 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-05-17T04:08:06.951 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-05-17T04:08:06.951 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000229664 s, 2.2 MB/s 2024-05-17T04:08:06.952 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-17T04:08:07.010 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2024-05-17T04:08:07.067 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-17T04:08:07.067 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-17T04:08:07.067 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-17T04:08:07.067 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-17T04:08:07.067 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-05-17T04:08:07.067 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-05-17 04:07:47.834246456 +0000 2024-05-17T04:08:07.067 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-05-17 04:05:09.116972626 +0000 2024-05-17T04:08:07.067 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-05-17 04:05:09.116972626 +0000 2024-05-17T04:08:07.067 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-05-17 04:05:09.116972626 +0000 2024-05-17T04:08:07.068 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-17T04:08:07.131 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-05-17T04:08:07.132 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-05-17T04:08:07.132 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000212706 s, 2.4 MB/s 2024-05-17T04:08:07.133 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-17T04:08:07.190 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2024-05-17T04:08:07.246 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-17T04:08:07.246 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-17T04:08:07.246 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-17T04:08:07.246 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-17T04:08:07.246 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-05-17T04:08:07.246 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-05-17 04:07:47.834246456 +0000 2024-05-17T04:08:07.246 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-05-17 04:05:09.461965918 +0000 2024-05-17T04:08:07.246 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-05-17 04:05:09.461965918 +0000 2024-05-17T04:08:07.247 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-05-17 04:05:09.461965918 +0000 2024-05-17T04:08:07.247 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-17T04:08:07.310 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-05-17T04:08:07.311 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-05-17T04:08:07.311 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.0002075 s, 2.5 MB/s 2024-05-17T04:08:07.312 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-17T04:08:07.368 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-17T04:08:07.369 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-17T04:08:07.369 INFO:tasks.ceph:Generating config... 2024-05-17T04:08:07.370 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-17T04:08:07.370 INFO:tasks.ceph:[client] debug client = 20 2024-05-17T04:08:07.370 INFO:tasks.ceph:[client] debug ms = 1 2024-05-17T04:08:07.370 INFO:tasks.ceph:[client] pid file = 2024-05-17T04:08:07.370 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-17T04:08:07.370 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-17T04:08:07.370 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-17T04:08:07.370 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-17T04:08:07.371 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-17T04:08:07.371 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-17T04:08:07.371 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-17T04:08:07.371 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-17T04:08:07.371 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-17T04:08:07.371 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-17T04:08:07.371 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-17T04:08:07.371 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-17T04:08:07.371 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-17T04:08:07.371 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-17T04:08:07.371 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-17T04:08:07.371 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-17T04:08:07.371 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-17T04:08:07.371 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-17T04:08:07.371 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-17T04:08:07.372 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-17T04:08:07.372 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-17T04:08:07.372 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-17T04:08:07.372 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-17T04:08:07.372 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-17T04:08:07.372 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-17T04:08:07.372 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-17T04:08:07.372 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-17T04:08:07.372 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-17T04:08:07.372 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-17T04:08:07.372 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-17T04:08:07.372 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-17T04:08:07.372 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-17T04:08:07.372 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-17T04:08:07.373 INFO:tasks.ceph:Setting up mon.a... 2024-05-17T04:08:07.373 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-17T04:08:07.439 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.keyring 2024-05-17T04:08:07.442 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-17T04:08:07.496 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-17T04:08:07.521 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.131'), ('mon.b', '172.21.15.150'), ('mon.c', '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]')] 2024-05-17T04:08:07.522 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.131,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-17T04:08:07.522 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:07.523 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-17T04:08:07.576 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.131 --add b 172.21.15.150 --addv c '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-17T04:08:07.672 INFO:teuthology.orchestra.run.smithi131.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-17T04:08:07.672 INFO:teuthology.orchestra.run.smithi131.stdout:monmaptool: generated fsid c9e29f2b-51db-4d2a-bace-3a87edcda397 2024-05-17T04:08:07.672 INFO:teuthology.orchestra.run.smithi131.stdout:setting min_mon_release = quincy 2024-05-17T04:08:07.672 INFO:teuthology.orchestra.run.smithi131.stdout:epoch 0 2024-05-17T04:08:07.672 INFO:teuthology.orchestra.run.smithi131.stdout:fsid c9e29f2b-51db-4d2a-bace-3a87edcda397 2024-05-17T04:08:07.672 INFO:teuthology.orchestra.run.smithi131.stdout:last_changed 2024-05-17T04:08:07.672618+0000 2024-05-17T04:08:07.672 INFO:teuthology.orchestra.run.smithi131.stdout:created 2024-05-17T04:08:07.672618+0000 2024-05-17T04:08:07.673 INFO:teuthology.orchestra.run.smithi131.stdout:min_mon_release 17 (quincy) 2024-05-17T04:08:07.673 INFO:teuthology.orchestra.run.smithi131.stdout:election_strategy: 1 2024-05-17T04:08:07.673 INFO:teuthology.orchestra.run.smithi131.stdout:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2024-05-17T04:08:07.673 INFO:teuthology.orchestra.run.smithi131.stdout:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-05-17T04:08:07.673 INFO:teuthology.orchestra.run.smithi131.stdout:2: [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] mon.c 2024-05-17T04:08:07.673 INFO:teuthology.orchestra.run.smithi131.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-17T04:08:07.674 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-17T04:08:07.689 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c9e29f2b-51db-4d2a-bace-3a87edcda397... 2024-05-17T04:08:07.690 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-17T04:08:07.732 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-17T04:08:07.772 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2024-05-17T04:08:07.772 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2024-05-17T04:08:07.772 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-17T04:08:07.772 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2024-05-17T04:08:07.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.773 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2024-05-17T04:08:07.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.773 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2024-05-17T04:08:07.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.773 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2024-05-17T04:08:07.773 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2024-05-17T04:08:07.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.773 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2024-05-17T04:08:07.773 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2024-05-17T04:08:07.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.773 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-17T04:08:07.773 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2024-05-17T04:08:07.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.774 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2024-05-17T04:08:07.774 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-17T04:08:07.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.774 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2024-05-17T04:08:07.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.774 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2024-05-17T04:08:07.774 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2024-05-17T04:08:07.774 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2024-05-17T04:08:07.774 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2024-05-17T04:08:07.774 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2024-05-17T04:08:07.774 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2024-05-17T04:08:07.775 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2024-05-17T04:08:07.775 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-17T04:08:07.775 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-17T04:08:07.775 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2024-05-17T04:08:07.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.775 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-17T04:08:07.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.775 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2024-05-17T04:08:07.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.775 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2024-05-17T04:08:07.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.775 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2024-05-17T04:08:07.776 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2024-05-17T04:08:07.776 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2024-05-17T04:08:07.776 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = "172.21.15.131,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2024-05-17T04:08:07.776 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = c9e29f2b-51db-4d2a-bace-3a87edcda397 2024-05-17T04:08:07.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.776 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2024-05-17T04:08:07.776 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2024-05-17T04:08:07.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.776 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2024-05-17T04:08:07.776 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2024-05-17T04:08:07.776 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2024-05-17T04:08:07.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.776 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2024-05-17T04:08:07.776 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2024-05-17T04:08:07.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.777 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2024-05-17T04:08:07.777 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2024-05-17T04:08:07.777 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2024-05-17T04:08:07.777 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug trim objects = true 2024-05-17T04:08:07.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.777 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2024-05-17T04:08:07.777 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2024-05-17T04:08:07.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.777 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2024-05-17T04:08:07.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.777 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2024-05-17T04:08:07.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.777 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2024-05-17T04:08:07.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.778 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2024-05-17T04:08:07.778 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2024-05-17T04:08:07.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.778 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2024-05-17T04:08:07.778 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2024-05-17T04:08:07.778 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2024-05-17T04:08:07.778 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2024-05-17T04:08:07.778 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 20 2024-05-17T04:08:07.778 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 20 2024-05-17T04:08:07.778 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-05-17T04:08:07.778 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2024-05-17T04:08:07.778 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 10 2024-05-17T04:08:07.778 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2024-05-17T04:08:07.779 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2024-05-17T04:08:07.779 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2024-05-17T04:08:07.779 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2024-05-17T04:08:07.779 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2024-05-17T04:08:07.779 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2024-05-17T04:08:07.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.779 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2024-05-17T04:08:07.779 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-05-17T04:08:07.779 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2024-05-17T04:08:07.779 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-05-17T04:08:07.779 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-05-17T04:08:07.779 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-05-17T04:08:07.779 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-05-17T04:08:07.779 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2024-05-17T04:08:07.780 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2024-05-17T04:08:07.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.780 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2024-05-17T04:08:07.780 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-05-17T04:08:07.780 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-05-17T04:08:07.780 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2024-05-17T04:08:07.780 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-05-17T04:08:07.780 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2024-05-17T04:08:07.780 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2024-05-17T04:08:07.780 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-05-17T04:08:07.780 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2024-05-17T04:08:07.780 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2024-05-17T04:08:07.780 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-05-17T04:08:07.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.781 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-17T04:08:07.781 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2024-05-17T04:08:07.781 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2024-05-17T04:08:07.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.781 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2024-05-17T04:08:07.781 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-17T04:08:07.781 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-17T04:08:07.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.781 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2024-05-17T04:08:07.781 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2024-05-17T04:08:07.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.781 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2024-05-17T04:08:07.782 INFO:teuthology.orchestra.run.smithi131.stdout: mon down mkfs grace = 300 2024-05-17T04:08:07.782 INFO:teuthology.orchestra.run.smithi131.stdout: mon op complaint time = 120 2024-05-17T04:08:07.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:07.782 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2024-05-17T04:08:07.782 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2024-05-17T04:08:07.782 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2024-05-17T04:08:07.782 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2024-05-17T04:08:07.782 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-17T04:08:07.782 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-17T04:08:07.782 INFO:teuthology.orchestra.run.smithi131.stdout: client mount timeout = 600 2024-05-17T04:08:07.782 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2024-05-17T04:08:07.782 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-05-17T04:08:07.782 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = "" 2024-05-17T04:08:07.783 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2024-05-17T04:08:07.783 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2024-05-17T04:08:07.783 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2024-05-17T04:08:07.783 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.b] 2024-05-17T04:08:07.783 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.c] 2024-05-17T04:08:07.783 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2024-05-17T04:08:07.783 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2024-05-17T04:08:07.783 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2024-05-17T04:08:07.783 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2024-05-17T04:08:07.783 INFO:teuthology.orchestra.run.smithi131.stdout:[mds] 2024-05-17T04:08:07.783 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds = 20 2024-05-17T04:08:07.783 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds balancer = 20 2024-05-17T04:08:07.784 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-05-17T04:08:07.784 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug frag = True 2024-05-17T04:08:07.784 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug scatterstat = True 2024-05-17T04:08:07.784 INFO:teuthology.orchestra.run.smithi131.stdout: mds op complaint time = 180 2024-05-17T04:08:07.784 INFO:teuthology.orchestra.run.smithi131.stdout: mds verify scatter = True 2024-05-17T04:08:07.784 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2024-05-17T04:08:07.784 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2024-05-17T04:08:07.784 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2024-05-17T04:08:07.785 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2024-05-17T04:08:07.785 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2024-05-17T04:08:07.785 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-17T04:08:07.785 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2024-05-17T04:08:07.785 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.785 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2024-05-17T04:08:07.785 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.785 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2024-05-17T04:08:07.785 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.785 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2024-05-17T04:08:07.785 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2024-05-17T04:08:07.786 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.786 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2024-05-17T04:08:07.786 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2024-05-17T04:08:07.786 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.786 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-17T04:08:07.786 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2024-05-17T04:08:07.786 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.786 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2024-05-17T04:08:07.786 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-17T04:08:07.786 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.786 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2024-05-17T04:08:07.786 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.787 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2024-05-17T04:08:07.787 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2024-05-17T04:08:07.787 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2024-05-17T04:08:07.787 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2024-05-17T04:08:07.787 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2024-05-17T04:08:07.787 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2024-05-17T04:08:07.787 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2024-05-17T04:08:07.787 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-17T04:08:07.787 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-17T04:08:07.787 INFO:teuthology.orchestra.run.smithi150.stdout: mon_allow_pool_size_one = true 2024-05-17T04:08:07.788 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.788 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-17T04:08:07.788 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.788 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2024-05-17T04:08:07.788 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.788 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2024-05-17T04:08:07.788 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.788 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2024-05-17T04:08:07.788 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2024-05-17T04:08:07.788 INFO:teuthology.orchestra.run.smithi150.stdout: mon health detail to clog = false 2024-05-17T04:08:07.788 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = "172.21.15.131,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2024-05-17T04:08:07.788 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = c9e29f2b-51db-4d2a-bace-3a87edcda397 2024-05-17T04:08:07.788 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.789 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2024-05-17T04:08:07.789 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2024-05-17T04:08:07.789 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.789 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2024-05-17T04:08:07.789 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2024-05-17T04:08:07.789 INFO:teuthology.orchestra.run.smithi150.stdout: osd mclock profile = high_recovery_ops 2024-05-17T04:08:07.789 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.789 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2024-05-17T04:08:07.790 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2024-05-17T04:08:07.790 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.790 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2024-05-17T04:08:07.790 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2024-05-17T04:08:07.790 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2024-05-17T04:08:07.790 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug trim objects = true 2024-05-17T04:08:07.790 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.790 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2024-05-17T04:08:07.791 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2024-05-17T04:08:07.791 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.791 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2024-05-17T04:08:07.791 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.791 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2024-05-17T04:08:07.791 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.791 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2024-05-17T04:08:07.791 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.791 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2024-05-17T04:08:07.792 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2024-05-17T04:08:07.792 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.792 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2024-05-17T04:08:07.792 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2024-05-17T04:08:07.792 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore block size = 96636764160 2024-05-17T04:08:07.792 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore fsck on mount = True 2024-05-17T04:08:07.792 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluefs = 20 2024-05-17T04:08:07.792 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluestore = 20 2024-05-17T04:08:07.792 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-05-17T04:08:07.792 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 20 2024-05-17T04:08:07.792 INFO:teuthology.orchestra.run.smithi150.stdout: debug rocksdb = 10 2024-05-17T04:08:07.793 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd backfillfull_ratio = 0.85 2024-05-17T04:08:07.793 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd full ratio = 0.9 2024-05-17T04:08:07.793 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd nearfull ratio = 0.8 2024-05-17T04:08:07.793 INFO:teuthology.orchestra.run.smithi150.stdout: osd failsafe full ratio = 0.95 2024-05-17T04:08:07.793 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = bluestore 2024-05-17T04:08:07.793 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2024-05-17T04:08:07.793 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.793 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2024-05-17T04:08:07.793 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-05-17T04:08:07.793 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2024-05-17T04:08:07.793 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-05-17T04:08:07.793 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-05-17T04:08:07.793 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-05-17T04:08:07.794 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-05-17T04:08:07.794 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2024-05-17T04:08:07.794 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2024-05-17T04:08:07.794 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.794 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2024-05-17T04:08:07.794 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-05-17T04:08:07.794 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-05-17T04:08:07.794 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2024-05-17T04:08:07.795 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-05-17T04:08:07.795 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2024-05-17T04:08:07.795 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2024-05-17T04:08:07.795 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-05-17T04:08:07.795 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2024-05-17T04:08:07.795 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2024-05-17T04:08:07.795 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-05-17T04:08:07.795 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.795 INFO:teuthology.orchestra.run.smithi150.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-17T04:08:07.795 INFO:teuthology.orchestra.run.smithi150.stdout: auth mon ticket ttl = 660 # 11m 2024-05-17T04:08:07.795 INFO:teuthology.orchestra.run.smithi150.stdout: auth service ticket ttl = 240 # 4m 2024-05-17T04:08:07.796 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.796 INFO:teuthology.orchestra.run.smithi150.stdout: # don't complain about insecure global_id in the test suite 2024-05-17T04:08:07.796 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-17T04:08:07.796 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-17T04:08:07.796 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.796 INFO:teuthology.orchestra.run.smithi150.stdout: # 1m isn't quite enough 2024-05-17T04:08:07.796 INFO:teuthology.orchestra.run.smithi150.stdout: mon_down_mkfs_grace = 2m 2024-05-17T04:08:07.796 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.796 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_filestore_osds = false 2024-05-17T04:08:07.796 INFO:teuthology.orchestra.run.smithi150.stdout: mon down mkfs grace = 300 2024-05-17T04:08:07.796 INFO:teuthology.orchestra.run.smithi150.stdout: mon op complaint time = 120 2024-05-17T04:08:07.796 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-17T04:08:07.796 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2024-05-17T04:08:07.796 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2024-05-17T04:08:07.797 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = true 2024-05-17T04:08:07.797 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2024-05-17T04:08:07.797 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-17T04:08:07.797 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-17T04:08:07.797 INFO:teuthology.orchestra.run.smithi150.stdout: client mount timeout = 600 2024-05-17T04:08:07.797 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2024-05-17T04:08:07.797 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-05-17T04:08:07.797 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = "" 2024-05-17T04:08:07.797 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2024-05-17T04:08:07.797 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2024-05-17T04:08:07.797 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2024-05-17T04:08:07.797 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.b] 2024-05-17T04:08:07.797 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.c] 2024-05-17T04:08:07.798 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2024-05-17T04:08:07.798 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2024-05-17T04:08:07.798 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2024-05-17T04:08:07.798 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2024-05-17T04:08:07.798 INFO:teuthology.orchestra.run.smithi150.stdout:[mds] 2024-05-17T04:08:07.798 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds = 20 2024-05-17T04:08:07.798 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds balancer = 20 2024-05-17T04:08:07.798 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-05-17T04:08:07.798 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug frag = True 2024-05-17T04:08:07.798 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug scatterstat = True 2024-05-17T04:08:07.798 INFO:teuthology.orchestra.run.smithi150.stdout: mds op complaint time = 180 2024-05-17T04:08:07.799 INFO:teuthology.orchestra.run.smithi150.stdout: mds verify scatter = True 2024-05-17T04:08:07.799 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2024-05-17T04:08:07.799 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2024-05-17T04:08:07.799 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2024-05-17T04:08:07.800 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-17T04:08:07.800 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-17T04:08:07.904 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-17T04:08:07.904 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:07.904 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-17T04:08:07.919 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:07.919 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-17T04:08:07.974 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi131.front.sepia.ceph.com 2024-05-17T04:08:07.975 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:07.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-17T04:08:07.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-17T04:08:08.049 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:08.049 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-17T04:08:08.104 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2024-05-17T04:08:08.104 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:08.104 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-17T04:08:08.104 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-17T04:08:08.141 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:08.141 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-17T04:08:08.198 INFO:tasks.ceph:Setting up mon nodes... 2024-05-17T04:08:08.198 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-17T04:08:08.198 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-17T04:08:08.258 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-17T04:08:08.262 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-17T04:08:08.332 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-17T04:08:08.335 INFO:tasks.ceph:Setting up mds nodes... 2024-05-17T04:08:08.335 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-17T04:08:08.396 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-17T04:08:08.399 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-17T04:08:08.424 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-17T04:08:08.525 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-17T04:08:08.528 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-17T04:08:08.552 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-17T04:08:08.613 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-17T04:08:08.617 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-17T04:08:08.641 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-17T04:08:08.741 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-17T04:08:08.744 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-17T04:08:08.770 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-17T04:08:08.770 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-17T04:08:08.820 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-17T04:08:08.833 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-17T04:08:08.882 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-17T04:08:08.896 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-17T04:08:08.947 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-17T04:08:08.960 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-17T04:08:09.010 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-17T04:08:09.023 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-17T04:08:09.025 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-17T04:08:09.025 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-17T04:08:09.050 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-17T04:08:09.050 INFO:tasks.ceph:role: osd.0 2024-05-17T04:08:09.050 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-17T04:08:09.051 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-17T04:08:09.123 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-17T04:08:09.123 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-17T04:08:09.124 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-17T04:08:09.124 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-17T04:08:09.124 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-17T04:08:09.124 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-05-17T04:08:09.124 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-17T04:08:09.124 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-17T04:08:09.124 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-17T04:08:09.124 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-17T04:08:09.633 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-05-17T04:08:09.638 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-05-17T04:08:09.638 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-17T04:08:09.769 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-17T04:08:09.800 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-17T04:08:09.864 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-17T04:08:09.864 INFO:tasks.ceph:role: osd.1 2024-05-17T04:08:09.865 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-17T04:08:09.865 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-17T04:08:09.937 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-17T04:08:09.937 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-17T04:08:09.937 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-17T04:08:09.937 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-17T04:08:09.938 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-17T04:08:09.938 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-05-17T04:08:09.938 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-17T04:08:09.938 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-17T04:08:09.938 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-17T04:08:09.938 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-17T04:08:10.400 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-05-17T04:08:10.402 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-05-17T04:08:10.402 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-17T04:08:10.496 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-17T04:08:10.524 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-17T04:08:10.589 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-17T04:08:10.589 INFO:tasks.ceph:role: osd.2 2024-05-17T04:08:10.590 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-17T04:08:10.590 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-17T04:08:10.661 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-17T04:08:10.662 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-17T04:08:10.662 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-17T04:08:10.662 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-17T04:08:10.662 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-17T04:08:10.662 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-05-17T04:08:10.662 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-17T04:08:10.662 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-17T04:08:10.662 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-17T04:08:10.662 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-17T04:08:11.145 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-05-17T04:08:11.147 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-05-17T04:08:11.147 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-17T04:08:11.296 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-17T04:08:11.327 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-17T04:08:11.392 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-17T04:08:11.392 INFO:tasks.ceph:role: osd.3 2024-05-17T04:08:11.392 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-17T04:08:11.392 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-17T04:08:11.464 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-17T04:08:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-17T04:08:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-17T04:08:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-17T04:08:11.464 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-17T04:08:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-05-17T04:08:11.465 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-17T04:08:11.465 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-17T04:08:11.465 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-17T04:08:11.465 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-17T04:08:11.981 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-05-17T04:08:11.983 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-05-17T04:08:11.983 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-17T04:08:12.114 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-17T04:08:12.147 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-17T04:08:12.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:12.254+0000 7fcdea415640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-17T04:08:12.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:12.254+0000 7fcdea415640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-17T04:08:12.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:12.254+0000 7fcdea415640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-17T04:08:12.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:12.254+0000 7fcdea415640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-17T04:08:12.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:12.254+0000 7fcdea415640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-17T04:08:12.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:12.255+0000 7fcdea415640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-17T04:08:15.113 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-17T04:08:15.140 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-17T04:08:15.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:15.238+0000 7fc805d57640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-17T04:08:15.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:15.239+0000 7fc805d57640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-17T04:08:15.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:15.239+0000 7fc805d57640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-17T04:08:15.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:15.239+0000 7fc805d57640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-17T04:08:15.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:15.239+0000 7fc805d57640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-17T04:08:15.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:15.239+0000 7fc805d57640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-17T04:08:18.093 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-17T04:08:18.123 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-17T04:08:18.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:18.222+0000 7f3673a25640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-17T04:08:18.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:18.222+0000 7f3673a25640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-17T04:08:18.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:18.222+0000 7f3673a25640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-17T04:08:18.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:18.222+0000 7f3673a25640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-17T04:08:18.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:18.222+0000 7f3673a25640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-17T04:08:18.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:18.223+0000 7f3673a25640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-17T04:08:21.079 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-17T04:08:21.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-17T04:08:21.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:21.201+0000 7f99e5b1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-17T04:08:21.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:21.201+0000 7f99e5b1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-17T04:08:21.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:21.201+0000 7f99e5b1a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-17T04:08:21.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:21.201+0000 7f99e5b1a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-17T04:08:21.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:21.202+0000 7f99e5b1a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-17T04:08:21.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:21.202+0000 7f99e5b1a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-17T04:08:24.050 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-17T04:08:24.080 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-17T04:08:24.111 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-17T04:08:24.111 INFO:tasks.ceph:role: osd.4 2024-05-17T04:08:24.111 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2024-05-17T04:08:24.111 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-17T04:08:24.188 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-17T04:08:24.188 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-17T04:08:24.188 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-17T04:08:24.188 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-17T04:08:24.188 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-17T04:08:24.188 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-05-17T04:08:24.188 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-17T04:08:24.188 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-17T04:08:24.189 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-17T04:08:24.189 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-17T04:08:24.710 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-05-17T04:08:24.712 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-05-17T04:08:24.712 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-17T04:08:24.855 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-17T04:08:24.888 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-17T04:08:24.953 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-17T04:08:24.953 INFO:tasks.ceph:role: osd.5 2024-05-17T04:08:24.953 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com 2024-05-17T04:08:24.953 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-17T04:08:25.025 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-17T04:08:25.025 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-17T04:08:25.025 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-17T04:08:25.025 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-17T04:08:25.025 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-17T04:08:25.025 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-05-17T04:08:25.025 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-17T04:08:25.025 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-17T04:08:25.026 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-17T04:08:25.026 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-17T04:08:25.467 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-05-17T04:08:25.469 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-05-17T04:08:25.470 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-17T04:08:25.568 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-17T04:08:25.597 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-17T04:08:25.662 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-17T04:08:25.663 INFO:tasks.ceph:role: osd.6 2024-05-17T04:08:25.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com 2024-05-17T04:08:25.663 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-17T04:08:25.736 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-17T04:08:25.736 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-17T04:08:25.736 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-17T04:08:25.736 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-17T04:08:25.736 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-17T04:08:25.736 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-05-17T04:08:25.737 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-17T04:08:25.737 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-17T04:08:25.737 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-17T04:08:25.737 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-17T04:08:26.220 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-05-17T04:08:26.222 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-05-17T04:08:26.222 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-17T04:08:26.374 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-17T04:08:26.407 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-17T04:08:26.472 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-17T04:08:26.472 INFO:tasks.ceph:role: osd.7 2024-05-17T04:08:26.473 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com 2024-05-17T04:08:26.473 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-17T04:08:26.545 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-17T04:08:26.545 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-17T04:08:26.545 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-17T04:08:26.545 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-17T04:08:26.545 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-17T04:08:26.545 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-05-17T04:08:26.545 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-17T04:08:26.545 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-17T04:08:26.545 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-17T04:08:26.546 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-17T04:08:27.048 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-05-17T04:08:27.048 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-05-17T04:08:27.048 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-17T04:08:27.191 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-17T04:08:27.222 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-17T04:08:27.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:27.342+0000 7f5cb6e25640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-17T04:08:27.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:27.342+0000 7f5cb6e25640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-17T04:08:27.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:27.342+0000 7f5cb6e25640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-17T04:08:27.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:27.342+0000 7f5cb6e25640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-17T04:08:27.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:27.342+0000 7f5cb6e25640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-17T04:08:27.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:27.343+0000 7f5cb6e25640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-17T04:08:30.190 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-17T04:08:30.218 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-17T04:08:30.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:30.316+0000 7f1af3c18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-17T04:08:30.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:30.317+0000 7f1af3c18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-17T04:08:30.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:30.317+0000 7f1af3c18640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-17T04:08:30.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:30.317+0000 7f1af3c18640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-17T04:08:30.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:30.317+0000 7f1af3c18640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-17T04:08:30.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:30.317+0000 7f1af3c18640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-17T04:08:33.180 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-17T04:08:33.210 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-17T04:08:33.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:33.318+0000 7fb74813e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-17T04:08:33.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:33.318+0000 7fb74813e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-17T04:08:33.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:33.318+0000 7fb74813e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-17T04:08:33.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:33.318+0000 7fb74813e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-17T04:08:33.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:33.318+0000 7fb74813e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-17T04:08:33.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:33.319+0000 7fb74813e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-17T04:08:35.788 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:08:35.791 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:08:36.174 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-17T04:08:36.199 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-17T04:08:36.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:36.294+0000 7f8f1f486640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-17T04:08:36.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:36.294+0000 7f8f1f486640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-17T04:08:36.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:36.294+0000 7f8f1f486640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-17T04:08:36.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:36.294+0000 7f8f1f486640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-17T04:08:36.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:36.294+0000 7f8f1f486640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-17T04:08:36.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:36.295+0000 7f8f1f486640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-17T04:08:39.143 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-17T04:08:39.170 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-17T04:08:39.170 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:39.170 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-17T04:08:39.199 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:39.200 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-17T04:08:39.268 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:39.269 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-17T04:08:39.337 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:39.337 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-17T04:08:39.403 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:39.404 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-17T04:08:39.471 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:39.471 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-17T04:08:39.539 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:39.539 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-17T04:08:39.605 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:39.605 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-17T04:08:39.635 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:39.636 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-17T04:08:39.705 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:39.705 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-17T04:08:39.772 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:39.773 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-17T04:08:39.839 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:39.839 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-17T04:08:39.905 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:39.905 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-17T04:08:39.971 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:39.971 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-17T04:08:40.036 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:40.036 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-17T04:08:40.054 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:40.054 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-17T04:08:40.111 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:40.111 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-17T04:08:40.126 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:40.127 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-17T04:08:40.182 INFO:tasks.ceph:Adding keys to all mons... 2024-05-17T04:08:40.183 DEBUG:teuthology.orchestra.run.smithi131:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-17T04:08:40.185 DEBUG:teuthology.orchestra.run.smithi150:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-17T04:08:40.226 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.y] 2024-05-17T04:08:40.226 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAo2EZmpXVwDxAA480Fd1pQXWmbKRKQLQ/peA== 2024-05-17T04:08:40.227 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2024-05-17T04:08:40.227 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAo2EZmPfihFxAA2kg5+fAicFy/rzEq6Z1Zzw== 2024-05-17T04:08:40.227 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2024-05-17T04:08:40.227 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAo2EZmFEFWHxAAcVFOLk4BIgfPddmYDX4bvw== 2024-05-17T04:08:40.227 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.0] 2024-05-17T04:08:40.227 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAs2EZmbGMrDxAAXyD+J/3el16d/DqixYFocA== 2024-05-17T04:08:40.227 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.1] 2024-05-17T04:08:40.227 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAv2EZmPdxODhAAYtAoZ+kAxN5f12GsQprdvw== 2024-05-17T04:08:40.227 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.2] 2024-05-17T04:08:40.227 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAy2EZmchhVDRAAy33imJlj9IZD8pEAq7DG1w== 2024-05-17T04:08:40.227 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.3] 2024-05-17T04:08:40.227 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA12EZmpYYZDBAAdSY711ZardICQkehwT9ToA== 2024-05-17T04:08:40.227 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.x] 2024-05-17T04:08:40.228 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAo2EZmPtPRExAAJ5ag2LAxwzUZUAQz0jCNbw== 2024-05-17T04:08:40.228 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2024-05-17T04:08:40.228 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAo2EZmI2CdJBAAP+AuWB4Y9Ruxx7YPFF+INw== 2024-05-17T04:08:40.228 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2024-05-17T04:08:40.228 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAo2EZmLys7LBAAWYz6TNvnK3jjmkdehCAUew== 2024-05-17T04:08:40.228 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.4] 2024-05-17T04:08:40.228 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA72EZmyRF0FBAAptR7qdMV+KD+B1Fd4D9mJA== 2024-05-17T04:08:40.228 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.5] 2024-05-17T04:08:40.228 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA+2EZmGlDqEhAAkFqHiBqkwiK6xrJEE/7ztg== 2024-05-17T04:08:40.228 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.6] 2024-05-17T04:08:40.228 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQBB2EZmQV3/EhAAuD5k0P441rbiEkmprCflhw== 2024-05-17T04:08:40.228 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.7] 2024-05-17T04:08:40.228 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQBE2EZmVTeSERAAbVrh1aPseyWnb75xGqNHzQ== 2024-05-17T04:08:40.228 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2024-05-17T04:08:40.229 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAo2EZm18HoMBAALbZPYs0ajHhO8BUkz1amdw== 2024-05-17T04:08:40.229 INFO:teuthology.orchestra.run.smithi131.stdout:[client.2] 2024-05-17T04:08:40.229 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAo2EZm6bGmNBAAlhJcLWnOzTRep1u5X5sXQA== 2024-05-17T04:08:40.229 INFO:teuthology.orchestra.run.smithi131.stdout:[client.1] 2024-05-17T04:08:40.229 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAo2EZmUQGAOBAAt7329zcgCmdCConfCDgjpg== 2024-05-17T04:08:40.229 INFO:teuthology.orchestra.run.smithi131.stdout:[client.3] 2024-05-17T04:08:40.229 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAp2EZm0rakABAAUYqMoamKTlxtOFaCmCG3Wg== 2024-05-17T04:08:40.246 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.y] 2024-05-17T04:08:40.246 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAo2EZmpXVwDxAA480Fd1pQXWmbKRKQLQ/peA== 2024-05-17T04:08:40.246 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2024-05-17T04:08:40.246 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAo2EZmPfihFxAA2kg5+fAicFy/rzEq6Z1Zzw== 2024-05-17T04:08:40.246 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2024-05-17T04:08:40.247 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAo2EZmFEFWHxAAcVFOLk4BIgfPddmYDX4bvw== 2024-05-17T04:08:40.247 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2024-05-17T04:08:40.247 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAs2EZmbGMrDxAAXyD+J/3el16d/DqixYFocA== 2024-05-17T04:08:40.247 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2024-05-17T04:08:40.247 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAv2EZmPdxODhAAYtAoZ+kAxN5f12GsQprdvw== 2024-05-17T04:08:40.247 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2024-05-17T04:08:40.247 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAy2EZmchhVDRAAy33imJlj9IZD8pEAq7DG1w== 2024-05-17T04:08:40.247 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.3] 2024-05-17T04:08:40.247 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQA12EZmpYYZDBAAdSY711ZardICQkehwT9ToA== 2024-05-17T04:08:40.247 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.x] 2024-05-17T04:08:40.247 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAo2EZmPtPRExAAJ5ag2LAxwzUZUAQz0jCNbw== 2024-05-17T04:08:40.247 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2024-05-17T04:08:40.247 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAo2EZmI2CdJBAAP+AuWB4Y9Ruxx7YPFF+INw== 2024-05-17T04:08:40.247 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2024-05-17T04:08:40.248 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAo2EZmLys7LBAAWYz6TNvnK3jjmkdehCAUew== 2024-05-17T04:08:40.248 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.4] 2024-05-17T04:08:40.248 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQA72EZmyRF0FBAAptR7qdMV+KD+B1Fd4D9mJA== 2024-05-17T04:08:40.248 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.5] 2024-05-17T04:08:40.248 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQA+2EZmGlDqEhAAkFqHiBqkwiK6xrJEE/7ztg== 2024-05-17T04:08:40.248 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.6] 2024-05-17T04:08:40.248 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBB2EZmQV3/EhAAuD5k0P441rbiEkmprCflhw== 2024-05-17T04:08:40.248 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.7] 2024-05-17T04:08:40.248 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBE2EZmVTeSERAAbVrh1aPseyWnb75xGqNHzQ== 2024-05-17T04:08:40.248 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-05-17T04:08:40.248 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAo2EZm18HoMBAALbZPYs0ajHhO8BUkz1amdw== 2024-05-17T04:08:40.248 INFO:teuthology.orchestra.run.smithi150.stdout:[client.2] 2024-05-17T04:08:40.248 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAo2EZm6bGmNBAAlhJcLWnOzTRep1u5X5sXQA== 2024-05-17T04:08:40.248 INFO:teuthology.orchestra.run.smithi150.stdout:[client.1] 2024-05-17T04:08:40.248 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAo2EZmUQGAOBAAt7329zcgCmdCConfCDgjpg== 2024-05-17T04:08:40.249 INFO:teuthology.orchestra.run.smithi150.stdout:[client.3] 2024-05-17T04:08:40.249 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAp2EZm0rakABAAUYqMoamKTlxtOFaCmCG3Wg== 2024-05-17T04:08:40.250 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-17T04:08:40.272 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-17T04:08:40.351 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-17T04:08:40.353 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-17T04:08:40.418 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-17T04:08:40.420 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-17T04:08:40.485 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:40.487 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:40.552 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:40.554 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:40.615 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:40.617 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:40.677 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:40.680 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:40.740 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-17T04:08:40.742 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-17T04:08:40.802 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-17T04:08:40.804 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-17T04:08:40.868 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-17T04:08:40.870 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-17T04:08:40.934 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:40.936 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:40.997 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:40.999 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:41.060 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:41.063 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:41.125 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:41.127 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-17T04:08:41.187 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-17T04:08:41.190 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-17T04:08:41.254 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-17T04:08:41.257 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-17T04:08:41.320 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-17T04:08:41.322 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-17T04:08:41.386 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-17T04:08:41.389 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-17T04:08:41.452 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-17T04:08:41.453 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-17T04:08:41.477 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-17T04:08:41.585 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-17T04:08:41.609 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-17T04:08:41.635 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-17T04:08:41.742 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-17T04:08:41.767 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-17T04:08:41.832 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-17T04:08:41.939 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-17T04:08:41.964 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-17T04:08:41.967 DEBUG:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-17T04:08:42.020 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-17T04:08:42.020 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-17T04:08:42.021 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-17T04:08:42.023 INFO:tasks.ceph.mon.a:Started 2024-05-17T04:08:42.023 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-17T04:08:42.023 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-17T04:08:42.062 INFO:tasks.ceph.mon.b:Started 2024-05-17T04:08:42.062 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-17T04:08:42.063 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-17T04:08:42.064 INFO:tasks.ceph.mon.c:Started 2024-05-17T04:08:42.065 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-17T04:08:42.065 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-17T04:08:42.065 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-17T04:08:42.067 INFO:tasks.ceph.mgr.y:Started 2024-05-17T04:08:42.067 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-17T04:08:42.067 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-17T04:08:42.069 INFO:tasks.ceph.mgr.x:Started 2024-05-17T04:08:42.069 INFO:tasks.ceph:Setting crush tunables to default 2024-05-17T04:08:42.070 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd crush tunables default 2024-05-17T04:08:42.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.181+0000 7f114f52a640 1 Processor -- start 2024-05-17T04:08:42.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.181+0000 7f114f52a640 1 -- start start 2024-05-17T04:08:42.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114f52a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11480cd720 0x7f11480d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:42.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114f52a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f11480d1580 0x7f114806f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:42.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114f52a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11480d1990 con 0x7f114806f890 2024-05-17T04:08:42.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114f52a640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f1148160930 con 0x7f11480d1580 2024-05-17T04:08:42.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114f52a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f114806e870 con 0x7f11480cd720 2024-05-17T04:08:42.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114dac7640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f114806f890 0x7f11480b2ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:55410/0 (socket says 172.21.15.131:55410) 2024-05-17T04:08:42.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114dac7640 1 -- 172.21.15.131:0/462621528 learned_addr learned my addr 172.21.15.131:0/462621528 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:08:42.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114d2c6640 1 --2- 172.21.15.131:0/462621528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11480cd720 0x7f11480d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:42.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114cac5640 1 --2- 172.21.15.131:0/462621528 >> v2:172.21.15.150:3300/0 conn(0x7f11480d1580 0x7f114806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:42.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114d2c6640 1 -- 172.21.15.131:0/462621528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11480cd720 msgr2=0x7f11480d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-17T04:08:42.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114d2c6640 1 -- 172.21.15.131:0/462621528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11480cd720 msgr2=0x7f11480d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-17T04:08:42.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114d2c6640 1 --2- 172.21.15.131:0/462621528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11480cd720 0x7f11480d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-17T04:08:42.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114d2c6640 1 --2- 172.21.15.131:0/462621528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11480cd720 0x7f11480d1040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-17T04:08:42.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114cac5640 1 -- 172.21.15.131:0/462621528 >> v2:172.21.15.150:3300/0 conn(0x7f11480d1580 msgr2=0x7f114806f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-17T04:08:42.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114cac5640 1 -- 172.21.15.131:0/462621528 >> v2:172.21.15.150:3300/0 conn(0x7f11480d1580 msgr2=0x7f114806f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-17T04:08:42.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114cac5640 1 --2- 172.21.15.131:0/462621528 >> v2:172.21.15.150:3300/0 conn(0x7f11480d1580 0x7f114806f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-17T04:08:42.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.183+0000 7f114cac5640 1 --2- 172.21.15.131:0/462621528 >> v2:172.21.15.150:3300/0 conn(0x7f11480d1580 0x7f114806f350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-17T04:08:42.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 -- 172.21.15.131:0/462621528 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3485985815 0 0) 0x7f1140001490 con 0x7f114806f890 2024-05-17T04:08:42.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 -- 172.21.15.131:0/462621528 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1134003520 con 0x7f114806f890 2024-05-17T04:08:42.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 -- 172.21.15.131:0/462621528 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3818934307 0 0) 0x7f1134003520 con 0x7f114806f890 2024-05-17T04:08:42.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 -- 172.21.15.131:0/462621528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11480cd720 msgr2=0x7f11480d1040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-17T04:08:42.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 --2- 172.21.15.131:0/462621528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11480cd720 0x7f11480d1040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:42.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 -- 172.21.15.131:0/462621528 >> v2:172.21.15.150:3300/0 conn(0x7f11480d1580 msgr2=0x7f114806f350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-17T04:08:42.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 --2- 172.21.15.131:0/462621528 >> v2:172.21.15.150:3300/0 conn(0x7f11480d1580 0x7f114806f350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:42.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 -- 172.21.15.131:0/462621528 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114806eb50 con 0x7f114806f890 2024-05-17T04:08:42.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 -- 172.21.15.131:0/462621528 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7f1140001c40 con 0x7f114806f890 2024-05-17T04:08:42.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 -- 172.21.15.131:0/462621528 >> v1:172.21.15.131:6789/0 conn(0x7f114806f890 legacy=0x7f11480b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:42.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 --2- 172.21.15.131:0/462621528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11480cd720 0x7f1134003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:42.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 --2- 172.21.15.131:0/462621528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1134004080 0x7f1134004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:42.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 --2- 172.21.15.131:0/462621528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1134004d40 0x7f1134005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:42.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 -- 172.21.15.131:0/462621528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1148160930 con 0x7f1134004080 2024-05-17T04:08:42.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 -- 172.21.15.131:0/462621528 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f114806e870 con 0x7f1134004d40 2024-05-17T04:08:42.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f113ffff640 1 -- 172.21.15.131:0/462621528 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f113400bc00 con 0x7f11480cd720 2024-05-17T04:08:42.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f114cac5640 1 --2- 172.21.15.131:0/462621528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1134004080 0x7f1134004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:42.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f114dac7640 1 --2- 172.21.15.131:0/462621528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1134004d40 0x7f1134005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:42.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f114d2c6640 1 --2- 172.21.15.131:0/462621528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11480cd720 0x7f1134003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:42.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f114cac5640 1 -- 172.21.15.131:0/462621528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11480cd720 msgr2=0x7f1134003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:08:42.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f114cac5640 1 --2- 172.21.15.131:0/462621528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11480cd720 0x7f1134003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:42.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f114cac5640 1 -- 172.21.15.131:0/462621528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1134004d40 msgr2=0x7f1134005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:08:42.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f114cac5640 1 --2- 172.21.15.131:0/462621528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1134004d40 0x7f1134005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:42.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.346+0000 7f114cac5640 1 -- 172.21.15.131:0/462621528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1134003520 con 0x7f1134004080 2024-05-17T04:08:42.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.347+0000 7f114cac5640 1 --2- 172.21.15.131:0/462621528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1134004080 0x7f1134004800 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f11480744d0 tx=0x7f1134005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b7dfe4fcbbb1dc server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:42.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.347+0000 7f113ffff640 1 -- 172.21.15.131:0/462621528 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138030070 con 0x7f1134004080 2024-05-17T04:08:42.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.347+0000 7f113ffff640 1 -- 172.21.15.131:0/462621528 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f113802ad70 con 0x7f1134004080 2024-05-17T04:08:42.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.347+0000 7f113ffff640 1 -- 172.21.15.131:0/462621528 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113800b5e0 con 0x7f1134004080 2024-05-17T04:08:42.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.348+0000 7f114f52a640 1 -- 172.21.15.131:0/462621528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1134004080 msgr2=0x7f1134004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:42.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.348+0000 7f114f52a640 1 --2- 172.21.15.131:0/462621528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1134004080 0x7f1134004800 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f11480744d0 tx=0x7f1134005830 comp rx=0 tx=0).stop 2024-05-17T04:08:42.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.348+0000 7f114dac7640 1 -- 172.21.15.131:0/462621528 reap_dead start 2024-05-17T04:08:42.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.348+0000 7f114f52a640 1 -- 172.21.15.131:0/462621528 shutdown_connections 2024-05-17T04:08:42.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.348+0000 7f114f52a640 1 -- 172.21.15.131:0/462621528 >> 172.21.15.131:0/462621528 conn(0x7f11480b4e40 msgr2=0x7f11480b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:42.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.348+0000 7f114f52a640 1 -- 172.21.15.131:0/462621528 shutdown_connections 2024-05-17T04:08:42.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.348+0000 7f114f52a640 1 -- 172.21.15.131:0/462621528 wait complete. 2024-05-17T04:08:42.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.350+0000 7f114f52a640 1 Processor -- start 2024-05-17T04:08:42.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.350+0000 7f114f52a640 1 -- start start 2024-05-17T04:08:42.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.351+0000 7f114f52a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1134004080 0x7f11481f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:42.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.351+0000 7f114f52a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11481541c0 0x7f11480b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:42.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.351+0000 7f114f52a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11480cbe40 0x7f11480cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:42.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.351+0000 7f114f52a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f11480d11c0 con 0x7f11480cbe40 2024-05-17T04:08:42.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.351+0000 7f114f52a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f11480d1040 con 0x7f1134004080 2024-05-17T04:08:42.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.351+0000 7f114f52a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f11480d1340 con 0x7f11481541c0 2024-05-17T04:08:42.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.352+0000 7f114dac7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11480cbe40 0x7f11480cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:42.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.352+0000 7f114dac7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11480cbe40 0x7f11480cc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50502/0 (socket says 172.21.15.131:50502) 2024-05-17T04:08:42.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.352+0000 7f114dac7640 1 -- 172.21.15.131:0/349493021 learned_addr learned my addr 172.21.15.131:0/349493021 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:08:42.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.352+0000 7f114d2c6640 1 --2- 172.21.15.131:0/349493021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1134004080 0x7f11481f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:42.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.352+0000 7f114cac5640 1 --2- 172.21.15.131:0/349493021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11481541c0 0x7f11480b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:42.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.352+0000 7f114dac7640 1 -- 172.21.15.131:0/349493021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11481541c0 msgr2=0x7f11480b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:42.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.352+0000 7f114dac7640 1 --2- 172.21.15.131:0/349493021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11481541c0 0x7f11480b69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:42.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.352+0000 7f114dac7640 1 -- 172.21.15.131:0/349493021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1134004080 msgr2=0x7f11481f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:42.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.352+0000 7f114dac7640 1 --2- 172.21.15.131:0/349493021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1134004080 0x7f11481f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:42.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.352+0000 7f114dac7640 1 -- 172.21.15.131:0/349493021 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11480b7b40 con 0x7f11480cbe40 2024-05-17T04:08:42.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.352+0000 7f114dac7640 1 --2- 172.21.15.131:0/349493021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11480cbe40 0x7f11480cc250 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1140002230 tx=0x7f114000af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:42.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.352+0000 7f113dffb640 1 -- 172.21.15.131:0/349493021 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140007800 con 0x7f11480cbe40 2024-05-17T04:08:42.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.352+0000 7f113dffb640 1 -- 172.21.15.131:0/349493021 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1140018070 con 0x7f11480cbe40 2024-05-17T04:08:42.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.352+0000 7f113dffb640 1 -- 172.21.15.131:0/349493021 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11400133f0 con 0x7f11480cbe40 2024-05-17T04:08:42.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.352+0000 7f114f52a640 1 -- 172.21.15.131:0/349493021 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11481f5a00 con 0x7f11480cbe40 2024-05-17T04:08:42.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.353+0000 7f113dffb640 1 -- 172.21.15.131:0/349493021 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1140013590 con 0x7f11480cbe40 2024-05-17T04:08:42.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.353+0000 7f114f52a640 1 -- 172.21.15.131:0/349493021 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11480b75d0 con 0x7f11480cbe40 2024-05-17T04:08:42.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.353+0000 7f113dffb640 1 -- 172.21.15.131:0/349493021 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f114001d4c0 con 0x7f11480cbe40 2024-05-17T04:08:42.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.354+0000 7f114f52a640 1 -- 172.21.15.131:0/349493021 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f114806f350 con 0x7f11480cbe40 2024-05-17T04:08:42.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.356+0000 7f113dffb640 1 -- 172.21.15.131:0/349493021 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f11480d1990 con 0x7f11480cbe40 2024-05-17T04:08:42.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.423+0000 7f114f52a640 1 -- 172.21.15.131:0/349493021 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f11481604c0 con 0x7f11480cbe40 2024-05-17T04:08:42.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.424+0000 7f113dffb640 1 -- 172.21.15.131:0/349493021 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f1140013ab0 con 0x7f11480cbe40 2024-05-17T04:08:42.425 INFO:teuthology.orchestra.run.smithi131.stderr:adjusted tunables profile to default 2024-05-17T04:08:42.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.425+0000 7f114f52a640 1 -- 172.21.15.131:0/349493021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11480cbe40 msgr2=0x7f11480cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:42.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.425+0000 7f114f52a640 1 --2- 172.21.15.131:0/349493021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11480cbe40 0x7f11480cc250 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1140002230 tx=0x7f114000af80 comp rx=0 tx=0).stop 2024-05-17T04:08:42.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.425+0000 7f114f52a640 1 -- 172.21.15.131:0/349493021 shutdown_connections 2024-05-17T04:08:42.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.425+0000 7f114f52a640 1 --2- 172.21.15.131:0/349493021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11480cbe40 0x7f11480cc250 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:42.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.425+0000 7f114f52a640 1 --2- 172.21.15.131:0/349493021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11481541c0 0x7f11480b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:42.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.425+0000 7f114f52a640 1 --2- 172.21.15.131:0/349493021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1134004080 0x7f11481f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:42.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.425+0000 7f114f52a640 1 -- 172.21.15.131:0/349493021 >> 172.21.15.131:0/349493021 conn(0x7f11480b4e40 msgr2=0x7f1148160ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:42.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.425+0000 7f114f52a640 1 -- 172.21.15.131:0/349493021 shutdown_connections 2024-05-17T04:08:42.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:42.425+0000 7f114f52a640 1 -- 172.21.15.131:0/349493021 wait complete. 2024-05-17T04:08:42.438 INFO:tasks.ceph:check_enable_crimson: False 2024-05-17T04:08:42.438 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-17T04:08:42.438 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:42.438 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-17T04:08:42.457 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:42.456+0000 7fbd2e321040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-17T04:08:42.464 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:42.464 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-17T04:08:42.476 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:42.475+0000 7f656fc1b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-17T04:08:42.501 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:42.501 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-17T04:08:42.567 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:08:42.567 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-17T04:08:42.618 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:42.618+0000 7fbd2e321040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-17T04:08:42.632 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:42.633 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-17T04:08:42.641 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:42.640+0000 7f656fc1b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-17T04:08:42.657 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:42.658 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-17T04:08:42.675 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:42.674+0000 7fbd2e321040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-17T04:08:42.696 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:42.695+0000 7f656fc1b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-17T04:08:42.699 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:42.699 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-17T04:08:42.764 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:08:42.764 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-17T04:08:42.829 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 681b916b-7c1d-4f04-88d7-8ce0acca5731 0 2024-05-17T04:08:42.931 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:42.931+0000 7fbd2e321040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-17T04:08:42.949 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:42.948+0000 7f656fc1b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-17T04:08:42.979 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:42.979+0000 7fbd2e321040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-17T04:08:42.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.980+0000 7f44eb9ee640 1 Processor -- start 2024-05-17T04:08:42.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.980+0000 7f44eb9ee640 1 -- start start 2024-05-17T04:08:42.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.982+0000 7f44eb9ee640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f44e415e490 0x7f44e415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:42.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.982+0000 7f44eb9ee640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e40cdeb0 con 0x7f44e41607e0 2024-05-17T04:08:42.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.982+0000 7f44eb9ee640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e415ede0 con 0x7f44e406df90 2024-05-17T04:08:42.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.982+0000 7f44eb9ee640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f44e40d1770 con 0x7f44e415e490 2024-05-17T04:08:42.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.982+0000 7f44e9f8b640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f44e415e490 0x7f44e415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:42.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.982+0000 7f44e9f8b640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f44e415e490 0x7f44e415e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60952/0 (socket says 172.21.15.150:60952) 2024-05-17T04:08:42.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.982+0000 7f44e8f89640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f44e406df90 0x7f44e406e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43944/0 (socket says 172.21.15.150:43944) 2024-05-17T04:08:42.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.982+0000 7f44e9f8b640 1 -- 172.21.15.150:0/867923067 learned_addr learned my addr 172.21.15.150:0/867923067 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-17T04:08:42.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.982+0000 7f44e9f8b640 1 -- 172.21.15.150:0/867923067 >> v1:172.21.15.150:6789/0 conn(0x7f44e406df90 legacy=0x7f44e406e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:42.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.982+0000 7f44e9f8b640 1 -- 172.21.15.150:0/867923067 >> v1:172.21.15.131:6789/0 conn(0x7f44e41607e0 legacy=0x7f44e40d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:42.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.982+0000 7f44e9f8b640 1 -- 172.21.15.150:0/867923067 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e40d0ed0 con 0x7f44e415e490 2024-05-17T04:08:42.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.983+0000 7f44e9f8b640 1 --2- 172.21.15.150:0/867923067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e415e490 0x7f44e415e8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f44dc009e50 tx=0x7f44dc02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f88cd9ebec545f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:42.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.983+0000 7f44dbfff640 1 -- 172.21.15.150:0/867923067 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc036070 con 0x7f44e415e490 2024-05-17T04:08:42.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.983+0000 7f44dbfff640 1 -- 172.21.15.150:0/867923067 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44dc031600 con 0x7f44e415e490 2024-05-17T04:08:42.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.983+0000 7f44dbfff640 1 -- 172.21.15.150:0/867923067 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc0319d0 con 0x7f44e415e490 2024-05-17T04:08:42.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.984+0000 7f44eb9ee640 1 -- 172.21.15.150:0/867923067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e415e490 msgr2=0x7f44e415e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:42.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.984+0000 7f44eb9ee640 1 --2- 172.21.15.150:0/867923067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e415e490 0x7f44e415e8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f44dc009e50 tx=0x7f44dc02a730 comp rx=0 tx=0).stop 2024-05-17T04:08:42.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.984+0000 7f44eb9ee640 1 -- 172.21.15.150:0/867923067 shutdown_connections 2024-05-17T04:08:42.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.984+0000 7f44eb9ee640 1 --2- 172.21.15.150:0/867923067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e415e490 0x7f44e415e8a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:42.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.984+0000 7f44eb9ee640 1 -- 172.21.15.150:0/867923067 >> 172.21.15.150:0/867923067 conn(0x7f44e40d2140 msgr2=0x7f44e4072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:42.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.984+0000 7f44eb9ee640 1 -- 172.21.15.150:0/867923067 shutdown_connections 2024-05-17T04:08:42.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.984+0000 7f44eb9ee640 1 -- 172.21.15.150:0/867923067 wait complete. 2024-05-17T04:08:42.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.987+0000 7f44eb9ee640 1 Processor -- start 2024-05-17T04:08:42.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.987+0000 7f44eb9ee640 1 -- start start 2024-05-17T04:08:42.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.989+0000 7f44eb9ee640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e406df90 0x7f44e414d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:42.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.989+0000 7f44eb9ee640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44e415e490 0x7f44e4153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:42.991 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.989+0000 7f44eb9ee640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e41607e0 0x7f44e4154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:42.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.989+0000 7f44eb9ee640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f44e4160bf0 con 0x7f44e415e490 2024-05-17T04:08:42.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.989+0000 7f44eb9ee640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f44e40d1490 con 0x7f44e406df90 2024-05-17T04:08:42.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.989+0000 7f44eb9ee640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f44e4150250 con 0x7f44e41607e0 2024-05-17T04:08:42.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.989+0000 7f44e978a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e406df90 0x7f44e414d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:42.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.989+0000 7f44e978a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e406df90 0x7f44e414d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60964/0 (socket says 172.21.15.150:60964) 2024-05-17T04:08:42.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.989+0000 7f44e978a640 1 -- 172.21.15.150:0/1891049437 learned_addr learned my addr 172.21.15.150:0/1891049437 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-17T04:08:42.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.990+0000 7f44e8f89640 1 --2- 172.21.15.150:0/1891049437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44e415e490 0x7f44e4153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:42.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.990+0000 7f44e9f8b640 1 --2- 172.21.15.150:0/1891049437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e41607e0 0x7f44e4154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:42.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.990+0000 7f44e978a640 1 -- 172.21.15.150:0/1891049437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e41607e0 msgr2=0x7f44e4154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:42.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.990+0000 7f44e978a640 1 --2- 172.21.15.150:0/1891049437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e41607e0 0x7f44e4154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:42.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.990+0000 7f44e978a640 1 -- 172.21.15.150:0/1891049437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44e415e490 msgr2=0x7f44e4153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:42.992 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.990+0000 7f44e978a640 1 --2- 172.21.15.150:0/1891049437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44e415e490 0x7f44e4153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.990+0000 7f44e978a640 1 -- 172.21.15.150:0/1891049437 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e4155af0 con 0x7f44e406df90 2024-05-17T04:08:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.990+0000 7f44e9f8b640 1 --2- 172.21.15.150:0/1891049437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e41607e0 0x7f44e4154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:08:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.990+0000 7f44e978a640 1 --2- 172.21.15.150:0/1891049437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e406df90 0x7f44e414d1f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f44d400c370 tx=0x7f44d400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.990+0000 7f44d9ffb640 1 -- 172.21.15.150:0/1891049437 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d40052d0 con 0x7f44e406df90 2024-05-17T04:08:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.990+0000 7f44d9ffb640 1 -- 172.21.15.150:0/1891049437 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d4007020 con 0x7f44e406df90 2024-05-17T04:08:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.990+0000 7f44d9ffb640 1 -- 172.21.15.150:0/1891049437 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d40054b0 con 0x7f44e406df90 2024-05-17T04:08:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.990+0000 7f44eb9ee640 1 -- 172.21.15.150:0/1891049437 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e4155dd0 con 0x7f44e406df90 2024-05-17T04:08:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.990+0000 7f44d9ffb640 1 -- 172.21.15.150:0/1891049437 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f44d4007410 con 0x7f44e406df90 2024-05-17T04:08:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.990+0000 7f44eb9ee640 1 -- 172.21.15.150:0/1891049437 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e4156390 con 0x7f44e406df90 2024-05-17T04:08:42.993 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.991+0000 7f44d9ffb640 1 -- 172.21.15.150:0/1891049437 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f44d4003a50 con 0x7f44e406df90 2024-05-17T04:08:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.992+0000 7f44eb9ee640 1 -- 172.21.15.150:0/1891049437 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e415e8a0 con 0x7f44e406df90 2024-05-17T04:08:42.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:42.994+0000 7f44d9ffb640 1 -- 172.21.15.150:0/1891049437 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f44d4021070 con 0x7f44e406df90 2024-05-17T04:08:42.996 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:42.995+0000 7f656fc1b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-17T04:08:43.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.066+0000 7f44eb9ee640 1 -- 172.21.15.150:0/1891049437 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "681b916b-7c1d-4f04-88d7-8ce0acca5731", "id": 0} v 0) -- 0x7f44e415f380 con 0x7f44e406df90 2024-05-17T04:08:43.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.070+0000 7f44d9ffb640 1 -- 172.21.15.150:0/1891049437 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "681b916b-7c1d-4f04-88d7-8ce0acca5731", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f44d4003c50 con 0x7f44e406df90 2024-05-17T04:08:43.070 INFO:teuthology.orchestra.run.smithi150.stdout:0 2024-05-17T04:08:43.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.071+0000 7f44eb9ee640 1 -- 172.21.15.150:0/1891049437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e406df90 msgr2=0x7f44e414d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.071+0000 7f44eb9ee640 1 --2- 172.21.15.150:0/1891049437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e406df90 0x7f44e414d1f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f44d400c370 tx=0x7f44d400c830 comp rx=0 tx=0).stop 2024-05-17T04:08:43.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.071+0000 7f44eb9ee640 1 -- 172.21.15.150:0/1891049437 shutdown_connections 2024-05-17T04:08:43.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.071+0000 7f44eb9ee640 1 --2- 172.21.15.150:0/1891049437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44e415e490 0x7f44e4153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.071+0000 7f44eb9ee640 1 --2- 172.21.15.150:0/1891049437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e41607e0 0x7f44e4154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.071+0000 7f44eb9ee640 1 --2- 172.21.15.150:0/1891049437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e406df90 0x7f44e414d1f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.071+0000 7f44eb9ee640 1 -- 172.21.15.150:0/1891049437 >> 172.21.15.150:0/1891049437 conn(0x7f44e40d2140 msgr2=0x7f44e4072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:43.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.071+0000 7f44eb9ee640 1 -- 172.21.15.150:0/1891049437 shutdown_connections 2024-05-17T04:08:43.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.071+0000 7f44eb9ee640 1 -- 172.21.15.150:0/1891049437 wait complete. 2024-05-17T04:08:43.082 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 2c1a0cff-fe51-4321-bc12-4fce285e0506 1 2024-05-17T04:08:43.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.192+0000 7feaa389c640 1 Processor -- start 2024-05-17T04:08:43.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.193+0000 7feaa389c640 1 -- start start 2024-05-17T04:08:43.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.194+0000 7feaa389c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea9c163470 0x7fea9c163880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.194+0000 7feaa389c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fea9c0b61c0 0x7fea9c0b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.194+0000 7feaa389c640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9c0b6b10 con 0x7fea9c0d02b0 2024-05-17T04:08:43.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.194+0000 7feaa389c640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fea9c15fe30 con 0x7fea9c0b61c0 2024-05-17T04:08:43.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.194+0000 7feaa389c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fea9c0d06c0 con 0x7fea9c163470 2024-05-17T04:08:43.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.194+0000 7feaa1638640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fea9c0d02b0 0x7fea9c160870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43960/0 (socket says 172.21.15.150:43960) 2024-05-17T04:08:43.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.194+0000 7feaa1638640 1 -- 172.21.15.150:0/433438975 learned_addr learned my addr 172.21.15.150:0/433438975 (peer_addr_for_me v1:172.21.15.150:0/0) 2024-05-17T04:08:43.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.194+0000 7feaa1e39640 1 --2- 172.21.15.150:0/433438975 >> v2:172.21.15.150:3300/0 conn(0x7fea9c0b61c0 0x7fea9c0b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.194+0000 7feaa0e37640 1 --2- 172.21.15.150:0/433438975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea9c163470 0x7fea9c163880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.194+0000 7feaa1e39640 1 -- 172.21.15.150:0/433438975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea9c163470 msgr2=0x7fea9c163880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:08:43.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.194+0000 7feaa1e39640 1 --2- 172.21.15.150:0/433438975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea9c163470 0x7fea9c163880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.194+0000 7feaa1e39640 1 -- 172.21.15.150:0/433438975 >> v1:172.21.15.150:6789/0 conn(0x7fea9c0d02b0 legacy=0x7fea9c160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.194+0000 7feaa1e39640 1 -- 172.21.15.150:0/433438975 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9c163ec0 con 0x7fea9c0b61c0 2024-05-17T04:08:43.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.194+0000 7fea8ffff640 1 -- 172.21.15.150:0/433438975 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773434027 0 0) 0x7fea98001110 con 0x7fea9c0d02b0 2024-05-17T04:08:43.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.194+0000 7feaa0e37640 1 --2- 172.21.15.150:0/433438975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea9c163470 0x7fea9c163880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:08:43.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.195+0000 7feaa1e39640 1 --2- 172.21.15.150:0/433438975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea9c0b61c0 0x7fea9c0b65d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fea94009d90 tx=0x7fea9402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c667b9aeee039597 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:43.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.195+0000 7fea8ffff640 1 -- 172.21.15.150:0/433438975 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea94007740 con 0x7fea9c0b61c0 2024-05-17T04:08:43.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.195+0000 7fea8ffff640 1 -- 172.21.15.150:0/433438975 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea940078e0 con 0x7fea9c0b61c0 2024-05-17T04:08:43.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.195+0000 7fea8ffff640 1 -- 172.21.15.150:0/433438975 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea94007cb0 con 0x7fea9c0b61c0 2024-05-17T04:08:43.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.196+0000 7feaa389c640 1 -- 172.21.15.150:0/433438975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea9c0b61c0 msgr2=0x7fea9c0b65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.196+0000 7feaa389c640 1 --2- 172.21.15.150:0/433438975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea9c0b61c0 0x7fea9c0b65d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fea94009d90 tx=0x7fea9402a660 comp rx=0 tx=0).stop 2024-05-17T04:08:43.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.196+0000 7feaa389c640 1 -- 172.21.15.150:0/433438975 shutdown_connections 2024-05-17T04:08:43.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.196+0000 7feaa389c640 1 --2- 172.21.15.150:0/433438975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea9c163470 0x7fea9c163880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.196+0000 7feaa389c640 1 --2- 172.21.15.150:0/433438975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea9c0b61c0 0x7fea9c0b65d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.196+0000 7feaa389c640 1 -- 172.21.15.150:0/433438975 >> 172.21.15.150:0/433438975 conn(0x7fea9c0b50a0 msgr2=0x7fea9c0b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:43.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.196+0000 7feaa389c640 1 -- 172.21.15.150:0/433438975 shutdown_connections 2024-05-17T04:08:43.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.196+0000 7feaa389c640 1 -- 172.21.15.150:0/433438975 wait complete. 2024-05-17T04:08:43.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.198+0000 7feaa389c640 1 Processor -- start 2024-05-17T04:08:43.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.198+0000 7feaa389c640 1 -- start start 2024-05-17T04:08:43.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.199+0000 7feaa389c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea9c0b61c0 0x7fea9c1f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.199+0000 7feaa389c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea9c0d02b0 0x7fea9c0c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.199+0000 7feaa389c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea9c163470 0x7fea9c146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.199+0000 7feaa389c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c160350 con 0x7fea9c0d02b0 2024-05-17T04:08:43.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.199+0000 7feaa389c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c160070 con 0x7fea9c163470 2024-05-17T04:08:43.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.199+0000 7feaa389c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fea9c0cfab0 con 0x7fea9c0b61c0 2024-05-17T04:08:43.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.199+0000 7feaa1638640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea9c0b61c0 0x7fea9c1f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.199+0000 7feaa1e39640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea9c163470 0x7fea9c146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.199+0000 7feaa1638640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea9c0b61c0 0x7fea9c1f5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:46858/0 (socket says 172.21.15.150:46858) 2024-05-17T04:08:43.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.199+0000 7feaa1638640 1 -- 172.21.15.150:0/3948730572 learned_addr learned my addr 172.21.15.150:0/3948730572 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-17T04:08:43.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.199+0000 7feaa0e37640 1 --2- 172.21.15.150:0/3948730572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea9c0d02b0 0x7fea9c0c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.200+0000 7feaa1638640 1 -- 172.21.15.150:0/3948730572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea9c163470 msgr2=0x7fea9c146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.200+0000 7feaa1638640 1 --2- 172.21.15.150:0/3948730572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea9c163470 0x7fea9c146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.200+0000 7feaa1638640 1 -- 172.21.15.150:0/3948730572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea9c0d02b0 msgr2=0x7fea9c0c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.200+0000 7feaa1638640 1 --2- 172.21.15.150:0/3948730572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea9c0d02b0 0x7fea9c0c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.200+0000 7feaa1638640 1 -- 172.21.15.150:0/3948730572 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9c0c7140 con 0x7fea9c0b61c0 2024-05-17T04:08:43.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.200+0000 7feaa0e37640 1 --2- 172.21.15.150:0/3948730572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea9c0d02b0 0x7fea9c0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:08:43.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.200+0000 7feaa1638640 1 --2- 172.21.15.150:0/3948730572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea9c0b61c0 0x7fea9c1f5b40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fea9800c440 tx=0x7fea9800c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:43.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.200+0000 7fea8dffb640 1 -- 172.21.15.150:0/3948730572 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea98018070 con 0x7fea9c0b61c0 2024-05-17T04:08:43.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.200+0000 7fea8dffb640 1 -- 172.21.15.150:0/3948730572 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea98007500 con 0x7fea9c0b61c0 2024-05-17T04:08:43.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.200+0000 7feaa389c640 1 -- 172.21.15.150:0/3948730572 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9c0c93f0 con 0x7fea9c0b61c0 2024-05-17T04:08:43.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.200+0000 7fea8dffb640 1 -- 172.21.15.150:0/3948730572 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea98004a20 con 0x7fea9c0b61c0 2024-05-17T04:08:43.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.200+0000 7feaa389c640 1 -- 172.21.15.150:0/3948730572 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fea9c0c99b0 con 0x7fea9c0b61c0 2024-05-17T04:08:43.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.200+0000 7fea8dffb640 1 -- 172.21.15.150:0/3948730572 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fea9801b070 con 0x7fea9c0b61c0 2024-05-17T04:08:43.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.200+0000 7fea8dffb640 1 -- 172.21.15.150:0/3948730572 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fea9801d7f0 con 0x7fea9c0b61c0 2024-05-17T04:08:43.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.201+0000 7feaa389c640 1 -- 172.21.15.150:0/3948730572 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9c0b77d0 con 0x7fea9c0b61c0 2024-05-17T04:08:43.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.204+0000 7fea8dffb640 1 -- 172.21.15.150:0/3948730572 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fea9c0b77d0 con 0x7fea9c0b61c0 2024-05-17T04:08:43.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.275+0000 7feaa389c640 1 -- 172.21.15.150:0/3948730572 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2c1a0cff-fe51-4321-bc12-4fce285e0506", "id": 1} v 0) -- 0x7fea9c0d2520 con 0x7fea9c0b61c0 2024-05-17T04:08:43.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.281+0000 7fea8dffb640 1 -- 172.21.15.150:0/3948730572 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c1a0cff-fe51-4321-bc12-4fce285e0506", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fea9c0d2520 con 0x7fea9c0b61c0 2024-05-17T04:08:43.281 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-05-17T04:08:43.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.282+0000 7feaa389c640 1 -- 172.21.15.150:0/3948730572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea9c0b61c0 msgr2=0x7fea9c1f5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.282+0000 7feaa389c640 1 --2- 172.21.15.150:0/3948730572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea9c0b61c0 0x7fea9c1f5b40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fea9800c440 tx=0x7fea9800c900 comp rx=0 tx=0).stop 2024-05-17T04:08:43.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.282+0000 7feaa389c640 1 -- 172.21.15.150:0/3948730572 shutdown_connections 2024-05-17T04:08:43.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.282+0000 7feaa389c640 1 --2- 172.21.15.150:0/3948730572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea9c0d02b0 0x7fea9c0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.282+0000 7feaa389c640 1 --2- 172.21.15.150:0/3948730572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea9c163470 0x7fea9c146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.282+0000 7feaa389c640 1 --2- 172.21.15.150:0/3948730572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea9c0b61c0 0x7fea9c1f5b40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.282+0000 7feaa389c640 1 -- 172.21.15.150:0/3948730572 >> 172.21.15.150:0/3948730572 conn(0x7fea9c0b50a0 msgr2=0x7fea9c157e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:43.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.282+0000 7feaa389c640 1 -- 172.21.15.150:0/3948730572 shutdown_connections 2024-05-17T04:08:43.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.282+0000 7feaa389c640 1 -- 172.21.15.150:0/3948730572 wait complete. 2024-05-17T04:08:43.294 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 93025ad1-b979-4efb-9693-fa5ee41c80aa 2 2024-05-17T04:08:43.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.405+0000 7f4efd42d640 1 Processor -- start 2024-05-17T04:08:43.405 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.405+0000 7f4efd42d640 1 -- start start 2024-05-17T04:08:43.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.406+0000 7f4efd42d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80d05e0 0x7f4ef815f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.406+0000 7f4efd42d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4ef80d0db0 0x7f4ef80d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.406+0000 7f4efd42d640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef80d2ca0 con 0x7f4ef80d2890 2024-05-17T04:08:43.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.406+0000 7f4efd42d640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f4ef80d09f0 con 0x7f4ef80d0db0 2024-05-17T04:08:43.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.406+0000 7f4efd42d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef80d14b0 con 0x7f4ef80d05e0 2024-05-17T04:08:43.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.406+0000 7f4ef6ffd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80d05e0 0x7f4ef815f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.406+0000 7f4ef6ffd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80d05e0 0x7f4ef815f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:46872/0 (socket says 172.21.15.150:46872) 2024-05-17T04:08:43.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.406+0000 7f4ef77fe640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f4ef80d2890 0x7f4ef8073880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43962/0 (socket says 172.21.15.150:43962) 2024-05-17T04:08:43.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.406+0000 7f4ef6ffd640 1 -- 172.21.15.150:0/2318305800 learned_addr learned my addr 172.21.15.150:0/2318305800 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-17T04:08:43.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.407+0000 7f4eeffff640 1 --2- 172.21.15.150:0/2318305800 >> v2:172.21.15.131:3300/0 conn(0x7f4ef80d0db0 0x7f4ef80d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.407+0000 7f4ef67fc640 1 -- 172.21.15.150:0/2318305800 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857083888 0 0) 0x7f4ef0001490 con 0x7f4ef80d2890 2024-05-17T04:08:43.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.407+0000 7f4ef67fc640 1 -- 172.21.15.150:0/2318305800 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ee4003520 con 0x7f4ef80d2890 2024-05-17T04:08:43.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.407+0000 7f4ef6ffd640 1 -- 172.21.15.150:0/2318305800 >> v2:172.21.15.131:3300/0 conn(0x7f4ef80d0db0 msgr2=0x7f4ef80d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:08:43.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.407+0000 7f4ef6ffd640 1 --2- 172.21.15.150:0/2318305800 >> v2:172.21.15.131:3300/0 conn(0x7f4ef80d0db0 0x7f4ef80d2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.407+0000 7f4ef6ffd640 1 -- 172.21.15.150:0/2318305800 >> v1:172.21.15.150:6789/0 conn(0x7f4ef80d2890 legacy=0x7f4ef8073880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.407+0000 7f4ef6ffd640 1 -- 172.21.15.150:0/2318305800 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef80d1790 con 0x7f4ef80d05e0 2024-05-17T04:08:43.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.407+0000 7f4eeffff640 1 --2- 172.21.15.150:0/2318305800 >> v2:172.21.15.131:3300/0 conn(0x7f4ef80d0db0 0x7f4ef80d2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:08:43.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.407+0000 7f4ef6ffd640 1 --2- 172.21.15.150:0/2318305800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80d05e0 0x7f4ef815f5a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009870 tx=0x7f4ee802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76ea0690a103997d server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:43.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.408+0000 7f4ef67fc640 1 -- 172.21.15.150:0/2318305800 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8037070 con 0x7f4ef80d05e0 2024-05-17T04:08:43.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.408+0000 7f4ef67fc640 1 -- 172.21.15.150:0/2318305800 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee8032440 con 0x7f4ef80d05e0 2024-05-17T04:08:43.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.408+0000 7f4ef67fc640 1 -- 172.21.15.150:0/2318305800 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8032810 con 0x7f4ef80d05e0 2024-05-17T04:08:43.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.408+0000 7f4efd42d640 1 -- 172.21.15.150:0/2318305800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80d05e0 msgr2=0x7f4ef815f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.408+0000 7f4efd42d640 1 --2- 172.21.15.150:0/2318305800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80d05e0 0x7f4ef815f5a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009870 tx=0x7f4ee802a250 comp rx=0 tx=0).stop 2024-05-17T04:08:43.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.408+0000 7f4efd42d640 1 -- 172.21.15.150:0/2318305800 shutdown_connections 2024-05-17T04:08:43.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.408+0000 7f4efd42d640 1 --2- 172.21.15.150:0/2318305800 >> v2:172.21.15.131:3300/0 conn(0x7f4ef80d0db0 0x7f4ef80d2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.408+0000 7f4efd42d640 1 --2- 172.21.15.150:0/2318305800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80d05e0 0x7f4ef815f5a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.408+0000 7f4efd42d640 1 -- 172.21.15.150:0/2318305800 >> 172.21.15.150:0/2318305800 conn(0x7f4ef80b4250 msgr2=0x7f4ef80b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:43.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.409+0000 7f4efd42d640 1 -- 172.21.15.150:0/2318305800 shutdown_connections 2024-05-17T04:08:43.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.409+0000 7f4efd42d640 1 -- 172.21.15.150:0/2318305800 wait complete. 2024-05-17T04:08:43.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.410+0000 7f4efd42d640 1 Processor -- start 2024-05-17T04:08:43.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.410+0000 7f4efd42d640 1 -- start start 2024-05-17T04:08:43.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.411+0000 7f4efd42d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80d05e0 0x7f4ef806d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4efd42d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef80d0db0 0x7f4ef8150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4efd42d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ef80d2890 0x7f4ef80b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4efd42d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef80d11c0 con 0x7f4ef80d2890 2024-05-17T04:08:43.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4efd42d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef80d1d50 con 0x7f4ef80d0db0 2024-05-17T04:08:43.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4efd42d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef80af0f0 con 0x7f4ef80d05e0 2024-05-17T04:08:43.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4ef6ffd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80d05e0 0x7f4ef806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4ef6ffd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80d05e0 0x7f4ef806d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:46888/0 (socket says 172.21.15.150:46888) 2024-05-17T04:08:43.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4eeffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef80d0db0 0x7f4ef8150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4ef6ffd640 1 -- 172.21.15.150:0/3005534461 learned_addr learned my addr 172.21.15.150:0/3005534461 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-17T04:08:43.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4ef77fe640 1 --2- 172.21.15.150:0/3005534461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ef80d2890 0x7f4ef80b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4ef6ffd640 1 -- 172.21.15.150:0/3005534461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef80d0db0 msgr2=0x7f4ef8150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4ef6ffd640 1 --2- 172.21.15.150:0/3005534461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef80d0db0 0x7f4ef8150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4ef6ffd640 1 -- 172.21.15.150:0/3005534461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ef80d2890 msgr2=0x7f4ef80b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4ef6ffd640 1 --2- 172.21.15.150:0/3005534461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ef80d2890 0x7f4ef80b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4ef6ffd640 1 -- 172.21.15.150:0/3005534461 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef81545f0 con 0x7f4ef80d05e0 2024-05-17T04:08:43.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4eeffff640 1 --2- 172.21.15.150:0/3005534461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef80d0db0 0x7f4ef8150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:08:43.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4ef6ffd640 1 --2- 172.21.15.150:0/3005534461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80d05e0 0x7f4ef806d900 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8000c00 tx=0x7f4ee80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:43.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4eef7fe640 1 -- 172.21.15.150:0/3005534461 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8037040 con 0x7f4ef80d05e0 2024-05-17T04:08:43.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4eef7fe640 1 -- 172.21.15.150:0/3005534461 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee8042070 con 0x7f4ef80d05e0 2024-05-17T04:08:43.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4efd42d640 1 -- 172.21.15.150:0/3005534461 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef81548d0 con 0x7f4ef80d05e0 2024-05-17T04:08:43.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4eef7fe640 1 -- 172.21.15.150:0/3005534461 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8030880 con 0x7f4ef80d05e0 2024-05-17T04:08:43.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.412+0000 7f4efd42d640 1 -- 172.21.15.150:0/3005534461 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef806de40 con 0x7f4ef80d05e0 2024-05-17T04:08:43.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.413+0000 7f4eef7fe640 1 -- 172.21.15.150:0/3005534461 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4ee8030a20 con 0x7f4ef80d05e0 2024-05-17T04:08:43.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.413+0000 7f4eef7fe640 1 -- 172.21.15.150:0/3005534461 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f4ee803b430 con 0x7f4ef80d05e0 2024-05-17T04:08:43.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.413+0000 7f4efd42d640 1 -- 172.21.15.150:0/3005534461 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef80b22c0 con 0x7f4ef80d05e0 2024-05-17T04:08:43.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.415+0000 7f4eef7fe640 1 -- 172.21.15.150:0/3005534461 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f4ee8047b90 con 0x7f4ef80d05e0 2024-05-17T04:08:43.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.487+0000 7f4efd42d640 1 -- 172.21.15.150:0/3005534461 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "93025ad1-b979-4efb-9693-fa5ee41c80aa", "id": 2} v 0) -- 0x7f4ef815d3d0 con 0x7f4ef80d05e0 2024-05-17T04:08:43.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.493+0000 7f4eef7fe640 1 -- 172.21.15.150:0/3005534461 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93025ad1-b979-4efb-9693-fa5ee41c80aa", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f4ee8047460 con 0x7f4ef80d05e0 2024-05-17T04:08:43.493 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-05-17T04:08:43.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.493+0000 7f4efd42d640 1 -- 172.21.15.150:0/3005534461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80d05e0 msgr2=0x7f4ef806d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.493+0000 7f4efd42d640 1 --2- 172.21.15.150:0/3005534461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80d05e0 0x7f4ef806d900 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8000c00 tx=0x7f4ee80046c0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.493+0000 7f4efd42d640 1 -- 172.21.15.150:0/3005534461 shutdown_connections 2024-05-17T04:08:43.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.493+0000 7f4efd42d640 1 --2- 172.21.15.150:0/3005534461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ef80d2890 0x7f4ef80b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.493+0000 7f4efd42d640 1 --2- 172.21.15.150:0/3005534461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef80d0db0 0x7f4ef8150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.493+0000 7f4efd42d640 1 --2- 172.21.15.150:0/3005534461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80d05e0 0x7f4ef806d900 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.493+0000 7f4efd42d640 1 -- 172.21.15.150:0/3005534461 >> 172.21.15.150:0/3005534461 conn(0x7f4ef80b4250 msgr2=0x7f4ef815db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:43.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.493+0000 7f4efd42d640 1 -- 172.21.15.150:0/3005534461 shutdown_connections 2024-05-17T04:08:43.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.493+0000 7f4efd42d640 1 -- 172.21.15.150:0/3005534461 wait complete. 2024-05-17T04:08:43.505 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 615a41eb-71fc-4751-8aec-4f03ee61d8f8 3 2024-05-17T04:08:43.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.617+0000 7f78c768f640 1 Processor -- start 2024-05-17T04:08:43.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.617+0000 7f78c768f640 1 -- start start 2024-05-17T04:08:43.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.618+0000 7f78c768f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f78c015f5a0 0x7f78c00d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.618+0000 7f78c768f640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78c015f9b0 con 0x7f78c00d2a60 2024-05-17T04:08:43.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.618+0000 7f78c768f640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78c00d14b0 con 0x7f78c00d05e0 2024-05-17T04:08:43.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.618+0000 7f78c768f640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f78c00d09f0 con 0x7f78c015f5a0 2024-05-17T04:08:43.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.618+0000 7f78c5c2c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f78c015f5a0 0x7f78c00d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.618+0000 7f78c542b640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f78c00d05e0 0x7f78c00d2350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43968/0 (socket says 172.21.15.150:43968) 2024-05-17T04:08:43.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.618+0000 7f78c542b640 1 -- 172.21.15.150:0/2801035312 learned_addr learned my addr 172.21.15.150:0/2801035312 (peer_addr_for_me v1:172.21.15.150:0/0) 2024-05-17T04:08:43.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.619+0000 7f78b7fff640 1 -- 172.21.15.150:0/2801035312 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3429932557 0 0) 0x7f78c00d14b0 con 0x7f78c00d05e0 2024-05-17T04:08:43.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.619+0000 7f78b7fff640 1 -- 172.21.15.150:0/2801035312 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78ac003520 con 0x7f78c00d05e0 2024-05-17T04:08:43.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.619+0000 7f78c5c2c640 1 -- 172.21.15.150:0/2801035312 >> v1:172.21.15.150:6789/0 conn(0x7f78c00d05e0 legacy=0x7f78c00d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.619+0000 7f78b7fff640 1 -- 172.21.15.150:0/2801035312 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 639920423 0 0) 0x7f78bc001110 con 0x7f78c00d2a60 2024-05-17T04:08:43.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.619+0000 7f78c5c2c640 1 -- 172.21.15.150:0/2801035312 >> v1:172.21.15.131:6789/0 conn(0x7f78c00d2a60 legacy=0x7f78c00af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.619+0000 7f78c5c2c640 1 -- 172.21.15.150:0/2801035312 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c00d1790 con 0x7f78c015f5a0 2024-05-17T04:08:43.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.619+0000 7f78c5c2c640 1 --2- 172.21.15.150:0/2801035312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78c015f5a0 0x7f78c00d0db0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009d90 tx=0x7f78b802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56e64aa2f6c45bda server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:43.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.620+0000 7f78b7fff640 1 -- 172.21.15.150:0/2801035312 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8007740 con 0x7f78c015f5a0 2024-05-17T04:08:43.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.620+0000 7f78b7fff640 1 -- 172.21.15.150:0/2801035312 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b80078e0 con 0x7f78c015f5a0 2024-05-17T04:08:43.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.620+0000 7f78b7fff640 1 -- 172.21.15.150:0/2801035312 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8007cb0 con 0x7f78c015f5a0 2024-05-17T04:08:43.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.620+0000 7f78c768f640 1 -- 172.21.15.150:0/2801035312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78c015f5a0 msgr2=0x7f78c00d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.620+0000 7f78c768f640 1 --2- 172.21.15.150:0/2801035312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78c015f5a0 0x7f78c00d0db0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009d90 tx=0x7f78b802a6f0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.620+0000 7f78c768f640 1 -- 172.21.15.150:0/2801035312 shutdown_connections 2024-05-17T04:08:43.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.620+0000 7f78c768f640 1 --2- 172.21.15.150:0/2801035312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78c015f5a0 0x7f78c00d0db0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.620+0000 7f78c768f640 1 -- 172.21.15.150:0/2801035312 >> 172.21.15.150:0/2801035312 conn(0x7f78c00b4250 msgr2=0x7f78c00b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:43.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.621+0000 7f78c768f640 1 -- 172.21.15.150:0/2801035312 shutdown_connections 2024-05-17T04:08:43.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.621+0000 7f78c768f640 1 -- 172.21.15.150:0/2801035312 wait complete. 2024-05-17T04:08:43.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.622+0000 7f78c768f640 1 Processor -- start 2024-05-17T04:08:43.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.622+0000 7f78c768f640 1 -- start start 2024-05-17T04:08:43.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c768f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78c00d05e0 0x7f78c014fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c768f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78c015f5a0 0x7f78c006f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c768f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78c0161ba0 0x7f78c0161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c768f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f78c00af0f0 con 0x7f78c00d05e0 2024-05-17T04:08:43.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c768f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f78c00d1d50 con 0x7f78c0161ba0 2024-05-17T04:08:43.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c768f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f78c00afd90 con 0x7f78c015f5a0 2024-05-17T04:08:43.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c4c2a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78c015f5a0 0x7f78c006f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c5c2c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78c0161ba0 0x7f78c0161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c4c2a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78c015f5a0 0x7f78c006f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:46902/0 (socket says 172.21.15.150:46902) 2024-05-17T04:08:43.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c4c2a640 1 -- 172.21.15.150:0/4063500304 learned_addr learned my addr 172.21.15.150:0/4063500304 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-17T04:08:43.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c542b640 1 --2- 172.21.15.150:0/4063500304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78c00d05e0 0x7f78c014fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c5c2c640 1 -- 172.21.15.150:0/4063500304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78c015f5a0 msgr2=0x7f78c006f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c5c2c640 1 --2- 172.21.15.150:0/4063500304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78c015f5a0 0x7f78c006f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c5c2c640 1 -- 172.21.15.150:0/4063500304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78c00d05e0 msgr2=0x7f78c014fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c5c2c640 1 --2- 172.21.15.150:0/4063500304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78c00d05e0 0x7f78c014fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c5c2c640 1 -- 172.21.15.150:0/4063500304 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c01624f0 con 0x7f78c0161ba0 2024-05-17T04:08:43.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c4c2a640 1 --2- 172.21.15.150:0/4063500304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78c015f5a0 0x7f78c006f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:08:43.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.624+0000 7f78c5c2c640 1 --2- 172.21.15.150:0/4063500304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78c0161ba0 0x7f78c0161fb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f78b8031000 tx=0x7f78b8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:43.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.625+0000 7f78b5ffb640 1 -- 172.21.15.150:0/4063500304 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8040070 con 0x7f78c0161ba0 2024-05-17T04:08:43.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.625+0000 7f78b5ffb640 1 -- 172.21.15.150:0/4063500304 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b8031bc0 con 0x7f78c0161ba0 2024-05-17T04:08:43.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.625+0000 7f78c768f640 1 -- 172.21.15.150:0/4063500304 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c015aad0 con 0x7f78c0161ba0 2024-05-17T04:08:43.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.625+0000 7f78b5ffb640 1 -- 172.21.15.150:0/4063500304 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8009450 con 0x7f78c0161ba0 2024-05-17T04:08:43.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.625+0000 7f78c768f640 1 -- 172.21.15.150:0/4063500304 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c015b090 con 0x7f78c0161ba0 2024-05-17T04:08:43.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.625+0000 7f78b5ffb640 1 -- 172.21.15.150:0/4063500304 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f78b8039040 con 0x7f78c0161ba0 2024-05-17T04:08:43.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.625+0000 7f78b5ffb640 1 -- 172.21.15.150:0/4063500304 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f78b804d880 con 0x7f78c0161ba0 2024-05-17T04:08:43.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.626+0000 7f78c768f640 1 -- 172.21.15.150:0/4063500304 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c00d0db0 con 0x7f78c0161ba0 2024-05-17T04:08:43.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.628+0000 7f78b5ffb640 1 -- 172.21.15.150:0/4063500304 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f78c01624f0 con 0x7f78c0161ba0 2024-05-17T04:08:43.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.699+0000 7f78c768f640 1 -- 172.21.15.150:0/4063500304 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "615a41eb-71fc-4751-8aec-4f03ee61d8f8", "id": 3} v 0) -- 0x7f78c00b11e0 con 0x7f78c0161ba0 2024-05-17T04:08:43.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.705+0000 7f78b5ffb640 1 -- 172.21.15.150:0/4063500304 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "615a41eb-71fc-4751-8aec-4f03ee61d8f8", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f78b804d3f0 con 0x7f78c0161ba0 2024-05-17T04:08:43.705 INFO:teuthology.orchestra.run.smithi150.stdout:3 2024-05-17T04:08:43.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.706+0000 7f78c768f640 1 -- 172.21.15.150:0/4063500304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78c0161ba0 msgr2=0x7f78c0161fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.706+0000 7f78c768f640 1 --2- 172.21.15.150:0/4063500304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78c0161ba0 0x7f78c0161fb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f78b8031000 tx=0x7f78b8004a40 comp rx=0 tx=0).stop 2024-05-17T04:08:43.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.706+0000 7f78c768f640 1 -- 172.21.15.150:0/4063500304 shutdown_connections 2024-05-17T04:08:43.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.706+0000 7f78c768f640 1 --2- 172.21.15.150:0/4063500304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78c0161ba0 0x7f78c0161fb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.706+0000 7f78c768f640 1 --2- 172.21.15.150:0/4063500304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78c015f5a0 0x7f78c006f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.706+0000 7f78c768f640 1 --2- 172.21.15.150:0/4063500304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78c00d05e0 0x7f78c014fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.706+0000 7f78c768f640 1 -- 172.21.15.150:0/4063500304 >> 172.21.15.150:0/4063500304 conn(0x7f78c00b4250 msgr2=0x7f78c00b0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:43.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.706+0000 7f78c768f640 1 -- 172.21.15.150:0/4063500304 shutdown_connections 2024-05-17T04:08:43.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.706+0000 7f78c768f640 1 -- 172.21.15.150:0/4063500304 wait complete. 2024-05-17T04:08:43.717 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new bbc3c773-dd6d-4a5c-915d-70cd59896f5d 4 2024-05-17T04:08:43.757 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:43.756+0000 7f656fc1b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-17T04:08:43.758 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:43.758+0000 7fbd2e321040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-17T04:08:43.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.827+0000 7f4eb552a640 1 Processor -- start 2024-05-17T04:08:43.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.827+0000 7f4eb552a640 1 -- start start 2024-05-17T04:08:43.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.828+0000 7f4eb552a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4eb015f7e0 0x7f4eb00b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.828+0000 7f4eb552a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb006c6f0 0x7f4eb006cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.828+0000 7f4eb552a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eb006d040 con 0x7f4eb00d3e10 2024-05-17T04:08:43.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.828+0000 7f4eb552a640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f4eb00d1830 con 0x7f4eb015f7e0 2024-05-17T04:08:43.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.828+0000 7f4eb552a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb00cfe90 con 0x7f4eb006c6f0 2024-05-17T04:08:43.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.829+0000 7f4eaeffd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4eb015f7e0 0x7f4eb00b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.829+0000 7f4eaf7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb006c6f0 0x7f4eb006cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.829+0000 7f4eaf7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb006c6f0 0x7f4eb006cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:46918/0 (socket says 172.21.15.150:46918) 2024-05-17T04:08:43.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.829+0000 7f4eaeffd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4eb015f7e0 0x7f4eb00b87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60996/0 (socket says 172.21.15.150:60996) 2024-05-17T04:08:43.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.829+0000 7f4eaf7fe640 1 -- 172.21.15.150:0/3668217650 learned_addr learned my addr 172.21.15.150:0/3668217650 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-17T04:08:43.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.829+0000 7f4eaf7fe640 1 -- 172.21.15.150:0/3668217650 >> v2:172.21.15.150:3300/0 conn(0x7f4eb015f7e0 msgr2=0x7f4eb00b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:08:43.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.829+0000 7f4eaf7fe640 1 --2- 172.21.15.150:0/3668217650 >> v2:172.21.15.150:3300/0 conn(0x7f4eb015f7e0 0x7f4eb00b87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.829+0000 7f4eaf7fe640 1 -- 172.21.15.150:0/3668217650 >> v1:172.21.15.131:6789/0 conn(0x7f4eb00d3e10 legacy=0x7f4eb00d4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.829+0000 7f4eaf7fe640 1 -- 172.21.15.150:0/3668217650 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb00cf880 con 0x7f4eb006c6f0 2024-05-17T04:08:43.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.830+0000 7f4eaf7fe640 1 --2- 172.21.15.150:0/3668217650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb006c6f0 0x7f4eb006cb00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009e50 tx=0x7f4ea802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3050987b357cc13 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:43.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.830+0000 7f4eadffb640 1 -- 172.21.15.150:0/3668217650 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8036070 con 0x7f4eb006c6f0 2024-05-17T04:08:43.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.830+0000 7f4eadffb640 1 -- 172.21.15.150:0/3668217650 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea8031600 con 0x7f4eb006c6f0 2024-05-17T04:08:43.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.830+0000 7f4eadffb640 1 -- 172.21.15.150:0/3668217650 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea80319d0 con 0x7f4eb006c6f0 2024-05-17T04:08:43.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.831+0000 7f4eb552a640 1 -- 172.21.15.150:0/3668217650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb006c6f0 msgr2=0x7f4eb006cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.831+0000 7f4eb552a640 1 --2- 172.21.15.150:0/3668217650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb006c6f0 0x7f4eb006cb00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009e50 tx=0x7f4ea802a710 comp rx=0 tx=0).stop 2024-05-17T04:08:43.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.831+0000 7f4eb552a640 1 -- 172.21.15.150:0/3668217650 shutdown_connections 2024-05-17T04:08:43.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.831+0000 7f4eb552a640 1 --2- 172.21.15.150:0/3668217650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb006c6f0 0x7f4eb006cb00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.831+0000 7f4eb552a640 1 --2- 172.21.15.150:0/3668217650 >> v2:172.21.15.150:3300/0 conn(0x7f4eb015f7e0 0x7f4eb00b87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.832 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.831+0000 7f4eb552a640 1 -- 172.21.15.150:0/3668217650 >> 172.21.15.150:0/3668217650 conn(0x7f4eb00d5860 msgr2=0x7f4eb00d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:43.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.831+0000 7f4eb552a640 1 -- 172.21.15.150:0/3668217650 shutdown_connections 2024-05-17T04:08:43.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.831+0000 7f4eb552a640 1 -- 172.21.15.150:0/3668217650 wait complete. 2024-05-17T04:08:43.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.833+0000 7f4eb552a640 1 Processor -- start 2024-05-17T04:08:43.833 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.833+0000 7f4eb552a640 1 -- start start 2024-05-17T04:08:43.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eb552a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb006c6f0 0x7f4eb015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eb552a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4eb00d3e10 0x7f4eb00cede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eb552a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb015f7e0 0x7f4eb00c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:43.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eb552a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb00cfb20 con 0x7f4eb00d3e10 2024-05-17T04:08:43.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eb552a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb006d5b0 con 0x7f4eb006c6f0 2024-05-17T04:08:43.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eb552a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb00b8d30 con 0x7f4eb015f7e0 2024-05-17T04:08:43.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eaf7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb015f7e0 0x7f4eb00c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eaeffd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb006c6f0 0x7f4eb015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eaf7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb015f7e0 0x7f4eb00c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:46930/0 (socket says 172.21.15.150:46930) 2024-05-17T04:08:43.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eaf7fe640 1 -- 172.21.15.150:0/1666717244 learned_addr learned my addr 172.21.15.150:0/1666717244 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-17T04:08:43.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eae7fc640 1 --2- 172.21.15.150:0/1666717244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4eb00d3e10 0x7f4eb00cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:43.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eaf7fe640 1 -- 172.21.15.150:0/1666717244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb006c6f0 msgr2=0x7f4eb015aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eaf7fe640 1 --2- 172.21.15.150:0/1666717244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb006c6f0 0x7f4eb015aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eaf7fe640 1 -- 172.21.15.150:0/1666717244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4eb00d3e10 msgr2=0x7f4eb00cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eaf7fe640 1 --2- 172.21.15.150:0/1666717244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4eb00d3e10 0x7f4eb00cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.834+0000 7f4eaf7fe640 1 -- 172.21.15.150:0/1666717244 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb00cf320 con 0x7f4eb015f7e0 2024-05-17T04:08:43.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.835+0000 7f4eaf7fe640 1 --2- 172.21.15.150:0/1666717244 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb015f7e0 0x7f4eb00c9920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4ea802ad00 tx=0x7f4ea8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:43.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.835+0000 7f4ea77fe640 1 -- 172.21.15.150:0/1666717244 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8036030 con 0x7f4eb015f7e0 2024-05-17T04:08:43.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.835+0000 7f4ea77fe640 1 -- 172.21.15.150:0/1666717244 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea8040070 con 0x7f4eb015f7e0 2024-05-17T04:08:43.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.835+0000 7f4eb552a640 1 -- 172.21.15.150:0/1666717244 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb00cd840 con 0x7f4eb015f7e0 2024-05-17T04:08:43.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.835+0000 7f4ea77fe640 1 -- 172.21.15.150:0/1666717244 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8009510 con 0x7f4eb015f7e0 2024-05-17T04:08:43.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.835+0000 7f4eb552a640 1 -- 172.21.15.150:0/1666717244 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb00ce020 con 0x7f4eb015f7e0 2024-05-17T04:08:43.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.835+0000 7f4ea77fe640 1 -- 172.21.15.150:0/1666717244 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4ea8007bf0 con 0x7f4eb015f7e0 2024-05-17T04:08:43.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.835+0000 7f4ea77fe640 1 -- 172.21.15.150:0/1666717244 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f4ea8045be0 con 0x7f4eb015f7e0 2024-05-17T04:08:43.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.836+0000 7f4eb552a640 1 -- 172.21.15.150:0/1666717244 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb006cb00 con 0x7f4eb015f7e0 2024-05-17T04:08:43.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.838+0000 7f4ea77fe640 1 -- 172.21.15.150:0/1666717244 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f4eb00cf320 con 0x7f4eb015f7e0 2024-05-17T04:08:43.844 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:43.843+0000 7f656fc1b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-17T04:08:43.853 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:43.853+0000 7fbd2e321040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-17T04:08:43.886 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:43.885+0000 7f656fc1b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-17T04:08:43.898 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:43.898+0000 7fbd2e321040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-17T04:08:43.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.910+0000 7f4eb552a640 1 -- 172.21.15.150:0/1666717244 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bbc3c773-dd6d-4a5c-915d-70cd59896f5d", "id": 4} v 0) -- 0x7f4eb006d8d0 con 0x7f4eb015f7e0 2024-05-17T04:08:43.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.916+0000 7f4ea77fe640 1 -- 172.21.15.150:0/1666717244 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bbc3c773-dd6d-4a5c-915d-70cd59896f5d", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f4ea8045460 con 0x7f4eb015f7e0 2024-05-17T04:08:43.916 INFO:teuthology.orchestra.run.smithi150.stdout:4 2024-05-17T04:08:43.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.917+0000 7f4eb552a640 1 -- 172.21.15.150:0/1666717244 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb015f7e0 msgr2=0x7f4eb00c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:43.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.917+0000 7f4eb552a640 1 --2- 172.21.15.150:0/1666717244 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb015f7e0 0x7f4eb00c9920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4ea802ad00 tx=0x7f4ea8004a40 comp rx=0 tx=0).stop 2024-05-17T04:08:43.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.917+0000 7f4eb552a640 1 -- 172.21.15.150:0/1666717244 shutdown_connections 2024-05-17T04:08:43.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.917+0000 7f4eb552a640 1 --2- 172.21.15.150:0/1666717244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4eb00d3e10 0x7f4eb00cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.917+0000 7f4eb552a640 1 --2- 172.21.15.150:0/1666717244 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb015f7e0 0x7f4eb00c9920 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.917+0000 7f4eb552a640 1 --2- 172.21.15.150:0/1666717244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb006c6f0 0x7f4eb015aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:43.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.917+0000 7f4eb552a640 1 -- 172.21.15.150:0/1666717244 >> 172.21.15.150:0/1666717244 conn(0x7f4eb00d5860 msgr2=0x7f4eb015db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:43.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.917+0000 7f4eb552a640 1 -- 172.21.15.150:0/1666717244 shutdown_connections 2024-05-17T04:08:43.918 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:43.917+0000 7f4eb552a640 1 -- 172.21.15.150:0/1666717244 wait complete. 2024-05-17T04:08:43.928 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 9d1030bb-bf6f-4fee-b1ea-9a7c94a49488 5 2024-05-17T04:08:44.054 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:44.053+0000 7f656fc1b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-17T04:08:44.073 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:44.073+0000 7fbd2e321040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-17T04:08:44.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.078+0000 7fe94fac1640 1 Processor -- start 2024-05-17T04:08:44.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.078+0000 7fe94fac1640 1 -- start start 2024-05-17T04:08:44.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.079+0000 7fe94fac1640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe9480d2a60 0x7fe94815f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.079+0000 7fe94fac1640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe9480d0db0 0x7fe9480af680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.079+0000 7fe94fac1640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9480d14b0 con 0x7fe9480d05e0 2024-05-17T04:08:44.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.079+0000 7fe94fac1640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe9480d09f0 con 0x7fe9480d0db0 2024-05-17T04:08:44.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.079+0000 7fe94fac1640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe9480d1790 con 0x7fe9480d2a60 2024-05-17T04:08:44.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.079+0000 7fe94d05c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe9480d2a60 0x7fe94815f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.079+0000 7fe94d05c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe9480d2a60 0x7fe94815f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:32772/0 (socket says 172.21.15.150:32772) 2024-05-17T04:08:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.079+0000 7fe94d05c640 1 -- 172.21.15.150:0/373023464 learned_addr learned my addr 172.21.15.150:0/373023464 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-17T04:08:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.079+0000 7fe94e05e640 1 --2- 172.21.15.150:0/373023464 >> v2:172.21.15.131:3300/0 conn(0x7fe9480d0db0 0x7fe9480af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.080+0000 7fe94d05c640 1 -- 172.21.15.150:0/373023464 >> v2:172.21.15.131:3300/0 conn(0x7fe9480d0db0 msgr2=0x7fe9480af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:08:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.080+0000 7fe94d05c640 1 --2- 172.21.15.150:0/373023464 >> v2:172.21.15.131:3300/0 conn(0x7fe9480d0db0 0x7fe9480af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.080+0000 7fe94d05c640 1 -- 172.21.15.150:0/373023464 >> v1:172.21.15.150:6789/0 conn(0x7fe9480d05e0 legacy=0x7fe9480d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.080+0000 7fe94d05c640 1 -- 172.21.15.150:0/373023464 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9480d1a70 con 0x7fe9480d2a60 2024-05-17T04:08:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.080+0000 7fe94c85b640 1 -- 172.21.15.150:0/373023464 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 322678665 0 0) 0x7fe9480d14b0 con 0x7fe9480d05e0 2024-05-17T04:08:44.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.080+0000 7fe94d05c640 1 --2- 172.21.15.150:0/373023464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9480d2a60 0x7fe94815f5a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe9480ceb80 tx=0x7fe94402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b86ee4180ecc152 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:44.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.081+0000 7fe94c85b640 1 -- 172.21.15.150:0/373023464 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944037070 con 0x7fe9480d2a60 2024-05-17T04:08:44.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.081+0000 7fe94c85b640 1 -- 172.21.15.150:0/373023464 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe944032440 con 0x7fe9480d2a60 2024-05-17T04:08:44.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.081+0000 7fe94c85b640 1 -- 172.21.15.150:0/373023464 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944032810 con 0x7fe9480d2a60 2024-05-17T04:08:44.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.081+0000 7fe94fac1640 1 -- 172.21.15.150:0/373023464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9480d2a60 msgr2=0x7fe94815f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.081+0000 7fe94fac1640 1 --2- 172.21.15.150:0/373023464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9480d2a60 0x7fe94815f5a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe9480ceb80 tx=0x7fe94402a270 comp rx=0 tx=0).stop 2024-05-17T04:08:44.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.081+0000 7fe94fac1640 1 -- 172.21.15.150:0/373023464 shutdown_connections 2024-05-17T04:08:44.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.082+0000 7fe94fac1640 1 --2- 172.21.15.150:0/373023464 >> v2:172.21.15.131:3300/0 conn(0x7fe9480d0db0 0x7fe9480af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.082+0000 7fe94fac1640 1 --2- 172.21.15.150:0/373023464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9480d2a60 0x7fe94815f5a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.082+0000 7fe94fac1640 1 -- 172.21.15.150:0/373023464 >> 172.21.15.150:0/373023464 conn(0x7fe9480b4250 msgr2=0x7fe9480b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:44.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.082+0000 7fe94fac1640 1 -- 172.21.15.150:0/373023464 shutdown_connections 2024-05-17T04:08:44.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.082+0000 7fe94fac1640 1 -- 172.21.15.150:0/373023464 wait complete. 2024-05-17T04:08:44.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.083+0000 7fe94fac1640 1 Processor -- start 2024-05-17T04:08:44.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.083+0000 7fe94fac1640 1 -- start start 2024-05-17T04:08:44.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94fac1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9480d05e0 0x7fe948156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94fac1640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9480d0db0 0x7fe948158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94fac1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe948158ac0 0x7fe94806e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94fac1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe9480af0f0 con 0x7fe948158ac0 2024-05-17T04:08:44.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94fac1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe9480d11c0 con 0x7fe9480d05e0 2024-05-17T04:08:44.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94fac1640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe9480afbc0 con 0x7fe9480d0db0 2024-05-17T04:08:44.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94d85d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9480d05e0 0x7fe948156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94d05c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9480d0db0 0x7fe948158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94d85d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9480d05e0 0x7fe948156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:32780/0 (socket says 172.21.15.150:32780) 2024-05-17T04:08:44.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94d85d640 1 -- 172.21.15.150:0/4131760200 learned_addr learned my addr 172.21.15.150:0/4131760200 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-17T04:08:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94e05e640 1 --2- 172.21.15.150:0/4131760200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe948158ac0 0x7fe94806e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94d85d640 1 -- 172.21.15.150:0/4131760200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9480d0db0 msgr2=0x7fe948158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94d85d640 1 --2- 172.21.15.150:0/4131760200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9480d0db0 0x7fe948158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94d85d640 1 -- 172.21.15.150:0/4131760200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe948158ac0 msgr2=0x7fe94806e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94d85d640 1 --2- 172.21.15.150:0/4131760200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe948158ac0 0x7fe94806e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94d85d640 1 -- 172.21.15.150:0/4131760200 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9481f5140 con 0x7fe9480d05e0 2024-05-17T04:08:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe94d85d640 1 --2- 172.21.15.150:0/4131760200 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9480d05e0 0x7fe948156cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe93800c3c0 tx=0x7fe93800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe93e7fc640 1 -- 172.21.15.150:0/4131760200 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe938017070 con 0x7fe9480d05e0 2024-05-17T04:08:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe93e7fc640 1 -- 172.21.15.150:0/4131760200 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9380035f0 con 0x7fe9480d05e0 2024-05-17T04:08:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.085+0000 7fe93e7fc640 1 -- 172.21.15.150:0/4131760200 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe938003a20 con 0x7fe9480d05e0 2024-05-17T04:08:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.086+0000 7fe94fac1640 1 -- 172.21.15.150:0/4131760200 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe948158ed0 con 0x7fe9480d05e0 2024-05-17T04:08:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.086+0000 7fe94fac1640 1 -- 172.21.15.150:0/4131760200 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe948160370 con 0x7fe9480d05e0 2024-05-17T04:08:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.086+0000 7fe93e7fc640 1 -- 172.21.15.150:0/4131760200 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe93801a070 con 0x7fe9480d05e0 2024-05-17T04:08:44.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.086+0000 7fe93e7fc640 1 -- 172.21.15.150:0/4131760200 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fe938012980 con 0x7fe9480d05e0 2024-05-17T04:08:44.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.087+0000 7fe94fac1640 1 -- 172.21.15.150:0/4131760200 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9480746b0 con 0x7fe9480d05e0 2024-05-17T04:08:44.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.089+0000 7fe93e7fc640 1 -- 172.21.15.150:0/4131760200 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe9480746b0 con 0x7fe9480d05e0 2024-05-17T04:08:44.102 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:44.101+0000 7f656fc1b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-17T04:08:44.124 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:44.124+0000 7fbd2e321040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-17T04:08:44.155 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:44.154+0000 7f656fc1b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-17T04:08:44.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.161+0000 7fe94fac1640 1 -- 172.21.15.150:0/4131760200 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9d1030bb-bf6f-4fee-b1ea-9a7c94a49488", "id": 5} v 0) -- 0x7fe9480af680 con 0x7fe9480d05e0 2024-05-17T04:08:44.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.164+0000 7fe93e7fc640 1 -- 172.21.15.150:0/4131760200 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d1030bb-bf6f-4fee-b1ea-9a7c94a49488", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fe938021020 con 0x7fe9480d05e0 2024-05-17T04:08:44.164 INFO:teuthology.orchestra.run.smithi150.stdout:5 2024-05-17T04:08:44.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.165+0000 7fe94fac1640 1 -- 172.21.15.150:0/4131760200 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9480d05e0 msgr2=0x7fe948156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.165+0000 7fe94fac1640 1 --2- 172.21.15.150:0/4131760200 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9480d05e0 0x7fe948156cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe93800c3c0 tx=0x7fe93800c880 comp rx=0 tx=0).stop 2024-05-17T04:08:44.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.165+0000 7fe94fac1640 1 -- 172.21.15.150:0/4131760200 shutdown_connections 2024-05-17T04:08:44.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.165+0000 7fe94fac1640 1 --2- 172.21.15.150:0/4131760200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe948158ac0 0x7fe94806e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.166+0000 7fe94fac1640 1 --2- 172.21.15.150:0/4131760200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9480d0db0 0x7fe948158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.166+0000 7fe94fac1640 1 --2- 172.21.15.150:0/4131760200 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9480d05e0 0x7fe948156cd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.166+0000 7fe94fac1640 1 -- 172.21.15.150:0/4131760200 >> 172.21.15.150:0/4131760200 conn(0x7fe9480b4250 msgr2=0x7fe94815ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:44.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.166+0000 7fe94fac1640 1 -- 172.21.15.150:0/4131760200 shutdown_connections 2024-05-17T04:08:44.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.166+0000 7fe94fac1640 1 -- 172.21.15.150:0/4131760200 wait complete. 2024-05-17T04:08:44.180 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new c8dc3f80-e552-424b-8faa-218fb03cd631 6 2024-05-17T04:08:44.185 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:44.185+0000 7fbd2e321040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-17T04:08:44.268 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:44.267+0000 7f656fc1b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-17T04:08:44.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.289+0000 7f15de32a640 1 Processor -- start 2024-05-17T04:08:44.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.289+0000 7f15de32a640 1 -- start start 2024-05-17T04:08:44.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.291+0000 7f15de32a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f15d815f5a0 0x7f15d80d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.291+0000 7f15de32a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d815f9b0 con 0x7f15d80d05e0 2024-05-17T04:08:44.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.291+0000 7f15de32a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d80d14b0 con 0x7f15d80d2a60 2024-05-17T04:08:44.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.291+0000 7f15de32a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f15d80d09f0 con 0x7f15d815f5a0 2024-05-17T04:08:44.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.291+0000 7f15d77fe640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f15d80d2a60 0x7f15d80af680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43976/0 (socket says 172.21.15.150:43976) 2024-05-17T04:08:44.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.291+0000 7f15d77fe640 1 -- 172.21.15.150:0/1881732019 learned_addr learned my addr 172.21.15.150:0/1881732019 (peer_addr_for_me v1:172.21.15.150:0/0) 2024-05-17T04:08:44.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.291+0000 7f15dc8c7640 1 --2- 172.21.15.150:0/1881732019 >> v2:172.21.15.131:3300/0 conn(0x7f15d815f5a0 0x7f15d80d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.291+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 902166870 0 0) 0x7f15d80d14b0 con 0x7f15d80d2a60 2024-05-17T04:08:44.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.291+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15c4003520 con 0x7f15d80d2a60 2024-05-17T04:08:44.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.291+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3754145039 0 0) 0x7f15c8001110 con 0x7f15d80d05e0 2024-05-17T04:08:44.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.291+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15d80d14b0 con 0x7f15d80d05e0 2024-05-17T04:08:44.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.291+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1333712732 0 0) 0x7f15c4003520 con 0x7f15d80d2a60 2024-05-17T04:08:44.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 >> v2:172.21.15.131:3300/0 conn(0x7f15d815f5a0 msgr2=0x7f15d80d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:08:44.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d6ffd640 1 --2- 172.21.15.150:0/1881732019 >> v2:172.21.15.131:3300/0 conn(0x7f15d815f5a0 0x7f15d80d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 >> v1:172.21.15.131:6789/0 conn(0x7f15d80d05e0 legacy=0x7f15d80d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d80d1790 con 0x7f15d80d2a60 2024-05-17T04:08:44.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7f15c00016f0 con 0x7f15d80d2a60 2024-05-17T04:08:44.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 >> v1:172.21.15.150:6789/0 conn(0x7f15d80d2a60 legacy=0x7f15d80af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d6ffd640 1 --2- 172.21.15.150:0/1881732019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15c4003c30 0x7f15c4004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d6ffd640 1 --2- 172.21.15.150:0/1881732019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4004800 0x7f15c4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d6ffd640 1 --2- 172.21.15.150:0/1881732019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15c4005280 0x7f15c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f15d80d09f0 con 0x7f15c4004800 2024-05-17T04:08:44.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f15c400c230 con 0x7f15c4005280 2024-05-17T04:08:44.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f15c400c430 con 0x7f15c4003c30 2024-05-17T04:08:44.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d77fe640 1 --2- 172.21.15.150:0/1881732019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4004800 0x7f15c4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d7fff640 1 --2- 172.21.15.150:0/1881732019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15c4003c30 0x7f15c4004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15dc8c7640 1 --2- 172.21.15.150:0/1881732019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15c4005280 0x7f15c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d77fe640 1 -- 172.21.15.150:0/1881732019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15c4003c30 msgr2=0x7f15c4004080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:08:44.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d77fe640 1 --2- 172.21.15.150:0/1881732019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15c4003c30 0x7f15c4004080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d77fe640 1 -- 172.21.15.150:0/1881732019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15c4005280 msgr2=0x7f15c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:08:44.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d77fe640 1 --2- 172.21.15.150:0/1881732019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15c4005280 0x7f15c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15d77fe640 1 -- 172.21.15.150:0/1881732019 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c4003520 con 0x7f15c4004800 2024-05-17T04:08:44.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.292+0000 7f15dc8c7640 1 -- 172.21.15.150:0/1881732019 reap_dead start 2024-05-17T04:08:44.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.293+0000 7f15d77fe640 1 --2- 172.21.15.150:0/1881732019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4004800 0x7f15c4004c10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f15d8070640 tx=0x7f15c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708f1c60c4e592be server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:44.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.293+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0007ca0 con 0x7f15c4004800 2024-05-17T04:08:44.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.293+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c0005ad0 con 0x7f15c4004800 2024-05-17T04:08:44.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.293+0000 7f15d6ffd640 1 -- 172.21.15.150:0/1881732019 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0007070 con 0x7f15c4004800 2024-05-17T04:08:44.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.294+0000 7f15de32a640 1 -- 172.21.15.150:0/1881732019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4004800 msgr2=0x7f15c4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.294+0000 7f15de32a640 1 --2- 172.21.15.150:0/1881732019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4004800 0x7f15c4004c10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f15d8070640 tx=0x7f15c4005830 comp rx=0 tx=0).stop 2024-05-17T04:08:44.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.294+0000 7f15de32a640 1 -- 172.21.15.150:0/1881732019 shutdown_connections 2024-05-17T04:08:44.297 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.294+0000 7f15de32a640 1 --2- 172.21.15.150:0/1881732019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4004800 0x7f15c4004c10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.294+0000 7f15de32a640 1 -- 172.21.15.150:0/1881732019 >> 172.21.15.150:0/1881732019 conn(0x7f15d80b4250 msgr2=0x7f15d80b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:44.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.294+0000 7f15de32a640 1 -- 172.21.15.150:0/1881732019 shutdown_connections 2024-05-17T04:08:44.298 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.294+0000 7f15de32a640 1 -- 172.21.15.150:0/1881732019 wait complete. 2024-05-17T04:08:44.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.296+0000 7f15de32a640 1 Processor -- start 2024-05-17T04:08:44.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.296+0000 7f15de32a640 1 -- start start 2024-05-17T04:08:44.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.297+0000 7f15de32a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4004800 0x7f15d81619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.297+0000 7f15de32a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15d8152670 0x7f15d8154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.297+0000 7f15de32a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15d8155300 0x7f15d81531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.297+0000 7f15de32a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f15d80af0f0 con 0x7f15c4004800 2024-05-17T04:08:44.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.297+0000 7f15de32a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f15d80d1d50 con 0x7f15d8152670 2024-05-17T04:08:44.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.297+0000 7f15de32a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f15d80d0db0 con 0x7f15d8155300 2024-05-17T04:08:44.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.297+0000 7f15d77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15d8152670 0x7f15d8154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.297+0000 7f15d77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15d8152670 0x7f15d8154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:32798/0 (socket says 172.21.15.150:32798) 2024-05-17T04:08:44.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.297+0000 7f15d77fe640 1 -- 172.21.15.150:0/358899403 learned_addr learned my addr 172.21.15.150:0/358899403 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-17T04:08:44.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.297+0000 7f15dc8c7640 1 --2- 172.21.15.150:0/358899403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15d8155300 0x7f15d81531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.297+0000 7f15d7fff640 1 --2- 172.21.15.150:0/358899403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4004800 0x7f15d81619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.298+0000 7f15d77fe640 1 -- 172.21.15.150:0/358899403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15d8155300 msgr2=0x7f15d81531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.298+0000 7f15d77fe640 1 --2- 172.21.15.150:0/358899403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15d8155300 0x7f15d81531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.298+0000 7f15d77fe640 1 -- 172.21.15.150:0/358899403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4004800 msgr2=0x7f15d81619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.298+0000 7f15d77fe640 1 --2- 172.21.15.150:0/358899403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4004800 0x7f15d81619a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.298+0000 7f15d77fe640 1 -- 172.21.15.150:0/358899403 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d8155710 con 0x7f15d8152670 2024-05-17T04:08:44.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.298+0000 7f15d7fff640 1 --2- 172.21.15.150:0/358899403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4004800 0x7f15d81619a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:08:44.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.298+0000 7f15d77fe640 1 --2- 172.21.15.150:0/358899403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15d8152670 0x7f15d8154dc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f15c000c220 tx=0x7f15d80d1960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:44.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.298+0000 7f15d4ff9640 1 -- 172.21.15.150:0/358899403 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0037040 con 0x7f15d8152670 2024-05-17T04:08:44.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.298+0000 7f15d4ff9640 1 -- 172.21.15.150:0/358899403 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c0041070 con 0x7f15d8152670 2024-05-17T04:08:44.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.298+0000 7f15d4ff9640 1 -- 172.21.15.150:0/358899403 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c00047e0 con 0x7f15d8152670 2024-05-17T04:08:44.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.298+0000 7f15de32a640 1 -- 172.21.15.150:0/358899403 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d8157fb0 con 0x7f15d8152670 2024-05-17T04:08:44.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.298+0000 7f15de32a640 1 -- 172.21.15.150:0/358899403 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d8158570 con 0x7f15d8152670 2024-05-17T04:08:44.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.298+0000 7f15d4ff9640 1 -- 172.21.15.150:0/358899403 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f15c0004d10 con 0x7f15d8152670 2024-05-17T04:08:44.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.298+0000 7f15d4ff9640 1 -- 172.21.15.150:0/358899403 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f15c0032de0 con 0x7f15d8152670 2024-05-17T04:08:44.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.299+0000 7f15de32a640 1 -- 172.21.15.150:0/358899403 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d80d1140 con 0x7f15d8152670 2024-05-17T04:08:44.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.301+0000 7f15d4ff9640 1 -- 172.21.15.150:0/358899403 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f15d8155710 con 0x7f15d8152670 2024-05-17T04:08:44.306 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:44.306+0000 7fbd2e321040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-17T04:08:44.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.374+0000 7f15de32a640 1 -- 172.21.15.150:0/358899403 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c8dc3f80-e552-424b-8faa-218fb03cd631", "id": 6} v 0) -- 0x7f15d8157cd0 con 0x7f15d8152670 2024-05-17T04:08:44.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.382+0000 7f15d4ff9640 1 -- 172.21.15.150:0/358899403 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c8dc3f80-e552-424b-8faa-218fb03cd631", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f15c00327f0 con 0x7f15d8152670 2024-05-17T04:08:44.382 INFO:teuthology.orchestra.run.smithi150.stdout:6 2024-05-17T04:08:44.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.383+0000 7f15de32a640 1 -- 172.21.15.150:0/358899403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15d8152670 msgr2=0x7f15d8154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.383+0000 7f15de32a640 1 --2- 172.21.15.150:0/358899403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15d8152670 0x7f15d8154dc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f15c000c220 tx=0x7f15d80d1960 comp rx=0 tx=0).stop 2024-05-17T04:08:44.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.383+0000 7f15de32a640 1 -- 172.21.15.150:0/358899403 shutdown_connections 2024-05-17T04:08:44.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.383+0000 7f15de32a640 1 --2- 172.21.15.150:0/358899403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15d8155300 0x7f15d81531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.383+0000 7f15de32a640 1 --2- 172.21.15.150:0/358899403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15d8152670 0x7f15d8154dc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.383+0000 7f15de32a640 1 --2- 172.21.15.150:0/358899403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4004800 0x7f15d81619a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.383+0000 7f15de32a640 1 -- 172.21.15.150:0/358899403 >> 172.21.15.150:0/358899403 conn(0x7f15d80b4250 msgr2=0x7f15d815cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:44.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.383+0000 7f15de32a640 1 -- 172.21.15.150:0/358899403 shutdown_connections 2024-05-17T04:08:44.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.383+0000 7f15de32a640 1 -- 172.21.15.150:0/358899403 wait complete. 2024-05-17T04:08:44.395 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new a70e8c9d-e153-4858-bd65-f1097433f8e4 7 2024-05-17T04:08:44.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.547+0000 7f0be7531640 1 Processor -- start 2024-05-17T04:08:44.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.547+0000 7f0be7531640 1 -- start start 2024-05-17T04:08:44.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.548+0000 7f0be7531640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0be0073dd0 0x7f0be0163190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.548+0000 7f0be7531640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0be0144e80 con 0x7f0be00d0ee0 2024-05-17T04:08:44.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.548+0000 7f0be7531640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0be00b6990 con 0x7f0be01458f0 2024-05-17T04:08:44.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.548+0000 7f0be7531640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f0be0145d00 con 0x7f0be0073dd0 2024-05-17T04:08:44.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.549+0000 7f0be4acc640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0be01458f0 0x7f0be00736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:43984/0 (socket says 172.21.15.150:43984) 2024-05-17T04:08:44.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.549+0000 7f0be4acc640 1 -- 172.21.15.150:0/1933755931 learned_addr learned my addr 172.21.15.150:0/1933755931 (peer_addr_for_me v1:172.21.15.150:0/0) 2024-05-17T04:08:44.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.549+0000 7f0be5ace640 1 --2- 172.21.15.150:0/1933755931 >> v2:172.21.15.150:3300/0 conn(0x7f0be0073dd0 0x7f0be0163190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.549+0000 7f0be5ace640 1 -- 172.21.15.150:0/1933755931 >> v1:172.21.15.150:6789/0 conn(0x7f0be01458f0 legacy=0x7f0be00736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.549+0000 7f0be5ace640 1 -- 172.21.15.150:0/1933755931 >> v1:172.21.15.131:6789/0 conn(0x7f0be00d0ee0 legacy=0x7f0be00b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.549+0000 7f0be5ace640 1 -- 172.21.15.150:0/1933755931 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be01450f0 con 0x7f0be0073dd0 2024-05-17T04:08:44.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.550+0000 7f0be5ace640 1 --2- 172.21.15.150:0/1933755931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be0073dd0 0x7f0be0163190 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009d90 tx=0x7f0bd802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b45a2d61c74d0a84 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:44.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.550+0000 7f0bd7fff640 1 -- 172.21.15.150:0/1933755931 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8007740 con 0x7f0be0073dd0 2024-05-17T04:08:44.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.550+0000 7f0bd7fff640 1 -- 172.21.15.150:0/1933755931 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd80078e0 con 0x7f0be0073dd0 2024-05-17T04:08:44.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.550+0000 7f0bd7fff640 1 -- 172.21.15.150:0/1933755931 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8007cb0 con 0x7f0be0073dd0 2024-05-17T04:08:44.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.550+0000 7f0be7531640 1 -- 172.21.15.150:0/1933755931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be0073dd0 msgr2=0x7f0be0163190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.550+0000 7f0be7531640 1 --2- 172.21.15.150:0/1933755931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be0073dd0 0x7f0be0163190 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009d90 tx=0x7f0bd802a6f0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.551+0000 7f0be7531640 1 -- 172.21.15.150:0/1933755931 shutdown_connections 2024-05-17T04:08:44.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.551+0000 7f0be7531640 1 --2- 172.21.15.150:0/1933755931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be0073dd0 0x7f0be0163190 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.551+0000 7f0be7531640 1 -- 172.21.15.150:0/1933755931 >> 172.21.15.150:0/1933755931 conn(0x7f0be00d2140 msgr2=0x7f0be0072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:44.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.551+0000 7f0be7531640 1 -- 172.21.15.150:0/1933755931 shutdown_connections 2024-05-17T04:08:44.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.551+0000 7f0be7531640 1 -- 172.21.15.150:0/1933755931 wait complete. 2024-05-17T04:08:44.552 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.552+0000 7f0be7531640 1 Processor -- start 2024-05-17T04:08:44.553 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.552+0000 7f0be7531640 1 -- start start 2024-05-17T04:08:44.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be7531640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be00d0ee0 0x7f0be01e8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be7531640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0be01458f0 0x7f0be01622d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be7531640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be0148a50 0x7f0be0140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be7531640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0be0148f20 con 0x7f0be00d0ee0 2024-05-17T04:08:44.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be7531640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0be00b6c70 con 0x7f0be0148a50 2024-05-17T04:08:44.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be7531640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0be00b65e0 con 0x7f0be01458f0 2024-05-17T04:08:44.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be5ace640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be0148a50 0x7f0be0140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be4acc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0be01458f0 0x7f0be01622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be5ace640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be0148a50 0x7f0be0140930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:32824/0 (socket says 172.21.15.150:32824) 2024-05-17T04:08:44.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be4acc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0be01458f0 0x7f0be01622d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:46964/0 (socket says 172.21.15.150:46964) 2024-05-17T04:08:44.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be5ace640 1 -- 172.21.15.150:0/2148716713 learned_addr learned my addr 172.21.15.150:0/2148716713 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-17T04:08:44.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be52cd640 1 --2- 172.21.15.150:0/2148716713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be00d0ee0 0x7f0be01e8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be5ace640 1 -- 172.21.15.150:0/2148716713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0be01458f0 msgr2=0x7f0be01622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be5ace640 1 --2- 172.21.15.150:0/2148716713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0be01458f0 0x7f0be01622d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be5ace640 1 -- 172.21.15.150:0/2148716713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be00d0ee0 msgr2=0x7f0be01e8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be5ace640 1 --2- 172.21.15.150:0/2148716713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be00d0ee0 0x7f0be01e8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be5ace640 1 -- 172.21.15.150:0/2148716713 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be01e9010 con 0x7f0be0148a50 2024-05-17T04:08:44.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be4acc640 1 --2- 172.21.15.150:0/2148716713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0be01458f0 0x7f0be01622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:08:44.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0be5ace640 1 --2- 172.21.15.150:0/2148716713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be0148a50 0x7f0be0140930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009eb0 tx=0x7f0bd8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:44.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.554+0000 7f0bd5ffb640 1 -- 172.21.15.150:0/2148716713 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd803f070 con 0x7f0be0148a50 2024-05-17T04:08:44.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.555+0000 7f0bd5ffb640 1 -- 172.21.15.150:0/2148716713 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd8031c90 con 0x7f0be0148a50 2024-05-17T04:08:44.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.555+0000 7f0bd5ffb640 1 -- 172.21.15.150:0/2148716713 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8044680 con 0x7f0be0148a50 2024-05-17T04:08:44.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.555+0000 7f0be7531640 1 -- 172.21.15.150:0/2148716713 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be0161230 con 0x7f0be0148a50 2024-05-17T04:08:44.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.555+0000 7f0be7531640 1 -- 172.21.15.150:0/2148716713 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be01617f0 con 0x7f0be0148a50 2024-05-17T04:08:44.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.555+0000 7f0bd5ffb640 1 -- 172.21.15.150:0/2148716713 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0bd8044820 con 0x7f0be0148a50 2024-05-17T04:08:44.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.555+0000 7f0bd5ffb640 1 -- 172.21.15.150:0/2148716713 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f0bd803bde0 con 0x7f0be0148a50 2024-05-17T04:08:44.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.556+0000 7f0be7531640 1 -- 172.21.15.150:0/2148716713 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be0144ca0 con 0x7f0be0148a50 2024-05-17T04:08:44.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.558+0000 7f0bd5ffb640 1 -- 172.21.15.150:0/2148716713 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0be0144ca0 con 0x7f0be0148a50 2024-05-17T04:08:44.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.631+0000 7f0be7531640 1 -- 172.21.15.150:0/2148716713 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a70e8c9d-e153-4858-bd65-f1097433f8e4", "id": 7} v 0) -- 0x7f0be0160f50 con 0x7f0be0148a50 2024-05-17T04:08:44.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.639+0000 7f0bd5ffb640 1 -- 172.21.15.150:0/2148716713 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a70e8c9d-e153-4858-bd65-f1097433f8e4", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f0bd8007840 con 0x7f0be0148a50 2024-05-17T04:08:44.639 INFO:teuthology.orchestra.run.smithi150.stdout:7 2024-05-17T04:08:44.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.640+0000 7f0be7531640 1 -- 172.21.15.150:0/2148716713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be0148a50 msgr2=0x7f0be0140930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.640+0000 7f0be7531640 1 --2- 172.21.15.150:0/2148716713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be0148a50 0x7f0be0140930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009eb0 tx=0x7f0bd8004a40 comp rx=0 tx=0).stop 2024-05-17T04:08:44.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.640+0000 7f0be7531640 1 -- 172.21.15.150:0/2148716713 shutdown_connections 2024-05-17T04:08:44.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.640+0000 7f0be7531640 1 --2- 172.21.15.150:0/2148716713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be0148a50 0x7f0be0140930 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.640+0000 7f0be7531640 1 --2- 172.21.15.150:0/2148716713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0be01458f0 0x7f0be01622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.640+0000 7f0be7531640 1 --2- 172.21.15.150:0/2148716713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be00d0ee0 0x7f0be01e8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.640+0000 7f0be7531640 1 -- 172.21.15.150:0/2148716713 >> 172.21.15.150:0/2148716713 conn(0x7f0be00d2140 msgr2=0x7f0be0072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:44.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.640+0000 7f0be7531640 1 -- 172.21.15.150:0/2148716713 shutdown_connections 2024-05-17T04:08:44.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:08:44.640+0000 7f0be7531640 1 -- 172.21.15.150:0/2148716713 wait complete. 2024-05-17T04:08:44.650 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:44.650+0000 7f656fc1b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-17T04:08:44.651 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-17T04:08:44.652 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-17T04:08:44.654 INFO:tasks.ceph.osd.0:Started 2024-05-17T04:08:44.654 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-17T04:08:44.654 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-17T04:08:44.656 INFO:tasks.ceph.osd.1:Started 2024-05-17T04:08:44.656 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-17T04:08:44.657 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-17T04:08:44.659 INFO:tasks.ceph.osd.2:Started 2024-05-17T04:08:44.662 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-17T04:08:44.662 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-17T04:08:44.664 INFO:tasks.ceph.osd.3:Started 2024-05-17T04:08:44.664 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-17T04:08:44.664 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-17T04:08:44.666 INFO:tasks.ceph.osd.4:Started 2024-05-17T04:08:44.666 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-17T04:08:44.667 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-17T04:08:44.668 INFO:tasks.ceph.osd.5:Started 2024-05-17T04:08:44.669 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-17T04:08:44.669 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-17T04:08:44.670 INFO:tasks.ceph.osd.6:Started 2024-05-17T04:08:44.671 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-17T04:08:44.671 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-17T04:08:44.673 INFO:tasks.ceph.osd.7:Started 2024-05-17T04:08:44.674 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:08:44.745 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:44.744+0000 7fbd2e321040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-17T04:08:44.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.811+0000 7f3c52074640 1 Processor -- start 2024-05-17T04:08:44.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.811+0000 7f3c52074640 1 -- start start 2024-05-17T04:08:44.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.812+0000 7f3c52074640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c4c0d2450 0x7f3c4c0d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.812+0000 7f3c52074640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3c4c06e930 0x7f3c4c06ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.812+0000 7f3c52074640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4c0d2da0 con 0x7f3c4c073880 2024-05-17T04:08:44.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.812+0000 7f3c52074640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f3c4c06f6d0 con 0x7f3c4c06e930 2024-05-17T04:08:44.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.812+0000 7f3c52074640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3c4c06f9b0 con 0x7f3c4c0d2450 2024-05-17T04:08:44.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.813+0000 7f3c4affd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3c4c06e930 0x7f3c4c06ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.813+0000 7f3c4bfff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f3c4c073880 0x7f3c4c073c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:48594/0 (socket says 172.21.15.131:48594) 2024-05-17T04:08:44.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.813+0000 7f3c4bfff640 1 -- 172.21.15.131:0/695242337 learned_addr learned my addr 172.21.15.131:0/695242337 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:08:44.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.813+0000 7f3c4b7fe640 1 --2- 172.21.15.131:0/695242337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c4c0d2450 0x7f3c4c0d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.813+0000 7f3c4affd640 1 -- 172.21.15.131:0/695242337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c4c0d2450 msgr2=0x7f3c4c0d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:08:44.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.813+0000 7f3c4affd640 1 --2- 172.21.15.131:0/695242337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c4c0d2450 0x7f3c4c0d2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.813+0000 7f3c4a7fc640 1 -- 172.21.15.131:0/695242337 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503385455 0 0) 0x7f3c4c0d2da0 con 0x7f3c4c073880 2024-05-17T04:08:44.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.813+0000 7f3c4affd640 1 -- 172.21.15.131:0/695242337 >> v1:172.21.15.131:6789/0 conn(0x7f3c4c073880 legacy=0x7f3c4c073c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.813+0000 7f3c4affd640 1 -- 172.21.15.131:0/695242337 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c06fc90 con 0x7f3c4c06e930 2024-05-17T04:08:44.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.814+0000 7f3c4affd640 1 --2- 172.21.15.131:0/695242337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c4c06e930 0x7f3c4c06ed40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009d90 tx=0x7f3c4002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f3e8480660653f server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:44.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.814+0000 7f3c4a7fc640 1 -- 172.21.15.131:0/695242337 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c40031600 con 0x7f3c4c06e930 2024-05-17T04:08:44.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.814+0000 7f3c4a7fc640 1 -- 172.21.15.131:0/695242337 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c400317a0 con 0x7f3c4c06e930 2024-05-17T04:08:44.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.814+0000 7f3c4a7fc640 1 -- 172.21.15.131:0/695242337 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c40031b70 con 0x7f3c4c06e930 2024-05-17T04:08:44.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.815+0000 7f3c52074640 1 -- 172.21.15.131:0/695242337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c4c06e930 msgr2=0x7f3c4c06ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.815+0000 7f3c52074640 1 --2- 172.21.15.131:0/695242337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c4c06e930 0x7f3c4c06ed40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009d90 tx=0x7f3c4002a5d0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.815+0000 7f3c52074640 1 -- 172.21.15.131:0/695242337 shutdown_connections 2024-05-17T04:08:44.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.815+0000 7f3c52074640 1 --2- 172.21.15.131:0/695242337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c4c06e930 0x7f3c4c06ed40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.815+0000 7f3c52074640 1 --2- 172.21.15.131:0/695242337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c4c0d2450 0x7f3c4c0d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.815+0000 7f3c52074640 1 -- 172.21.15.131:0/695242337 >> 172.21.15.131:0/695242337 conn(0x7f3c4c0b4250 msgr2=0x7f3c4c0b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:44.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.815+0000 7f3c52074640 1 -- 172.21.15.131:0/695242337 shutdown_connections 2024-05-17T04:08:44.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.815+0000 7f3c52074640 1 -- 172.21.15.131:0/695242337 wait complete. 2024-05-17T04:08:44.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.817+0000 7f3c52074640 1 Processor -- start 2024-05-17T04:08:44.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.817+0000 7f3c52074640 1 -- start start 2024-05-17T04:08:44.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.818+0000 7f3c52074640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c4c06e930 0x7f3c4c14ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.818+0000 7f3c52074640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c4c073880 0x7f3c4c148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.818+0000 7f3c52074640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c4c0d2450 0x7f3c4c146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:44.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.818+0000 7f3c52074640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c06f400 con 0x7f3c4c06e930 2024-05-17T04:08:44.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.818+0000 7f3c52074640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c06f280 con 0x7f3c4c073880 2024-05-17T04:08:44.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.818+0000 7f3c4b7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c4c06e930 0x7f3c4c14ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c52074640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3c4c15c650 con 0x7f3c4c0d2450 2024-05-17T04:08:44.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c4b7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c4c06e930 0x7f3c4c14ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44132/0 (socket says 172.21.15.131:44132) 2024-05-17T04:08:44.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c4b7fe640 1 -- 172.21.15.131:0/3309921338 learned_addr learned my addr 172.21.15.131:0/3309921338 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:08:44.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c4affd640 1 --2- 172.21.15.131:0/3309921338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c4c073880 0x7f3c4c148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c4bfff640 1 --2- 172.21.15.131:0/3309921338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c4c0d2450 0x7f3c4c146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:44.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c4affd640 1 -- 172.21.15.131:0/3309921338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c4c0d2450 msgr2=0x7f3c4c146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c4affd640 1 --2- 172.21.15.131:0/3309921338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c4c0d2450 0x7f3c4c146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c4affd640 1 -- 172.21.15.131:0/3309921338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c4c06e930 msgr2=0x7f3c4c14ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c4affd640 1 --2- 172.21.15.131:0/3309921338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c4c06e930 0x7f3c4c14ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c4affd640 1 -- 172.21.15.131:0/3309921338 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c15e150 con 0x7f3c4c073880 2024-05-17T04:08:44.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c4b7fe640 1 --2- 172.21.15.131:0/3309921338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c4c06e930 0x7f3c4c14ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:08:44.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c4affd640 1 --2- 172.21.15.131:0/3309921338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c4c073880 0x7f3c4c148ca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3c40031000 tx=0x7f3c40004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:44.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c33fff640 1 -- 172.21.15.131:0/3309921338 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4003f070 con 0x7f3c4c073880 2024-05-17T04:08:44.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c33fff640 1 -- 172.21.15.131:0/3309921338 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c40030c00 con 0x7f3c4c073880 2024-05-17T04:08:44.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c33fff640 1 -- 172.21.15.131:0/3309921338 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c40009450 con 0x7f3c4c073880 2024-05-17T04:08:44.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c52074640 1 -- 172.21.15.131:0/3309921338 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4c14f670 con 0x7f3c4c073880 2024-05-17T04:08:44.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.819+0000 7f3c52074640 1 -- 172.21.15.131:0/3309921338 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c4c14fc30 con 0x7f3c4c073880 2024-05-17T04:08:44.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.820+0000 7f3c33fff640 1 -- 172.21.15.131:0/3309921338 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3c400437a0 con 0x7f3c4c073880 2024-05-17T04:08:44.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.820+0000 7f3c33fff640 1 -- 172.21.15.131:0/3309921338 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f3c4003bdb0 con 0x7f3c4c073880 2024-05-17T04:08:44.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.821+0000 7f3c52074640 1 -- 172.21.15.131:0/3309921338 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c4c06ed40 con 0x7f3c4c073880 2024-05-17T04:08:44.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.823+0000 7f3c33fff640 1 -- 172.21.15.131:0/3309921338 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3c40031700 con 0x7f3c4c073880 2024-05-17T04:08:44.838 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:44.837+0000 7f656fc1b040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-17T04:08:44.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.884+0000 7f3c52074640 1 -- 172.21.15.131:0/3309921338 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c4c14f380 con 0x7f3c4c073880 2024-05-17T04:08:44.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.885+0000 7f3c33fff640 1 -- 172.21.15.131:0/3309921338 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f3c40043c70 con 0x7f3c4c073880 2024-05-17T04:08:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:08:44.886 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":10,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:08:44.632547+0000","last_up_change":"0.000000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:08:44.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.886+0000 7f3c52074640 1 -- 172.21.15.131:0/3309921338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c4c073880 msgr2=0x7f3c4c148ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:44.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.886+0000 7f3c52074640 1 --2- 172.21.15.131:0/3309921338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c4c073880 0x7f3c4c148ca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3c40031000 tx=0x7f3c40004a40 comp rx=0 tx=0).stop 2024-05-17T04:08:44.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.886+0000 7f3c52074640 1 -- 172.21.15.131:0/3309921338 shutdown_connections 2024-05-17T04:08:44.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.886+0000 7f3c52074640 1 --2- 172.21.15.131:0/3309921338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c4c0d2450 0x7f3c4c146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.886+0000 7f3c52074640 1 --2- 172.21.15.131:0/3309921338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c4c073880 0x7f3c4c148ca0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.886+0000 7f3c52074640 1 --2- 172.21.15.131:0/3309921338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c4c06e930 0x7f3c4c14ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:44.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.886+0000 7f3c52074640 1 -- 172.21.15.131:0/3309921338 >> 172.21.15.131:0/3309921338 conn(0x7f3c4c0b4250 msgr2=0x7f3c4c06cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:44.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.886+0000 7f3c52074640 1 -- 172.21.15.131:0/3309921338 shutdown_connections 2024-05-17T04:08:44.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:08:44.886+0000 7f3c52074640 1 -- 172.21.15.131:0/3309921338 wait complete. 2024-05-17T04:08:44.897 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:44.897+0000 7fbd2e321040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-17T04:08:44.898 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-17T04:08:44.898 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-17T04:08:45.106 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:45.105+0000 7f656fc1b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-17T04:08:45.157 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:45.157+0000 7fbd2e321040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-17T04:08:45.158 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:45.157+0000 7f656fc1b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-17T04:08:45.208 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:45.208+0000 7fbd2e321040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-17T04:08:45.276 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:45.275+0000 7f656fc1b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-17T04:08:45.280 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T04:08:45.280+0000 7f582200f640 -1 Falling back to public interface 2024-05-17T04:08:45.287 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T04:08:45.286+0000 7f94e160d640 -1 Falling back to public interface 2024-05-17T04:08:45.292 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T04:08:45.292+0000 7fdfeec19640 -1 Falling back to public interface 2024-05-17T04:08:45.293 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T04:08:45.292+0000 7f5bb6a1e640 -1 Falling back to public interface 2024-05-17T04:08:45.293 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T04:08:45.293+0000 7f5bb5472640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2024-05-17T04:08:45.294 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T04:08:45.293+0000 7f5ebeba1640 -1 Falling back to public interface 2024-05-17T04:08:45.299 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T04:08:45.298+0000 7fd1693c0640 -1 Falling back to public interface 2024-05-17T04:08:45.300 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T04:08:45.299+0000 7f27d2a15640 -1 Falling back to public interface 2024-05-17T04:08:45.306 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T04:08:45.306+0000 7fac96023640 -1 Falling back to public interface 2024-05-17T04:08:45.331 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:45.331+0000 7fbd2e321040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-17T04:08:45.578 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:45.576+0000 7f656fc1b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-17T04:08:45.627 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:45.626+0000 7f656fc1b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-17T04:08:45.629 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:45.629+0000 7fbd2e321040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-17T04:08:45.677 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:45.676+0000 7fbd2e321040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-17T04:08:45.702 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-17T04:08:45.788 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:45.787+0000 7f656fc1b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-17T04:08:45.805 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.804+0000 7fb26b90a640 1 Processor -- start 2024-05-17T04:08:45.805 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.804+0000 7fb26b90a640 1 -- start start 2024-05-17T04:08:45.808 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb26b90a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb2640d07b0 0x7fb2640b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:45.808 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb26b90a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb264146d40 0x7fb2640d1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:45.808 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb26b90a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2640d2520 0x7fb2641610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:45.808 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb26b90a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb2640b66d0 con 0x7fb264146d40 2024-05-17T04:08:45.808 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb26b90a640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fb2640b3e80 con 0x7fb2640d07b0 2024-05-17T04:08:45.809 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb26b90a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb2640b4160 con 0x7fb2640d2520 2024-05-17T04:08:45.809 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb268ea5640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb264146d40 0x7fb2640d1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:45.809 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb268ea5640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb264146d40 0x7fb2640d1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44140/0 (socket says 172.21.15.131:44140) 2024-05-17T04:08:45.809 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb268ea5640 1 -- 172.21.15.131:0/2657689900 learned_addr learned my addr 172.21.15.131:0/2657689900 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:08:45.809 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb2696a6640 1 --2- 172.21.15.131:0/2657689900 >> v2:172.21.15.150:3300/0 conn(0x7fb2640d07b0 0x7fb2640b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:45.809 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb269ea7640 1 --2- 172.21.15.131:0/2657689900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2640d2520 0x7fb2641610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:45.809 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb268ea5640 1 -- 172.21.15.131:0/2657689900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2640d2520 msgr2=0x7fb2641610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:08:45.809 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb268ea5640 1 --2- 172.21.15.131:0/2657689900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2640d2520 0x7fb2641610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:45.809 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb268ea5640 1 -- 172.21.15.131:0/2657689900 >> v2:172.21.15.150:3300/0 conn(0x7fb2640d07b0 msgr2=0x7fb2640b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:08:45.809 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb268ea5640 1 --2- 172.21.15.131:0/2657689900 >> v2:172.21.15.150:3300/0 conn(0x7fb2640d07b0 0x7fb2640b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:45.809 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.806+0000 7fb268ea5640 1 -- 172.21.15.131:0/2657689900 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2640b4440 con 0x7fb264146d40 2024-05-17T04:08:45.809 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.807+0000 7fb268ea5640 1 --2- 172.21.15.131:0/2657689900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb264146d40 0x7fb2640d1fe0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb264073130 tx=0x7fb26002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab76e57967d4a7f server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:45.809 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.807+0000 7fb257fff640 1 -- 172.21.15.131:0/2657689900 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260037070 con 0x7fb264146d40 2024-05-17T04:08:45.810 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.807+0000 7fb257fff640 1 -- 172.21.15.131:0/2657689900 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb260032440 con 0x7fb264146d40 2024-05-17T04:08:45.810 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.807+0000 7fb257fff640 1 -- 172.21.15.131:0/2657689900 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260032810 con 0x7fb264146d40 2024-05-17T04:08:45.811 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.808+0000 7fb26b90a640 1 -- 172.21.15.131:0/2657689900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb264146d40 msgr2=0x7fb2640d1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:45.811 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.808+0000 7fb26b90a640 1 --2- 172.21.15.131:0/2657689900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb264146d40 0x7fb2640d1fe0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb264073130 tx=0x7fb26002a140 comp rx=0 tx=0).stop 2024-05-17T04:08:45.811 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.808+0000 7fb26b90a640 1 -- 172.21.15.131:0/2657689900 shutdown_connections 2024-05-17T04:08:45.811 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.808+0000 7fb26b90a640 1 --2- 172.21.15.131:0/2657689900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2640d2520 0x7fb2641610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:45.811 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.808+0000 7fb26b90a640 1 --2- 172.21.15.131:0/2657689900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb264146d40 0x7fb2640d1fe0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:45.811 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.808+0000 7fb26b90a640 1 --2- 172.21.15.131:0/2657689900 >> v2:172.21.15.150:3300/0 conn(0x7fb2640d07b0 0x7fb2640b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:45.811 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.808+0000 7fb26b90a640 1 -- 172.21.15.131:0/2657689900 >> 172.21.15.131:0/2657689900 conn(0x7fb2640d30c0 msgr2=0x7fb2640d34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:45.812 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.808+0000 7fb26b90a640 1 -- 172.21.15.131:0/2657689900 shutdown_connections 2024-05-17T04:08:45.812 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.808+0000 7fb26b90a640 1 -- 172.21.15.131:0/2657689900 wait complete. 2024-05-17T04:08:45.812 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.810+0000 7fb26b90a640 1 Processor -- start 2024-05-17T04:08:45.812 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.810+0000 7fb26b90a640 1 -- start start 2024-05-17T04:08:45.815 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.811+0000 7fb26b90a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2640d07b0 0x7fb2640b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:45.815 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.811+0000 7fb26b90a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2640d2520 0x7fb2641f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:45.815 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.811+0000 7fb26b90a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb264146d40 0x7fb2641f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:45.815 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.811+0000 7fb26b90a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb264161610 con 0x7fb264146d40 2024-05-17T04:08:45.815 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.811+0000 7fb26b90a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb2640d2930 con 0x7fb2640d2520 2024-05-17T04:08:45.815 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.811+0000 7fb26b90a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb264161790 con 0x7fb2640d07b0 2024-05-17T04:08:45.815 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.811+0000 7fb269ea7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb264146d40 0x7fb2641f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:45.816 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.811+0000 7fb268ea5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2640d2520 0x7fb2641f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:45.816 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.811+0000 7fb269ea7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb264146d40 0x7fb2641f7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44152/0 (socket says 172.21.15.131:44152) 2024-05-17T04:08:45.816 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.811+0000 7fb2696a6640 1 --2- 172.21.15.131:0/1825158827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2640d07b0 0x7fb2640b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:45.816 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.811+0000 7fb269ea7640 1 -- 172.21.15.131:0/1825158827 learned_addr learned my addr 172.21.15.131:0/1825158827 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:08:45.816 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.812+0000 7fb268ea5640 1 -- 172.21.15.131:0/1825158827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2640d07b0 msgr2=0x7fb2640b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:45.816 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.812+0000 7fb268ea5640 1 --2- 172.21.15.131:0/1825158827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2640d07b0 0x7fb2640b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:45.816 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.812+0000 7fb268ea5640 1 -- 172.21.15.131:0/1825158827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb264146d40 msgr2=0x7fb2641f7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:45.816 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.812+0000 7fb268ea5640 1 --2- 172.21.15.131:0/1825158827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb264146d40 0x7fb2641f7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:45.816 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.812+0000 7fb268ea5640 1 -- 172.21.15.131:0/1825158827 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2640ceac0 con 0x7fb2640d2520 2024-05-17T04:08:45.816 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.812+0000 7fb2696a6640 1 --2- 172.21.15.131:0/1825158827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2640d07b0 0x7fb2640b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:08:45.817 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.812+0000 7fb269ea7640 1 --2- 172.21.15.131:0/1825158827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb264146d40 0x7fb2641f7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:08:45.817 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.812+0000 7fb268ea5640 1 --2- 172.21.15.131:0/1825158827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2640d2520 0x7fb2641f6ec0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb264073180 tx=0x7fb2600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:45.817 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.812+0000 7fb255ffb640 1 -- 172.21.15.131:0/1825158827 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260041020 con 0x7fb2640d2520 2024-05-17T04:08:45.817 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.812+0000 7fb255ffb640 1 -- 172.21.15.131:0/1825158827 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26003d660 con 0x7fb2640d2520 2024-05-17T04:08:45.817 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.812+0000 7fb26b90a640 1 -- 172.21.15.131:0/1825158827 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2640ced80 con 0x7fb2640d2520 2024-05-17T04:08:45.817 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.812+0000 7fb255ffb640 1 -- 172.21.15.131:0/1825158827 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260037040 con 0x7fb2640d2520 2024-05-17T04:08:45.817 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.812+0000 7fb26b90a640 1 -- 172.21.15.131:0/1825158827 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2640aa4e0 con 0x7fb2640d2520 2024-05-17T04:08:45.817 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.813+0000 7fb255ffb640 1 -- 172.21.15.131:0/1825158827 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb260044020 con 0x7fb2640d2520 2024-05-17T04:08:45.817 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.813+0000 7fb255ffb640 1 -- 172.21.15.131:0/1825158827 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb26003bac0 con 0x7fb2640d2520 2024-05-17T04:08:45.817 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.814+0000 7fb26b90a640 1 -- 172.21.15.131:0/1825158827 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2641610d0 con 0x7fb2640d2520 2024-05-17T04:08:45.818 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.816+0000 7fb255ffb640 1 -- 172.21.15.131:0/1825158827 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb26004b070 con 0x7fb2640d2520 2024-05-17T04:08:45.833 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:45.833+0000 7fbd2e321040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-17T04:08:45.878 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.877+0000 7fb26b90a640 1 -- 172.21.15.131:0/1825158827 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb264068e30 con 0x7fb2640d2520 2024-05-17T04:08:45.879 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.878+0000 7fb255ffb640 1 -- 172.21.15.131:0/1825158827 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb26003bd10 con 0x7fb2640d2520 2024-05-17T04:08:45.879 INFO:teuthology.misc.health.smithi131.stdout: 2024-05-17T04:08:45.879 INFO:teuthology.misc.health.smithi131.stdout:{"epoch":10,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:08:44.632547+0000","last_up_change":"0.000000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:08:45.881 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.879+0000 7fb26b90a640 1 -- 172.21.15.131:0/1825158827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2640d2520 msgr2=0x7fb2641f6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:45.881 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.879+0000 7fb26b90a640 1 --2- 172.21.15.131:0/1825158827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2640d2520 0x7fb2641f6ec0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb264073180 tx=0x7fb2600046c0 comp rx=0 tx=0).stop 2024-05-17T04:08:45.881 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.879+0000 7fb26b90a640 1 -- 172.21.15.131:0/1825158827 shutdown_connections 2024-05-17T04:08:45.881 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.879+0000 7fb26b90a640 1 --2- 172.21.15.131:0/1825158827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb264146d40 0x7fb2641f7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:45.881 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.879+0000 7fb26b90a640 1 --2- 172.21.15.131:0/1825158827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2640d2520 0x7fb2641f6ec0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:45.881 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.879+0000 7fb26b90a640 1 --2- 172.21.15.131:0/1825158827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb2640d07b0 0x7fb2640b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:45.881 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.879+0000 7fb26b90a640 1 -- 172.21.15.131:0/1825158827 >> 172.21.15.131:0/1825158827 conn(0x7fb2640d30c0 msgr2=0x7fb264071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:45.881 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.879+0000 7fb26b90a640 1 -- 172.21.15.131:0/1825158827 shutdown_connections 2024-05-17T04:08:45.881 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:45.880+0000 7fb26b90a640 1 -- 172.21.15.131:0/1825158827 wait complete. 2024-05-17T04:08:45.890 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-17T04:08:45.932 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:45.931+0000 7f656fc1b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-17T04:08:45.970 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:45.970+0000 7fbd2e321040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-17T04:08:45.981 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:45.980+0000 7f656fc1b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-17T04:08:46.020 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:46.019+0000 7fbd2e321040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-17T04:08:46.050 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:46.049+0000 7f656fc1b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-17T04:08:46.089 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:46.089+0000 7fbd2e321040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-17T04:08:46.096 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:46.095+0000 7f656fc1b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-17T04:08:46.136 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:46.136+0000 7fbd2e321040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-17T04:08:46.578 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:46.577+0000 7f656fc1b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-17T04:08:46.615 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:46.615+0000 7fbd2e321040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-17T04:08:46.696 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:46.695+0000 7f656fc1b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-17T04:08:46.738 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-05-17T04:08:46.738+0000 7fbd2e321040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-17T04:08:47.713 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:47.712+0000 7f650f2fb640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-17T04:08:47.713 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-05-17T04:08:47.712+0000 7f650f2fb640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-17T04:08:48.756 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T04:08:48.755+0000 7f94e160d640 -1 osd.2 0 log_to_monitors true 2024-05-17T04:08:48.763 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T04:08:48.763+0000 7f582200f640 -1 osd.4 0 log_to_monitors true 2024-05-17T04:08:48.800 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T04:08:48.800+0000 7fdfeec19640 -1 osd.5 0 log_to_monitors true 2024-05-17T04:08:48.808 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T04:08:48.807+0000 7fd1693c0640 -1 osd.1 0 log_to_monitors true 2024-05-17T04:08:48.812 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T04:08:48.811+0000 7f27d2a15640 -1 osd.0 0 log_to_monitors true 2024-05-17T04:08:48.816 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T04:08:48.815+0000 7f5ebeba1640 -1 osd.3 0 log_to_monitors true 2024-05-17T04:08:48.837 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T04:08:48.837+0000 7fac96023640 -1 osd.7 0 log_to_monitors true 2024-05-17T04:08:48.840 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T04:08:48.840+0000 7f5bb6a1e640 -1 osd.6 0 log_to_monitors true 2024-05-17T04:08:52.702 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-17T04:08:52.841 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T04:08:52.840+0000 7f581d998640 -1 osd.4 0 waiting for initial osdmap 2024-05-17T04:08:52.853 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T04:08:52.853+0000 7f5815793640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-17T04:08:52.864 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T04:08:52.862+0000 7fd165356640 -1 osd.1 0 waiting for initial osdmap 2024-05-17T04:08:52.871 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.871+0000 7ff5dd99a640 1 Processor -- start 2024-05-17T04:08:52.871 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.871+0000 7ff5dd99a640 1 -- start start 2024-05-17T04:08:52.876 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.873+0000 7ff5dd99a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff5d00e7670 0x7ff5d0006f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:52.876 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.873+0000 7ff5dd99a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d00524b0 con 0x7ff5d001d760 2024-05-17T04:08:52.876 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.873+0000 7ff5dd99a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d0052790 con 0x7ff5d00329a0 2024-05-17T04:08:52.876 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.873+0000 7ff5dd99a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff5d0006780 con 0x7ff5d00e7670 2024-05-17T04:08:52.876 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.873+0000 7ff5dd199640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff5d001d760 0x7ff5d001db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:48610/0 (socket says 172.21.15.131:48610) 2024-05-17T04:08:52.877 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.873+0000 7ff5dd199640 1 -- 172.21.15.131:0/1324597952 learned_addr learned my addr 172.21.15.131:0/1324597952 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:08:52.877 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d7fff640 1 --2- 172.21.15.131:0/1324597952 >> v2:172.21.15.131:3300/0 conn(0x7ff5d00e7670 0x7ff5d0006f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:52.877 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274951184 0 0) 0x7ff5d00524b0 con 0x7ff5d001d760 2024-05-17T04:08:52.877 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5c8003520 con 0x7ff5d001d760 2024-05-17T04:08:52.877 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 354995348 0 0) 0x7ff5d0052790 con 0x7ff5d00329a0 2024-05-17T04:08:52.877 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5d00524b0 con 0x7ff5d00329a0 2024-05-17T04:08:52.877 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3567543630 0 0) 0x7ff5c8003520 con 0x7ff5d001d760 2024-05-17T04:08:52.877 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 >> v2:172.21.15.131:3300/0 conn(0x7ff5d00e7670 msgr2=0x7ff5d0006f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:08:52.877 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 --2- 172.21.15.131:0/1324597952 >> v2:172.21.15.131:3300/0 conn(0x7ff5d00e7670 0x7ff5d0006f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:52.877 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 >> v1:172.21.15.150:6789/0 conn(0x7ff5d00329a0 legacy=0x7ff5d0053f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:52.877 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d0006a60 con 0x7ff5d001d760 2024-05-17T04:08:52.877 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7ff5c40016f0 con 0x7ff5d001d760 2024-05-17T04:08:52.877 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 >> v1:172.21.15.131:6789/0 conn(0x7ff5d001d760 legacy=0x7ff5d001db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:52.878 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 --2- 172.21.15.131:0/1324597952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5c8003b40 0x7ff5c8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:52.878 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 --2- 172.21.15.131:0/1324597952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c8004800 0x7ff5c8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:52.878 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 --2- 172.21.15.131:0/1324597952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c80051a0 0x7ff5c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:52.878 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d0006780 con 0x7ff5c80051a0 2024-05-17T04:08:52.878 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c800c140 con 0x7ff5c8004800 2024-05-17T04:08:52.878 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.874+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff5c800c340 con 0x7ff5c8003b40 2024-05-17T04:08:52.878 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.875+0000 7ff5dd199640 1 --2- 172.21.15.131:0/1324597952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c80051a0 0x7ff5c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:52.878 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.875+0000 7ff5d7fff640 1 --2- 172.21.15.131:0/1324597952 >> v2:172.21.15.131:3300/0 conn(0x7ff5d00e7670 0x7ff5d0006f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:08:52.878 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.875+0000 7ff5dc998640 1 --2- 172.21.15.131:0/1324597952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5c8003b40 0x7ff5c8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:52.878 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.875+0000 7ff5d7fff640 1 --2- 172.21.15.131:0/1324597952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c8004800 0x7ff5c8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:52.878 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.875+0000 7ff5dc998640 1 -- 172.21.15.131:0/1324597952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c8004800 msgr2=0x7ff5c8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:08:52.878 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.875+0000 7ff5dc998640 1 --2- 172.21.15.131:0/1324597952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c8004800 0x7ff5c8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:52.879 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.875+0000 7ff5dc998640 1 -- 172.21.15.131:0/1324597952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c80051a0 msgr2=0x7ff5c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:08:52.879 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T04:08:52.876+0000 7f94dd038640 -1 osd.2 0 waiting for initial osdmap 2024-05-17T04:08:52.879 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.876+0000 7ff5dc998640 1 --2- 172.21.15.131:0/1324597952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c80051a0 0x7ff5c800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:52.879 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.876+0000 7ff5dc998640 1 -- 172.21.15.131:0/1324597952 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c8003520 con 0x7ff5c8003b40 2024-05-17T04:08:52.880 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.877+0000 7ff5dd199640 1 --2- 172.21.15.131:0/1324597952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c80051a0 0x7ff5c800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:08:52.880 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.877+0000 7ff5dd199640 1 -- 172.21.15.131:0/1324597952 reap_dead start 2024-05-17T04:08:52.880 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T04:08:52.877+0000 7fd15d151640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-17T04:08:52.881 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.878+0000 7ff5dc998640 1 --2- 172.21.15.131:0/1324597952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5c8003b40 0x7ff5c8003f90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80661b0 tx=0x7ff5c8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efdbc38e4a9c3add server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:52.881 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.878+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80ae070 con 0x7ff5c8003b40 2024-05-17T04:08:52.881 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.878+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d80aa710 con 0x7ff5c8003b40 2024-05-17T04:08:52.881 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.878+0000 7ff5d77fe640 1 -- 172.21.15.131:0/1324597952 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8050e50 con 0x7ff5c8003b40 2024-05-17T04:08:52.882 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.880+0000 7ff5dd99a640 1 -- 172.21.15.131:0/1324597952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5c8003b40 msgr2=0x7ff5c8003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:52.882 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.880+0000 7ff5dd99a640 1 --2- 172.21.15.131:0/1324597952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5c8003b40 0x7ff5c8003f90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80661b0 tx=0x7ff5c8005830 comp rx=0 tx=0).stop 2024-05-17T04:08:52.882 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.880+0000 7ff5dd99a640 1 -- 172.21.15.131:0/1324597952 shutdown_connections 2024-05-17T04:08:52.882 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.880+0000 7ff5dd99a640 1 --2- 172.21.15.131:0/1324597952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5c8003b40 0x7ff5c8003f90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:52.882 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.880+0000 7ff5dd99a640 1 -- 172.21.15.131:0/1324597952 >> 172.21.15.131:0/1324597952 conn(0x7ff5d00362c0 msgr2=0x7ff5d00366d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:52.882 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.880+0000 7ff5dd99a640 1 -- 172.21.15.131:0/1324597952 shutdown_connections 2024-05-17T04:08:52.882 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.881+0000 7ff5dd99a640 1 -- 172.21.15.131:0/1324597952 wait complete. 2024-05-17T04:08:52.882 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T04:08:52.876+0000 7f5bb2459640 -1 osd.6 0 waiting for initial osdmap 2024-05-17T04:08:52.883 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.884+0000 7ff5dd99a640 1 Processor -- start 2024-05-17T04:08:52.884 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.884+0000 7ff5dd99a640 1 -- start start 2024-05-17T04:08:52.886 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T04:08:52.886+0000 7f5baa265640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-17T04:08:52.888 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.886+0000 7ff5dd99a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c8003b40 0x7ff5d004d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:52.888 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.886+0000 7ff5dd99a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5d003a060 0x7ff5d004d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:52.888 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.886+0000 7ff5dc998640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c8003b40 0x7ff5d004d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:52.889 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.886+0000 7ff5dc998640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c8003b40 0x7ff5d004d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44258/0 (socket says 172.21.15.131:44258) 2024-05-17T04:08:52.889 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.886+0000 7ff5dd99a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5d004de40 0x7ff5d004b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:52.889 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.887+0000 7ff5dc998640 1 -- 172.21.15.131:0/3792905438 learned_addr learned my addr 172.21.15.131:0/3792905438 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:08:52.889 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.887+0000 7ff5d7fff640 1 --2- 172.21.15.131:0/3792905438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5d003a060 0x7ff5d004d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:52.889 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.887+0000 7ff5dd99a640 1 -- 172.21.15.131:0/3792905438 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d001dcf0 con 0x7ff5c8003b40 2024-05-17T04:08:52.889 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.887+0000 7ff5dd99a640 1 -- 172.21.15.131:0/3792905438 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d001db70 con 0x7ff5d004de40 2024-05-17T04:08:52.889 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.887+0000 7ff5dd99a640 1 -- 172.21.15.131:0/3792905438 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d001de70 con 0x7ff5d003a060 2024-05-17T04:08:52.889 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.887+0000 7ff5dd199640 1 --2- 172.21.15.131:0/3792905438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5d004de40 0x7ff5d004b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:52.889 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.887+0000 7ff5dc998640 1 -- 172.21.15.131:0/3792905438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5d003a060 msgr2=0x7ff5d004d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:52.890 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.887+0000 7ff5dc998640 1 --2- 172.21.15.131:0/3792905438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5d003a060 0x7ff5d004d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:52.890 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.887+0000 7ff5dc998640 1 -- 172.21.15.131:0/3792905438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5d004de40 msgr2=0x7ff5d004b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:52.890 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.887+0000 7ff5dc998640 1 --2- 172.21.15.131:0/3792905438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5d004de40 0x7ff5d004b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:52.890 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.887+0000 7ff5dc998640 1 -- 172.21.15.131:0/3792905438 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d004e250 con 0x7ff5c8003b40 2024-05-17T04:08:52.890 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.888+0000 7ff5dc998640 1 --2- 172.21.15.131:0/3792905438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c8003b40 0x7ff5d004d1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5d807bb00 tx=0x7ff5d80769a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:52.890 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.888+0000 7ff5d57fa640 1 -- 172.21.15.131:0/3792905438 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80ae040 con 0x7ff5c8003b40 2024-05-17T04:08:52.890 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.888+0000 7ff5dd99a640 1 -- 172.21.15.131:0/3792905438 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d004d6e0 con 0x7ff5c8003b40 2024-05-17T04:08:52.890 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.888+0000 7ff5dd99a640 1 -- 172.21.15.131:0/3792905438 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d00380b0 con 0x7ff5c8003b40 2024-05-17T04:08:52.890 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.888+0000 7ff5d57fa640 1 -- 172.21.15.131:0/3792905438 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d80aa6e0 con 0x7ff5c8003b40 2024-05-17T04:08:52.890 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.888+0000 7ff5d57fa640 1 -- 172.21.15.131:0/3792905438 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80b3650 con 0x7ff5c8003b40 2024-05-17T04:08:52.891 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.890+0000 7ff5dd99a640 1 -- 172.21.15.131:0/3792905438 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b8005290 con 0x7ff5c8003b40 2024-05-17T04:08:52.891 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.891+0000 7ff5d57fa640 1 -- 172.21.15.131:0/3792905438 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7ff5d80b1070 con 0x7ff5c8003b40 2024-05-17T04:08:52.891 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.892+0000 7ff5d57fa640 1 --2- 172.21.15.131:0/3792905438 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff5bc076270 0x7ff5bc078780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:08:52.892 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.892+0000 7ff5d57fa640 1 -- 172.21.15.131:0/3792905438 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7ff5d8132e20 con 0x7ff5c8003b40 2024-05-17T04:08:52.892 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.892+0000 7ff5d7fff640 1 --2- 172.21.15.131:0/3792905438 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff5bc076270 0x7ff5bc078780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:08:52.892 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.892+0000 7ff5d7fff640 1 --2- 172.21.15.131:0/3792905438 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff5bc076270 0x7ff5bc078780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00e5c60 tx=0x7ff5cc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:08:52.897 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T04:08:52.897+0000 7fac9227b640 -1 osd.7 0 waiting for initial osdmap 2024-05-17T04:08:52.899 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T04:08:52.899+0000 7f94d4e33640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-17T04:08:52.904 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:52.904+0000 7ff5d57fa640 1 -- 172.21.15.131:0/3792905438 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff5d8136030 con 0x7ff5c8003b40 2024-05-17T04:08:52.909 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T04:08:52.909+0000 7fac89862640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-17T04:08:52.921 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T04:08:52.921+0000 7f27ce2fb640 -1 osd.0 0 waiting for initial osdmap 2024-05-17T04:08:52.927 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T04:08:52.928+0000 7f5ebab37640 -1 osd.3 0 waiting for initial osdmap 2024-05-17T04:08:52.931 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T04:08:52.931+0000 7fdfeabaf640 -1 osd.5 0 waiting for initial osdmap 2024-05-17T04:08:52.933 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T04:08:52.933+0000 7f27c60f6640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-17T04:08:52.942 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T04:08:52.942+0000 7f5eb2932640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-17T04:08:52.944 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T04:08:52.944+0000 7fdfe29aa640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-17T04:08:53.103 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:53.103+0000 7ff5dd99a640 1 -- 172.21.15.131:0/3792905438 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5b8005580 con 0x7ff5c8003b40 2024-05-17T04:08:53.103 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:53.103+0000 7ff5d57fa640 1 -- 172.21.15.131:0/3792905438 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7ff5d80c4060 con 0x7ff5c8003b40 2024-05-17T04:08:53.104 INFO:teuthology.misc.health.smithi131.stdout: 2024-05-17T04:08:53.104 INFO:teuthology.misc.health.smithi131.stdout:{"epoch":12,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:08:50.711856+0000","last_up_change":"0.000000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:08:53.106 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:53.105+0000 7ff5dd99a640 1 -- 172.21.15.131:0/3792905438 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff5bc076270 msgr2=0x7ff5bc078780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:53.106 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:53.105+0000 7ff5dd99a640 1 --2- 172.21.15.131:0/3792905438 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff5bc076270 0x7ff5bc078780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00e5c60 tx=0x7ff5cc008040 comp rx=0 tx=0).stop 2024-05-17T04:08:53.106 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:53.105+0000 7ff5dd99a640 1 -- 172.21.15.131:0/3792905438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c8003b40 msgr2=0x7ff5d004d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:08:53.106 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:53.105+0000 7ff5dd99a640 1 --2- 172.21.15.131:0/3792905438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c8003b40 0x7ff5d004d1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5d807bb00 tx=0x7ff5d80769a0 comp rx=0 tx=0).stop 2024-05-17T04:08:53.106 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:53.105+0000 7ff5dd99a640 1 -- 172.21.15.131:0/3792905438 shutdown_connections 2024-05-17T04:08:53.106 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:53.105+0000 7ff5dd99a640 1 --2- 172.21.15.131:0/3792905438 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff5bc076270 0x7ff5bc078780 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:53.106 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:53.105+0000 7ff5dd99a640 1 --2- 172.21.15.131:0/3792905438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5d004de40 0x7ff5d004b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:53.106 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:53.105+0000 7ff5dd99a640 1 --2- 172.21.15.131:0/3792905438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5d003a060 0x7ff5d004d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:53.107 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:53.105+0000 7ff5dd99a640 1 --2- 172.21.15.131:0/3792905438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c8003b40 0x7ff5d004d1a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:08:53.107 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:53.105+0000 7ff5dd99a640 1 -- 172.21.15.131:0/3792905438 >> 172.21.15.131:0/3792905438 conn(0x7ff5d00362c0 msgr2=0x7ff5d0005320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:08:53.107 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:53.105+0000 7ff5dd99a640 1 -- 172.21.15.131:0/3792905438 shutdown_connections 2024-05-17T04:08:53.107 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:08:53.105+0000 7ff5dd99a640 1 -- 172.21.15.131:0/3792905438 wait complete. 2024-05-17T04:08:53.115 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-17T04:08:59.923 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-17T04:09:00.038 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.038+0000 7fb0d50e4640 1 Processor -- start 2024-05-17T04:09:00.038 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.038+0000 7fb0d50e4640 1 -- start start 2024-05-17T04:09:00.040 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.039+0000 7fb0d50e4640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb0d00ae9f0 0x7fb0d00708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:00.040 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.040+0000 7fb0d50e4640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb0d006ff10 0x7fb0d006d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:00.040 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.040+0000 7fb0d50e4640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d00b5320 con 0x7fb0d015f7a0 2024-05-17T04:09:00.040 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.040+0000 7fb0d50e4640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb0d00b5600 con 0x7fb0d00ae9f0 2024-05-17T04:09:00.041 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.040+0000 7fb0d50e4640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fb0d00b47c0 con 0x7fb0d006ff10 2024-05-17T04:09:00.041 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.040+0000 7fb0ced9d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb0d00ae9f0 0x7fb0d00708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:00.041 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.040+0000 7fb0c7fff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb0d015f7a0 0x7fb0d006f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:43068/0 (socket says 172.21.15.131:43068) 2024-05-17T04:09:00.041 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.040+0000 7fb0c7fff640 1 -- 172.21.15.131:0/1351110263 learned_addr learned my addr 172.21.15.131:0/1351110263 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:00.041 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.040+0000 7fb0cf59e640 1 --2- 172.21.15.131:0/1351110263 >> v2:172.21.15.150:3300/0 conn(0x7fb0d006ff10 0x7fb0d006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:00.041 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.040+0000 7fb0ced9d640 1 -- 172.21.15.131:0/1351110263 >> v2:172.21.15.150:3300/0 conn(0x7fb0d006ff10 msgr2=0x7fb0d006d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:00.041 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.040+0000 7fb0ced9d640 1 --2- 172.21.15.131:0/1351110263 >> v2:172.21.15.150:3300/0 conn(0x7fb0d006ff10 0x7fb0d006d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.041 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.040+0000 7fb0ced9d640 1 -- 172.21.15.131:0/1351110263 >> v1:172.21.15.131:6789/0 conn(0x7fb0d015f7a0 legacy=0x7fb0d006f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:00.041 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.040+0000 7fb0ced9d640 1 -- 172.21.15.131:0/1351110263 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d00b4aa0 con 0x7fb0d00ae9f0 2024-05-17T04:09:00.041 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.040+0000 7fb0ce59c640 1 -- 172.21.15.131:0/1351110263 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2492846297 0 0) 0x7fb0d00b5320 con 0x7fb0d015f7a0 2024-05-17T04:09:00.042 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.041+0000 7fb0ced9d640 1 --2- 172.21.15.131:0/1351110263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d00ae9f0 0x7fb0d00708a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0076540 tx=0x7fb0c002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e2c7ba2dc52fc server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:00.042 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.041+0000 7fb0ce59c640 1 -- 172.21.15.131:0/1351110263 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0037070 con 0x7fb0d00ae9f0 2024-05-17T04:09:00.042 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.041+0000 7fb0ce59c640 1 -- 172.21.15.131:0/1351110263 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c0032440 con 0x7fb0d00ae9f0 2024-05-17T04:09:00.043 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.041+0000 7fb0ce59c640 1 -- 172.21.15.131:0/1351110263 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0032810 con 0x7fb0d00ae9f0 2024-05-17T04:09:00.043 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.042+0000 7fb0d50e4640 1 -- 172.21.15.131:0/1351110263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d00ae9f0 msgr2=0x7fb0d00708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:00.043 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.042+0000 7fb0d50e4640 1 --2- 172.21.15.131:0/1351110263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d00ae9f0 0x7fb0d00708a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0076540 tx=0x7fb0c002a1a0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.043 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.042+0000 7fb0d50e4640 1 -- 172.21.15.131:0/1351110263 shutdown_connections 2024-05-17T04:09:00.043 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.042+0000 7fb0d50e4640 1 --2- 172.21.15.131:0/1351110263 >> v2:172.21.15.150:3300/0 conn(0x7fb0d006ff10 0x7fb0d006d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.043 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.042+0000 7fb0d50e4640 1 --2- 172.21.15.131:0/1351110263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d00ae9f0 0x7fb0d00708a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.043 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.042+0000 7fb0d50e4640 1 -- 172.21.15.131:0/1351110263 >> 172.21.15.131:0/1351110263 conn(0x7fb0d00d1700 msgr2=0x7fb0d00d1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:00.043 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.042+0000 7fb0d50e4640 1 -- 172.21.15.131:0/1351110263 shutdown_connections 2024-05-17T04:09:00.043 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.042+0000 7fb0d50e4640 1 -- 172.21.15.131:0/1351110263 wait complete. 2024-05-17T04:09:00.044 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.044+0000 7fb0d50e4640 1 Processor -- start 2024-05-17T04:09:00.044 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.044+0000 7fb0d50e4640 1 -- start start 2024-05-17T04:09:00.046 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0d50e4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d006ff10 0x7fb0d01527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:00.046 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0d50e4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0d00ae9f0 0x7fb0d0150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:00.046 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0d50e4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0d015f7a0 0x7fb0d01540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:00.046 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0d50e4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d00704a0 con 0x7fb0d006ff10 2024-05-17T04:09:00.047 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0d50e4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d0070320 con 0x7fb0d015f7a0 2024-05-17T04:09:00.047 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0d50e4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d0070620 con 0x7fb0d00ae9f0 2024-05-17T04:09:00.047 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0ced9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d006ff10 0x7fb0d01527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:00.047 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0ced9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d006ff10 0x7fb0d01527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:36302/0 (socket says 172.21.15.131:36302) 2024-05-17T04:09:00.047 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0ced9d640 1 -- 172.21.15.131:0/2278772150 learned_addr learned my addr 172.21.15.131:0/2278772150 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:00.047 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0c7fff640 1 --2- 172.21.15.131:0/2278772150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0d00ae9f0 0x7fb0d0150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:00.047 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0cf59e640 1 --2- 172.21.15.131:0/2278772150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0d015f7a0 0x7fb0d01540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:00.047 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0ced9d640 1 -- 172.21.15.131:0/2278772150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0d00ae9f0 msgr2=0x7fb0d0150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:00.047 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0ced9d640 1 --2- 172.21.15.131:0/2278772150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0d00ae9f0 0x7fb0d0150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.047 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0ced9d640 1 -- 172.21.15.131:0/2278772150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0d015f7a0 msgr2=0x7fb0d01540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:00.047 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0ced9d640 1 --2- 172.21.15.131:0/2278772150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0d015f7a0 0x7fb0d01540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.047 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.045+0000 7fb0ced9d640 1 -- 172.21.15.131:0/2278772150 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d015ff20 con 0x7fb0d006ff10 2024-05-17T04:09:00.048 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.046+0000 7fb0ced9d640 1 --2- 172.21.15.131:0/2278772150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d006ff10 0x7fb0d01527c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0035040 tx=0x7fb0c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:00.048 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.046+0000 7fb0c77fe640 1 -- 172.21.15.131:0/2278772150 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0037050 con 0x7fb0d006ff10 2024-05-17T04:09:00.048 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.046+0000 7fb0c77fe640 1 -- 172.21.15.131:0/2278772150 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c0038040 con 0x7fb0d006ff10 2024-05-17T04:09:00.048 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.046+0000 7fb0d50e4640 1 -- 172.21.15.131:0/2278772150 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d0160200 con 0x7fb0d006ff10 2024-05-17T04:09:00.048 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.046+0000 7fb0c77fe640 1 -- 172.21.15.131:0/2278772150 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0004470 con 0x7fb0d006ff10 2024-05-17T04:09:00.048 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.046+0000 7fb0d50e4640 1 -- 172.21.15.131:0/2278772150 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d01607c0 con 0x7fb0d006ff10 2024-05-17T04:09:00.049 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.047+0000 7fb0d50e4640 1 -- 172.21.15.131:0/2278772150 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d006d700 con 0x7fb0d006ff10 2024-05-17T04:09:00.049 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.048+0000 7fb0c77fe640 1 -- 172.21.15.131:0/2278772150 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb0c0030900 con 0x7fb0d006ff10 2024-05-17T04:09:00.049 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.048+0000 7fb0c77fe640 1 --2- 172.21.15.131:0/2278772150 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb0b00762d0 0x7fb0b00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:00.049 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.048+0000 7fb0c7fff640 1 --2- 172.21.15.131:0/2278772150 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb0b00762d0 0x7fb0b00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:00.049 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.048+0000 7fb0c77fe640 1 -- 172.21.15.131:0/2278772150 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb0c00b7e30 con 0x7fb0d006ff10 2024-05-17T04:09:00.049 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.049+0000 7fb0c7fff640 1 --2- 172.21.15.131:0/2278772150 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb0b00762d0 0x7fb0b00787e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8000f60 tx=0x7fb0b8007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:00.053 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.053+0000 7fb0c77fe640 1 -- 172.21.15.131:0/2278772150 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb0d006d700 con 0x7fb0d006ff10 2024-05-17T04:09:00.238 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.238+0000 7fb0d50e4640 1 -- 172.21.15.131:0/2278772150 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0d00d1240 con 0x7fb0d006ff10 2024-05-17T04:09:00.239 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.239+0000 7fb0c77fe640 1 -- 172.21.15.131:0/2278772150 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12908 (secure 0 0 0) 0x7fb0d00d1240 con 0x7fb0d006ff10 2024-05-17T04:09:00.239 INFO:teuthology.misc.health.smithi131.stdout: 2024-05-17T04:09:00.240 INFO:teuthology.misc.health.smithi131.stdout:{"epoch":16,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:08:56.964613+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:09:00.242 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.242+0000 7fb0d50e4640 1 -- 172.21.15.131:0/2278772150 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb0b00762d0 msgr2=0x7fb0b00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:00.242 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.242+0000 7fb0d50e4640 1 --2- 172.21.15.131:0/2278772150 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb0b00762d0 0x7fb0b00787e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8000f60 tx=0x7fb0b8007c00 comp rx=0 tx=0).stop 2024-05-17T04:09:00.242 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.242+0000 7fb0d50e4640 1 -- 172.21.15.131:0/2278772150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d006ff10 msgr2=0x7fb0d01527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:00.242 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.242+0000 7fb0d50e4640 1 --2- 172.21.15.131:0/2278772150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d006ff10 0x7fb0d01527c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0035040 tx=0x7fb0c00046c0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.243 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.242+0000 7fb0d50e4640 1 -- 172.21.15.131:0/2278772150 shutdown_connections 2024-05-17T04:09:00.243 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.242+0000 7fb0d50e4640 1 --2- 172.21.15.131:0/2278772150 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb0b00762d0 0x7fb0b00787e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.243 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.242+0000 7fb0d50e4640 1 --2- 172.21.15.131:0/2278772150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0d015f7a0 0x7fb0d01540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.243 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.242+0000 7fb0d50e4640 1 --2- 172.21.15.131:0/2278772150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0d00ae9f0 0x7fb0d0150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.243 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.242+0000 7fb0d50e4640 1 --2- 172.21.15.131:0/2278772150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0d006ff10 0x7fb0d01527c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.243 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.242+0000 7fb0d50e4640 1 -- 172.21.15.131:0/2278772150 >> 172.21.15.131:0/2278772150 conn(0x7fb0d00d1700 msgr2=0x7fb0d006f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:00.243 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.242+0000 7fb0d50e4640 1 -- 172.21.15.131:0/2278772150 shutdown_connections 2024-05-17T04:09:00.243 INFO:teuthology.misc.health.smithi131.stderr:2024-05-17T04:09:00.242+0000 7fb0d50e4640 1 -- 172.21.15.131:0/2278772150 wait complete. 2024-05-17T04:09:00.252 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-17T04:09:00.253 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-17T04:09:00.253 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-17T04:09:00.253 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-17T04:09:00.255 INFO:tasks.ceph.mds.a:Started 2024-05-17T04:09:00.256 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-17T04:09:00.256 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-17T04:09:00.257 INFO:tasks.ceph.mds.c:Started 2024-05-17T04:09:00.258 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-17T04:09:00.258 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-17T04:09:00.261 INFO:tasks.ceph.mds.b:Started 2024-05-17T04:09:00.261 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-17T04:09:00.261 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-17T04:09:00.263 INFO:tasks.ceph.mds.d:Started 2024-05-17T04:09:00.263 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-17T04:09:00.263 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T04:09:00.343 INFO:tasks.ceph.mds.a.smithi131.stdout:starting mds.a at 2024-05-17T04:09:00.343 INFO:tasks.ceph.mds.c.smithi131.stdout:starting mds.c at 2024-05-17T04:09:00.359 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-05-17T04:09:00.360 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2024-05-17T04:09:00.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.383+0000 7f3151b94640 1 Processor -- start 2024-05-17T04:09:00.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.383+0000 7f3151b94640 1 -- start start 2024-05-17T04:09:00.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.385+0000 7f3151b94640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f314c0d05e0 0x7f314c15f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:00.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.385+0000 7f3151b94640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f314c0d2a60 0x7f314c0af680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:00.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.385+0000 7f3151b94640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f314c0d14b0 con 0x7f314c0d0db0 2024-05-17T04:09:00.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.385+0000 7f3151b94640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f314c0d09f0 con 0x7f314c0d05e0 2024-05-17T04:09:00.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.385+0000 7f3151b94640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f314c0d1790 con 0x7f314c0d2a60 2024-05-17T04:09:00.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.385+0000 7f314b7fe640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f314c0d05e0 0x7f314c15f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:00.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.385+0000 7f314affd640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f314c0d0db0 0x7f314c0d2350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:47974/0 (socket says 172.21.15.131:47974) 2024-05-17T04:09:00.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.385+0000 7f314affd640 1 -- 172.21.15.131:0/382167006 learned_addr learned my addr 172.21.15.131:0/382167006 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:00.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.385+0000 7f314bfff640 1 --2- 172.21.15.131:0/382167006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f314c0d2a60 0x7f314c0af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:00.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.385+0000 7f314b7fe640 1 -- 172.21.15.131:0/382167006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f314c0d2a60 msgr2=0x7f314c0af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:00.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.385+0000 7f314b7fe640 1 --2- 172.21.15.131:0/382167006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f314c0d2a60 0x7f314c0af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.385+0000 7f314b7fe640 1 -- 172.21.15.131:0/382167006 >> v1:172.21.15.150:6789/0 conn(0x7f314c0d0db0 legacy=0x7f314c0d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:00.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.385+0000 7f314a7fc640 1 -- 172.21.15.131:0/382167006 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4157134374 0 0) 0x7f314c0d14b0 con 0x7f314c0d0db0 2024-05-17T04:09:00.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.385+0000 7f314b7fe640 1 -- 172.21.15.131:0/382167006 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314c0d1a70 con 0x7f314c0d05e0 2024-05-17T04:09:00.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.385+0000 7f314bfff640 1 --2- 172.21.15.131:0/382167006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f314c0d2a60 0x7f314c0af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:00.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.386+0000 7f314b7fe640 1 --2- 172.21.15.131:0/382167006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f314c0d05e0 0x7f314c15f5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f313c0097a0 tx=0x7f313c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=627073117f64e4c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:00.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.386+0000 7f314a7fc640 1 -- 172.21.15.131:0/382167006 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c037070 con 0x7f314c0d05e0 2024-05-17T04:09:00.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.386+0000 7f314a7fc640 1 -- 172.21.15.131:0/382167006 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f313c032440 con 0x7f314c0d05e0 2024-05-17T04:09:00.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.386+0000 7f314a7fc640 1 -- 172.21.15.131:0/382167006 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c032810 con 0x7f314c0d05e0 2024-05-17T04:09:00.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.387+0000 7f3151b94640 1 -- 172.21.15.131:0/382167006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f314c0d05e0 msgr2=0x7f314c15f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:00.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.387+0000 7f3151b94640 1 --2- 172.21.15.131:0/382167006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f314c0d05e0 0x7f314c15f5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f313c0097a0 tx=0x7f313c02a180 comp rx=0 tx=0).stop 2024-05-17T04:09:00.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.387+0000 7f3151b94640 1 -- 172.21.15.131:0/382167006 shutdown_connections 2024-05-17T04:09:00.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.387+0000 7f3151b94640 1 --2- 172.21.15.131:0/382167006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f314c0d2a60 0x7f314c0af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.387+0000 7f3151b94640 1 --2- 172.21.15.131:0/382167006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f314c0d05e0 0x7f314c15f5a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.387+0000 7f3151b94640 1 -- 172.21.15.131:0/382167006 >> 172.21.15.131:0/382167006 conn(0x7f314c0b4250 msgr2=0x7f314c0b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:00.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.387+0000 7f3151b94640 1 -- 172.21.15.131:0/382167006 shutdown_connections 2024-05-17T04:09:00.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.387+0000 7f3151b94640 1 -- 172.21.15.131:0/382167006 wait complete. 2024-05-17T04:09:00.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.389+0000 7f3151b94640 1 Processor -- start 2024-05-17T04:09:00.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.389+0000 7f3151b94640 1 -- start start 2024-05-17T04:09:00.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.390+0000 7f3151b94640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f314c0d05e0 0x7f314c151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:00.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.390+0000 7f3151b94640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f314c0d0db0 0x7f314c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:00.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.390+0000 7f3151b94640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f314c1611d0 0x7f314c1615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:00.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.390+0000 7f3151b94640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f314c0af0f0 con 0x7f314c1611d0 2024-05-17T04:09:00.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.390+0000 7f3151b94640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f314c0d11c0 con 0x7f314c0d05e0 2024-05-17T04:09:00.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.390+0000 7f3151b94640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f314c0afbc0 con 0x7f314c0d0db0 2024-05-17T04:09:00.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.390+0000 7f314bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f314c1611d0 0x7f314c1615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:00.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.390+0000 7f314bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f314c1611d0 0x7f314c1615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:36358/0 (socket says 172.21.15.131:36358) 2024-05-17T04:09:00.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.390+0000 7f314bfff640 1 -- 172.21.15.131:0/359293917 learned_addr learned my addr 172.21.15.131:0/359293917 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:00.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.391+0000 7f314affd640 1 --2- 172.21.15.131:0/359293917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f314c0d0db0 0x7f314c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:00.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.391+0000 7f314b7fe640 1 --2- 172.21.15.131:0/359293917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f314c0d05e0 0x7f314c151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:00.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.391+0000 7f314bfff640 1 -- 172.21.15.131:0/359293917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f314c0d0db0 msgr2=0x7f314c06ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:00.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.391+0000 7f314bfff640 1 --2- 172.21.15.131:0/359293917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f314c0d0db0 0x7f314c06ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.391+0000 7f314bfff640 1 -- 172.21.15.131:0/359293917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f314c0d05e0 msgr2=0x7f314c151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:00.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.391+0000 7f314bfff640 1 --2- 172.21.15.131:0/359293917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f314c0d05e0 0x7f314c151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.391+0000 7f314bfff640 1 -- 172.21.15.131:0/359293917 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314c161b20 con 0x7f314c1611d0 2024-05-17T04:09:00.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.391+0000 7f314bfff640 1 --2- 172.21.15.131:0/359293917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f314c1611d0 0x7f314c1615e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f314400efc0 tx=0x7f314400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:00.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.391+0000 7f3133fff640 1 -- 172.21.15.131:0/359293917 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3144018030 con 0x7f314c1611d0 2024-05-17T04:09:00.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.391+0000 7f3133fff640 1 -- 172.21.15.131:0/359293917 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f314400ccd0 con 0x7f314c1611d0 2024-05-17T04:09:00.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.391+0000 7f3133fff640 1 -- 172.21.15.131:0/359293917 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3144003bb0 con 0x7f314c1611d0 2024-05-17T04:09:00.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.391+0000 7f3151b94640 1 -- 172.21.15.131:0/359293917 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f314c06ddc0 con 0x7f314c1611d0 2024-05-17T04:09:00.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.391+0000 7f3151b94640 1 -- 172.21.15.131:0/359293917 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f314c06e380 con 0x7f314c1611d0 2024-05-17T04:09:00.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.392+0000 7f3151b94640 1 -- 172.21.15.131:0/359293917 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f314c15f5a0 con 0x7f314c1611d0 2024-05-17T04:09:00.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.393+0000 7f3133fff640 1 -- 172.21.15.131:0/359293917 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f314401b070 con 0x7f314c1611d0 2024-05-17T04:09:00.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.393+0000 7f3133fff640 1 --2- 172.21.15.131:0/359293917 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3138076300 0x7f3138078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:00.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.393+0000 7f3133fff640 1 -- 172.21.15.131:0/359293917 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3144097aa0 con 0x7f314c1611d0 2024-05-17T04:09:00.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.393+0000 7f314b7fe640 1 --2- 172.21.15.131:0/359293917 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3138076300 0x7f3138078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:00.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.394+0000 7f314b7fe640 1 --2- 172.21.15.131:0/359293917 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3138076300 0x7f3138078810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f313c034000 tx=0x7f313c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:00.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.398+0000 7f3133fff640 1 -- 172.21.15.131:0/359293917 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f314c161b20 con 0x7f314c1611d0 2024-05-17T04:09:00.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.616+0000 7f3151b94640 1 -- 172.21.15.131:0/359293917 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f314c152fb0 con 0x7f314c1611d0 2024-05-17T04:09:00.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.617+0000 7f3133fff640 1 -- 172.21.15.131:0/359293917 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f3144010040 con 0x7f314c1611d0 2024-05-17T04:09:00.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:00.618 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/4068751282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4068751282},{"type":"v1","addr":"172.21.15.131:6836","nonce":4068751282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-17T04:09:00.618 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 2 2024-05-17T04:09:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.619+0000 7f3151b94640 1 -- 172.21.15.131:0/359293917 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3138076300 msgr2=0x7f3138078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.619+0000 7f3151b94640 1 --2- 172.21.15.131:0/359293917 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3138076300 0x7f3138078810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f313c034000 tx=0x7f313c02e000 comp rx=0 tx=0).stop 2024-05-17T04:09:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.619+0000 7f3151b94640 1 -- 172.21.15.131:0/359293917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f314c1611d0 msgr2=0x7f314c1615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.619+0000 7f3151b94640 1 --2- 172.21.15.131:0/359293917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f314c1611d0 0x7f314c1615e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f314400efc0 tx=0x7f314400c490 comp rx=0 tx=0).stop 2024-05-17T04:09:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.619+0000 7f3151b94640 1 -- 172.21.15.131:0/359293917 shutdown_connections 2024-05-17T04:09:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.619+0000 7f3151b94640 1 --2- 172.21.15.131:0/359293917 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3138076300 0x7f3138078810 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.619+0000 7f3151b94640 1 --2- 172.21.15.131:0/359293917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f314c1611d0 0x7f314c1615e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.619+0000 7f3151b94640 1 --2- 172.21.15.131:0/359293917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f314c0d0db0 0x7f314c06ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.619+0000 7f3151b94640 1 --2- 172.21.15.131:0/359293917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f314c0d05e0 0x7f314c151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.619+0000 7f3151b94640 1 -- 172.21.15.131:0/359293917 >> 172.21.15.131:0/359293917 conn(0x7f314c0b4250 msgr2=0x7f314c0b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.619+0000 7f3151b94640 1 -- 172.21.15.131:0/359293917 shutdown_connections 2024-05-17T04:09:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:00.619+0000 7f3151b94640 1 -- 172.21.15.131:0/359293917 wait complete. 2024-05-17T04:09:02.631 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T04:09:02.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.754+0000 7ffaacfa8640 1 Processor -- start 2024-05-17T04:09:02.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.754+0000 7ffaacfa8640 1 -- start start 2024-05-17T04:09:02.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaacfa8640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ffaa815d300 0x7ffaa80cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:02.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaacfa8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffaa80b48b0 0x7ffaa80b5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:02.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaacfa8640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffaa80b4cc0 0x7ffaa80b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:02.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaacfa8640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa80b3e60 con 0x7ffaa815d300 2024-05-17T04:09:02.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaacfa8640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa806dab0 con 0x7ffaa80b4cc0 2024-05-17T04:09:02.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaacfa8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa80d0780 con 0x7ffaa80b48b0 2024-05-17T04:09:02.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaa659c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ffaa815d300 0x7ffaa80cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:02.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaa659c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ffaa815d300 0x7ffaa80cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:36360/0 (socket says 172.21.15.131:36360) 2024-05-17T04:09:02.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaa659c640 1 -- 172.21.15.131:0/1491699769 learned_addr learned my addr 172.21.15.131:0/1491699769 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:02.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaa659c640 1 -- 172.21.15.131:0/1491699769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffaa80b48b0 msgr2=0x7ffaa80b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:02.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffa9dd9b640 1 --2- 172.21.15.131:0/1491699769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffaa80b48b0 0x7ffaa80b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:02.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaa6d9d640 1 --2- 172.21.15.131:0/1491699769 >> v2:172.21.15.150:3300/0 conn(0x7ffaa80b4cc0 0x7ffaa80b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:02.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaa659c640 1 --2- 172.21.15.131:0/1491699769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffaa80b48b0 0x7ffaa80b5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:02.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaa659c640 1 -- 172.21.15.131:0/1491699769 >> v2:172.21.15.150:3300/0 conn(0x7ffaa80b4cc0 msgr2=0x7ffaa80b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:02.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaa659c640 1 --2- 172.21.15.131:0/1491699769 >> v2:172.21.15.150:3300/0 conn(0x7ffaa80b4cc0 0x7ffaa80b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:02.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaa659c640 1 -- 172.21.15.131:0/1491699769 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa80d0a60 con 0x7ffaa815d300 2024-05-17T04:09:02.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.756+0000 7ffaa6d9d640 1 --2- 172.21.15.131:0/1491699769 >> v2:172.21.15.150:3300/0 conn(0x7ffaa80b4cc0 0x7ffaa80b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:02.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.757+0000 7ffaa659c640 1 --2- 172.21.15.131:0/1491699769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaa815d300 0x7ffaa80cd2e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80b0a80 tx=0x7ffa9802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5238a9c1c340b304 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:02.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.757+0000 7ffaa5d9b640 1 -- 172.21.15.131:0/1491699769 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98037070 con 0x7ffaa815d300 2024-05-17T04:09:02.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.757+0000 7ffaa5d9b640 1 -- 172.21.15.131:0/1491699769 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa98032440 con 0x7ffaa815d300 2024-05-17T04:09:02.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.757+0000 7ffaa5d9b640 1 -- 172.21.15.131:0/1491699769 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98032810 con 0x7ffaa815d300 2024-05-17T04:09:02.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.758+0000 7ffaacfa8640 1 -- 172.21.15.131:0/1491699769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaa815d300 msgr2=0x7ffaa80cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:02.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.758+0000 7ffaacfa8640 1 --2- 172.21.15.131:0/1491699769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaa815d300 0x7ffaa80cd2e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80b0a80 tx=0x7ffa9802a1e0 comp rx=0 tx=0).stop 2024-05-17T04:09:02.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.758+0000 7ffaacfa8640 1 -- 172.21.15.131:0/1491699769 shutdown_connections 2024-05-17T04:09:02.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.758+0000 7ffaacfa8640 1 --2- 172.21.15.131:0/1491699769 >> v2:172.21.15.150:3300/0 conn(0x7ffaa80b4cc0 0x7ffaa80b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:02.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.758+0000 7ffaacfa8640 1 --2- 172.21.15.131:0/1491699769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffaa80b48b0 0x7ffaa80b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:02.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.758+0000 7ffaacfa8640 1 --2- 172.21.15.131:0/1491699769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaa815d300 0x7ffaa80cd2e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:02.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.758+0000 7ffaacfa8640 1 -- 172.21.15.131:0/1491699769 >> 172.21.15.131:0/1491699769 conn(0x7ffaa80b36d0 msgr2=0x7ffaa80d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:02.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.758+0000 7ffaacfa8640 1 -- 172.21.15.131:0/1491699769 shutdown_connections 2024-05-17T04:09:02.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.758+0000 7ffaacfa8640 1 -- 172.21.15.131:0/1491699769 wait complete. 2024-05-17T04:09:02.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.760+0000 7ffaacfa8640 1 Processor -- start 2024-05-17T04:09:02.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.760+0000 7ffaacfa8640 1 -- start start 2024-05-17T04:09:02.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.761+0000 7ffaacfa8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa80b48b0 0x7ffaa81434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:02.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.761+0000 7ffaacfa8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaa80b4cc0 0x7ffaa81400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:02.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.761+0000 7ffaacfa8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffaa815d300 0x7ffaa81e6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:02.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffaacfa8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa815d710 con 0x7ffaa80b4cc0 2024-05-17T04:09:02.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffaacfa8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa80b4390 con 0x7ffaa80b48b0 2024-05-17T04:09:02.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffaacfa8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa80cd820 con 0x7ffaa815d300 2024-05-17T04:09:02.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffa9dd9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaa80b4cc0 0x7ffaa81400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:02.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffa9dd9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaa80b4cc0 0x7ffaa81400c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:36372/0 (socket says 172.21.15.131:36372) 2024-05-17T04:09:02.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffa9dd9b640 1 -- 172.21.15.131:0/133768895 learned_addr learned my addr 172.21.15.131:0/133768895 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:02.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffaa6d9d640 1 --2- 172.21.15.131:0/133768895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffaa815d300 0x7ffaa81e6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:02.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffaa659c640 1 --2- 172.21.15.131:0/133768895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa80b48b0 0x7ffaa81434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:02.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffa9dd9b640 1 -- 172.21.15.131:0/133768895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffaa815d300 msgr2=0x7ffaa81e6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:02.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffa9dd9b640 1 --2- 172.21.15.131:0/133768895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffaa815d300 0x7ffaa81e6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:02.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffa9dd9b640 1 -- 172.21.15.131:0/133768895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa80b48b0 msgr2=0x7ffaa81434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:02.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffa9dd9b640 1 --2- 172.21.15.131:0/133768895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa80b48b0 0x7ffaa81434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:02.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffa9dd9b640 1 -- 172.21.15.131:0/133768895 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa8140600 con 0x7ffaa80b4cc0 2024-05-17T04:09:02.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffaa659c640 1 --2- 172.21.15.131:0/133768895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa80b48b0 0x7ffaa81434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:02.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffa9dd9b640 1 --2- 172.21.15.131:0/133768895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaa80b4cc0 0x7ffaa81400c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c820 tx=0x7ffa9000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:02.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffa9f7fe640 1 -- 172.21.15.131:0/133768895 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90015070 con 0x7ffaa80b4cc0 2024-05-17T04:09:02.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffa9f7fe640 1 -- 172.21.15.131:0/133768895 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa90004020 con 0x7ffaa80b4cc0 2024-05-17T04:09:02.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffaacfa8640 1 -- 172.21.15.131:0/133768895 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa815b4f0 con 0x7ffaa80b4cc0 2024-05-17T04:09:02.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffa9f7fe640 1 -- 172.21.15.131:0/133768895 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa900043f0 con 0x7ffaa80b4cc0 2024-05-17T04:09:02.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.762+0000 7ffaacfa8640 1 -- 172.21.15.131:0/133768895 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa815bab0 con 0x7ffaa80b4cc0 2024-05-17T04:09:02.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.764+0000 7ffaacfa8640 1 -- 172.21.15.131:0/133768895 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa80cde50 con 0x7ffaa80b4cc0 2024-05-17T04:09:02.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.764+0000 7ffa9f7fe640 1 -- 172.21.15.131:0/133768895 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffa90007830 con 0x7ffaa80b4cc0 2024-05-17T04:09:02.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.765+0000 7ffa9f7fe640 1 --2- 172.21.15.131:0/133768895 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ffa88076300 0x7ffa88078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:02.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.765+0000 7ffa9f7fe640 1 -- 172.21.15.131:0/133768895 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ffa90097000 con 0x7ffaa80b4cc0 2024-05-17T04:09:02.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.765+0000 7ffaa659c640 1 --2- 172.21.15.131:0/133768895 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ffa88076300 0x7ffa88078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:02.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.765+0000 7ffaa659c640 1 --2- 172.21.15.131:0/133768895 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ffa88076300 0x7ffa88078810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa98034000 tx=0x7ffa9802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:02.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.769+0000 7ffa9f7fe640 1 -- 172.21.15.131:0/133768895 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffaa80cde50 con 0x7ffaa80b4cc0 2024-05-17T04:09:02.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.985+0000 7ffaacfa8640 1 -- 172.21.15.131:0/133768895 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffaa80d02f0 con 0x7ffaa80b4cc0 2024-05-17T04:09:02.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.986+0000 7ffa9f7fe640 1 -- 172.21.15.131:0/133768895 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3876 (secure 0 0 0) 0x7ffa90060cb0 con 0x7ffaa80b4cc0 2024-05-17T04:09:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:02.987 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2897828294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2897828294},{"type":"v1","addr":"172.21.15.131:6837","nonce":2897828294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/4068751282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4068751282},{"type":"v1","addr":"172.21.15.131:6836","nonce":4068751282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2776700884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2776700884},{"type":"v1","addr":"172.21.15.150:6834","nonce":2776700884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2635477484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2635477484},{"type":"v1","addr":"172.21.15.150:6835","nonce":2635477484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-17T04:09:02.988 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 3 2024-05-17T04:09:02.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.988+0000 7ffaacfa8640 1 -- 172.21.15.131:0/133768895 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ffa88076300 msgr2=0x7ffa88078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:02.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.988+0000 7ffaacfa8640 1 --2- 172.21.15.131:0/133768895 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ffa88076300 0x7ffa88078810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa98034000 tx=0x7ffa9802e000 comp rx=0 tx=0).stop 2024-05-17T04:09:02.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.988+0000 7ffaacfa8640 1 -- 172.21.15.131:0/133768895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaa80b4cc0 msgr2=0x7ffaa81400c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:02.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.988+0000 7ffaacfa8640 1 --2- 172.21.15.131:0/133768895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaa80b4cc0 0x7ffaa81400c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c820 tx=0x7ffa9000cce0 comp rx=0 tx=0).stop 2024-05-17T04:09:02.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.988+0000 7ffaacfa8640 1 -- 172.21.15.131:0/133768895 shutdown_connections 2024-05-17T04:09:02.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.988+0000 7ffaacfa8640 1 --2- 172.21.15.131:0/133768895 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ffa88076300 0x7ffa88078810 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:02.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.988+0000 7ffaacfa8640 1 --2- 172.21.15.131:0/133768895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaa80b4cc0 0x7ffaa81400c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:02.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.988+0000 7ffaacfa8640 1 --2- 172.21.15.131:0/133768895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffaa815d300 0x7ffaa81e6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:02.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.988+0000 7ffaacfa8640 1 --2- 172.21.15.131:0/133768895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa80b48b0 0x7ffaa81434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:02.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.988+0000 7ffaacfa8640 1 -- 172.21.15.131:0/133768895 >> 172.21.15.131:0/133768895 conn(0x7ffaa80b36d0 msgr2=0x7ffaa8154de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:02.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.988+0000 7ffaacfa8640 1 -- 172.21.15.131:0/133768895 shutdown_connections 2024-05-17T04:09:02.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:02.988+0000 7ffaacfa8640 1 -- 172.21.15.131:0/133768895 wait complete. 2024-05-17T04:09:03.000 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-17T04:09:03.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.109+0000 7f7e7328f640 1 Processor -- start 2024-05-17T04:09:03.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.109+0000 7f7e7328f640 1 -- start start 2024-05-17T04:09:03.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7328f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7e6c0cddd0 0x7f7e6c0cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:03.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7328f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7e6c0d0120 0x7f7e6c15da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:03.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7328f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e6c15df80 0x7f7e6c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:03.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7328f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7e6c0b8ef0 con 0x7f7e6c0d0120 2024-05-17T04:09:03.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7328f640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f7e6c15e970 con 0x7f7e6c0cddd0 2024-05-17T04:09:03.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7328f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6c0d0530 con 0x7f7e6c15df80 2024-05-17T04:09:03.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7082a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7e6c0d0120 0x7f7e6c15da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:03.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7082a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7e6c0d0120 0x7f7e6c15da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:36384/0 (socket says 172.21.15.131:36384) 2024-05-17T04:09:03.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7082a640 1 -- 172.21.15.131:0/2245468042 learned_addr learned my addr 172.21.15.131:0/2245468042 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:03.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7102b640 1 --2- 172.21.15.131:0/2245468042 >> v2:172.21.15.150:3300/0 conn(0x7f7e6c0cddd0 0x7f7e6c0cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:03.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7182c640 1 --2- 172.21.15.131:0/2245468042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e6c15df80 0x7f7e6c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:03.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7082a640 1 -- 172.21.15.131:0/2245468042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e6c15df80 msgr2=0x7f7e6c153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:03.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7082a640 1 --2- 172.21.15.131:0/2245468042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e6c15df80 0x7f7e6c153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7082a640 1 -- 172.21.15.131:0/2245468042 >> v2:172.21.15.150:3300/0 conn(0x7f7e6c0cddd0 msgr2=0x7f7e6c0cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:03.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7082a640 1 --2- 172.21.15.131:0/2245468042 >> v2:172.21.15.150:3300/0 conn(0x7f7e6c0cddd0 0x7f7e6c0cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7082a640 1 -- 172.21.15.131:0/2245468042 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6c15e690 con 0x7f7e6c0d0120 2024-05-17T04:09:03.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.111+0000 7f7e7102b640 1 --2- 172.21.15.131:0/2245468042 >> v2:172.21.15.150:3300/0 conn(0x7f7e6c0cddd0 0x7f7e6c0cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:03.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.112+0000 7f7e7082a640 1 --2- 172.21.15.131:0/2245468042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e6c0d0120 0x7f7e6c15da40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0d06e0 tx=0x7f7e5c02a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8046e1b459fea927 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:03.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.112+0000 7f7e63fff640 1 -- 172.21.15.131:0/2245468042 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c037070 con 0x7f7e6c0d0120 2024-05-17T04:09:03.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.112+0000 7f7e63fff640 1 -- 172.21.15.131:0/2245468042 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e5c02adf0 con 0x7f7e6c0d0120 2024-05-17T04:09:03.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.112+0000 7f7e63fff640 1 -- 172.21.15.131:0/2245468042 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c032660 con 0x7f7e6c0d0120 2024-05-17T04:09:03.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.113+0000 7f7e7328f640 1 -- 172.21.15.131:0/2245468042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e6c0d0120 msgr2=0x7f7e6c15da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:03.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.113+0000 7f7e7328f640 1 --2- 172.21.15.131:0/2245468042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e6c0d0120 0x7f7e6c15da40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0d06e0 tx=0x7f7e5c02a0a0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.113+0000 7f7e7328f640 1 -- 172.21.15.131:0/2245468042 shutdown_connections 2024-05-17T04:09:03.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.113+0000 7f7e7328f640 1 --2- 172.21.15.131:0/2245468042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e6c15df80 0x7f7e6c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.113+0000 7f7e7328f640 1 --2- 172.21.15.131:0/2245468042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e6c0d0120 0x7f7e6c15da40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.113+0000 7f7e7328f640 1 --2- 172.21.15.131:0/2245468042 >> v2:172.21.15.150:3300/0 conn(0x7f7e6c0cddd0 0x7f7e6c0cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.113+0000 7f7e7328f640 1 -- 172.21.15.131:0/2245468042 >> 172.21.15.131:0/2245468042 conn(0x7f7e6c0b4e40 msgr2=0x7f7e6c0b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:03.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.113+0000 7f7e7328f640 1 -- 172.21.15.131:0/2245468042 shutdown_connections 2024-05-17T04:09:03.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.113+0000 7f7e7328f640 1 -- 172.21.15.131:0/2245468042 wait complete. 2024-05-17T04:09:03.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.115+0000 7f7e7328f640 1 Processor -- start 2024-05-17T04:09:03.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.115+0000 7f7e7328f640 1 -- start start 2024-05-17T04:09:03.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7328f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e6c0cddd0 0x7f7e6c0c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:03.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7328f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e6c0d0120 0x7f7e6c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:03.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7328f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e6c15df80 0x7f7e6c15c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7328f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c15e390 con 0x7f7e6c0cddd0 2024-05-17T04:09:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7328f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c0d10b0 con 0x7f7e6c15df80 2024-05-17T04:09:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7328f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6c0ce1e0 con 0x7f7e6c0d0120 2024-05-17T04:09:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7102b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e6c0cddd0 0x7f7e6c0c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7102b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e6c0cddd0 0x7f7e6c0c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:36390/0 (socket says 172.21.15.131:36390) 2024-05-17T04:09:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7102b640 1 -- 172.21.15.131:0/2238540955 learned_addr learned my addr 172.21.15.131:0/2238540955 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7082a640 1 --2- 172.21.15.131:0/2238540955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e6c0d0120 0x7f7e6c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7182c640 1 --2- 172.21.15.131:0/2238540955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e6c15df80 0x7f7e6c15c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7102b640 1 -- 172.21.15.131:0/2238540955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e6c0d0120 msgr2=0x7f7e6c15c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7102b640 1 --2- 172.21.15.131:0/2238540955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e6c0d0120 0x7f7e6c15c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7102b640 1 -- 172.21.15.131:0/2238540955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e6c15df80 msgr2=0x7f7e6c15c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7102b640 1 --2- 172.21.15.131:0/2238540955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e6c15df80 0x7f7e6c15c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.116+0000 7f7e7102b640 1 -- 172.21.15.131:0/2238540955 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6c0c6f80 con 0x7f7e6c0cddd0 2024-05-17T04:09:03.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.117+0000 7f7e7102b640 1 --2- 172.21.15.131:0/2238540955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e6c0cddd0 0x7f7e6c0c8020 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800d830 tx=0x7f7e6800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:03.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.117+0000 7f7e61ffb640 1 -- 172.21.15.131:0/2238540955 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68018070 con 0x7f7e6c0cddd0 2024-05-17T04:09:03.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.117+0000 7f7e61ffb640 1 -- 172.21.15.131:0/2238540955 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6800be10 con 0x7f7e6c0cddd0 2024-05-17T04:09:03.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.117+0000 7f7e7328f640 1 -- 172.21.15.131:0/2238540955 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e6c0c7260 con 0x7f7e6c0cddd0 2024-05-17T04:09:03.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.117+0000 7f7e61ffb640 1 -- 172.21.15.131:0/2238540955 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68004250 con 0x7f7e6c0cddd0 2024-05-17T04:09:03.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.117+0000 7f7e7328f640 1 -- 172.21.15.131:0/2238540955 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e6c0c7820 con 0x7f7e6c0cddd0 2024-05-17T04:09:03.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.118+0000 7f7e7328f640 1 -- 172.21.15.131:0/2238540955 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e6c0c6b80 con 0x7f7e6c0cddd0 2024-05-17T04:09:03.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.118+0000 7f7e61ffb640 1 -- 172.21.15.131:0/2238540955 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7e680098b0 con 0x7f7e6c0cddd0 2024-05-17T04:09:03.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.119+0000 7f7e61ffb640 1 --2- 172.21.15.131:0/2238540955 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7e50076300 0x7f7e50078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:03.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.119+0000 7f7e61ffb640 1 -- 172.21.15.131:0/2238540955 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f7e68097430 con 0x7f7e6c0cddd0 2024-05-17T04:09:03.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.119+0000 7f7e7082a640 1 --2- 172.21.15.131:0/2238540955 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7e50076300 0x7f7e50078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:03.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.119+0000 7f7e7082a640 1 --2- 172.21.15.131:0/2238540955 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7e50076300 0x7f7e50078810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c034000 tx=0x7f7e5c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:03.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.123+0000 7f7e61ffb640 1 -- 172.21.15.131:0/2238540955 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7e68060a00 con 0x7f7e6c0cddd0 2024-05-17T04:09:03.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.304+0000 7f7e7328f640 1 -- 172.21.15.131:0/2238540955 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7e6c0cfbe0 con 0x7f7e6c0cddd0 2024-05-17T04:09:03.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.305+0000 7f7e61ffb640 1 -- 172.21.15.131:0/2238540955 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f7e68064d00 con 0x7f7e6c0cddd0 2024-05-17T04:09:03.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:03.306 INFO:teuthology.orchestra.run.smithi131.stdout:[ 2024-05-17T04:09:03.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:03.306 INFO:teuthology.orchestra.run.smithi131.stdout: "poolnum": 1, 2024-05-17T04:09:03.306 INFO:teuthology.orchestra.run.smithi131.stdout: "poolname": ".mgr" 2024-05-17T04:09:03.306 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:03.307 INFO:teuthology.orchestra.run.smithi131.stdout:] 2024-05-17T04:09:03.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.307+0000 7f7e7328f640 1 -- 172.21.15.131:0/2238540955 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7e50076300 msgr2=0x7f7e50078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:03.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.307+0000 7f7e7328f640 1 --2- 172.21.15.131:0/2238540955 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7e50076300 0x7f7e50078810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c034000 tx=0x7f7e5c02e000 comp rx=0 tx=0).stop 2024-05-17T04:09:03.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.307+0000 7f7e7328f640 1 -- 172.21.15.131:0/2238540955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e6c0cddd0 msgr2=0x7f7e6c0c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:03.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.307+0000 7f7e7328f640 1 --2- 172.21.15.131:0/2238540955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e6c0cddd0 0x7f7e6c0c8020 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800d830 tx=0x7f7e6800dcf0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.307+0000 7f7e7328f640 1 -- 172.21.15.131:0/2238540955 shutdown_connections 2024-05-17T04:09:03.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.307+0000 7f7e7328f640 1 --2- 172.21.15.131:0/2238540955 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7e50076300 0x7f7e50078810 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.307+0000 7f7e7328f640 1 --2- 172.21.15.131:0/2238540955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e6c15df80 0x7f7e6c15c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.307+0000 7f7e7328f640 1 --2- 172.21.15.131:0/2238540955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e6c0d0120 0x7f7e6c15c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.307+0000 7f7e7328f640 1 --2- 172.21.15.131:0/2238540955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e6c0cddd0 0x7f7e6c0c8020 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.307+0000 7f7e7328f640 1 -- 172.21.15.131:0/2238540955 >> 172.21.15.131:0/2238540955 conn(0x7f7e6c0b4e40 msgr2=0x7f7e6c15f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:03.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.307+0000 7f7e7328f640 1 -- 172.21.15.131:0/2238540955 shutdown_connections 2024-05-17T04:09:03.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.307+0000 7f7e7328f640 1 -- 172.21.15.131:0/2238540955 wait complete. 2024-05-17T04:09:03.319 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-17T04:09:03.319 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-17T04:09:03.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.436+0000 7f51d1b70640 1 Processor -- start 2024-05-17T04:09:03.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.436+0000 7f51d1b70640 1 -- start start 2024-05-17T04:09:03.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.437+0000 7f51d1b70640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f51cc0cdfe0 0x7f51cc0d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:03.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.437+0000 7f51d1b70640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51cc0d05f0 0x7f51cc0b6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:03.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.437+0000 7f51d1b70640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51cc15da80 con 0x7f51cc15d670 2024-05-17T04:09:03.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.437+0000 7f51d1b70640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f51cc0d0a00 con 0x7f51cc0cdfe0 2024-05-17T04:09:03.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.437+0000 7f51d1b70640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f51cc0d2640 con 0x7f51cc0d05f0 2024-05-17T04:09:03.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.437+0000 7f51cb7fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f51cc15d670 0x7f51cc0d1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:43086/0 (socket says 172.21.15.131:43086) 2024-05-17T04:09:03.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.437+0000 7f51cb7fe640 1 -- 172.21.15.131:0/3186692731 learned_addr learned my addr 172.21.15.131:0/3186692731 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:03.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.437+0000 7f51caffd640 1 --2- 172.21.15.131:0/3186692731 >> v2:172.21.15.150:3300/0 conn(0x7f51cc0cdfe0 0x7f51cc0d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:03.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.437+0000 7f51cbfff640 1 --2- 172.21.15.131:0/3186692731 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51cc0d05f0 0x7f51cc0b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:03.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.437+0000 7f51ca7fc640 1 -- 172.21.15.131:0/3186692731 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 85289319 0 0) 0x7f51cc15da80 con 0x7f51cc15d670 2024-05-17T04:09:03.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.438+0000 7f51ca7fc640 1 -- 172.21.15.131:0/3186692731 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51b4003520 con 0x7f51cc15d670 2024-05-17T04:09:03.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.438+0000 7f51cbfff640 1 -- 172.21.15.131:0/3186692731 >> v2:172.21.15.150:3300/0 conn(0x7f51cc0cdfe0 msgr2=0x7f51cc0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:03.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.438+0000 7f51cbfff640 1 --2- 172.21.15.131:0/3186692731 >> v2:172.21.15.150:3300/0 conn(0x7f51cc0cdfe0 0x7f51cc0d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.438+0000 7f51ca7fc640 1 -- 172.21.15.131:0/3186692731 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 494071584 0 0) 0x7f51b4003520 con 0x7f51cc15d670 2024-05-17T04:09:03.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.438+0000 7f51cbfff640 1 -- 172.21.15.131:0/3186692731 >> v1:172.21.15.131:6789/0 conn(0x7f51cc15d670 legacy=0x7f51cc0d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:03.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.438+0000 7f51cbfff640 1 -- 172.21.15.131:0/3186692731 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51cc0d2920 con 0x7f51cc0d05f0 2024-05-17T04:09:03.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.438+0000 7f51caffd640 1 --2- 172.21.15.131:0/3186692731 >> v2:172.21.15.150:3300/0 conn(0x7f51cc0cdfe0 0x7f51cc0d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:03.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.438+0000 7f51cbfff640 1 --2- 172.21.15.131:0/3186692731 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51cc0d05f0 0x7f51cc0b6560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f51c40097a0 tx=0x7f51c402a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5932236ff0a1f077 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:03.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.439+0000 7f51ca7fc640 1 -- 172.21.15.131:0/3186692731 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4037070 con 0x7f51cc0d05f0 2024-05-17T04:09:03.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.439+0000 7f51ca7fc640 1 -- 172.21.15.131:0/3186692731 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c402ab10 con 0x7f51cc0d05f0 2024-05-17T04:09:03.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.439+0000 7f51ca7fc640 1 -- 172.21.15.131:0/3186692731 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc001a70 con 0x7f51cc0d05f0 2024-05-17T04:09:03.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.439+0000 7f51d1b70640 1 -- 172.21.15.131:0/3186692731 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51cc0d05f0 msgr2=0x7f51cc0b6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:03.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.439+0000 7f51d1b70640 1 --2- 172.21.15.131:0/3186692731 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51cc0d05f0 0x7f51cc0b6560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f51c40097a0 tx=0x7f51c402a080 comp rx=0 tx=0).stop 2024-05-17T04:09:03.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.439+0000 7f51d1b70640 1 -- 172.21.15.131:0/3186692731 shutdown_connections 2024-05-17T04:09:03.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.439+0000 7f51d1b70640 1 --2- 172.21.15.131:0/3186692731 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51cc0d05f0 0x7f51cc0b6560 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.439+0000 7f51d1b70640 1 --2- 172.21.15.131:0/3186692731 >> v2:172.21.15.150:3300/0 conn(0x7f51cc0cdfe0 0x7f51cc0d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.439+0000 7f51d1b70640 1 -- 172.21.15.131:0/3186692731 >> 172.21.15.131:0/3186692731 conn(0x7f51cc0b5080 msgr2=0x7f51cc0b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:03.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.439+0000 7f51d1b70640 1 -- 172.21.15.131:0/3186692731 shutdown_connections 2024-05-17T04:09:03.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.439+0000 7f51d1b70640 1 -- 172.21.15.131:0/3186692731 wait complete. 2024-05-17T04:09:03.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.441+0000 7f51d1b70640 1 Processor -- start 2024-05-17T04:09:03.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.441+0000 7f51d1b70640 1 -- start start 2024-05-17T04:09:03.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51d1b70640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51cc0cdfe0 0x7f51cc0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:03.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51d1b70640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc0d05f0 0x7f51cc0b8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:03.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51d1b70640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51cc15d670 0x7f51cc1e8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:03.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51d1b70640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc0ce3f0 con 0x7f51cc0cdfe0 2024-05-17T04:09:03.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51d1b70640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc0d2ee0 con 0x7f51cc0d05f0 2024-05-17T04:09:03.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51d1b70640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f51cc0b6aa0 con 0x7f51cc15d670 2024-05-17T04:09:03.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51cb7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51cc0cdfe0 0x7f51cc0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:03.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51cb7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51cc0cdfe0 0x7f51cc0cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:36402/0 (socket says 172.21.15.131:36402) 2024-05-17T04:09:03.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51cb7fe640 1 -- 172.21.15.131:0/2968367494 learned_addr learned my addr 172.21.15.131:0/2968367494 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:03.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51caffd640 1 --2- 172.21.15.131:0/2968367494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc0d05f0 0x7f51cc0b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:03.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51cbfff640 1 --2- 172.21.15.131:0/2968367494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51cc15d670 0x7f51cc1e8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:03.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51cb7fe640 1 -- 172.21.15.131:0/2968367494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51cc15d670 msgr2=0x7f51cc1e8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:03.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51cb7fe640 1 --2- 172.21.15.131:0/2968367494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51cc15d670 0x7f51cc1e8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51cb7fe640 1 -- 172.21.15.131:0/2968367494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc0d05f0 msgr2=0x7f51cc0b8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:03.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51cb7fe640 1 --2- 172.21.15.131:0/2968367494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc0d05f0 0x7f51cc0b8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:03.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51cb7fe640 1 -- 172.21.15.131:0/2968367494 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51cc0cc670 con 0x7f51cc0cdfe0 2024-05-17T04:09:03.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51caffd640 1 --2- 172.21.15.131:0/2968367494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc0d05f0 0x7f51cc0b8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:03.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51cb7fe640 1 --2- 172.21.15.131:0/2968367494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51cc0cdfe0 0x7f51cc0cc130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00cbd0 tx=0x7f51bc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:03.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51b3fff640 1 -- 172.21.15.131:0/2968367494 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00ad40 con 0x7f51cc0cdfe0 2024-05-17T04:09:03.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51b3fff640 1 -- 172.21.15.131:0/2968367494 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51bc012400 con 0x7f51cc0cdfe0 2024-05-17T04:09:03.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51b3fff640 1 -- 172.21.15.131:0/2968367494 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0127f0 con 0x7f51cc0cdfe0 2024-05-17T04:09:03.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.443+0000 7f51d1b70640 1 -- 172.21.15.131:0/2968367494 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51cc1e67f0 con 0x7f51cc0cdfe0 2024-05-17T04:09:03.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.444+0000 7f51d1b70640 1 -- 172.21.15.131:0/2968367494 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51cc1e6db0 con 0x7f51cc0cdfe0 2024-05-17T04:09:03.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.444+0000 7f51d1b70640 1 -- 172.21.15.131:0/2968367494 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51cc0d00b0 con 0x7f51cc0cdfe0 2024-05-17T04:09:03.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.445+0000 7f51b3fff640 1 -- 172.21.15.131:0/2968367494 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f51bc012ba0 con 0x7f51cc0cdfe0 2024-05-17T04:09:03.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.446+0000 7f51b3fff640 1 --2- 172.21.15.131:0/2968367494 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f51b8076300 0x7f51b8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:03.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.446+0000 7f51b3fff640 1 -- 172.21.15.131:0/2968367494 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f51bc097ca0 con 0x7f51cc0cdfe0 2024-05-17T04:09:03.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.446+0000 7f51caffd640 1 --2- 172.21.15.131:0/2968367494 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f51b8076300 0x7f51b8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:03.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.446+0000 7f51caffd640 1 --2- 172.21.15.131:0/2968367494 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f51b8076300 0x7f51b8078810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0b5600 tx=0x7f51c0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:03.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.450+0000 7f51b3fff640 1 -- 172.21.15.131:0/2968367494 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f51bc0618c0 con 0x7f51cc0cdfe0 2024-05-17T04:09:03.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:03.628+0000 7f51d1b70640 1 -- 172.21.15.131:0/2968367494 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f51cc0d1250 con 0x7f51cc0cdfe0 2024-05-17T04:09:04.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.367+0000 7f51b3fff640 1 -- 172.21.15.131:0/2968367494 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f51bc0611c0 con 0x7f51cc0cdfe0 2024-05-17T04:09:04.368 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_metadata' created 2024-05-17T04:09:04.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.369+0000 7f51d1b70640 1 -- 172.21.15.131:0/2968367494 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f51b8076300 msgr2=0x7f51b8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:04.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.369+0000 7f51d1b70640 1 --2- 172.21.15.131:0/2968367494 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f51b8076300 0x7f51b8078810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0b5600 tx=0x7f51c0008040 comp rx=0 tx=0).stop 2024-05-17T04:09:04.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.369+0000 7f51d1b70640 1 -- 172.21.15.131:0/2968367494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51cc0cdfe0 msgr2=0x7f51cc0cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:04.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.369+0000 7f51d1b70640 1 --2- 172.21.15.131:0/2968367494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51cc0cdfe0 0x7f51cc0cc130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00cbd0 tx=0x7f51bc00a430 comp rx=0 tx=0).stop 2024-05-17T04:09:04.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.369+0000 7f51d1b70640 1 -- 172.21.15.131:0/2968367494 shutdown_connections 2024-05-17T04:09:04.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.370+0000 7f51d1b70640 1 --2- 172.21.15.131:0/2968367494 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f51b8076300 0x7f51b8078810 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:04.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.370+0000 7f51d1b70640 1 --2- 172.21.15.131:0/2968367494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51cc15d670 0x7f51cc1e8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:04.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.370+0000 7f51d1b70640 1 --2- 172.21.15.131:0/2968367494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc0d05f0 0x7f51cc0b8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:04.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.370+0000 7f51d1b70640 1 --2- 172.21.15.131:0/2968367494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51cc0cdfe0 0x7f51cc0cc130 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:04.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.370+0000 7f51d1b70640 1 -- 172.21.15.131:0/2968367494 >> 172.21.15.131:0/2968367494 conn(0x7f51cc0b5080 msgr2=0x7f51cc15dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:04.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.370+0000 7f51d1b70640 1 -- 172.21.15.131:0/2968367494 shutdown_connections 2024-05-17T04:09:04.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.370+0000 7f51d1b70640 1 -- 172.21.15.131:0/2968367494 wait complete. 2024-05-17T04:09:04.387 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-17T04:09:04.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.505+0000 7f4817266640 1 Processor -- start 2024-05-17T04:09:04.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.505+0000 7f4817266640 1 -- start start 2024-05-17T04:09:04.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.506+0000 7f4817266640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4810145a60 0x7f4810163cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:04.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.506+0000 7f4817266640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4810073eb0 0x7f48100742c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:04.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4817266640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4810164230 con 0x7f48100b6200 2024-05-17T04:09:04.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4817266640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f48100d1840 con 0x7f4810073eb0 2024-05-17T04:09:04.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4817266640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f48100b0aa0 con 0x7f4810145a60 2024-05-17T04:09:04.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4815803640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f48100b6200 0x7f48100b6610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:45940/0 (socket says 172.21.15.131:45940) 2024-05-17T04:09:04.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4815803640 1 -- 172.21.15.131:0/3363839091 learned_addr learned my addr 172.21.15.131:0/3363839091 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:04.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4814801640 1 --2- 172.21.15.131:0/3363839091 >> v2:172.21.15.150:3300/0 conn(0x7f4810073eb0 0x7f48100742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4815002640 1 --2- 172.21.15.131:0/3363839091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4810145a60 0x7f4810163cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4807fff640 1 -- 172.21.15.131:0/3363839091 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178198895 0 0) 0x7f4808001110 con 0x7f48100b6200 2024-05-17T04:09:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4807fff640 1 -- 172.21.15.131:0/3363839091 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47fc003520 con 0x7f48100b6200 2024-05-17T04:09:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4807fff640 1 -- 172.21.15.131:0/3363839091 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1617715793 0 0) 0x7f47fc003520 con 0x7f48100b6200 2024-05-17T04:09:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4807fff640 1 -- 172.21.15.131:0/3363839091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4810145a60 msgr2=0x7f4810163cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4807fff640 1 --2- 172.21.15.131:0/3363839091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4810145a60 0x7f4810163cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4807fff640 1 -- 172.21.15.131:0/3363839091 >> v2:172.21.15.150:3300/0 conn(0x7f4810073eb0 msgr2=0x7f48100742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4807fff640 1 --2- 172.21.15.131:0/3363839091 >> v2:172.21.15.150:3300/0 conn(0x7f4810073eb0 0x7f48100742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4807fff640 1 -- 172.21.15.131:0/3363839091 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4810074800 con 0x7f48100b6200 2024-05-17T04:09:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4807fff640 1 -- 172.21.15.131:0/3363839091 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7f48080018c0 con 0x7f48100b6200 2024-05-17T04:09:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.507+0000 7f4807fff640 1 -- 172.21.15.131:0/3363839091 >> v1:172.21.15.131:6789/0 conn(0x7f48100b6200 legacy=0x7f48100b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.508+0000 7f4807fff640 1 --2- 172.21.15.131:0/3363839091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc003a00 0x7f47fc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.508+0000 7f4807fff640 1 --2- 172.21.15.131:0/3363839091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4810145a60 0x7f47fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.508+0000 7f4807fff640 1 --2- 172.21.15.131:0/3363839091 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47fc004d40 0x7f47fc005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.508+0000 7f4807fff640 1 -- 172.21.15.131:0/3363839091 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f48100d1840 con 0x7f47fc003a00 2024-05-17T04:09:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.508+0000 7f4807fff640 1 -- 172.21.15.131:0/3363839091 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f48100b0aa0 con 0x7f47fc004d40 2024-05-17T04:09:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.508+0000 7f4807fff640 1 -- 172.21.15.131:0/3363839091 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f47fc00ba70 con 0x7f4810145a60 2024-05-17T04:09:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.508+0000 7f4815002640 1 --2- 172.21.15.131:0/3363839091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc003a00 0x7f47fc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.508+0000 7f4814801640 1 --2- 172.21.15.131:0/3363839091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4810145a60 0x7f47fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.508+0000 7f4815803640 1 --2- 172.21.15.131:0/3363839091 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47fc004d40 0x7f47fc005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.508+0000 7f4815002640 1 -- 172.21.15.131:0/3363839091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4810145a60 msgr2=0x7f47fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.508+0000 7f4815002640 1 --2- 172.21.15.131:0/3363839091 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4810145a60 0x7f47fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.508+0000 7f4815002640 1 -- 172.21.15.131:0/3363839091 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47fc004d40 msgr2=0x7f47fc005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.508+0000 7f4815002640 1 --2- 172.21.15.131:0/3363839091 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47fc004d40 0x7f47fc005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.508+0000 7f4815002640 1 -- 172.21.15.131:0/3363839091 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47fc003520 con 0x7f47fc003a00 2024-05-17T04:09:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.509+0000 7f4815002640 1 --2- 172.21.15.131:0/3363839091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc003a00 0x7f47fc003e70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f480c009fc0 tx=0x7f47fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ff9304e61f87c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.509+0000 7f4807fff640 1 -- 172.21.15.131:0/3363839091 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480c034020 con 0x7f47fc003a00 2024-05-17T04:09:04.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.509+0000 7f4807fff640 1 -- 172.21.15.131:0/3363839091 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f480c0305f0 con 0x7f47fc003a00 2024-05-17T04:09:04.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.509+0000 7f4807fff640 1 -- 172.21.15.131:0/3363839091 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480c009c10 con 0x7f47fc003a00 2024-05-17T04:09:04.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.510+0000 7f4817266640 1 -- 172.21.15.131:0/3363839091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc003a00 msgr2=0x7f47fc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:04.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.510+0000 7f4817266640 1 --2- 172.21.15.131:0/3363839091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc003a00 0x7f47fc003e70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f480c009fc0 tx=0x7f47fc005830 comp rx=0 tx=0).stop 2024-05-17T04:09:04.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.510+0000 7f4815803640 1 -- 172.21.15.131:0/3363839091 reap_dead start 2024-05-17T04:09:04.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.510+0000 7f4817266640 1 -- 172.21.15.131:0/3363839091 shutdown_connections 2024-05-17T04:09:04.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.510+0000 7f4817266640 1 -- 172.21.15.131:0/3363839091 >> 172.21.15.131:0/3363839091 conn(0x7f48100b4450 msgr2=0x7f48100737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:04.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.510+0000 7f4817266640 1 -- 172.21.15.131:0/3363839091 shutdown_connections 2024-05-17T04:09:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.510+0000 7f4817266640 1 -- 172.21.15.131:0/3363839091 wait complete. 2024-05-17T04:09:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.512+0000 7f4817266640 1 Processor -- start 2024-05-17T04:09:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.512+0000 7f4817266640 1 -- start start 2024-05-17T04:09:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4817266640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47fc003a00 0x7f48101f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4817266640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f481006f940 0x7f48100c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4817266640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48101f8930 0x7f48101f8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4817266640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f48100d0f10 con 0x7f48101f8930 2024-05-17T04:09:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4817266640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f48100d0c30 con 0x7f481006f940 2024-05-17T04:09:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4817266640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f48100d11f0 con 0x7f47fc003a00 2024-05-17T04:09:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4815803640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48101f8930 0x7f48101f8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4815803640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48101f8930 0x7f48101f8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33978/0 (socket says 172.21.15.131:33978) 2024-05-17T04:09:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4815803640 1 -- 172.21.15.131:0/166682404 learned_addr learned my addr 172.21.15.131:0/166682404 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4814801640 1 --2- 172.21.15.131:0/166682404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f481006f940 0x7f48100c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4815002640 1 --2- 172.21.15.131:0/166682404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47fc003a00 0x7f48101f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:04.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4815803640 1 -- 172.21.15.131:0/166682404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47fc003a00 msgr2=0x7f48101f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:04.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4815803640 1 --2- 172.21.15.131:0/166682404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47fc003a00 0x7f48101f27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:04.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4815803640 1 -- 172.21.15.131:0/166682404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f481006f940 msgr2=0x7f48100c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:04.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4815803640 1 --2- 172.21.15.131:0/166682404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f481006f940 0x7f48100c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:04.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4815803640 1 -- 172.21.15.131:0/166682404 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48101f9280 con 0x7f48101f8930 2024-05-17T04:09:04.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4814801640 1 --2- 172.21.15.131:0/166682404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f481006f940 0x7f48100c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:04.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4815803640 1 --2- 172.21.15.131:0/166682404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48101f8930 0x7f48101f8d40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4808001a30 tx=0x7f4808007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:04.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4805ffb640 1 -- 172.21.15.131:0/166682404 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480801a070 con 0x7f48101f8930 2024-05-17T04:09:04.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.513+0000 7f4805ffb640 1 -- 172.21.15.131:0/166682404 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4808001180 con 0x7f48101f8930 2024-05-17T04:09:04.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.514+0000 7f4817266640 1 -- 172.21.15.131:0/166682404 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48100c75a0 con 0x7f48101f8930 2024-05-17T04:09:04.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.514+0000 7f4805ffb640 1 -- 172.21.15.131:0/166682404 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480800fb00 con 0x7f48101f8930 2024-05-17T04:09:04.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.514+0000 7f4817266640 1 -- 172.21.15.131:0/166682404 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48100c7b50 con 0x7f48101f8930 2024-05-17T04:09:04.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.515+0000 7f4817266640 1 -- 172.21.15.131:0/166682404 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48101490c0 con 0x7f48101f8930 2024-05-17T04:09:04.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.516+0000 7f4805ffb640 1 -- 172.21.15.131:0/166682404 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f480801d070 con 0x7f48101f8930 2024-05-17T04:09:04.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.516+0000 7f4805ffb640 1 --2- 172.21.15.131:0/166682404 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f47f4076300 0x7f47f4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:04.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.516+0000 7f4805ffb640 1 -- 172.21.15.131:0/166682404 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f4808096a60 con 0x7f48101f8930 2024-05-17T04:09:04.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.516+0000 7f4815002640 1 --2- 172.21.15.131:0/166682404 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f47f4076300 0x7f47f4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:04.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.517+0000 7f4815002640 1 --2- 172.21.15.131:0/166682404 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f47f4076300 0x7f47f4078810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f480c033040 tx=0x7f480c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:04.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.521+0000 7f4805ffb640 1 -- 172.21.15.131:0/166682404 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f48101f9280 con 0x7f48101f8930 2024-05-17T04:09:04.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:04.703+0000 7f4817266640 1 -- 172.21.15.131:0/166682404 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f4810163500 con 0x7f48101f8930 2024-05-17T04:09:05.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.374+0000 7f4805ffb640 1 -- 172.21.15.131:0/166682404 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f4810074800 con 0x7f48101f8930 2024-05-17T04:09:05.375 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_data' created 2024-05-17T04:09:05.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.377+0000 7f4817266640 1 -- 172.21.15.131:0/166682404 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f47f4076300 msgr2=0x7f47f4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:05.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.377+0000 7f4817266640 1 --2- 172.21.15.131:0/166682404 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f47f4076300 0x7f47f4078810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f480c033040 tx=0x7f480c02f000 comp rx=0 tx=0).stop 2024-05-17T04:09:05.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.377+0000 7f4817266640 1 -- 172.21.15.131:0/166682404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48101f8930 msgr2=0x7f48101f8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:05.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.377+0000 7f4817266640 1 --2- 172.21.15.131:0/166682404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48101f8930 0x7f48101f8d40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4808001a30 tx=0x7f4808007720 comp rx=0 tx=0).stop 2024-05-17T04:09:05.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.377+0000 7f4817266640 1 -- 172.21.15.131:0/166682404 shutdown_connections 2024-05-17T04:09:05.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.377+0000 7f4817266640 1 --2- 172.21.15.131:0/166682404 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f47f4076300 0x7f47f4078810 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:05.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.377+0000 7f4817266640 1 --2- 172.21.15.131:0/166682404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48101f8930 0x7f48101f8d40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:05.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.377+0000 7f4817266640 1 --2- 172.21.15.131:0/166682404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f481006f940 0x7f48100c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:05.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.377+0000 7f4817266640 1 --2- 172.21.15.131:0/166682404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47fc003a00 0x7f48101f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:05.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.377+0000 7f4817266640 1 -- 172.21.15.131:0/166682404 >> 172.21.15.131:0/166682404 conn(0x7f48100b4450 msgr2=0x7f4810146080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:05.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.377+0000 7f4817266640 1 -- 172.21.15.131:0/166682404 shutdown_connections 2024-05-17T04:09:05.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.377+0000 7f4817266640 1 -- 172.21.15.131:0/166682404 wait complete. 2024-05-17T04:09:05.405 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-17T04:09:05.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.520+0000 7fd70b991640 1 Processor -- start 2024-05-17T04:09:05.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.520+0000 7fd70b991640 1 -- start start 2024-05-17T04:09:05.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.521+0000 7fd70b991640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd704073eb0 0x7fd7040742c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:05.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.521+0000 7fd70b991640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7040afa90 0x7fd7040afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:05.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.521+0000 7fd70b991640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd704074800 con 0x7fd704145a60 2024-05-17T04:09:05.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.521+0000 7fd70b991640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd7040d1840 con 0x7fd704073eb0 2024-05-17T04:09:05.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.521+0000 7fd70b991640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd704145e70 con 0x7fd7040afa90 2024-05-17T04:09:05.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.521+0000 7fd708f2c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd704073eb0 0x7fd7040742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:05.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.522+0000 7fd709f2e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7040afa90 0x7fd7040afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:05.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.522+0000 7fd70972d640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd704145a60 0x7fd704163cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:48772/0 (socket says 172.21.15.131:48772) 2024-05-17T04:09:05.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.522+0000 7fd70972d640 1 -- 172.21.15.131:0/3951079524 learned_addr learned my addr 172.21.15.131:0/3951079524 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:05.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.522+0000 7fd708f2c640 1 -- 172.21.15.131:0/3951079524 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7040afa90 msgr2=0x7fd7040afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:05.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.522+0000 7fd708f2c640 1 --2- 172.21.15.131:0/3951079524 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7040afa90 0x7fd7040afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:05.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.522+0000 7fd708f2c640 1 -- 172.21.15.131:0/3951079524 >> v1:172.21.15.150:6789/0 conn(0x7fd704145a60 legacy=0x7fd704163cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:05.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.522+0000 7fd708f2c640 1 -- 172.21.15.131:0/3951079524 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7040d0c30 con 0x7fd704073eb0 2024-05-17T04:09:05.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.522+0000 7fd709f2e640 1 --2- 172.21.15.131:0/3951079524 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7040afa90 0x7fd7040afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:05.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.523+0000 7fd708f2c640 1 --2- 172.21.15.131:0/3951079524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd704073eb0 0x7fd7040742c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80097a0 tx=0x7fd6f802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52a2663afd43196a server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:05.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.523+0000 7fd703fff640 1 -- 172.21.15.131:0/3951079524 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8037070 con 0x7fd704073eb0 2024-05-17T04:09:05.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.523+0000 7fd703fff640 1 -- 172.21.15.131:0/3951079524 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f8032440 con 0x7fd704073eb0 2024-05-17T04:09:05.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.523+0000 7fd703fff640 1 -- 172.21.15.131:0/3951079524 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8032810 con 0x7fd704073eb0 2024-05-17T04:09:05.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.523+0000 7fd70b991640 1 -- 172.21.15.131:0/3951079524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd704073eb0 msgr2=0x7fd7040742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:05.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.523+0000 7fd70b991640 1 --2- 172.21.15.131:0/3951079524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd704073eb0 0x7fd7040742c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80097a0 tx=0x7fd6f802a180 comp rx=0 tx=0).stop 2024-05-17T04:09:05.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.524+0000 7fd70b991640 1 -- 172.21.15.131:0/3951079524 shutdown_connections 2024-05-17T04:09:05.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.524+0000 7fd70b991640 1 --2- 172.21.15.131:0/3951079524 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7040afa90 0x7fd7040afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:05.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.524+0000 7fd70b991640 1 --2- 172.21.15.131:0/3951079524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd704073eb0 0x7fd7040742c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:05.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.524+0000 7fd70b991640 1 -- 172.21.15.131:0/3951079524 >> 172.21.15.131:0/3951079524 conn(0x7fd7040b4450 msgr2=0x7fd7040737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:05.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.524+0000 7fd70b991640 1 -- 172.21.15.131:0/3951079524 shutdown_connections 2024-05-17T04:09:05.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.524+0000 7fd70b991640 1 -- 172.21.15.131:0/3951079524 wait complete. 2024-05-17T04:09:05.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.525+0000 7fd70b991640 1 Processor -- start 2024-05-17T04:09:05.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.525+0000 7fd70b991640 1 -- start start 2024-05-17T04:09:05.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd70b991640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd704073eb0 0x7fd704160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:05.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd70b991640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7040afa90 0x7fd70413c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:05.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd70b991640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd704145a60 0x7fd70413cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:05.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd70b991640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd7040d14d0 con 0x7fd704073eb0 2024-05-17T04:09:05.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd70b991640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd7040d11f0 con 0x7fd704145a60 2024-05-17T04:09:05.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd70b991640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd7041490c0 con 0x7fd7040afa90 2024-05-17T04:09:05.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd70972d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd704073eb0 0x7fd704160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:05.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd70972d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd704073eb0 0x7fd704160770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33988/0 (socket says 172.21.15.131:33988) 2024-05-17T04:09:05.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd70972d640 1 -- 172.21.15.131:0/3296667984 learned_addr learned my addr 172.21.15.131:0/3296667984 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:05.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd709f2e640 1 --2- 172.21.15.131:0/3296667984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd704145a60 0x7fd70413cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:05.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd708f2c640 1 --2- 172.21.15.131:0/3296667984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7040afa90 0x7fd70413c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:05.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd70972d640 1 -- 172.21.15.131:0/3296667984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7040afa90 msgr2=0x7fd70413c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:05.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd70972d640 1 --2- 172.21.15.131:0/3296667984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7040afa90 0x7fd70413c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:05.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd70972d640 1 -- 172.21.15.131:0/3296667984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd704145a60 msgr2=0x7fd70413cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:05.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd70972d640 1 --2- 172.21.15.131:0/3296667984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd704145a60 0x7fd70413cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:05.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd70972d640 1 -- 172.21.15.131:0/3296667984 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7041610e0 con 0x7fd704073eb0 2024-05-17T04:09:05.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd70972d640 1 --2- 172.21.15.131:0/3296667984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd704073eb0 0x7fd704160770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400cae0 tx=0x7fd6f400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:05.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.527+0000 7fd701ffb640 1 -- 172.21.15.131:0/3296667984 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4017070 con 0x7fd704073eb0 2024-05-17T04:09:05.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.528+0000 7fd701ffb640 1 -- 172.21.15.131:0/3296667984 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f400abf0 con 0x7fd704073eb0 2024-05-17T04:09:05.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.528+0000 7fd70b991640 1 -- 172.21.15.131:0/3296667984 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7041613c0 con 0x7fd704073eb0 2024-05-17T04:09:05.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.528+0000 7fd701ffb640 1 -- 172.21.15.131:0/3296667984 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4012400 con 0x7fd704073eb0 2024-05-17T04:09:05.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.528+0000 7fd70b991640 1 -- 172.21.15.131:0/3296667984 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd70406d300 con 0x7fd704073eb0 2024-05-17T04:09:05.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.529+0000 7fd70b991640 1 -- 172.21.15.131:0/3296667984 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7040d1cd0 con 0x7fd704073eb0 2024-05-17T04:09:05.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.529+0000 7fd701ffb640 1 -- 172.21.15.131:0/3296667984 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd6f401a070 con 0x7fd704073eb0 2024-05-17T04:09:05.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.530+0000 7fd701ffb640 1 --2- 172.21.15.131:0/3296667984 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd6f0076300 0x7fd6f0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:05.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.530+0000 7fd701ffb640 1 -- 172.21.15.131:0/3296667984 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fd6f4097180 con 0x7fd704073eb0 2024-05-17T04:09:05.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.530+0000 7fd708f2c640 1 --2- 172.21.15.131:0/3296667984 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd6f0076300 0x7fd6f0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:05.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.530+0000 7fd708f2c640 1 --2- 172.21.15.131:0/3296667984 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd6f0076300 0x7fd6f0078810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8034000 tx=0x7fd6f802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:05.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.534+0000 7fd701ffb640 1 -- 172.21.15.131:0/3296667984 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd704074800 con 0x7fd704073eb0 2024-05-17T04:09:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:05.753+0000 7fd70b991640 1 -- 172.21.15.131:0/3296667984 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd7040b6810 con 0x7fd704073eb0 2024-05-17T04:09:05.888 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:09:05.890 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:09:06.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.376+0000 7fd701ffb640 1 -- 172.21.15.131:0/3296667984 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fd6f40604f0 con 0x7fd704073eb0 2024-05-17T04:09:06.377 INFO:teuthology.orchestra.run.smithi131.stderr:new fs with metadata pool 2 and data pool 3 2024-05-17T04:09:06.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.381+0000 7fd70b991640 1 -- 172.21.15.131:0/3296667984 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd6f0076300 msgr2=0x7fd6f0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:06.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.381+0000 7fd70b991640 1 --2- 172.21.15.131:0/3296667984 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd6f0076300 0x7fd6f0078810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8034000 tx=0x7fd6f802e000 comp rx=0 tx=0).stop 2024-05-17T04:09:06.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.381+0000 7fd70b991640 1 -- 172.21.15.131:0/3296667984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd704073eb0 msgr2=0x7fd704160770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:06.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.381+0000 7fd70b991640 1 --2- 172.21.15.131:0/3296667984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd704073eb0 0x7fd704160770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400cae0 tx=0x7fd6f400cee0 comp rx=0 tx=0).stop 2024-05-17T04:09:06.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.381+0000 7fd70b991640 1 -- 172.21.15.131:0/3296667984 shutdown_connections 2024-05-17T04:09:06.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.381+0000 7fd70b991640 1 --2- 172.21.15.131:0/3296667984 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd6f0076300 0x7fd6f0078810 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:06.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.381+0000 7fd70b991640 1 --2- 172.21.15.131:0/3296667984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd704145a60 0x7fd70413cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:06.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.381+0000 7fd70b991640 1 --2- 172.21.15.131:0/3296667984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7040afa90 0x7fd70413c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:06.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.381+0000 7fd70b991640 1 --2- 172.21.15.131:0/3296667984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd704073eb0 0x7fd704160770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:06.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.381+0000 7fd70b991640 1 -- 172.21.15.131:0/3296667984 >> 172.21.15.131:0/3296667984 conn(0x7fd7040b4450 msgr2=0x7fd7040737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:06.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.388+0000 7fd70b991640 1 -- 172.21.15.131:0/3296667984 shutdown_connections 2024-05-17T04:09:06.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.392+0000 7fd70b991640 1 -- 172.21.15.131:0/3296667984 wait complete. 2024-05-17T04:09:06.420 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-17T04:09:06.420 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-17T04:09:06.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.538+0000 7f3e70cf1640 1 Processor -- start 2024-05-17T04:09:06.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.538+0000 7f3e70cf1640 1 -- start start 2024-05-17T04:09:06.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.539+0000 7f3e70cf1640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e6c0d2970 0x7f3e6c0b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:06.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.539+0000 7f3e70cf1640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3e6c0b5430 0x7f3e6c0b6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:06.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.540+0000 7f3e70cf1640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e6c0b5840 con 0x7f3e6c0d0c60 2024-05-17T04:09:06.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.540+0000 7f3e70cf1640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f3e6c0b60f0 con 0x7f3e6c0b5430 2024-05-17T04:09:06.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.540+0000 7f3e70cf1640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3e6c0d1ef0 con 0x7f3e6c0d2970 2024-05-17T04:09:06.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.540+0000 7f3e6ad9d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3e6c0b5430 0x7f3e6c0b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:06.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.540+0000 7f3e6ad9d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3e6c0b5430 0x7f3e6c0b6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33994/0 (socket says 172.21.15.131:33994) 2024-05-17T04:09:06.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.540+0000 7f3e6ad9d640 1 -- 172.21.15.131:0/538257562 learned_addr learned my addr 172.21.15.131:0/538257562 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:06.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.540+0000 7f3e61d9b640 1 --2- 172.21.15.131:0/538257562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e6c0d2970 0x7f3e6c0b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:06.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.540+0000 7f3e6ad9d640 1 -- 172.21.15.131:0/538257562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e6c0d2970 msgr2=0x7f3e6c0b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:06.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.540+0000 7f3e6ad9d640 1 --2- 172.21.15.131:0/538257562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e6c0d2970 0x7f3e6c0b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:06.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.540+0000 7f3e6ad9d640 1 -- 172.21.15.131:0/538257562 >> v1:172.21.15.150:6789/0 conn(0x7f3e6c0d0c60 legacy=0x7f3e6c15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:06.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.540+0000 7f3e6ad9d640 1 -- 172.21.15.131:0/538257562 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6c0d2190 con 0x7f3e6c0b5430 2024-05-17T04:09:06.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.540+0000 7f3e61d9b640 1 --2- 172.21.15.131:0/538257562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e6c0d2970 0x7f3e6c0b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:06.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.541+0000 7f3e6ad9d640 1 --2- 172.21.15.131:0/538257562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e6c0b5430 0x7f3e6c0b6580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009e50 tx=0x7f3e6402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885eac995db286a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:06.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.541+0000 7f3e69d9b640 1 -- 172.21.15.131:0/538257562 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64036070 con 0x7f3e6c0b5430 2024-05-17T04:09:06.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.541+0000 7f3e69d9b640 1 -- 172.21.15.131:0/538257562 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e64031600 con 0x7f3e6c0b5430 2024-05-17T04:09:06.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.541+0000 7f3e69d9b640 1 -- 172.21.15.131:0/538257562 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e640319d0 con 0x7f3e6c0b5430 2024-05-17T04:09:06.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.541+0000 7f3e70cf1640 1 -- 172.21.15.131:0/538257562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e6c0b5430 msgr2=0x7f3e6c0b6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:06.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.541+0000 7f3e70cf1640 1 --2- 172.21.15.131:0/538257562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e6c0b5430 0x7f3e6c0b6580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009e50 tx=0x7f3e6402a680 comp rx=0 tx=0).stop 2024-05-17T04:09:06.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.542+0000 7f3e70cf1640 1 -- 172.21.15.131:0/538257562 shutdown_connections 2024-05-17T04:09:06.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.542+0000 7f3e70cf1640 1 --2- 172.21.15.131:0/538257562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e6c0b5430 0x7f3e6c0b6580 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:06.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.542+0000 7f3e70cf1640 1 --2- 172.21.15.131:0/538257562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e6c0d2970 0x7f3e6c0b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:06.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.542+0000 7f3e70cf1640 1 -- 172.21.15.131:0/538257562 >> 172.21.15.131:0/538257562 conn(0x7f3e6c0cff30 msgr2=0x7f3e6c0d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:06.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.542+0000 7f3e70cf1640 1 -- 172.21.15.131:0/538257562 shutdown_connections 2024-05-17T04:09:06.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.542+0000 7f3e70cf1640 1 -- 172.21.15.131:0/538257562 wait complete. 2024-05-17T04:09:06.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.544+0000 7f3e70cf1640 1 Processor -- start 2024-05-17T04:09:06.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.544+0000 7f3e70cf1640 1 -- start start 2024-05-17T04:09:06.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e70cf1640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e6c0b5430 0x7f3e6c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:06.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e70cf1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e6c0d0c60 0x7f3e6c0cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:06.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e70cf1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e6c0d2970 0x7f3e6c149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:06.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e70cf1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c0b6ac0 con 0x7f3e6c0d2970 2024-05-17T04:09:06.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e70cf1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c0d2d80 con 0x7f3e6c0d0c60 2024-05-17T04:09:06.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e70cf1640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3e6c0b6c40 con 0x7f3e6c0b5430 2024-05-17T04:09:06.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e6ad9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e6c0d2970 0x7f3e6c149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:06.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e6ad9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e6c0d2970 0x7f3e6c149bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33996/0 (socket says 172.21.15.131:33996) 2024-05-17T04:09:06.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e6ad9d640 1 -- 172.21.15.131:0/1628813039 learned_addr learned my addr 172.21.15.131:0/1628813039 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:06.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e61d9b640 1 --2- 172.21.15.131:0/1628813039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e6c0d0c60 0x7f3e6c0cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:06.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e6a59c640 1 --2- 172.21.15.131:0/1628813039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e6c0b5430 0x7f3e6c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:06.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e6ad9d640 1 -- 172.21.15.131:0/1628813039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e6c0b5430 msgr2=0x7f3e6c0c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:06.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e6ad9d640 1 --2- 172.21.15.131:0/1628813039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e6c0b5430 0x7f3e6c0c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:06.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e6ad9d640 1 -- 172.21.15.131:0/1628813039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e6c0d0c60 msgr2=0x7f3e6c0cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:06.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e6ad9d640 1 --2- 172.21.15.131:0/1628813039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e6c0d0c60 0x7f3e6c0cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:06.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.545+0000 7f3e6ad9d640 1 -- 172.21.15.131:0/1628813039 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6c0c7e00 con 0x7f3e6c0d2970 2024-05-17T04:09:06.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.546+0000 7f3e6ad9d640 1 --2- 172.21.15.131:0/1628813039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e6c0d2970 0x7f3e6c149bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3e64034040 tx=0x7f3e64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:06.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.546+0000 7f3e637fe640 1 -- 172.21.15.131:0/1628813039 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6403f020 con 0x7f3e6c0d2970 2024-05-17T04:09:06.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.546+0000 7f3e637fe640 1 -- 172.21.15.131:0/1628813039 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e64037040 con 0x7f3e6c0d2970 2024-05-17T04:09:06.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.546+0000 7f3e70cf1640 1 -- 172.21.15.131:0/1628813039 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6c0c80e0 con 0x7f3e6c0d2970 2024-05-17T04:09:06.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.546+0000 7f3e637fe640 1 -- 172.21.15.131:0/1628813039 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64036070 con 0x7f3e6c0d2970 2024-05-17T04:09:06.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.546+0000 7f3e70cf1640 1 -- 172.21.15.131:0/1628813039 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e6c14a5f0 con 0x7f3e6c0d2970 2024-05-17T04:09:06.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.547+0000 7f3e70cf1640 1 -- 172.21.15.131:0/1628813039 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e6c0b6580 con 0x7f3e6c0d2970 2024-05-17T04:09:06.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.547+0000 7f3e637fe640 1 -- 172.21.15.131:0/1628813039 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3e64042020 con 0x7f3e6c0d2970 2024-05-17T04:09:06.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.548+0000 7f3e637fe640 1 --2- 172.21.15.131:0/1628813039 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3e4c0762d0 0x7f3e4c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:06.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.548+0000 7f3e637fe640 1 -- 172.21.15.131:0/1628813039 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f3e640b7a30 con 0x7f3e6c0d2970 2024-05-17T04:09:06.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.548+0000 7f3e6a59c640 1 --2- 172.21.15.131:0/1628813039 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3e4c0762d0 0x7f3e4c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:06.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.548+0000 7f3e6a59c640 1 --2- 172.21.15.131:0/1628813039 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3e4c0762d0 0x7f3e4c0787e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c001720 tx=0x7f3e5c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:06.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.552+0000 7f3e637fe640 1 -- 172.21.15.131:0/1628813039 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3e64049030 con 0x7f3e6c0d2970 2024-05-17T04:09:06.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:06.744+0000 7f3e70cf1640 1 -- 172.21.15.131:0/1628813039 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f3e6c0c7b90 con 0x7f3e6c0d2970 2024-05-17T04:09:07.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.389+0000 7f3e637fe640 1 -- 172.21.15.131:0/1628813039 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f3e64080cc0 con 0x7f3e6c0d2970 2024-05-17T04:09:07.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.393+0000 7f3e70cf1640 1 -- 172.21.15.131:0/1628813039 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3e4c0762d0 msgr2=0x7f3e4c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:07.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.393+0000 7f3e70cf1640 1 --2- 172.21.15.131:0/1628813039 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3e4c0762d0 0x7f3e4c0787e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c001720 tx=0x7f3e5c009040 comp rx=0 tx=0).stop 2024-05-17T04:09:07.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.393+0000 7f3e70cf1640 1 -- 172.21.15.131:0/1628813039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e6c0d2970 msgr2=0x7f3e6c149bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:07.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.393+0000 7f3e70cf1640 1 --2- 172.21.15.131:0/1628813039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e6c0d2970 0x7f3e6c149bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3e64034040 tx=0x7f3e64004a40 comp rx=0 tx=0).stop 2024-05-17T04:09:07.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.394+0000 7f3e70cf1640 1 -- 172.21.15.131:0/1628813039 shutdown_connections 2024-05-17T04:09:07.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.394+0000 7f3e70cf1640 1 --2- 172.21.15.131:0/1628813039 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3e4c0762d0 0x7f3e4c0787e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:07.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.394+0000 7f3e70cf1640 1 --2- 172.21.15.131:0/1628813039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e6c0d2970 0x7f3e6c149bb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:07.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.394+0000 7f3e70cf1640 1 --2- 172.21.15.131:0/1628813039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e6c0d0c60 0x7f3e6c0cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:07.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.394+0000 7f3e70cf1640 1 --2- 172.21.15.131:0/1628813039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e6c0b5430 0x7f3e6c0c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:07.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.394+0000 7f3e70cf1640 1 -- 172.21.15.131:0/1628813039 >> 172.21.15.131:0/1628813039 conn(0x7f3e6c0cff30 msgr2=0x7f3e6c15c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:07.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.394+0000 7f3e70cf1640 1 -- 172.21.15.131:0/1628813039 shutdown_connections 2024-05-17T04:09:07.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.394+0000 7f3e70cf1640 1 -- 172.21.15.131:0/1628813039 wait complete. 2024-05-17T04:09:07.409 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-17T04:09:07.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.533+0000 7f695708f640 1 Processor -- start 2024-05-17T04:09:07.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.533+0000 7f695708f640 1 -- start start 2024-05-17T04:09:07.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f695708f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f695015f3c0 0x7f695006e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:07.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f695708f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f695006ec40 0x7f69500cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:07.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f695708f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f69500cc460 0x7f6950072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:07.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f695708f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f695006f050 con 0x7f695015f3c0 2024-05-17T04:09:07.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f695708f640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f69500cc870 con 0x7f69500cc460 2024-05-17T04:09:07.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f695708f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6950074190 con 0x7f695006ec40 2024-05-17T04:09:07.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f6954e2b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f695015f3c0 0x7f695006e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:07.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f6954e2b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f695015f3c0 0x7f695006e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34010/0 (socket says 172.21.15.131:34010) 2024-05-17T04:09:07.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f6954e2b640 1 -- 172.21.15.131:0/3140079711 learned_addr learned my addr 172.21.15.131:0/3140079711 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:07.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f694ffff640 1 --2- 172.21.15.131:0/3140079711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f695006ec40 0x7f69500cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:07.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f695562c640 1 --2- 172.21.15.131:0/3140079711 >> v2:172.21.15.150:3300/0 conn(0x7f69500cc460 0x7f6950072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:07.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f6954e2b640 1 -- 172.21.15.131:0/3140079711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f695006ec40 msgr2=0x7f69500cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:07.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f6954e2b640 1 --2- 172.21.15.131:0/3140079711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f695006ec40 0x7f69500cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:07.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f6954e2b640 1 -- 172.21.15.131:0/3140079711 >> v2:172.21.15.150:3300/0 conn(0x7f69500cc460 msgr2=0x7f6950072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:07.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f6954e2b640 1 --2- 172.21.15.131:0/3140079711 >> v2:172.21.15.150:3300/0 conn(0x7f69500cc460 0x7f6950072da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:07.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.535+0000 7f6954e2b640 1 -- 172.21.15.131:0/3140079711 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695006f270 con 0x7f695015f3c0 2024-05-17T04:09:07.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.536+0000 7f6954e2b640 1 --2- 172.21.15.131:0/3140079711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f695015f3c0 0x7f695006e700 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6950074540 tx=0x7f694002c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0d7b3a81f4ecd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:07.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.536+0000 7f694f7fe640 1 -- 172.21.15.131:0/3140079711 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694003a070 con 0x7f695015f3c0 2024-05-17T04:09:07.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.536+0000 7f694f7fe640 1 -- 172.21.15.131:0/3140079711 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6940032480 con 0x7f695015f3c0 2024-05-17T04:09:07.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.536+0000 7f694f7fe640 1 -- 172.21.15.131:0/3140079711 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940032850 con 0x7f695015f3c0 2024-05-17T04:09:07.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.537+0000 7f695708f640 1 -- 172.21.15.131:0/3140079711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f695015f3c0 msgr2=0x7f695006e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:07.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.537+0000 7f695708f640 1 --2- 172.21.15.131:0/3140079711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f695015f3c0 0x7f695006e700 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6950074540 tx=0x7f694002c670 comp rx=0 tx=0).stop 2024-05-17T04:09:07.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.537+0000 7f695708f640 1 -- 172.21.15.131:0/3140079711 shutdown_connections 2024-05-17T04:09:07.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.537+0000 7f695708f640 1 --2- 172.21.15.131:0/3140079711 >> v2:172.21.15.150:3300/0 conn(0x7f69500cc460 0x7f6950072da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:07.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.537+0000 7f695708f640 1 --2- 172.21.15.131:0/3140079711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f695006ec40 0x7f69500cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:07.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.537+0000 7f695708f640 1 --2- 172.21.15.131:0/3140079711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f695015f3c0 0x7f695006e700 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:07.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.537+0000 7f695708f640 1 -- 172.21.15.131:0/3140079711 >> 172.21.15.131:0/3140079711 conn(0x7f69500cdb30 msgr2=0x7f69500cdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:07.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.537+0000 7f695708f640 1 -- 172.21.15.131:0/3140079711 shutdown_connections 2024-05-17T04:09:07.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.537+0000 7f695708f640 1 -- 172.21.15.131:0/3140079711 wait complete. 2024-05-17T04:09:07.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.539+0000 7f695708f640 1 Processor -- start 2024-05-17T04:09:07.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.539+0000 7f695708f640 1 -- start start 2024-05-17T04:09:07.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.540+0000 7f695708f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f695006ec40 0x7f69500b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:07.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.540+0000 7f695708f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69500cc460 0x7f69500afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:07.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.540+0000 7f695708f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f695015f3c0 0x7f6950152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:07.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.540+0000 7f695708f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f695006fb10 con 0x7f69500cc460 2024-05-17T04:09:07.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.540+0000 7f695708f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f695006f830 con 0x7f695015f3c0 2024-05-17T04:09:07.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.540+0000 7f695708f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f695006d700 con 0x7f695006ec40 2024-05-17T04:09:07.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.540+0000 7f694ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69500cc460 0x7f69500afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:07.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.540+0000 7f694ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69500cc460 0x7f69500afd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34018/0 (socket says 172.21.15.131:34018) 2024-05-17T04:09:07.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.540+0000 7f694ffff640 1 -- 172.21.15.131:0/1702525630 learned_addr learned my addr 172.21.15.131:0/1702525630 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:07.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.540+0000 7f695562c640 1 --2- 172.21.15.131:0/1702525630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f695015f3c0 0x7f6950152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:07.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.540+0000 7f6954e2b640 1 --2- 172.21.15.131:0/1702525630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f695006ec40 0x7f69500b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:07.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.541+0000 7f694ffff640 1 -- 172.21.15.131:0/1702525630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f695006ec40 msgr2=0x7f69500b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:07.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.541+0000 7f694ffff640 1 --2- 172.21.15.131:0/1702525630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f695006ec40 0x7f69500b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:07.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.541+0000 7f694ffff640 1 -- 172.21.15.131:0/1702525630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f695015f3c0 msgr2=0x7f6950152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:07.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.541+0000 7f694ffff640 1 --2- 172.21.15.131:0/1702525630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f695015f3c0 0x7f6950152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:07.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.541+0000 7f694ffff640 1 -- 172.21.15.131:0/1702525630 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69500b56b0 con 0x7f69500cc460 2024-05-17T04:09:07.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.541+0000 7f694ffff640 1 --2- 172.21.15.131:0/1702525630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69500cc460 0x7f69500afd90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f694400eed0 tx=0x7f694400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:07.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.541+0000 7f694d7fa640 1 -- 172.21.15.131:0/1702525630 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944018020 con 0x7f69500cc460 2024-05-17T04:09:07.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.541+0000 7f694d7fa640 1 -- 172.21.15.131:0/1702525630 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694400bda0 con 0x7f69500cc460 2024-05-17T04:09:07.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.541+0000 7f695708f640 1 -- 172.21.15.131:0/1702525630 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69500b40d0 con 0x7f69500cc460 2024-05-17T04:09:07.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.541+0000 7f694d7fa640 1 -- 172.21.15.131:0/1702525630 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944014640 con 0x7f69500cc460 2024-05-17T04:09:07.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.541+0000 7f695708f640 1 -- 172.21.15.131:0/1702525630 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69500b4690 con 0x7f69500cc460 2024-05-17T04:09:07.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.542+0000 7f695708f640 1 -- 172.21.15.131:0/1702525630 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69500b3e30 con 0x7f69500cc460 2024-05-17T04:09:07.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.543+0000 7f694d7fa640 1 -- 172.21.15.131:0/1702525630 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6944005d10 con 0x7f69500cc460 2024-05-17T04:09:07.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.543+0000 7f694d7fa640 1 --2- 172.21.15.131:0/1702525630 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f693c076300 0x7f693c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:07.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.543+0000 7f6954e2b640 1 --2- 172.21.15.131:0/1702525630 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f693c076300 0x7f693c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:07.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.543+0000 7f694d7fa640 1 -- 172.21.15.131:0/1702525630 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f6944097cb0 con 0x7f69500cc460 2024-05-17T04:09:07.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.544+0000 7f6954e2b640 1 --2- 172.21.15.131:0/1702525630 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f693c076300 0x7f693c078810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6940037000 tx=0x7f6940030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:07.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.548+0000 7f694d7fa640 1 -- 172.21.15.131:0/1702525630 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f69500b3e30 con 0x7f69500cc460 2024-05-17T04:09:07.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:07.731+0000 7f695708f640 1 -- 172.21.15.131:0/1702525630 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f695006ea20 con 0x7f69500cc460 2024-05-17T04:09:09.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.394+0000 7f694d7fa640 1 -- 172.21.15.131:0/1702525630 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f6944022070 con 0x7f69500cc460 2024-05-17T04:09:09.395 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_data_ec' created 2024-05-17T04:09:09.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.398+0000 7f695708f640 1 -- 172.21.15.131:0/1702525630 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f693c076300 msgr2=0x7f693c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:09.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.398+0000 7f695708f640 1 --2- 172.21.15.131:0/1702525630 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f693c076300 0x7f693c078810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6940037000 tx=0x7f6940030000 comp rx=0 tx=0).stop 2024-05-17T04:09:09.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.398+0000 7f695708f640 1 -- 172.21.15.131:0/1702525630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69500cc460 msgr2=0x7f69500afd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:09.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.398+0000 7f695708f640 1 --2- 172.21.15.131:0/1702525630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69500cc460 0x7f69500afd90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f694400eed0 tx=0x7f694400b480 comp rx=0 tx=0).stop 2024-05-17T04:09:09.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.398+0000 7f695708f640 1 -- 172.21.15.131:0/1702525630 shutdown_connections 2024-05-17T04:09:09.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.398+0000 7f695708f640 1 --2- 172.21.15.131:0/1702525630 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f693c076300 0x7f693c078810 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:09.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.398+0000 7f695708f640 1 --2- 172.21.15.131:0/1702525630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69500cc460 0x7f69500afd90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:09.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.398+0000 7f695708f640 1 --2- 172.21.15.131:0/1702525630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f695015f3c0 0x7f6950152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:09.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.398+0000 7f695708f640 1 --2- 172.21.15.131:0/1702525630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f695006ec40 0x7f69500b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:09.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.398+0000 7f695708f640 1 -- 172.21.15.131:0/1702525630 >> 172.21.15.131:0/1702525630 conn(0x7f69500cdb30 msgr2=0x7f69500b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:09.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.398+0000 7f695708f640 1 -- 172.21.15.131:0/1702525630 shutdown_connections 2024-05-17T04:09:09.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.399+0000 7f695708f640 1 -- 172.21.15.131:0/1702525630 wait complete. 2024-05-17T04:09:09.421 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-17T04:09:09.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.539+0000 7f9abec47640 1 Processor -- start 2024-05-17T04:09:09.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.539+0000 7f9abec47640 1 -- start start 2024-05-17T04:09:09.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.541+0000 7f9abec47640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9ab80d0c60 0x7f9ab80d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:09.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.541+0000 7f9abec47640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ab80b5600 0x7f9ab80b6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:09.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.541+0000 7f9abec47640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ab80d1ef0 con 0x7f9ab815d640 2024-05-17T04:09:09.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.541+0000 7f9abec47640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f9ab80b60f0 con 0x7f9ab80d0c60 2024-05-17T04:09:09.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.541+0000 7f9abec47640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab80d2190 con 0x7f9ab80b5600 2024-05-17T04:09:09.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.541+0000 7f9abd1e4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ab80b5600 0x7f9ab80b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:09.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.541+0000 7f9abc9e3640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9ab80d0c60 0x7f9ab80d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:09.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.541+0000 7f9abd1e4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ab80b5600 0x7f9ab80b6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:52568/0 (socket says 172.21.15.131:52568) 2024-05-17T04:09:09.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.541+0000 7f9abd1e4640 1 -- 172.21.15.131:0/3278279311 learned_addr learned my addr 172.21.15.131:0/3278279311 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:09.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.542+0000 7f9abc9e3640 1 -- 172.21.15.131:0/3278279311 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ab80b5600 msgr2=0x7f9ab80b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:09.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.542+0000 7f9abc9e3640 1 --2- 172.21.15.131:0/3278279311 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ab80b5600 0x7f9ab80b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:09.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.542+0000 7f9abc9e3640 1 -- 172.21.15.131:0/3278279311 >> v1:172.21.15.150:6789/0 conn(0x7f9ab815d640 legacy=0x7f9ab80b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:09.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.542+0000 7f9abc9e3640 1 -- 172.21.15.131:0/3278279311 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab80d2470 con 0x7f9ab80d0c60 2024-05-17T04:09:09.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.542+0000 7f9abd1e4640 1 --2- 172.21.15.131:0/3278279311 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ab80b5600 0x7f9ab80b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:09.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.542+0000 7f9abc9e3640 1 --2- 172.21.15.131:0/3278279311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ab80d0c60 0x7f9ab80d2970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40097a0 tx=0x7f9ab402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2db1ee58c266e140 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:09.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.543+0000 7f9aaf7fe640 1 -- 172.21.15.131:0/3278279311 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4037070 con 0x7f9ab80d0c60 2024-05-17T04:09:09.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.543+0000 7f9aaf7fe640 1 -- 172.21.15.131:0/3278279311 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab402ae50 con 0x7f9ab80d0c60 2024-05-17T04:09:09.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.543+0000 7f9aaf7fe640 1 -- 172.21.15.131:0/3278279311 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4032660 con 0x7f9ab80d0c60 2024-05-17T04:09:09.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.543+0000 7f9abec47640 1 -- 172.21.15.131:0/3278279311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ab80d0c60 msgr2=0x7f9ab80d2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:09.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.543+0000 7f9abec47640 1 --2- 172.21.15.131:0/3278279311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ab80d0c60 0x7f9ab80d2970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40097a0 tx=0x7f9ab402a100 comp rx=0 tx=0).stop 2024-05-17T04:09:09.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.543+0000 7f9abec47640 1 -- 172.21.15.131:0/3278279311 shutdown_connections 2024-05-17T04:09:09.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.543+0000 7f9abec47640 1 --2- 172.21.15.131:0/3278279311 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ab80b5600 0x7f9ab80b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:09.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.543+0000 7f9abec47640 1 --2- 172.21.15.131:0/3278279311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ab80d0c60 0x7f9ab80d2970 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:09.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.543+0000 7f9abec47640 1 -- 172.21.15.131:0/3278279311 >> 172.21.15.131:0/3278279311 conn(0x7f9ab80cff30 msgr2=0x7f9ab80d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:09.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.543+0000 7f9abec47640 1 -- 172.21.15.131:0/3278279311 shutdown_connections 2024-05-17T04:09:09.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.543+0000 7f9abec47640 1 -- 172.21.15.131:0/3278279311 wait complete. 2024-05-17T04:09:09.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.545+0000 7f9abec47640 1 Processor -- start 2024-05-17T04:09:09.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.545+0000 7f9abec47640 1 -- start start 2024-05-17T04:09:09.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9abec47640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ab80d0c60 0x7f9ab80c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:09.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9abec47640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ab815d640 0x7f9ab814f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:09.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9abec47640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ab8160080 0x7f9ab8160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:09.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9abec47640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab80b6c40 con 0x7f9ab815d640 2024-05-17T04:09:09.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9abec47640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab80b6ac0 con 0x7f9ab80d0c60 2024-05-17T04:09:09.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9abec47640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab80b6dc0 con 0x7f9ab8160080 2024-05-17T04:09:09.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9aaffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ab815d640 0x7f9ab814f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:09.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9aaffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ab815d640 0x7f9ab814f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34028/0 (socket says 172.21.15.131:34028) 2024-05-17T04:09:09.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9aaffff640 1 -- 172.21.15.131:0/3745703867 learned_addr learned my addr 172.21.15.131:0/3745703867 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:09.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9abc9e3640 1 --2- 172.21.15.131:0/3745703867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ab80d0c60 0x7f9ab80c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:09.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9abd1e4640 1 --2- 172.21.15.131:0/3745703867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ab8160080 0x7f9ab8160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:09.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9aaffff640 1 -- 172.21.15.131:0/3745703867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ab8160080 msgr2=0x7f9ab8160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:09.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9aaffff640 1 --2- 172.21.15.131:0/3745703867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ab8160080 0x7f9ab8160490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:09.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9aaffff640 1 -- 172.21.15.131:0/3745703867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ab80d0c60 msgr2=0x7f9ab80c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:09.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9aaffff640 1 --2- 172.21.15.131:0/3745703867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ab80d0c60 0x7f9ab80c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:09.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9aaffff640 1 -- 172.21.15.131:0/3745703867 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab81609d0 con 0x7f9ab815d640 2024-05-17T04:09:09.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9aaffff640 1 --2- 172.21.15.131:0/3745703867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ab815d640 0x7f9ab814f110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800c3a0 tx=0x7f9aa800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:09.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9aad7fa640 1 -- 172.21.15.131:0/3745703867 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80052d0 con 0x7f9ab815d640 2024-05-17T04:09:09.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9aad7fa640 1 -- 172.21.15.131:0/3745703867 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa8007020 con 0x7f9ab815d640 2024-05-17T04:09:09.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9abec47640 1 -- 172.21.15.131:0/3745703867 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab80c70e0 con 0x7f9ab815d640 2024-05-17T04:09:09.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.547+0000 7f9aad7fa640 1 -- 172.21.15.131:0/3745703867 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80054b0 con 0x7f9ab815d640 2024-05-17T04:09:09.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.548+0000 7f9abec47640 1 -- 172.21.15.131:0/3745703867 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab80c7bb0 con 0x7f9ab815d640 2024-05-17T04:09:09.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.548+0000 7f9abec47640 1 -- 172.21.15.131:0/3745703867 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab80b6580 con 0x7f9ab815d640 2024-05-17T04:09:09.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.549+0000 7f9aad7fa640 1 -- 172.21.15.131:0/3745703867 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9aa8007410 con 0x7f9ab815d640 2024-05-17T04:09:09.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.550+0000 7f9aad7fa640 1 --2- 172.21.15.131:0/3745703867 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9aa4076300 0x7f9aa4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:09.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.550+0000 7f9abc9e3640 1 --2- 172.21.15.131:0/3745703867 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9aa4076300 0x7f9aa4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:09.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.550+0000 7f9aad7fa640 1 -- 172.21.15.131:0/3745703867 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f9aa8096dc0 con 0x7f9ab815d640 2024-05-17T04:09:09.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.550+0000 7f9abc9e3640 1 --2- 172.21.15.131:0/3745703867 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9aa4076300 0x7f9aa4078810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4034000 tx=0x7f9ab402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:09.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.554+0000 7f9aad7fa640 1 -- 172.21.15.131:0/3745703867 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9ab81609d0 con 0x7f9ab815d640 2024-05-17T04:09:09.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:09.737+0000 7f9abec47640 1 -- 172.21.15.131:0/3745703867 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f9ab80d1190 con 0x7f9ab815d640 2024-05-17T04:09:10.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.395+0000 7f9aad7fa640 1 -- 172.21.15.131:0/3745703867 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f9aa8068370 con 0x7f9ab815d640 2024-05-17T04:09:10.397 INFO:teuthology.orchestra.run.smithi131.stderr:set pool 4 allow_ec_overwrites to true 2024-05-17T04:09:10.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.398+0000 7f9abec47640 1 -- 172.21.15.131:0/3745703867 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9aa4076300 msgr2=0x7f9aa4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:10.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.398+0000 7f9abec47640 1 --2- 172.21.15.131:0/3745703867 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9aa4076300 0x7f9aa4078810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4034000 tx=0x7f9ab402e000 comp rx=0 tx=0).stop 2024-05-17T04:09:10.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.398+0000 7f9abec47640 1 -- 172.21.15.131:0/3745703867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ab815d640 msgr2=0x7f9ab814f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:10.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.398+0000 7f9abec47640 1 --2- 172.21.15.131:0/3745703867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ab815d640 0x7f9ab814f110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800c3a0 tx=0x7f9aa800c860 comp rx=0 tx=0).stop 2024-05-17T04:09:10.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.398+0000 7f9abec47640 1 -- 172.21.15.131:0/3745703867 shutdown_connections 2024-05-17T04:09:10.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.398+0000 7f9abec47640 1 --2- 172.21.15.131:0/3745703867 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9aa4076300 0x7f9aa4078810 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:10.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.398+0000 7f9abec47640 1 --2- 172.21.15.131:0/3745703867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ab815d640 0x7f9ab814f110 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:10.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.398+0000 7f9abec47640 1 --2- 172.21.15.131:0/3745703867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ab8160080 0x7f9ab8160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:10.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.398+0000 7f9abec47640 1 --2- 172.21.15.131:0/3745703867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ab80d0c60 0x7f9ab80c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:10.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.398+0000 7f9abec47640 1 -- 172.21.15.131:0/3745703867 >> 172.21.15.131:0/3745703867 conn(0x7f9ab80cff30 msgr2=0x7f9ab80b8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:10.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.398+0000 7f9abec47640 1 -- 172.21.15.131:0/3745703867 shutdown_connections 2024-05-17T04:09:10.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.398+0000 7f9abec47640 1 -- 172.21.15.131:0/3745703867 wait complete. 2024-05-17T04:09:10.424 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-17T04:09:10.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.539+0000 7f30b715b640 1 Processor -- start 2024-05-17T04:09:10.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.539+0000 7f30b715b640 1 -- start start 2024-05-17T04:09:10.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.540+0000 7f30b715b640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f30b00cddd0 0x7f30b00cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:10.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.540+0000 7f30b715b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30b015e150 0x7f30b0153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:10.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.540+0000 7f30b715b640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b00d0530 con 0x7f30b00d0120 2024-05-17T04:09:10.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.540+0000 7f30b715b640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f30b00b8ef0 con 0x7f30b00cddd0 2024-05-17T04:09:10.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.540+0000 7f30b715b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f30b015e970 con 0x7f30b015e150 2024-05-17T04:09:10.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.540+0000 7f30b4ef7640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f30b00cddd0 0x7f30b00cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:10.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.540+0000 7f30b56f8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30b015e150 0x7f30b0153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:10.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.540+0000 7f30b56f8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30b015e150 0x7f30b0153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:52578/0 (socket says 172.21.15.131:52578) 2024-05-17T04:09:10.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.540+0000 7f30b4ef7640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f30b00cddd0 0x7f30b00cfbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:51466/0 (socket says 172.21.15.131:51466) 2024-05-17T04:09:10.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.540+0000 7f30b56f8640 1 -- 172.21.15.131:0/1164369403 learned_addr learned my addr 172.21.15.131:0/1164369403 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:10.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.540+0000 7f30affff640 1 --1- 172.21.15.131:0/1164369403 >> v1:172.21.15.150:6789/0 conn(0x7f30b00d0120 0x7f30b015da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:48806/0 (socket says 172.21.15.131:48806) 2024-05-17T04:09:10.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.541+0000 7f30b4ef7640 1 -- 172.21.15.131:0/1164369403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30b015e150 msgr2=0x7f30b0153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:10.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.541+0000 7f30b4ef7640 1 --2- 172.21.15.131:0/1164369403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30b015e150 0x7f30b0153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:10.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.541+0000 7f30b4ef7640 1 -- 172.21.15.131:0/1164369403 >> v1:172.21.15.150:6789/0 conn(0x7f30b00d0120 legacy=0x7f30b015da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:10.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.541+0000 7f30b4ef7640 1 -- 172.21.15.131:0/1164369403 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b015e690 con 0x7f30b00cddd0 2024-05-17T04:09:10.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.541+0000 7f30b56f8640 1 --2- 172.21.15.131:0/1164369403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30b015e150 0x7f30b0153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:10.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.541+0000 7f30b4ef7640 1 --2- 172.21.15.131:0/1164369403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30b00cddd0 0x7f30b00cfbe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f30a00097a0 tx=0x7f30a002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a36bbb21dde8f100 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:10.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.542+0000 7f30af7fe640 1 -- 172.21.15.131:0/1164369403 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0037070 con 0x7f30b00cddd0 2024-05-17T04:09:10.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.542+0000 7f30af7fe640 1 -- 172.21.15.131:0/1164369403 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a002adb0 con 0x7f30b00cddd0 2024-05-17T04:09:10.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.542+0000 7f30af7fe640 1 -- 172.21.15.131:0/1164369403 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0032660 con 0x7f30b00cddd0 2024-05-17T04:09:10.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.542+0000 7f30b715b640 1 -- 172.21.15.131:0/1164369403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30b00cddd0 msgr2=0x7f30b00cfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:10.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.542+0000 7f30b715b640 1 --2- 172.21.15.131:0/1164369403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30b00cddd0 0x7f30b00cfbe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f30a00097a0 tx=0x7f30a002a060 comp rx=0 tx=0).stop 2024-05-17T04:09:10.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.542+0000 7f30b715b640 1 -- 172.21.15.131:0/1164369403 shutdown_connections 2024-05-17T04:09:10.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.542+0000 7f30b715b640 1 --2- 172.21.15.131:0/1164369403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30b015e150 0x7f30b0153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:10.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.542+0000 7f30b715b640 1 --2- 172.21.15.131:0/1164369403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30b00cddd0 0x7f30b00cfbe0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:10.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.542+0000 7f30b715b640 1 -- 172.21.15.131:0/1164369403 >> 172.21.15.131:0/1164369403 conn(0x7f30b00b4e40 msgr2=0x7f30b00b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:10.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.542+0000 7f30b715b640 1 -- 172.21.15.131:0/1164369403 shutdown_connections 2024-05-17T04:09:10.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.542+0000 7f30b715b640 1 -- 172.21.15.131:0/1164369403 wait complete. 2024-05-17T04:09:10.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.544+0000 7f30b715b640 1 Processor -- start 2024-05-17T04:09:10.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.544+0000 7f30b715b640 1 -- start start 2024-05-17T04:09:10.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.545+0000 7f30b715b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30b00cddd0 0x7f30b01e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:10.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.545+0000 7f30b715b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30b00d0120 0x7f30b014f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:10.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b715b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30b015e150 0x7f30b0152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:10.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b715b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f30b00ce1e0 con 0x7f30b015e150 2024-05-17T04:09:10.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b715b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f30b00d10b0 con 0x7f30b00cddd0 2024-05-17T04:09:10.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b715b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f30b0159d50 con 0x7f30b00d0120 2024-05-17T04:09:10.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b56f8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30b015e150 0x7f30b0152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:10.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b56f8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30b015e150 0x7f30b0152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34036/0 (socket says 172.21.15.131:34036) 2024-05-17T04:09:10.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b56f8640 1 -- 172.21.15.131:0/182502400 learned_addr learned my addr 172.21.15.131:0/182502400 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:10.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30affff640 1 --2- 172.21.15.131:0/182502400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30b00d0120 0x7f30b014f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:10.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b4ef7640 1 --2- 172.21.15.131:0/182502400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30b00cddd0 0x7f30b01e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:10.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b56f8640 1 -- 172.21.15.131:0/182502400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30b00d0120 msgr2=0x7f30b014f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:10.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b56f8640 1 --2- 172.21.15.131:0/182502400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30b00d0120 0x7f30b014f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:10.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b56f8640 1 -- 172.21.15.131:0/182502400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30b00cddd0 msgr2=0x7f30b01e7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:10.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b56f8640 1 --2- 172.21.15.131:0/182502400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30b00cddd0 0x7f30b01e7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:10.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b56f8640 1 -- 172.21.15.131:0/182502400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b01e7da0 con 0x7f30b015e150 2024-05-17T04:09:10.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30affff640 1 --2- 172.21.15.131:0/182502400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30b00d0120 0x7f30b014f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:10.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b56f8640 1 --2- 172.21.15.131:0/182502400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30b015e150 0x7f30b0152770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f30a800efc0 tx=0x7f30a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:10.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30ad7fa640 1 -- 172.21.15.131:0/182502400 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a800cbe0 con 0x7f30b015e150 2024-05-17T04:09:10.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30ad7fa640 1 -- 172.21.15.131:0/182502400 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a800cd80 con 0x7f30b015e150 2024-05-17T04:09:10.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b715b640 1 -- 172.21.15.131:0/182502400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b01e82b0 con 0x7f30b015e150 2024-05-17T04:09:10.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30ad7fa640 1 -- 172.21.15.131:0/182502400 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8003bd0 con 0x7f30b015e150 2024-05-17T04:09:10.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.546+0000 7f30b715b640 1 -- 172.21.15.131:0/182502400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b01e8870 con 0x7f30b015e150 2024-05-17T04:09:10.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.547+0000 7f30b715b640 1 -- 172.21.15.131:0/182502400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b00cfbe0 con 0x7f30b015e150 2024-05-17T04:09:10.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.548+0000 7f30ad7fa640 1 -- 172.21.15.131:0/182502400 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f30a801b030 con 0x7f30b015e150 2024-05-17T04:09:10.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.548+0000 7f30ad7fa640 1 --2- 172.21.15.131:0/182502400 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f309c0762d0 0x7f309c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:10.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.549+0000 7f30ad7fa640 1 -- 172.21.15.131:0/182502400 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f30a8097cb0 con 0x7f30b015e150 2024-05-17T04:09:10.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.549+0000 7f30b4ef7640 1 --2- 172.21.15.131:0/182502400 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f309c0762d0 0x7f309c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:10.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.549+0000 7f30b4ef7640 1 --2- 172.21.15.131:0/182502400 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f309c0762d0 0x7f309c0787e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f30a0034000 tx=0x7f30a002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:10.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.553+0000 7f30ad7fa640 1 -- 172.21.15.131:0/182502400 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f30a8022020 con 0x7f30b015e150 2024-05-17T04:09:10.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:10.775+0000 7f30b715b640 1 -- 172.21.15.131:0/182502400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f30b0070cb0 con 0x7f30b015e150 2024-05-17T04:09:11.357 INFO:tasks.ceph.mds.b.smithi150.stderr:2024-05-17T04:09:11.357+0000 7fd62258d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-17T04:09:11.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.426+0000 7f30ad7fa640 1 -- 172.21.15.131:0/182502400 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7f30a8010040 con 0x7f30b015e150 2024-05-17T04:09:11.427 INFO:teuthology.orchestra.run.smithi131.stderr:added data pool 4 to fsmap 2024-05-17T04:09:11.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.429+0000 7f30b715b640 1 -- 172.21.15.131:0/182502400 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f309c0762d0 msgr2=0x7f309c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:11.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.429+0000 7f30b715b640 1 --2- 172.21.15.131:0/182502400 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f309c0762d0 0x7f309c0787e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f30a0034000 tx=0x7f30a002e000 comp rx=0 tx=0).stop 2024-05-17T04:09:11.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.429+0000 7f30b715b640 1 -- 172.21.15.131:0/182502400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30b015e150 msgr2=0x7f30b0152770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:11.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.429+0000 7f30b715b640 1 --2- 172.21.15.131:0/182502400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30b015e150 0x7f30b0152770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f30a800efc0 tx=0x7f30a800c490 comp rx=0 tx=0).stop 2024-05-17T04:09:11.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.429+0000 7f30b715b640 1 -- 172.21.15.131:0/182502400 shutdown_connections 2024-05-17T04:09:11.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.429+0000 7f30b715b640 1 --2- 172.21.15.131:0/182502400 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f309c0762d0 0x7f309c0787e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.429+0000 7f30b715b640 1 --2- 172.21.15.131:0/182502400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30b015e150 0x7f30b0152770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.429+0000 7f30b715b640 1 --2- 172.21.15.131:0/182502400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30b00d0120 0x7f30b014f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.429+0000 7f30b715b640 1 --2- 172.21.15.131:0/182502400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30b00cddd0 0x7f30b01e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.429+0000 7f30b715b640 1 -- 172.21.15.131:0/182502400 >> 172.21.15.131:0/182502400 conn(0x7f30b00b4e40 msgr2=0x7f30b00b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:11.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.429+0000 7f30b715b640 1 -- 172.21.15.131:0/182502400 shutdown_connections 2024-05-17T04:09:11.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.429+0000 7f30b715b640 1 -- 172.21.15.131:0/182502400 wait complete. 2024-05-17T04:09:11.445 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T04:09:11.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.560+0000 7fdaf8103640 1 Processor -- start 2024-05-17T04:09:11.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.560+0000 7fdaf8103640 1 -- start start 2024-05-17T04:09:11.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.561+0000 7fdaf8103640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdaf00b2ab0 0x7fdaf0161750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:11.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.562+0000 7fdaf8103640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf00b3220 con 0x7fdaf0161c90 2024-05-17T04:09:11.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.562+0000 7fdaf8103640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf00b3500 con 0x7fdaf00d29b0 2024-05-17T04:09:11.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.562+0000 7fdaf8103640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fdaf00b37e0 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.562+0000 7fdaf569e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdaf00b2ab0 0x7fdaf0161750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:11.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.562+0000 7fdaf569e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdaf00b2ab0 0x7fdaf0161750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34040/0 (socket says 172.21.15.131:34040) 2024-05-17T04:09:11.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.562+0000 7fdaf66a0640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fdaf0161c90 0x7fdaf00b5f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:45952/0 (socket says 172.21.15.131:45952) 2024-05-17T04:09:11.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.562+0000 7fdaf569e640 1 -- 172.21.15.131:0/3418384859 learned_addr learned my addr 172.21.15.131:0/3418384859 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:11.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.562+0000 7fdaf569e640 1 -- 172.21.15.131:0/3418384859 >> v1:172.21.15.150:6789/0 conn(0x7fdaf00d29b0 legacy=0x7fdaf015d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:11.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.562+0000 7fdaf569e640 1 -- 172.21.15.131:0/3418384859 >> v1:172.21.15.131:6789/0 conn(0x7fdaf0161c90 legacy=0x7fdaf00b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:11.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.562+0000 7fdaf569e640 1 -- 172.21.15.131:0/3418384859 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf0161230 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.562+0000 7fdaf4e9d640 1 -- 172.21.15.131:0/3418384859 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 500107709 0 0) 0x7fdaf00b3220 con 0x7fdaf0161c90 2024-05-17T04:09:11.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.563+0000 7fdaf569e640 1 --2- 172.21.15.131:0/3418384859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf00b2ab0 0x7fdaf0161750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009870 tx=0x7fdae402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c70eff4a376945 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:11.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.563+0000 7fdaf4e9d640 1 -- 172.21.15.131:0/3418384859 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae4037070 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.563+0000 7fdaf4e9d640 1 -- 172.21.15.131:0/3418384859 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae4032440 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.563+0000 7fdaf4e9d640 1 -- 172.21.15.131:0/3418384859 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae4032810 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.564+0000 7fdaf8103640 1 -- 172.21.15.131:0/3418384859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf00b2ab0 msgr2=0x7fdaf0161750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:11.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.564+0000 7fdaf8103640 1 --2- 172.21.15.131:0/3418384859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf00b2ab0 0x7fdaf0161750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009870 tx=0x7fdae402a270 comp rx=0 tx=0).stop 2024-05-17T04:09:11.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.564+0000 7fdaf8103640 1 -- 172.21.15.131:0/3418384859 shutdown_connections 2024-05-17T04:09:11.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.564+0000 7fdaf8103640 1 --2- 172.21.15.131:0/3418384859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf00b2ab0 0x7fdaf0161750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.564+0000 7fdaf8103640 1 -- 172.21.15.131:0/3418384859 >> 172.21.15.131:0/3418384859 conn(0x7fdaf00b4e40 msgr2=0x7fdaf00b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:11.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.564+0000 7fdaf8103640 1 -- 172.21.15.131:0/3418384859 shutdown_connections 2024-05-17T04:09:11.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.564+0000 7fdaf8103640 1 -- 172.21.15.131:0/3418384859 wait complete. 2024-05-17T04:09:11.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.565+0000 7fdaf8103640 1 Processor -- start 2024-05-17T04:09:11.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.565+0000 7fdaf8103640 1 -- start start 2024-05-17T04:09:11.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf8103640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf00b2ab0 0x7fdaf01f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:11.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf8103640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaf00d29b0 0x7fdaf00c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:11.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf8103640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdaf0161c90 0x7fdaf0157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:11.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf8103640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf00b67f0 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf8103640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf00b6670 con 0x7fdaf00d29b0 2024-05-17T04:09:11.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf8103640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf00cfc00 con 0x7fdaf0161c90 2024-05-17T04:09:11.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf5e9f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf00b2ab0 0x7fdaf01f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:11.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf5e9f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf00b2ab0 0x7fdaf01f7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34044/0 (socket says 172.21.15.131:34044) 2024-05-17T04:09:11.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf5e9f640 1 -- 172.21.15.131:0/2561612386 learned_addr learned my addr 172.21.15.131:0/2561612386 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:11.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf569e640 1 --2- 172.21.15.131:0/2561612386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaf00d29b0 0x7fdaf00c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:11.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf5e9f640 1 -- 172.21.15.131:0/2561612386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdaf0161c90 msgr2=0x7fdaf0157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:11.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf66a0640 1 --2- 172.21.15.131:0/2561612386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdaf0161c90 0x7fdaf0157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:11.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf5e9f640 1 --2- 172.21.15.131:0/2561612386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdaf0161c90 0x7fdaf0157950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf5e9f640 1 -- 172.21.15.131:0/2561612386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaf00d29b0 msgr2=0x7fdaf00c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:11.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf5e9f640 1 --2- 172.21.15.131:0/2561612386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaf00d29b0 0x7fdaf00c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf5e9f640 1 -- 172.21.15.131:0/2561612386 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf0148370 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf569e640 1 --2- 172.21.15.131:0/2561612386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaf00d29b0 0x7fdaf00c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:11.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf5e9f640 1 --2- 172.21.15.131:0/2561612386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf00b2ab0 0x7fdaf01f7940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdae800c430 tx=0x7fdae800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:11.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaee7fc640 1 -- 172.21.15.131:0/2561612386 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8017070 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaee7fc640 1 -- 172.21.15.131:0/2561612386 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae80052d0 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaf8103640 1 -- 172.21.15.131:0/2561612386 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf0148650 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.567+0000 7fdaee7fc640 1 -- 172.21.15.131:0/2561612386 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8003830 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.568+0000 7fdaf8103640 1 -- 172.21.15.131:0/2561612386 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf015e570 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.569+0000 7fdaf8103640 1 -- 172.21.15.131:0/2561612386 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf0148b70 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.569+0000 7fdaee7fc640 1 -- 172.21.15.131:0/2561612386 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdae801a070 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.570+0000 7fdaee7fc640 1 --2- 172.21.15.131:0/2561612386 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fdadc0762d0 0x7fdadc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:11.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.570+0000 7fdaf569e640 1 --2- 172.21.15.131:0/2561612386 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fdadc0762d0 0x7fdadc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:11.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.570+0000 7fdaee7fc640 1 -- 172.21.15.131:0/2561612386 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdae8096d70 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.570+0000 7fdaf569e640 1 --2- 172.21.15.131:0/2561612386 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fdadc0762d0 0x7fdadc0787e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdae4034000 tx=0x7fdae402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:11.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.574+0000 7fdaee7fc640 1 -- 172.21.15.131:0/2561612386 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdae8060300 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.797+0000 7fdaf8103640 1 -- 172.21.15.131:0/2561612386 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdaf0161750 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.798+0000 7fdaee7fc640 1 -- 172.21.15.131:0/2561612386 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5189 (secure 0 0 0) 0x7fdae8068380 con 0x7fdaf00b2ab0 2024-05-17T04:09:11.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:11.799 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2897828294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2897828294},{"type":"v1","addr":"172.21.15.131:6837","nonce":2897828294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/4068751282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4068751282},{"type":"v1","addr":"172.21.15.131:6836","nonce":4068751282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2776700884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2776700884},{"type":"v1","addr":"172.21.15.150:6834","nonce":2776700884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:05.755541+0000","modified":"2024-05-17T04:09:10.777630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2635477484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2635477484},{"type":"v1","addr":"172.21.15.150:6835","nonce":2635477484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-05-17T04:09:11.799 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 6 2024-05-17T04:09:11.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.800+0000 7fdaf8103640 1 -- 172.21.15.131:0/2561612386 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fdadc0762d0 msgr2=0x7fdadc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:11.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.800+0000 7fdaf8103640 1 --2- 172.21.15.131:0/2561612386 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fdadc0762d0 0x7fdadc0787e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdae4034000 tx=0x7fdae402e000 comp rx=0 tx=0).stop 2024-05-17T04:09:11.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.800+0000 7fdaf8103640 1 -- 172.21.15.131:0/2561612386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf00b2ab0 msgr2=0x7fdaf01f7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:11.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.800+0000 7fdaf8103640 1 --2- 172.21.15.131:0/2561612386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf00b2ab0 0x7fdaf01f7940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdae800c430 tx=0x7fdae800c8f0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.800+0000 7fdaf8103640 1 -- 172.21.15.131:0/2561612386 shutdown_connections 2024-05-17T04:09:11.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.800+0000 7fdaf8103640 1 --2- 172.21.15.131:0/2561612386 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fdadc0762d0 0x7fdadc0787e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.800+0000 7fdaf8103640 1 --2- 172.21.15.131:0/2561612386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdaf0161c90 0x7fdaf0157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.800+0000 7fdaf8103640 1 --2- 172.21.15.131:0/2561612386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaf00d29b0 0x7fdaf00c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.800+0000 7fdaf8103640 1 --2- 172.21.15.131:0/2561612386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf00b2ab0 0x7fdaf01f7940 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.800+0000 7fdaf8103640 1 -- 172.21.15.131:0/2561612386 >> 172.21.15.131:0/2561612386 conn(0x7fdaf00b4e40 msgr2=0x7fdaf015b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:11.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.800+0000 7fdaf8103640 1 -- 172.21.15.131:0/2561612386 shutdown_connections 2024-05-17T04:09:11.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.800+0000 7fdaf8103640 1 -- 172.21.15.131:0/2561612386 wait complete. 2024-05-17T04:09:11.812 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:09:11.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.922+0000 7feabf5d2640 1 Processor -- start 2024-05-17T04:09:11.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.922+0000 7feabf5d2640 1 -- start start 2024-05-17T04:09:11.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.923+0000 7feabf5d2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab80cde50 0x7feab8071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:11.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.923+0000 7feabf5d2640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7feab8071ab0 0x7feab80d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:11.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.923+0000 7feabf5d2640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab815dad0 con 0x7feab80d27e0 2024-05-17T04:09:11.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.923+0000 7feabf5d2640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7feab815dd40 con 0x7feab8071ab0 2024-05-17T04:09:11.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.923+0000 7feabf5d2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7feab815e020 con 0x7feab80cde50 2024-05-17T04:09:11.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.923+0000 7feabdb6f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7feab8071ab0 0x7feab80d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:11.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.923+0000 7feabd36e640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7feab80d27e0 0x7feab80cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:45962/0 (socket says 172.21.15.131:45962) 2024-05-17T04:09:11.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.923+0000 7feabd36e640 1 -- 172.21.15.131:0/2690053146 learned_addr learned my addr 172.21.15.131:0/2690053146 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:11.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.924+0000 7feabcb6d640 1 --2- 172.21.15.131:0/2690053146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab80cde50 0x7feab8071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:11.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.924+0000 7feaaffff640 1 -- 172.21.15.131:0/2690053146 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1063103256 0 0) 0x7feab815dad0 con 0x7feab80d27e0 2024-05-17T04:09:11.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.924+0000 7feaaffff640 1 -- 172.21.15.131:0/2690053146 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feaa4003520 con 0x7feab80d27e0 2024-05-17T04:09:11.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.924+0000 7feabdb6f640 1 -- 172.21.15.131:0/2690053146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab80cde50 msgr2=0x7feab8071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:11.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.924+0000 7feabdb6f640 1 --2- 172.21.15.131:0/2690053146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab80cde50 0x7feab8071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.924+0000 7feabdb6f640 1 -- 172.21.15.131:0/2690053146 >> v1:172.21.15.131:6789/0 conn(0x7feab80d27e0 legacy=0x7feab80cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:11.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.924+0000 7feabdb6f640 1 -- 172.21.15.131:0/2690053146 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab815e300 con 0x7feab8071ab0 2024-05-17T04:09:11.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.924+0000 7feabcb6d640 1 --2- 172.21.15.131:0/2690053146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab80cde50 0x7feab8071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:11.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.925+0000 7feabdb6f640 1 --2- 172.21.15.131:0/2690053146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab8071ab0 0x7feab80d0cc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feab00097a0 tx=0x7feab002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7db005d76853a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:11.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.925+0000 7feaaffff640 1 -- 172.21.15.131:0/2690053146 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab0037070 con 0x7feab8071ab0 2024-05-17T04:09:11.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.925+0000 7feaaffff640 1 -- 172.21.15.131:0/2690053146 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab0032440 con 0x7feab8071ab0 2024-05-17T04:09:11.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.925+0000 7feaaffff640 1 -- 172.21.15.131:0/2690053146 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab0032810 con 0x7feab8071ab0 2024-05-17T04:09:11.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.925+0000 7feabf5d2640 1 -- 172.21.15.131:0/2690053146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab8071ab0 msgr2=0x7feab80d0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:11.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.925+0000 7feabf5d2640 1 --2- 172.21.15.131:0/2690053146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab8071ab0 0x7feab80d0cc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feab00097a0 tx=0x7feab002a180 comp rx=0 tx=0).stop 2024-05-17T04:09:11.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.925+0000 7feabf5d2640 1 -- 172.21.15.131:0/2690053146 shutdown_connections 2024-05-17T04:09:11.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.925+0000 7feabf5d2640 1 --2- 172.21.15.131:0/2690053146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab8071ab0 0x7feab80d0cc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.925+0000 7feabf5d2640 1 --2- 172.21.15.131:0/2690053146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab80cde50 0x7feab8071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.925+0000 7feabf5d2640 1 -- 172.21.15.131:0/2690053146 >> 172.21.15.131:0/2690053146 conn(0x7feab80b4c60 msgr2=0x7feab80b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:11.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.926+0000 7feabf5d2640 1 -- 172.21.15.131:0/2690053146 shutdown_connections 2024-05-17T04:09:11.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.926+0000 7feabf5d2640 1 -- 172.21.15.131:0/2690053146 wait complete. 2024-05-17T04:09:11.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.927+0000 7feabf5d2640 1 Processor -- start 2024-05-17T04:09:11.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.927+0000 7feabf5d2640 1 -- start start 2024-05-17T04:09:11.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabf5d2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab8071ab0 0x7feab80b7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:11.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabf5d2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab80d27e0 0x7feab80b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:11.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabf5d2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab80b1890 0x7feab80b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:11.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabf5d2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feab815e820 con 0x7feab80b1890 2024-05-17T04:09:11.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabf5d2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7feab8071ec0 con 0x7feab8071ab0 2024-05-17T04:09:11.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabf5d2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7feab806f920 con 0x7feab80d27e0 2024-05-17T04:09:11.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabdb6f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab80b1890 0x7feab80b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:11.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabdb6f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab80b1890 0x7feab80b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34068/0 (socket says 172.21.15.131:34068) 2024-05-17T04:09:11.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabdb6f640 1 -- 172.21.15.131:0/3899520005 learned_addr learned my addr 172.21.15.131:0/3899520005 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:11.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabcb6d640 1 --2- 172.21.15.131:0/3899520005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab80d27e0 0x7feab80b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:11.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabd36e640 1 --2- 172.21.15.131:0/3899520005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab8071ab0 0x7feab80b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:11.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabdb6f640 1 -- 172.21.15.131:0/3899520005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab80d27e0 msgr2=0x7feab80b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:11.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabdb6f640 1 --2- 172.21.15.131:0/3899520005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab80d27e0 0x7feab80b7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabdb6f640 1 -- 172.21.15.131:0/3899520005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab8071ab0 msgr2=0x7feab80b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:11.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabdb6f640 1 --2- 172.21.15.131:0/3899520005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab8071ab0 0x7feab80b7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:11.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabdb6f640 1 -- 172.21.15.131:0/3899520005 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab806e130 con 0x7feab80b1890 2024-05-17T04:09:11.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabd36e640 1 --2- 172.21.15.131:0/3899520005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab8071ab0 0x7feab80b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:11.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabdb6f640 1 --2- 172.21.15.131:0/3899520005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab80b1890 0x7feab80b1ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feab00098c0 tx=0x7feab00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:11.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feaadffb640 1 -- 172.21.15.131:0/3899520005 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab0037040 con 0x7feab80b1890 2024-05-17T04:09:11.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feaadffb640 1 -- 172.21.15.131:0/3899520005 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab0042070 con 0x7feab80b1890 2024-05-17T04:09:11.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feabf5d2640 1 -- 172.21.15.131:0/3899520005 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab81f5760 con 0x7feab80b1890 2024-05-17T04:09:11.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.929+0000 7feaadffb640 1 -- 172.21.15.131:0/3899520005 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab00308a0 con 0x7feab80b1890 2024-05-17T04:09:11.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.930+0000 7feabf5d2640 1 -- 172.21.15.131:0/3899520005 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab81f5d20 con 0x7feab80b1890 2024-05-17T04:09:11.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.930+0000 7feabf5d2640 1 -- 172.21.15.131:0/3899520005 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab8071570 con 0x7feab80b1890 2024-05-17T04:09:11.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.931+0000 7feaadffb640 1 -- 172.21.15.131:0/3899520005 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feab0030a40 con 0x7feab80b1890 2024-05-17T04:09:11.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.932+0000 7feaadffb640 1 --2- 172.21.15.131:0/3899520005 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fea9c076300 0x7fea9c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:11.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.932+0000 7feaadffb640 1 -- 172.21.15.131:0/3899520005 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feab00b8150 con 0x7feab80b1890 2024-05-17T04:09:11.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.932+0000 7feabd36e640 1 --2- 172.21.15.131:0/3899520005 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fea9c076300 0x7fea9c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:11.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.932+0000 7feabd36e640 1 --2- 172.21.15.131:0/3899520005 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fea9c076300 0x7fea9c078810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feab4005c00 tx=0x7feab4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:11.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:11.936+0000 7feaadffb640 1 -- 172.21.15.131:0/3899520005 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feab0081770 con 0x7feab80b1890 2024-05-17T04:09:12.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.118+0000 7feabf5d2640 1 -- 172.21.15.131:0/3899520005 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feab80ce1f0 con 0x7feab80b1890 2024-05-17T04:09:12.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.119+0000 7feaadffb640 1 -- 172.21.15.131:0/3899520005 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7feab0081070 con 0x7feab80b1890 2024-05-17T04:09:12.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:12.120 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":24,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:09:10.777455+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:03.633460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:04.707669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-17T04:09:08.400498+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:09:12.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.121+0000 7feabf5d2640 1 -- 172.21.15.131:0/3899520005 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fea9c076300 msgr2=0x7fea9c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.121+0000 7feabf5d2640 1 --2- 172.21.15.131:0/3899520005 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fea9c076300 0x7fea9c078810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feab4005c00 tx=0x7feab4009040 comp rx=0 tx=0).stop 2024-05-17T04:09:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.121+0000 7feabf5d2640 1 -- 172.21.15.131:0/3899520005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab80b1890 msgr2=0x7feab80b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.121+0000 7feabf5d2640 1 --2- 172.21.15.131:0/3899520005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab80b1890 0x7feab80b1ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feab00098c0 tx=0x7feab00046c0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.121+0000 7feabf5d2640 1 -- 172.21.15.131:0/3899520005 shutdown_connections 2024-05-17T04:09:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.121+0000 7feabf5d2640 1 --2- 172.21.15.131:0/3899520005 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fea9c076300 0x7fea9c078810 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.121+0000 7feabf5d2640 1 --2- 172.21.15.131:0/3899520005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab80b1890 0x7feab80b1ca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.121+0000 7feabf5d2640 1 --2- 172.21.15.131:0/3899520005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab80d27e0 0x7feab80b7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.121+0000 7feabf5d2640 1 --2- 172.21.15.131:0/3899520005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab8071ab0 0x7feab80b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.121+0000 7feabf5d2640 1 -- 172.21.15.131:0/3899520005 >> 172.21.15.131:0/3899520005 conn(0x7feab80b4c60 msgr2=0x7feab815b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.121+0000 7feabf5d2640 1 -- 172.21.15.131:0/3899520005 shutdown_connections 2024-05-17T04:09:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.121+0000 7feabf5d2640 1 -- 172.21.15.131:0/3899520005 wait complete. 2024-05-17T04:09:12.134 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:09:12.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.242+0000 7f4b14d7b640 1 Processor -- start 2024-05-17T04:09:12.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.242+0000 7f4b14d7b640 1 -- start start 2024-05-17T04:09:12.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.244+0000 7f4b14d7b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4b100cddd0 0x7f4b100cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.244+0000 7f4b14d7b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b1015e150 0x7f4b10153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.244+0000 7f4b14d7b640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b100d0530 con 0x7f4b100d0120 2024-05-17T04:09:12.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.244+0000 7f4b14d7b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f4b100b8ef0 con 0x7f4b100cddd0 2024-05-17T04:09:12.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.244+0000 7f4b14d7b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4b1015e970 con 0x7f4b1015e150 2024-05-17T04:09:12.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.244+0000 7f4b0e59c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4b100cddd0 0x7f4b100cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.244+0000 7f4b07fff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f4b100d0120 0x7f4b1015da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:45974/0 (socket says 172.21.15.131:45974) 2024-05-17T04:09:12.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.244+0000 7f4b0e59c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4b100cddd0 0x7f4b100cfbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34084/0 (socket says 172.21.15.131:34084) 2024-05-17T04:09:12.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.244+0000 7f4b07fff640 1 -- 172.21.15.131:0/3871809917 learned_addr learned my addr 172.21.15.131:0/3871809917 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:12.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.244+0000 7f4b0ed9d640 1 --2- 172.21.15.131:0/3871809917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b1015e150 0x7f4b10153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.244+0000 7f4b0e59c640 1 -- 172.21.15.131:0/3871809917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b1015e150 msgr2=0x7f4b10153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:12.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.244+0000 7f4b0e59c640 1 --2- 172.21.15.131:0/3871809917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b1015e150 0x7f4b10153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.244+0000 7f4b0e59c640 1 -- 172.21.15.131:0/3871809917 >> v1:172.21.15.131:6789/0 conn(0x7f4b100d0120 legacy=0x7f4b1015da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.244+0000 7f4b0e59c640 1 -- 172.21.15.131:0/3871809917 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1015e690 con 0x7f4b100cddd0 2024-05-17T04:09:12.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.244+0000 7f4b0dd9b640 1 -- 172.21.15.131:0/3871809917 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 618112258 0 0) 0x7f4af8001110 con 0x7f4b100d0120 2024-05-17T04:09:12.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.245+0000 7f4b0e59c640 1 --2- 172.21.15.131:0/3871809917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b100cddd0 0x7f4b100cfbe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4b000097a0 tx=0x7f4b0002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f38cda657df08f server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:12.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.245+0000 7f4b0dd9b640 1 -- 172.21.15.131:0/3871809917 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00037070 con 0x7f4b100cddd0 2024-05-17T04:09:12.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.245+0000 7f4b0dd9b640 1 -- 172.21.15.131:0/3871809917 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b0002adb0 con 0x7f4b100cddd0 2024-05-17T04:09:12.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.245+0000 7f4b0dd9b640 1 -- 172.21.15.131:0/3871809917 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00032660 con 0x7f4b100cddd0 2024-05-17T04:09:12.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.246+0000 7f4b14d7b640 1 -- 172.21.15.131:0/3871809917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b100cddd0 msgr2=0x7f4b100cfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.246+0000 7f4b14d7b640 1 --2- 172.21.15.131:0/3871809917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b100cddd0 0x7f4b100cfbe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4b000097a0 tx=0x7f4b0002a060 comp rx=0 tx=0).stop 2024-05-17T04:09:12.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.246+0000 7f4b14d7b640 1 -- 172.21.15.131:0/3871809917 shutdown_connections 2024-05-17T04:09:12.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.246+0000 7f4b14d7b640 1 --2- 172.21.15.131:0/3871809917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b1015e150 0x7f4b10153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.246+0000 7f4b14d7b640 1 --2- 172.21.15.131:0/3871809917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b100cddd0 0x7f4b100cfbe0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.246+0000 7f4b14d7b640 1 -- 172.21.15.131:0/3871809917 >> 172.21.15.131:0/3871809917 conn(0x7f4b100b4e40 msgr2=0x7f4b100b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:12.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.246+0000 7f4b14d7b640 1 -- 172.21.15.131:0/3871809917 shutdown_connections 2024-05-17T04:09:12.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.246+0000 7f4b14d7b640 1 -- 172.21.15.131:0/3871809917 wait complete. 2024-05-17T04:09:12.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.248+0000 7f4b14d7b640 1 Processor -- start 2024-05-17T04:09:12.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.248+0000 7f4b14d7b640 1 -- start start 2024-05-17T04:09:12.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.249+0000 7f4b14d7b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b100cddd0 0x7f4b101535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.249+0000 7f4b14d7b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b100d0120 0x7f4b101f7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.249+0000 7f4b14d7b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b1015e150 0x7f4b101f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.249+0000 7f4b14d7b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4b100ce1e0 con 0x7f4b100cddd0 2024-05-17T04:09:12.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.249+0000 7f4b14d7b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4b100d10b0 con 0x7f4b1015e150 2024-05-17T04:09:12.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.249+0000 7f4b14d7b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4b101f6e10 con 0x7f4b100d0120 2024-05-17T04:09:12.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.249+0000 7f4b0e59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b100cddd0 0x7f4b101535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.249+0000 7f4b0e59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b100cddd0 0x7f4b101535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34090/0 (socket says 172.21.15.131:34090) 2024-05-17T04:09:12.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.249+0000 7f4b0e59c640 1 -- 172.21.15.131:0/587598007 learned_addr learned my addr 172.21.15.131:0/587598007 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:12.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.250+0000 7f4b0ed9d640 1 --2- 172.21.15.131:0/587598007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b1015e150 0x7f4b101f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.250+0000 7f4b07fff640 1 --2- 172.21.15.131:0/587598007 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b100d0120 0x7f4b101f7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.250+0000 7f4b0e59c640 1 -- 172.21.15.131:0/587598007 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b100d0120 msgr2=0x7f4b101f7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.250+0000 7f4b0e59c640 1 --2- 172.21.15.131:0/587598007 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b100d0120 0x7f4b101f7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.250+0000 7f4b0e59c640 1 -- 172.21.15.131:0/587598007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b1015e150 msgr2=0x7f4b101f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.250+0000 7f4b0e59c640 1 --2- 172.21.15.131:0/587598007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b1015e150 0x7f4b101f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.250+0000 7f4b0e59c640 1 -- 172.21.15.131:0/587598007 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b10152280 con 0x7f4b100cddd0 2024-05-17T04:09:12.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.250+0000 7f4b0ed9d640 1 --2- 172.21.15.131:0/587598007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b1015e150 0x7f4b101f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:12.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.250+0000 7f4b0e59c640 1 --2- 172.21.15.131:0/587598007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b100cddd0 0x7f4b101535b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4b00035040 tx=0x7f4b000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:12.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.250+0000 7f4b06ffd640 1 -- 172.21.15.131:0/587598007 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00037040 con 0x7f4b100cddd0 2024-05-17T04:09:12.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.250+0000 7f4b06ffd640 1 -- 172.21.15.131:0/587598007 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b00004030 con 0x7f4b100cddd0 2024-05-17T04:09:12.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.250+0000 7f4b14d7b640 1 -- 172.21.15.131:0/587598007 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b101e6e50 con 0x7f4b100cddd0 2024-05-17T04:09:12.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.250+0000 7f4b06ffd640 1 -- 172.21.15.131:0/587598007 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00004400 con 0x7f4b100cddd0 2024-05-17T04:09:12.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.250+0000 7f4b14d7b640 1 -- 172.21.15.131:0/587598007 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b101e7410 con 0x7f4b100cddd0 2024-05-17T04:09:12.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.251+0000 7f4b14d7b640 1 -- 172.21.15.131:0/587598007 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b100cfbe0 con 0x7f4b100cddd0 2024-05-17T04:09:12.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.252+0000 7f4b06ffd640 1 -- 172.21.15.131:0/587598007 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4b00003610 con 0x7f4b100cddd0 2024-05-17T04:09:12.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.252+0000 7f4b06ffd640 1 --2- 172.21.15.131:0/587598007 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f4af00762d0 0x7f4af00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.252+0000 7f4b06ffd640 1 -- 172.21.15.131:0/587598007 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4b000b87d0 con 0x7f4b100cddd0 2024-05-17T04:09:12.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.252+0000 7f4b07fff640 1 --2- 172.21.15.131:0/587598007 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f4af00762d0 0x7f4af00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.253+0000 7f4b07fff640 1 --2- 172.21.15.131:0/587598007 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f4af00762d0 0x7f4af00787e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b100d2980 tx=0x7f4af8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:12.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.257+0000 7f4b06ffd640 1 -- 172.21.15.131:0/587598007 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4b00081cc0 con 0x7f4b100cddd0 2024-05-17T04:09:12.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.440+0000 7f4b14d7b640 1 -- 172.21.15.131:0/587598007 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b10152f50 con 0x7f4b100cddd0 2024-05-17T04:09:12.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.441+0000 7f4b06ffd640 1 -- 172.21.15.131:0/587598007 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f4b000815c0 con 0x7f4b100cddd0 2024-05-17T04:09:12.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:12.442 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":24,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:09:10.777455+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:03.633460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:04.707669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-17T04:09:08.400498+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:09:12.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.443+0000 7f4b14d7b640 1 -- 172.21.15.131:0/587598007 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f4af00762d0 msgr2=0x7f4af00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.443+0000 7f4b14d7b640 1 --2- 172.21.15.131:0/587598007 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f4af00762d0 0x7f4af00787e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b100d2980 tx=0x7f4af8009040 comp rx=0 tx=0).stop 2024-05-17T04:09:12.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.443+0000 7f4b14d7b640 1 -- 172.21.15.131:0/587598007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b100cddd0 msgr2=0x7f4b101535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.443+0000 7f4b14d7b640 1 --2- 172.21.15.131:0/587598007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b100cddd0 0x7f4b101535b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4b00035040 tx=0x7f4b000046c0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.443+0000 7f4b14d7b640 1 -- 172.21.15.131:0/587598007 shutdown_connections 2024-05-17T04:09:12.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.443+0000 7f4b14d7b640 1 --2- 172.21.15.131:0/587598007 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f4af00762d0 0x7f4af00787e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.443+0000 7f4b14d7b640 1 --2- 172.21.15.131:0/587598007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b1015e150 0x7f4b101f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.443+0000 7f4b14d7b640 1 --2- 172.21.15.131:0/587598007 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b100d0120 0x7f4b101f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.443+0000 7f4b14d7b640 1 --2- 172.21.15.131:0/587598007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b100cddd0 0x7f4b101535b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.443+0000 7f4b14d7b640 1 -- 172.21.15.131:0/587598007 >> 172.21.15.131:0/587598007 conn(0x7f4b100b4e40 msgr2=0x7f4b100702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:12.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.443+0000 7f4b14d7b640 1 -- 172.21.15.131:0/587598007 shutdown_connections 2024-05-17T04:09:12.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.443+0000 7f4b14d7b640 1 -- 172.21.15.131:0/587598007 wait complete. 2024-05-17T04:09:12.472 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T04:09:12.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.581+0000 7f16fb773640 1 Processor -- start 2024-05-17T04:09:12.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.582+0000 7f16fb773640 1 -- start start 2024-05-17T04:09:12.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.583+0000 7f16fb773640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f16f40d0900 0x7f16f4163150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.583+0000 7f16fb773640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f16f4071aa0 0x7f16f40b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.583+0000 7f16fb773640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f4163690 con 0x7f16f40b6f10 2024-05-17T04:09:12.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.583+0000 7f16fb773640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f16f40d0d10 con 0x7f16f4071aa0 2024-05-17T04:09:12.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.583+0000 7f16fb773640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f16f40b1470 con 0x7f16f40d0900 2024-05-17T04:09:12.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.583+0000 7f16f9d10640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f16f4071aa0 0x7f16f40b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.583+0000 7f16f9d10640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f16f4071aa0 0x7f16f40b7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34092/0 (socket says 172.21.15.131:34092) 2024-05-17T04:09:12.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.583+0000 7f16f9d10640 1 -- 172.21.15.131:0/1214661285 learned_addr learned my addr 172.21.15.131:0/1214661285 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:12.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.583+0000 7f16f950f640 1 --2- 172.21.15.131:0/1214661285 >> v2:172.21.15.150:3300/0 conn(0x7f16f40d0900 0x7f16f4163150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.584+0000 7f16f9d10640 1 -- 172.21.15.131:0/1214661285 >> v2:172.21.15.150:3300/0 conn(0x7f16f40d0900 msgr2=0x7f16f4163150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:12.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.584+0000 7f16f9d10640 1 --2- 172.21.15.131:0/1214661285 >> v2:172.21.15.150:3300/0 conn(0x7f16f40d0900 0x7f16f4163150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.584+0000 7f16f9d10640 1 -- 172.21.15.131:0/1214661285 >> v1:172.21.15.150:6789/0 conn(0x7f16f40b6f10 legacy=0x7f16f4071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.584+0000 7f16f9d10640 1 -- 172.21.15.131:0/1214661285 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f4163910 con 0x7f16f4071aa0 2024-05-17T04:09:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.584+0000 7f16f9d10640 1 --2- 172.21.15.131:0/1214661285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f4071aa0 0x7f16f40b7320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f16f4073160 tx=0x7f16ec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880c881e3d4909c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.584+0000 7f16f3fff640 1 -- 172.21.15.131:0/1214661285 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec037070 con 0x7f16f4071aa0 2024-05-17T04:09:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.584+0000 7f16f3fff640 1 -- 172.21.15.131:0/1214661285 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ec032440 con 0x7f16f4071aa0 2024-05-17T04:09:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.584+0000 7f16f3fff640 1 -- 172.21.15.131:0/1214661285 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec032810 con 0x7f16f4071aa0 2024-05-17T04:09:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.585+0000 7f16fb773640 1 -- 172.21.15.131:0/1214661285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f4071aa0 msgr2=0x7f16f40b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.585+0000 7f16fb773640 1 --2- 172.21.15.131:0/1214661285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f4071aa0 0x7f16f40b7320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f16f4073160 tx=0x7f16ec02a1e0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.585+0000 7f16fb773640 1 -- 172.21.15.131:0/1214661285 shutdown_connections 2024-05-17T04:09:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.585+0000 7f16fb773640 1 --2- 172.21.15.131:0/1214661285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f4071aa0 0x7f16f40b7320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.585+0000 7f16fb773640 1 --2- 172.21.15.131:0/1214661285 >> v2:172.21.15.150:3300/0 conn(0x7f16f40d0900 0x7f16f4163150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.585+0000 7f16fb773640 1 -- 172.21.15.131:0/1214661285 >> 172.21.15.131:0/1214661285 conn(0x7f16f4074690 msgr2=0x7f16f40b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:12.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.585+0000 7f16fb773640 1 -- 172.21.15.131:0/1214661285 shutdown_connections 2024-05-17T04:09:12.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.585+0000 7f16fb773640 1 -- 172.21.15.131:0/1214661285 wait complete. 2024-05-17T04:09:12.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.587+0000 7f16fb773640 1 Processor -- start 2024-05-17T04:09:12.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.587+0000 7f16fb773640 1 -- start start 2024-05-17T04:09:12.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.588+0000 7f16fb773640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16f40b6f10 0x7f16f41f95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.588+0000 7f16fb773640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f40d0900 0x7f16f41610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.588+0000 7f16fb773640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f415a420 0x7f16f415a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.588+0000 7f16fb773640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f16f40b69f0 con 0x7f16f40d0900 2024-05-17T04:09:12.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.588+0000 7f16fb773640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f16f4163ed0 con 0x7f16f415a420 2024-05-17T04:09:12.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.588+0000 7f16fb773640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f16f415f650 con 0x7f16f40b6f10 2024-05-17T04:09:12.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.588+0000 7f16f8d0e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f40d0900 0x7f16f41610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.588+0000 7f16f8d0e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f40d0900 0x7f16f41610e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34104/0 (socket says 172.21.15.131:34104) 2024-05-17T04:09:12.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.588+0000 7f16f8d0e640 1 -- 172.21.15.131:0/2312037055 learned_addr learned my addr 172.21.15.131:0/2312037055 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:12.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.589+0000 7f16f9d10640 1 --2- 172.21.15.131:0/2312037055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f415a420 0x7f16f415a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.589+0000 7f16f950f640 1 --2- 172.21.15.131:0/2312037055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16f40b6f10 0x7f16f41f95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.589+0000 7f16f8d0e640 1 -- 172.21.15.131:0/2312037055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16f40b6f10 msgr2=0x7f16f41f95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.589+0000 7f16f8d0e640 1 --2- 172.21.15.131:0/2312037055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16f40b6f10 0x7f16f41f95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.589+0000 7f16f8d0e640 1 -- 172.21.15.131:0/2312037055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f415a420 msgr2=0x7f16f415a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.589+0000 7f16f8d0e640 1 --2- 172.21.15.131:0/2312037055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f415a420 0x7f16f415a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.589+0000 7f16f8d0e640 1 -- 172.21.15.131:0/2312037055 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f41f9b00 con 0x7f16f40d0900 2024-05-17T04:09:12.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.589+0000 7f16f8d0e640 1 --2- 172.21.15.131:0/2312037055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f40d0900 0x7f16f41610e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16e800c3a0 tx=0x7f16e800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:12.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.589+0000 7f16f1ffb640 1 -- 172.21.15.131:0/2312037055 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8017070 con 0x7f16f40d0900 2024-05-17T04:09:12.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.589+0000 7f16f1ffb640 1 -- 172.21.15.131:0/2312037055 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e80052d0 con 0x7f16f40d0900 2024-05-17T04:09:12.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.589+0000 7f16fb773640 1 -- 172.21.15.131:0/2312037055 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f415ad70 con 0x7f16f40d0900 2024-05-17T04:09:12.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.589+0000 7f16f1ffb640 1 -- 172.21.15.131:0/2312037055 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8003830 con 0x7f16f40d0900 2024-05-17T04:09:12.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.589+0000 7f16fb773640 1 -- 172.21.15.131:0/2312037055 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f4156ca0 con 0x7f16f40d0900 2024-05-17T04:09:12.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.590+0000 7f16fb773640 1 -- 172.21.15.131:0/2312037055 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f4069940 con 0x7f16f40d0900 2024-05-17T04:09:12.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.591+0000 7f16f1ffb640 1 -- 172.21.15.131:0/2312037055 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f16e801a070 con 0x7f16f40d0900 2024-05-17T04:09:12.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.591+0000 7f16f1ffb640 1 --2- 172.21.15.131:0/2312037055 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f16e00762d0 0x7f16e00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.591+0000 7f16f1ffb640 1 -- 172.21.15.131:0/2312037055 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f16e8096c20 con 0x7f16f40d0900 2024-05-17T04:09:12.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.591+0000 7f16f950f640 1 --2- 172.21.15.131:0/2312037055 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f16e00762d0 0x7f16e00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.592+0000 7f16f950f640 1 --2- 172.21.15.131:0/2312037055 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f16e00762d0 0x7f16e00787e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f16e4003b80 tx=0x7f16e4009880 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:12.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.596+0000 7f16f1ffb640 1 -- 172.21.15.131:0/2312037055 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f16f4069940 con 0x7f16f40d0900 2024-05-17T04:09:12.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.814+0000 7f16fb773640 1 -- 172.21.15.131:0/2312037055 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16f4163150 con 0x7f16f40d0900 2024-05-17T04:09:12.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.814+0000 7f16f1ffb640 1 -- 172.21.15.131:0/2312037055 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5189 (secure 0 0 0) 0x7f16f415ad70 con 0x7f16f40d0900 2024-05-17T04:09:12.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:12.815 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2897828294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2897828294},{"type":"v1","addr":"172.21.15.131:6837","nonce":2897828294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/4068751282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4068751282},{"type":"v1","addr":"172.21.15.131:6836","nonce":4068751282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2776700884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2776700884},{"type":"v1","addr":"172.21.15.150:6834","nonce":2776700884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:05.755541+0000","modified":"2024-05-17T04:09:10.777630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2635477484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2635477484},{"type":"v1","addr":"172.21.15.150:6835","nonce":2635477484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-05-17T04:09:12.816 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 6 2024-05-17T04:09:12.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.816+0000 7f16fb773640 1 -- 172.21.15.131:0/2312037055 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f16e00762d0 msgr2=0x7f16e00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.816+0000 7f16fb773640 1 --2- 172.21.15.131:0/2312037055 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f16e00762d0 0x7f16e00787e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f16e4003b80 tx=0x7f16e4009880 comp rx=0 tx=0).stop 2024-05-17T04:09:12.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.816+0000 7f16fb773640 1 -- 172.21.15.131:0/2312037055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f40d0900 msgr2=0x7f16f41610e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.816+0000 7f16fb773640 1 --2- 172.21.15.131:0/2312037055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f40d0900 0x7f16f41610e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16e800c3a0 tx=0x7f16e800c860 comp rx=0 tx=0).stop 2024-05-17T04:09:12.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.816+0000 7f16fb773640 1 -- 172.21.15.131:0/2312037055 shutdown_connections 2024-05-17T04:09:12.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.816+0000 7f16fb773640 1 --2- 172.21.15.131:0/2312037055 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f16e00762d0 0x7f16e00787e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.816+0000 7f16fb773640 1 --2- 172.21.15.131:0/2312037055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f40d0900 0x7f16f41610e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.816+0000 7f16fb773640 1 --2- 172.21.15.131:0/2312037055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16f415a420 0x7f16f415a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.816+0000 7f16fb773640 1 --2- 172.21.15.131:0/2312037055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16f40b6f10 0x7f16f41f95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.816+0000 7f16fb773640 1 -- 172.21.15.131:0/2312037055 >> 172.21.15.131:0/2312037055 conn(0x7f16f4074690 msgr2=0x7f16f40b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:12.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.816+0000 7f16fb773640 1 -- 172.21.15.131:0/2312037055 shutdown_connections 2024-05-17T04:09:12.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.816+0000 7f16fb773640 1 -- 172.21.15.131:0/2312037055 wait complete. 2024-05-17T04:09:12.829 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:09:12.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.938+0000 7fe8b2b2e640 1 Processor -- start 2024-05-17T04:09:12.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.938+0000 7fe8b2b2e640 1 -- start start 2024-05-17T04:09:12.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8b2b2e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe8ac0d1750 0x7fe8ac06f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8b2b2e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8ac160930 con 0x7fe8ac0cd720 2024-05-17T04:09:12.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8b2b2e640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8ac06e870 con 0x7fe8ac06f890 2024-05-17T04:09:12.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8b2b2e640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe8ac06eb50 con 0x7fe8ac0d1750 2024-05-17T04:09:12.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8b08ca640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe8ac0cd720 0x7fe8ac0d1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:45986/0 (socket says 172.21.15.131:45986) 2024-05-17T04:09:12.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8b08ca640 1 -- 172.21.15.131:0/3945796286 learned_addr learned my addr 172.21.15.131:0/3945796286 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:12.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8abfff640 1 --2- 172.21.15.131:0/3945796286 >> v2:172.21.15.150:3300/0 conn(0x7fe8ac0d1750 0x7fe8ac06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8ab7fe640 1 -- 172.21.15.131:0/3945796286 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409774188 0 0) 0x7fe8ac160930 con 0x7fe8ac0cd720 2024-05-17T04:09:12.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8ab7fe640 1 -- 172.21.15.131:0/3945796286 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe894003520 con 0x7fe8ac0cd720 2024-05-17T04:09:12.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8ab7fe640 1 -- 172.21.15.131:0/3945796286 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3190496162 0 0) 0x7fe894003520 con 0x7fe8ac0cd720 2024-05-17T04:09:12.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8ab7fe640 1 -- 172.21.15.131:0/3945796286 >> v2:172.21.15.150:3300/0 conn(0x7fe8ac0d1750 msgr2=0x7fe8ac06f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:12.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8ab7fe640 1 --2- 172.21.15.131:0/3945796286 >> v2:172.21.15.150:3300/0 conn(0x7fe8ac0d1750 0x7fe8ac06f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8ab7fe640 1 -- 172.21.15.131:0/3945796286 >> v1:172.21.15.150:6789/0 conn(0x7fe8ac06f890 legacy=0x7fe8ac15f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8ab7fe640 1 -- 172.21.15.131:0/3945796286 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac06ee30 con 0x7fe8ac0cd720 2024-05-17T04:09:12.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8ab7fe640 1 -- 172.21.15.131:0/3945796286 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7fe89c001710 con 0x7fe8ac0cd720 2024-05-17T04:09:12.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8ab7fe640 1 -- 172.21.15.131:0/3945796286 >> v1:172.21.15.131:6789/0 conn(0x7fe8ac0cd720 legacy=0x7fe8ac0d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.940+0000 7fe8ab7fe640 1 --2- 172.21.15.131:0/3945796286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe894003a50 0x7fe894003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.941+0000 7fe8ab7fe640 1 --2- 172.21.15.131:0/3945796286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe894004800 0x7fe894004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.941+0000 7fe8ab7fe640 1 --2- 172.21.15.131:0/3945796286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe894005250 0x7fe89400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.941+0000 7fe8ab7fe640 1 -- 172.21.15.131:0/3945796286 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac06eb50 con 0x7fe894005250 2024-05-17T04:09:12.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.941+0000 7fe8ab7fe640 1 -- 172.21.15.131:0/3945796286 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe89400c1e0 con 0x7fe894003a50 2024-05-17T04:09:12.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.941+0000 7fe8ab7fe640 1 -- 172.21.15.131:0/3945796286 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe89400c3e0 con 0x7fe894004800 2024-05-17T04:09:12.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.941+0000 7fe8b10cb640 1 --2- 172.21.15.131:0/3945796286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe894005250 0x7fe89400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.941+0000 7fe8b08ca640 1 --2- 172.21.15.131:0/3945796286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe894003a50 0x7fe894003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.941+0000 7fe8abfff640 1 --2- 172.21.15.131:0/3945796286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe894004800 0x7fe894004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.941+0000 7fe8b10cb640 1 -- 172.21.15.131:0/3945796286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe894004800 msgr2=0x7fe894004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:12.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.941+0000 7fe8b10cb640 1 --2- 172.21.15.131:0/3945796286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe894004800 0x7fe894004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.941+0000 7fe8b10cb640 1 -- 172.21.15.131:0/3945796286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe894003a50 msgr2=0x7fe894003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:12.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.941+0000 7fe8b10cb640 1 --2- 172.21.15.131:0/3945796286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe894003a50 0x7fe894003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.941+0000 7fe8b10cb640 1 -- 172.21.15.131:0/3945796286 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe894003520 con 0x7fe894005250 2024-05-17T04:09:12.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.941+0000 7fe8b10cb640 1 -- 172.21.15.131:0/3945796286 reap_dead start 2024-05-17T04:09:12.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.942+0000 7fe8b10cb640 1 --2- 172.21.15.131:0/3945796286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe894005250 0x7fe89400b9c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0d0e00 tx=0x7fe894005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e6748d3842d2f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:12.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.942+0000 7fe8ab7fe640 1 -- 172.21.15.131:0/3945796286 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4001ab0 con 0x7fe894005250 2024-05-17T04:09:12.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.942+0000 7fe8ab7fe640 1 -- 172.21.15.131:0/3945796286 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8a402adf0 con 0x7fe894005250 2024-05-17T04:09:12.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.942+0000 7fe8ab7fe640 1 -- 172.21.15.131:0/3945796286 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4003bb0 con 0x7fe894005250 2024-05-17T04:09:12.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.942+0000 7fe8b2b2e640 1 -- 172.21.15.131:0/3945796286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe894005250 msgr2=0x7fe89400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.942+0000 7fe8b2b2e640 1 --2- 172.21.15.131:0/3945796286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe894005250 0x7fe89400b9c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0d0e00 tx=0x7fe894005830 comp rx=0 tx=0).stop 2024-05-17T04:09:12.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.942+0000 7fe8b2b2e640 1 -- 172.21.15.131:0/3945796286 shutdown_connections 2024-05-17T04:09:12.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.942+0000 7fe8b2b2e640 1 --2- 172.21.15.131:0/3945796286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe894005250 0x7fe89400b9c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.942+0000 7fe8b2b2e640 1 -- 172.21.15.131:0/3945796286 >> 172.21.15.131:0/3945796286 conn(0x7fe8ac0b4e40 msgr2=0x7fe8ac0b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:12.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.942+0000 7fe8b2b2e640 1 -- 172.21.15.131:0/3945796286 shutdown_connections 2024-05-17T04:09:12.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.942+0000 7fe8b2b2e640 1 -- 172.21.15.131:0/3945796286 wait complete. 2024-05-17T04:09:12.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.944+0000 7fe8b2b2e640 1 Processor -- start 2024-05-17T04:09:12.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.944+0000 7fe8b2b2e640 1 -- start start 2024-05-17T04:09:12.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b2b2e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe894005250 0x7fe8ac154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b2b2e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8ac0c8970 0x7fe8ac15d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b2b2e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ac0c8d80 0x7fe8ac15dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b2b2e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac06f6e0 con 0x7fe8ac0c8d80 2024-05-17T04:09:12.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b2b2e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac06f560 con 0x7fe894005250 2024-05-17T04:09:12.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b2b2e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ac06fca0 con 0x7fe8ac0c8970 2024-05-17T04:09:12.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b10cb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ac0c8d80 0x7fe8ac15dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b10cb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ac0c8d80 0x7fe8ac15dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34122/0 (socket says 172.21.15.131:34122) 2024-05-17T04:09:12.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b10cb640 1 -- 172.21.15.131:0/4196511399 learned_addr learned my addr 172.21.15.131:0/4196511399 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:12.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b08ca640 1 --2- 172.21.15.131:0/4196511399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe894005250 0x7fe8ac154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8abfff640 1 --2- 172.21.15.131:0/4196511399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8ac0c8970 0x7fe8ac15d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b10cb640 1 -- 172.21.15.131:0/4196511399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8ac0c8970 msgr2=0x7fe8ac15d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b10cb640 1 --2- 172.21.15.131:0/4196511399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8ac0c8970 0x7fe8ac15d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b10cb640 1 -- 172.21.15.131:0/4196511399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe894005250 msgr2=0x7fe8ac154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:12.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b10cb640 1 --2- 172.21.15.131:0/4196511399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe894005250 0x7fe8ac154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:12.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b10cb640 1 -- 172.21.15.131:0/4196511399 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac0c9300 con 0x7fe8ac0c8d80 2024-05-17T04:09:12.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b10cb640 1 --2- 172.21.15.131:0/4196511399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ac0c8d80 0x7fe8ac15dc80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe8a402a8a0 tx=0x7fe8a40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:12.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8a97fa640 1 -- 172.21.15.131:0/4196511399 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4007df0 con 0x7fe8ac0c8d80 2024-05-17T04:09:12.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8a97fa640 1 -- 172.21.15.131:0/4196511399 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8a402abf0 con 0x7fe8ac0c8d80 2024-05-17T04:09:12.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b2b2e640 1 -- 172.21.15.131:0/4196511399 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ac0c9800 con 0x7fe8ac0c8d80 2024-05-17T04:09:12.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8a97fa640 1 -- 172.21.15.131:0/4196511399 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4001ab0 con 0x7fe8ac0c8d80 2024-05-17T04:09:12.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.946+0000 7fe8b2b2e640 1 -- 172.21.15.131:0/4196511399 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8ac0c7040 con 0x7fe8ac0c8d80 2024-05-17T04:09:12.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.947+0000 7fe8b2b2e640 1 -- 172.21.15.131:0/4196511399 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8ac0c9570 con 0x7fe8ac0c8d80 2024-05-17T04:09:12.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.948+0000 7fe8a97fa640 1 -- 172.21.15.131:0/4196511399 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe8a4043020 con 0x7fe8ac0c8d80 2024-05-17T04:09:12.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.949+0000 7fe8a97fa640 1 --2- 172.21.15.131:0/4196511399 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe8980762d0 0x7fe8980787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:12.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.949+0000 7fe8a97fa640 1 -- 172.21.15.131:0/4196511399 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe8a40b68d0 con 0x7fe8ac0c8d80 2024-05-17T04:09:12.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.949+0000 7fe8b08ca640 1 --2- 172.21.15.131:0/4196511399 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe8980762d0 0x7fe8980787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:12.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.949+0000 7fe8b08ca640 1 --2- 172.21.15.131:0/4196511399 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe8980762d0 0x7fe8980787e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe89c001eb0 tx=0x7fe89c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:12.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:12.953+0000 7fe8a97fa640 1 -- 172.21.15.131:0/4196511399 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe8a407fed0 con 0x7fe8ac0c8d80 2024-05-17T04:09:13.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.135+0000 7fe8b2b2e640 1 -- 172.21.15.131:0/4196511399 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8ac070030 con 0x7fe8ac0c8d80 2024-05-17T04:09:13.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.136+0000 7fe8a97fa640 1 -- 172.21.15.131:0/4196511399 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fe8a407f7d0 con 0x7fe8ac0c8d80 2024-05-17T04:09:13.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:13.138 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":24,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:09:10.777455+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:03.633460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:04.707669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-17T04:09:08.400498+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:09:13.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.139+0000 7fe8b2b2e640 1 -- 172.21.15.131:0/4196511399 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe8980762d0 msgr2=0x7fe8980787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.139+0000 7fe8b2b2e640 1 --2- 172.21.15.131:0/4196511399 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe8980762d0 0x7fe8980787e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe89c001eb0 tx=0x7fe89c009040 comp rx=0 tx=0).stop 2024-05-17T04:09:13.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.139+0000 7fe8b2b2e640 1 -- 172.21.15.131:0/4196511399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ac0c8d80 msgr2=0x7fe8ac15dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.139+0000 7fe8b2b2e640 1 --2- 172.21.15.131:0/4196511399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ac0c8d80 0x7fe8ac15dc80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe8a402a8a0 tx=0x7fe8a40014a0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.139+0000 7fe8b2b2e640 1 -- 172.21.15.131:0/4196511399 shutdown_connections 2024-05-17T04:09:13.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.139+0000 7fe8b2b2e640 1 --2- 172.21.15.131:0/4196511399 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe8980762d0 0x7fe8980787e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.139+0000 7fe8b2b2e640 1 --2- 172.21.15.131:0/4196511399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ac0c8d80 0x7fe8ac15dc80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.139+0000 7fe8b2b2e640 1 --2- 172.21.15.131:0/4196511399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8ac0c8970 0x7fe8ac15d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.139+0000 7fe8b2b2e640 1 --2- 172.21.15.131:0/4196511399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe894005250 0x7fe8ac154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.139+0000 7fe8b2b2e640 1 -- 172.21.15.131:0/4196511399 >> 172.21.15.131:0/4196511399 conn(0x7fe8ac0b4e40 msgr2=0x7fe8ac0d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:13.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.139+0000 7fe8b2b2e640 1 -- 172.21.15.131:0/4196511399 shutdown_connections 2024-05-17T04:09:13.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.139+0000 7fe8b2b2e640 1 -- 172.21.15.131:0/4196511399 wait complete. 2024-05-17T04:09:13.554 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-17T04:09:05.755541+0000', 'modified': '2024-05-17T04:09:10.777630+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4309': {'gid': 4309, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/2635477484', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6833', 'nonce': 2635477484}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 2635477484}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4309, 'qdb_cluster': [4309]} 2024-05-17T04:09:13.554 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-17T04:09:13.554 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-17T04:09:13.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.666+0000 7f608d1d4640 1 Processor -- start 2024-05-17T04:09:13.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.666+0000 7f608d1d4640 1 -- start start 2024-05-17T04:09:13.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.667+0000 7f608d1d4640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f60880cd720 0x7f60880d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.667+0000 7f608d1d4640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f608806fa60 0x7f608815f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.667+0000 7f608d1d4640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60880d1990 con 0x7f60880d1580 2024-05-17T04:09:13.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.667+0000 7f608d1d4640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6088160930 con 0x7f608806fa60 2024-05-17T04:09:13.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.667+0000 7f608d1d4640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f608806e870 con 0x7f60880cd720 2024-05-17T04:09:13.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.668+0000 7f608759e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f608806fa60 0x7f608815f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.668+0000 7f608759e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f608806fa60 0x7f608815f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34132/0 (socket says 172.21.15.131:34132) 2024-05-17T04:09:13.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.668+0000 7f608759e640 1 -- 172.21.15.131:0/2871271727 learned_addr learned my addr 172.21.15.131:0/2871271727 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:13.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.668+0000 7f6086d9d640 1 --2- 172.21.15.131:0/2871271727 >> v2:172.21.15.150:3300/0 conn(0x7f60880cd720 0x7f60880d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.668+0000 7f608759e640 1 -- 172.21.15.131:0/2871271727 >> v2:172.21.15.150:3300/0 conn(0x7f60880cd720 msgr2=0x7f60880d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:13.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.668+0000 7f608759e640 1 --2- 172.21.15.131:0/2871271727 >> v2:172.21.15.150:3300/0 conn(0x7f60880cd720 0x7f60880d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.668+0000 7f608759e640 1 -- 172.21.15.131:0/2871271727 >> v1:172.21.15.150:6789/0 conn(0x7f60880d1580 legacy=0x7f608806f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.668+0000 7f608759e640 1 -- 172.21.15.131:0/2871271727 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608806eb50 con 0x7f608806fa60 2024-05-17T04:09:13.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.668+0000 7f608759e640 1 --2- 172.21.15.131:0/2871271727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608806fa60 0x7f608815f730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f60880d08b0 tx=0x7f608002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afc1ff8313f7fcb server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:13.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.669+0000 7f6085d9b640 1 -- 172.21.15.131:0/2871271727 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6080036070 con 0x7f608806fa60 2024-05-17T04:09:13.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.669+0000 7f6085d9b640 1 -- 172.21.15.131:0/2871271727 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6080031600 con 0x7f608806fa60 2024-05-17T04:09:13.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.669+0000 7f6085d9b640 1 -- 172.21.15.131:0/2871271727 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60800319d0 con 0x7f608806fa60 2024-05-17T04:09:13.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.669+0000 7f608d1d4640 1 -- 172.21.15.131:0/2871271727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608806fa60 msgr2=0x7f608815f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.669+0000 7f608d1d4640 1 --2- 172.21.15.131:0/2871271727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608806fa60 0x7f608815f730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f60880d08b0 tx=0x7f608002a730 comp rx=0 tx=0).stop 2024-05-17T04:09:13.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.669+0000 7f608d1d4640 1 -- 172.21.15.131:0/2871271727 shutdown_connections 2024-05-17T04:09:13.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.669+0000 7f608d1d4640 1 --2- 172.21.15.131:0/2871271727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608806fa60 0x7f608815f730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.669+0000 7f608d1d4640 1 --2- 172.21.15.131:0/2871271727 >> v2:172.21.15.150:3300/0 conn(0x7f60880cd720 0x7f60880d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.669+0000 7f608d1d4640 1 -- 172.21.15.131:0/2871271727 >> 172.21.15.131:0/2871271727 conn(0x7f60880b4e40 msgr2=0x7f60880b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:13.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.669+0000 7f608d1d4640 1 -- 172.21.15.131:0/2871271727 shutdown_connections 2024-05-17T04:09:13.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.669+0000 7f608d1d4640 1 -- 172.21.15.131:0/2871271727 wait complete. 2024-05-17T04:09:13.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.671+0000 7f608d1d4640 1 Processor -- start 2024-05-17T04:09:13.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.672+0000 7f608d1d4640 1 -- start start 2024-05-17T04:09:13.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f608d1d4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608806fa60 0x7f60880b89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f608d1d4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60880cd720 0x7f60881f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f608d1d4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60880d1580 0x7f608814c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f608d1d4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f608806fff0 con 0x7f608806fa60 2024-05-17T04:09:13.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f608d1d4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f608806fe70 con 0x7f60880cd720 2024-05-17T04:09:13.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f608d1d4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f608815fc70 con 0x7f60880d1580 2024-05-17T04:09:13.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f6086d9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608806fa60 0x7f60880b89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f6086d9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608806fa60 0x7f60880b89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34142/0 (socket says 172.21.15.131:34142) 2024-05-17T04:09:13.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f6086d9d640 1 -- 172.21.15.131:0/2362419339 learned_addr learned my addr 172.21.15.131:0/2362419339 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:13.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f608659c640 1 --2- 172.21.15.131:0/2362419339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60880cd720 0x7f60881f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f608759e640 1 --2- 172.21.15.131:0/2362419339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60880d1580 0x7f608814c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f6086d9d640 1 -- 172.21.15.131:0/2362419339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60880d1580 msgr2=0x7f608814c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f6086d9d640 1 --2- 172.21.15.131:0/2362419339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60880d1580 0x7f608814c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f6086d9d640 1 -- 172.21.15.131:0/2362419339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60880cd720 msgr2=0x7f60881f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f6086d9d640 1 --2- 172.21.15.131:0/2362419339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60880cd720 0x7f60881f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f6086d9d640 1 -- 172.21.15.131:0/2362419339 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60880cc690 con 0x7f608806fa60 2024-05-17T04:09:13.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f6086d9d640 1 --2- 172.21.15.131:0/2362419339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608806fa60 0x7f60880b89d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f607800e870 tx=0x7f607800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:13.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.673+0000 7f606f7fe640 1 -- 172.21.15.131:0/2362419339 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078017070 con 0x7f608806fa60 2024-05-17T04:09:13.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.674+0000 7f606f7fe640 1 -- 172.21.15.131:0/2362419339 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607800c940 con 0x7f608806fa60 2024-05-17T04:09:13.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.674+0000 7f608d1d4640 1 -- 172.21.15.131:0/2362419339 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60880cc970 con 0x7f608806fa60 2024-05-17T04:09:13.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.674+0000 7f606f7fe640 1 -- 172.21.15.131:0/2362419339 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607800cd30 con 0x7f608806fa60 2024-05-17T04:09:13.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.674+0000 7f608d1d4640 1 -- 172.21.15.131:0/2362419339 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60880ccf30 con 0x7f608806fa60 2024-05-17T04:09:13.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.675+0000 7f606f7fe640 1 -- 172.21.15.131:0/2362419339 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f607801a070 con 0x7f608806fa60 2024-05-17T04:09:13.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.676+0000 7f606f7fe640 1 --2- 172.21.15.131:0/2362419339 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6074076300 0x7f6074078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.676+0000 7f606f7fe640 1 -- 172.21.15.131:0/2362419339 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6078097b60 con 0x7f608806fa60 2024-05-17T04:09:13.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.676+0000 7f608659c640 1 --2- 172.21.15.131:0/2362419339 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6074076300 0x7f6074078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.676+0000 7f608659c640 1 --2- 172.21.15.131:0/2362419339 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6074076300 0x7f6074078810 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6088150730 tx=0x7f607c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:13.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.677+0000 7f609416c740 1 Processor -- start 2024-05-17T04:09:13.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.677+0000 7f609416c740 1 -- start start 2024-05-17T04:09:13.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.678+0000 7f609416c740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a653270 0x55e99aa3afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.678+0000 7f609416c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a62a3b0 0x55e99aa3ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.678+0000 7f609416c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a632590 0x55e99a9f2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.678+0000 7f609416c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e99a968c80 con 0x55e99a62a3b0 2024-05-17T04:09:13.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.678+0000 7f609416c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e99a958820 con 0x55e99a632590 2024-05-17T04:09:13.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.678+0000 7f609416c740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55e99a95c860 con 0x55e99a653270 2024-05-17T04:09:13.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.678+0000 7f608659c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a62a3b0 0x55e99aa3ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.678+0000 7f608659c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a62a3b0 0x55e99aa3ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34148/0 (socket says 172.21.15.131:34148) 2024-05-17T04:09:13.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.678+0000 7f608659c640 1 -- 172.21.15.131:0/954193979 learned_addr learned my addr 172.21.15.131:0/954193979 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:13.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.679+0000 7f6086d9d640 1 --2- 172.21.15.131:0/954193979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a653270 0x55e99aa3afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.679+0000 7f608759e640 1 --2- 172.21.15.131:0/954193979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a632590 0x55e99a9f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.679+0000 7f608659c640 1 -- 172.21.15.131:0/954193979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a653270 msgr2=0x55e99aa3afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:13.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.679+0000 7f608659c640 1 --2- 172.21.15.131:0/954193979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a653270 0x55e99aa3afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.679+0000 7f608659c640 1 -- 172.21.15.131:0/954193979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a632590 msgr2=0x55e99a9f2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:13.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.679+0000 7f608659c640 1 --2- 172.21.15.131:0/954193979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a632590 0x55e99a9f2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.679+0000 7f608659c640 1 -- 172.21.15.131:0/954193979 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e99a922b40 con 0x55e99a62a3b0 2024-05-17T04:09:13.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.679+0000 7f608759e640 1 --2- 172.21.15.131:0/954193979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a632590 0x55e99a9f2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:13.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.679+0000 7f608659c640 1 --2- 172.21.15.131:0/954193979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a62a3b0 0x55e99aa3ce20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f607c00f9c0 tx=0x7f607c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d4e779f9ffa164 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:13.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.679+0000 7f606cff9640 1 -- 172.21.15.131:0/954193979 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c025070 con 0x55e99a62a3b0 2024-05-17T04:09:13.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.679+0000 7f606cff9640 1 -- 172.21.15.131:0/954193979 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607c01b050 con 0x55e99a62a3b0 2024-05-17T04:09:13.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.679+0000 7f606cff9640 1 -- 172.21.15.131:0/954193979 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c0013e0 con 0x55e99a62a3b0 2024-05-17T04:09:13.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.680+0000 7f609416c740 1 -- 172.21.15.131:0/954193979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a62a3b0 msgr2=0x55e99aa3ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.680+0000 7f609416c740 1 --2- 172.21.15.131:0/954193979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a62a3b0 0x55e99aa3ce20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f607c00f9c0 tx=0x7f607c012000 comp rx=0 tx=0).stop 2024-05-17T04:09:13.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.680+0000 7f609416c740 1 -- 172.21.15.131:0/954193979 shutdown_connections 2024-05-17T04:09:13.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.680+0000 7f609416c740 1 --2- 172.21.15.131:0/954193979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a62a3b0 0x55e99aa3ce20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.680+0000 7f609416c740 1 --2- 172.21.15.131:0/954193979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a632590 0x55e99a9f2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.680+0000 7f609416c740 1 --2- 172.21.15.131:0/954193979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a653270 0x55e99aa3afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.680+0000 7f609416c740 1 -- 172.21.15.131:0/954193979 >> 172.21.15.131:0/954193979 conn(0x55e99a6473c0 msgr2=0x55e99aa3c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:13.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.680+0000 7f609416c740 1 -- 172.21.15.131:0/954193979 shutdown_connections 2024-05-17T04:09:13.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.680+0000 7f609416c740 1 -- 172.21.15.131:0/954193979 wait complete. 2024-05-17T04:09:13.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.681+0000 7f609416c740 1 -- start start 2024-05-17T04:09:13.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.681+0000 7f609416c740 1 Processor -- start 2024-05-17T04:09:13.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.682+0000 7f609416c740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a62a3b0 0x55e99aa35df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.682+0000 7f609416c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a632590 0x55e99aa3c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.682+0000 7f609416c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a653270 0x55e99aa0fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.682+0000 7f609416c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e99a6cd620 con 0x55e99a653270 2024-05-17T04:09:13.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.682+0000 7f609416c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e99a9154c0 con 0x55e99a632590 2024-05-17T04:09:13.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.682+0000 7f609416c740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55e99aa124e0 con 0x55e99a62a3b0 2024-05-17T04:09:13.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.682+0000 7f609416c740 10 client.0 _ll_register_callbacks cb 0x55e99a952900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-17T04:09:13.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.682+0000 7f608759e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a653270 0x55e99aa0fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.682+0000 7f608759e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a653270 0x55e99aa0fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34164/0 (socket says 172.21.15.131:34164) 2024-05-17T04:09:13.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.682+0000 7f608759e640 1 -- 172.21.15.131:0/822062224 learned_addr learned my addr 172.21.15.131:0/822062224 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:13.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.682+0000 7f608659c640 1 --2- 172.21.15.131:0/822062224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a632590 0x55e99aa3c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.682+0000 7f6086d9d640 1 --2- 172.21.15.131:0/822062224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a62a3b0 0x55e99aa35df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.683+0000 7f608759e640 1 -- 172.21.15.131:0/822062224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a62a3b0 msgr2=0x55e99aa35df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:13.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.683+0000 7f608759e640 1 --2- 172.21.15.131:0/822062224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a62a3b0 0x55e99aa35df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.683+0000 7f608759e640 1 -- 172.21.15.131:0/822062224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a632590 msgr2=0x55e99aa3c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:13.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.683+0000 7f608759e640 1 --2- 172.21.15.131:0/822062224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a632590 0x55e99aa3c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.683+0000 7f608759e640 1 -- 172.21.15.131:0/822062224 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e99a920b80 con 0x55e99a653270 2024-05-17T04:09:13.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.683+0000 7f608759e640 1 --2- 172.21.15.131:0/822062224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a653270 0x55e99aa0fcb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6080034040 tx=0x7f6080004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fc865461bed4a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:13.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.683+0000 7f6065ffb640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-05-17T04:09:13.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.683+0000 7f6065ffb640 1 -- 172.21.15.131:0/822062224 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6080043070 con 0x55e99a653270 2024-05-17T04:09:13.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.683+0000 7f6065ffb640 1 -- 172.21.15.131:0/822062224 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f60800319d0 con 0x55e99a653270 2024-05-17T04:09:13.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.683+0000 7f609416c740 1 -- 172.21.15.131:0/822062224 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f607c01b050 con 0x55e99a653270 2024-05-17T04:09:13.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.683+0000 7f6065ffb640 1 -- 172.21.15.131:0/822062224 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f608004e050 con 0x55e99a653270 2024-05-17T04:09:13.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.683+0000 7f609416c740 10 client.4395 fetch_fsmap learned FSMap version 6 2024-05-17T04:09:13.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.683+0000 7f609416c740 1 -- 172.21.15.131:0/822062224 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55e99a6be850 con 0x55e99a653270 2024-05-17T04:09:13.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.683+0000 7f6065ffb640 1 -- 172.21.15.131:0/822062224 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607c01b050 con 0x55e99a653270 2024-05-17T04:09:13.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.683+0000 7f6065ffb640 1 -- 172.21.15.131:0/822062224 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f6080051020 con 0x55e99a653270 2024-05-17T04:09:13.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.684+0000 7f609416c740 10 client.4395 fetch_fsmap finished waiting for FSMap version 6 2024-05-17T04:09:13.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.684+0000 7f609416c740 10 client.4395 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-17T04:09:13.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.684+0000 7f609416c740 20 client.4395 populate_metadata read hostname 'smithi131' 2024-05-17T04:09:13.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.684+0000 7f609416c740 1 --2- 172.21.15.131:0/822062224 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55e99a611e40 0x55e99aa12990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.684+0000 7f609416c740 4 client.4395 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-17T04:09:13.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.684+0000 7f609416c740 1 -- 172.21.15.131:0/822062224 --> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e99a8fa780 con 0x55e99a611e40 2024-05-17T04:09:13.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.684+0000 7f6086d9d640 1 --2- 172.21.15.131:0/822062224 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55e99a611e40 0x55e99aa12990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.684+0000 7f6065ffb640 10 client.4395 ms_handle_connect on v2:172.21.15.150:6833/2635477484 2024-05-17T04:09:13.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.684+0000 7f6086d9d640 1 --2- 172.21.15.131:0/822062224 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55e99a611e40 0x55e99aa12990 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9bda5f43cc4fc5 server_cookie=22ad521ab71df207 in_seq=0 out_seq=0 2024-05-17T04:09:13.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.685+0000 7f6065ffb640 1 -- 172.21.15.131:0/822062224 <== mds.0 v2:172.21.15.150:6833/2635477484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e99a8fa780 con 0x55e99a611e40 2024-05-17T04:09:13.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.685+0000 7f6065ffb640 10 client.4395 handle_command_reply: tid=0 2024-05-17T04:09:13.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.685+0000 7f609416c740 1 client.4395 shutdown 2024-05-17T04:09:13.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.685+0000 7f609416c740 1 -- 172.21.15.131:0/822062224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a653270 msgr2=0x55e99aa0fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.685+0000 7f609416c740 1 --2- 172.21.15.131:0/822062224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a653270 0x55e99aa0fcb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6080034040 tx=0x7f6080004ab0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.685+0000 7f609416c740 1 -- 172.21.15.131:0/822062224 shutdown_connections 2024-05-17T04:09:13.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.685+0000 7f609416c740 1 --2- 172.21.15.131:0/822062224 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55e99a611e40 0x55e99aa12990 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.685+0000 7f609416c740 1 --2- 172.21.15.131:0/822062224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a653270 0x55e99aa0fcb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.685+0000 7f609416c740 1 --2- 172.21.15.131:0/822062224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a632590 0x55e99aa3c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.685+0000 7f6065ffb640 0 client.4395 ms_handle_reset on v2:172.21.15.150:6833/2635477484 2024-05-17T04:09:13.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.685+0000 7f609416c740 1 --2- 172.21.15.131:0/822062224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a62a3b0 0x55e99aa35df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.685+0000 7f609416c740 1 -- 172.21.15.131:0/822062224 >> 172.21.15.131:0/822062224 conn(0x55e99a6473c0 msgr2=0x55e99a9f1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:13.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.685+0000 7f609416c740 1 -- 172.21.15.131:0/822062224 shutdown_connections 2024-05-17T04:09:13.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.685+0000 7f609416c740 1 -- 172.21.15.131:0/822062224 wait complete. 2024-05-17T04:09:13.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.685+0000 7f609416c740 20 client.4395 trim_cache size 0 max 16384 2024-05-17T04:09:13.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.704+0000 7f609416c740 1 Processor -- start 2024-05-17T04:09:13.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.704+0000 7f609416c740 1 -- start start 2024-05-17T04:09:13.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.705+0000 7f609416c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a62a3b0 0x55e99a9f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.705+0000 7f609416c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a632590 0x55e99aa23a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.705+0000 7f609416c740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a653270 0x55e99aa3bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.705+0000 7f609416c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6088202760 con 0x55e99a632590 2024-05-17T04:09:13.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.705+0000 7f609416c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6088201ac0 con 0x55e99a62a3b0 2024-05-17T04:09:13.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.705+0000 7f609416c740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6088202110 con 0x55e99a653270 2024-05-17T04:09:13.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.705+0000 7f608659c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a632590 0x55e99aa23a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.705+0000 7f608659c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a632590 0x55e99aa23a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34168/0 (socket says 172.21.15.131:34168) 2024-05-17T04:09:13.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.705+0000 7f608659c640 1 -- 172.21.15.131:0/3441648590 learned_addr learned my addr 172.21.15.131:0/3441648590 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:13.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f608759e640 1 --2- 172.21.15.131:0/3441648590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a653270 0x55e99aa3bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f608659c640 1 -- 172.21.15.131:0/3441648590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a653270 msgr2=0x55e99aa3bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:13.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f608659c640 1 --2- 172.21.15.131:0/3441648590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a653270 0x55e99aa3bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f6086d9d640 1 --2- 172.21.15.131:0/3441648590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a62a3b0 0x55e99a9f7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f608659c640 1 -- 172.21.15.131:0/3441648590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a62a3b0 msgr2=0x55e99a9f7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:13.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f608659c640 1 --2- 172.21.15.131:0/3441648590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a62a3b0 0x55e99a9f7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f608659c640 1 -- 172.21.15.131:0/3441648590 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e99a7356b0 con 0x55e99a632590 2024-05-17T04:09:13.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f608659c640 1 --2- 172.21.15.131:0/3441648590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a632590 0x55e99aa23a20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f607c014820 tx=0x7f607c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c2314d115e6c65 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:13.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f6067fff640 1 -- 172.21.15.131:0/3441648590 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c025040 con 0x55e99a632590 2024-05-17T04:09:13.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f6067fff640 1 -- 172.21.15.131:0/3441648590 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607c014d60 con 0x55e99a632590 2024-05-17T04:09:13.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f6067fff640 1 -- 172.21.15.131:0/3441648590 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c02c660 con 0x55e99a632590 2024-05-17T04:09:13.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f609416c740 1 -- 172.21.15.131:0/3441648590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a632590 msgr2=0x55e99aa23a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f609416c740 1 --2- 172.21.15.131:0/3441648590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a632590 0x55e99aa23a20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f607c014820 tx=0x7f607c015000 comp rx=0 tx=0).stop 2024-05-17T04:09:13.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f609416c740 1 -- 172.21.15.131:0/3441648590 shutdown_connections 2024-05-17T04:09:13.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f609416c740 1 --2- 172.21.15.131:0/3441648590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a632590 0x55e99aa23a20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f609416c740 1 --2- 172.21.15.131:0/3441648590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a653270 0x55e99aa3bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.706+0000 7f609416c740 1 --2- 172.21.15.131:0/3441648590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a62a3b0 0x55e99a9f7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.707+0000 7f609416c740 1 -- 172.21.15.131:0/3441648590 >> 172.21.15.131:0/3441648590 conn(0x55e99a6473c0 msgr2=0x55e99aa219e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:13.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.707+0000 7f609416c740 1 -- 172.21.15.131:0/3441648590 shutdown_connections 2024-05-17T04:09:13.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.707+0000 7f609416c740 1 -- 172.21.15.131:0/3441648590 wait complete. 2024-05-17T04:09:13.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.707+0000 7f609416c740 1 -- start start 2024-05-17T04:09:13.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.707+0000 7f609416c740 1 Processor -- start 2024-05-17T04:09:13.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f609416c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a62a3b0 0x55e99aa3ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f609416c740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a632590 0x55e99aa3a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f609416c740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a653270 0x55e99aa3bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f609416c740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e99aa3c8b0 con 0x55e99a632590 2024-05-17T04:09:13.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f609416c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e99aa12270 con 0x55e99a62a3b0 2024-05-17T04:09:13.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f609416c740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55e99aa4af20 con 0x55e99a653270 2024-05-17T04:09:13.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f609416c740 10 client.0 _ll_register_callbacks cb 0x7f608002af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-17T04:09:13.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f608659c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a632590 0x55e99aa3a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f608659c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a632590 0x55e99aa3a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34176/0 (socket says 172.21.15.131:34176) 2024-05-17T04:09:13.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f608659c640 1 -- 172.21.15.131:0/3091935271 learned_addr learned my addr 172.21.15.131:0/3091935271 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:13.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f6086d9d640 1 --2- 172.21.15.131:0/3091935271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a62a3b0 0x55e99aa3ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f608759e640 1 --2- 172.21.15.131:0/3091935271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a653270 0x55e99aa3bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f608659c640 1 -- 172.21.15.131:0/3091935271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a653270 msgr2=0x55e99aa3bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:13.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f608659c640 1 --2- 172.21.15.131:0/3091935271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a653270 0x55e99aa3bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f608659c640 1 -- 172.21.15.131:0/3091935271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a62a3b0 msgr2=0x55e99aa3ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:13.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f608659c640 1 --2- 172.21.15.131:0/3091935271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a62a3b0 0x55e99aa3ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f608659c640 1 -- 172.21.15.131:0/3091935271 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e99a9f2f50 con 0x55e99a632590 2024-05-17T04:09:13.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f608659c640 1 --2- 172.21.15.131:0/3091935271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a632590 0x55e99aa3a550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f607c007ec0 tx=0x7f607c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e90701d5f585e server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:13.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f6065ffb640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-05-17T04:09:13.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f6065ffb640 1 -- 172.21.15.131:0/3091935271 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c025070 con 0x55e99a632590 2024-05-17T04:09:13.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f6065ffb640 1 -- 172.21.15.131:0/3091935271 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f607c02c870 con 0x55e99a632590 2024-05-17T04:09:13.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f609416c740 1 -- 172.21.15.131:0/3091935271 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f607c014d60 con 0x55e99a632590 2024-05-17T04:09:13.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f6065ffb640 1 -- 172.21.15.131:0/3091935271 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f607c041050 con 0x55e99a632590 2024-05-17T04:09:13.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.709+0000 7f609416c740 10 client.4401 fetch_fsmap learned FSMap version 6 2024-05-17T04:09:13.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.710+0000 7f609416c740 1 -- 172.21.15.131:0/3091935271 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55e99aa3fa20 con 0x55e99a632590 2024-05-17T04:09:13.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.710+0000 7f6065ffb640 1 -- 172.21.15.131:0/3091935271 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607c014d60 con 0x55e99a632590 2024-05-17T04:09:13.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.710+0000 7f6065ffb640 1 -- 172.21.15.131:0/3091935271 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f607c044020 con 0x55e99a632590 2024-05-17T04:09:13.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.710+0000 7f609416c740 10 client.4401 fetch_fsmap finished waiting for FSMap version 6 2024-05-17T04:09:13.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.710+0000 7f609416c740 10 client.4401 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-17T04:09:13.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.710+0000 7f609416c740 20 client.4401 populate_metadata read hostname 'smithi131' 2024-05-17T04:09:13.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.710+0000 7f609416c740 1 --2- 172.21.15.131:0/3091935271 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55e99aa3c2b0 0x55e99aa4dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.710+0000 7f609416c740 4 client.4401 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-17T04:09:13.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.710+0000 7f609416c740 1 -- 172.21.15.131:0/3091935271 --> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] -- command(tid 0: {"prefix": "status"}) -- 0x55e99a96abd0 con 0x55e99aa3c2b0 2024-05-17T04:09:13.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.710+0000 7f6086d9d640 1 --2- 172.21.15.131:0/3091935271 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55e99aa3c2b0 0x55e99aa4dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.710+0000 7f6065ffb640 10 client.4401 ms_handle_connect on v2:172.21.15.150:6833/2635477484 2024-05-17T04:09:13.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.710+0000 7f6086d9d640 1 --2- 172.21.15.131:0/3091935271 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55e99aa3c2b0 0x55e99aa4dc00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=583fe50b34ae78f2 server_cookie=33f15382017e6228 in_seq=0 out_seq=0 2024-05-17T04:09:13.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.710+0000 7f6065ffb640 1 -- 172.21.15.131:0/3091935271 <== mds.0 v2:172.21.15.150:6833/2635477484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55e99a96abd0 con 0x55e99aa3c2b0 2024-05-17T04:09:13.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f6065ffb640 10 client.4401 handle_command_reply: tid=0 2024-05-17T04:09:13.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f609416c740 1 client.4401 shutdown 2024-05-17T04:09:13.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f609416c740 1 -- 172.21.15.131:0/3091935271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a632590 msgr2=0x55e99aa3a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f609416c740 1 --2- 172.21.15.131:0/3091935271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a632590 0x55e99aa3a550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f607c007ec0 tx=0x7f607c000ed0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f609416c740 1 -- 172.21.15.131:0/3091935271 shutdown_connections 2024-05-17T04:09:13.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f609416c740 1 --2- 172.21.15.131:0/3091935271 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55e99aa3c2b0 0x55e99aa4dc00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f609416c740 1 --2- 172.21.15.131:0/3091935271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99a632590 0x55e99aa3a550 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f6065ffb640 0 client.4401 ms_handle_reset on v2:172.21.15.150:6833/2635477484 2024-05-17T04:09:13.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f609416c740 1 --2- 172.21.15.131:0/3091935271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e99a653270 0x55e99aa3bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f609416c740 1 --2- 172.21.15.131:0/3091935271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e99a62a3b0 0x55e99aa3ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f609416c740 1 -- 172.21.15.131:0/3091935271 >> 172.21.15.131:0/3091935271 conn(0x55e99a6473c0 msgr2=0x55e99aa23a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:13.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f609416c740 1 -- 172.21.15.131:0/3091935271 shutdown_connections 2024-05-17T04:09:13.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f609416c740 1 -- 172.21.15.131:0/3091935271 wait complete. 2024-05-17T04:09:13.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f609416c740 20 client.4401 trim_cache size 0 max 16384 2024-05-17T04:09:13.720 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T04:09:13.720 INFO:teuthology.orchestra.run.smithi131.stdout: "cluster_fsid": "c9e29f2b-51db-4d2a-bace-3a87edcda397", 2024-05-17T04:09:13.720 INFO:teuthology.orchestra.run.smithi131.stdout: "whoami": 0, 2024-05-17T04:09:13.720 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4309, 2024-05-17T04:09:13.720 INFO:teuthology.orchestra.run.smithi131.stdout: "want_state": "up:active", 2024-05-17T04:09:13.721 INFO:teuthology.orchestra.run.smithi131.stdout: "state": "up:active", 2024-05-17T04:09:13.721 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs", 2024-05-17T04:09:13.721 INFO:teuthology.orchestra.run.smithi131.stdout: "rank_uptime": 7.3337676979999999, 2024-05-17T04:09:13.721 INFO:teuthology.orchestra.run.smithi131.stdout: "mdsmap_epoch": 6, 2024-05-17T04:09:13.721 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch": 24, 2024-05-17T04:09:13.721 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch_barrier": 24, 2024-05-17T04:09:13.721 INFO:teuthology.orchestra.run.smithi131.stdout: "uptime": 13.350333856000001 2024-05-17T04:09:13.721 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T04:09:13.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f608d1d4640 1 -- 172.21.15.131:0/2362419339 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6074076300 msgr2=0x7f6074078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f608d1d4640 1 --2- 172.21.15.131:0/2362419339 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6074076300 0x7f6074078810 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6088150730 tx=0x7f607c009040 comp rx=0 tx=0).stop 2024-05-17T04:09:13.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f608d1d4640 1 -- 172.21.15.131:0/2362419339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608806fa60 msgr2=0x7f60880b89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f608d1d4640 1 --2- 172.21.15.131:0/2362419339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608806fa60 0x7f60880b89d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f607800e870 tx=0x7f607800ed30 comp rx=0 tx=0).stop 2024-05-17T04:09:13.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f608d1d4640 1 -- 172.21.15.131:0/2362419339 shutdown_connections 2024-05-17T04:09:13.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f608d1d4640 1 --2- 172.21.15.131:0/2362419339 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6074076300 0x7f6074078810 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f608d1d4640 1 --2- 172.21.15.131:0/2362419339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60880d1580 0x7f608814c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f608d1d4640 1 --2- 172.21.15.131:0/2362419339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60880cd720 0x7f60881f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f608d1d4640 1 --2- 172.21.15.131:0/2362419339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608806fa60 0x7f60880b89d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f608d1d4640 1 -- 172.21.15.131:0/2362419339 >> 172.21.15.131:0/2362419339 conn(0x7f60880b4e40 msgr2=0x7f60880cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:13.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f608d1d4640 1 -- 172.21.15.131:0/2362419339 shutdown_connections 2024-05-17T04:09:13.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.711+0000 7f608d1d4640 1 -- 172.21.15.131:0/2362419339 wait complete. 2024-05-17T04:09:13.724 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-17T04:09:13.724 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-17T04:09:13.724 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-17T04:09:13.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.833+0000 7f3871af7640 1 Processor -- start 2024-05-17T04:09:13.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.833+0000 7f3871af7640 1 -- start start 2024-05-17T04:09:13.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.834+0000 7f3871af7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c15aeb0 0x7f386c06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.834+0000 7f3871af7640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f386c0d2a60 0x7f386c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.834+0000 7f3871af7640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f386c15da10 con 0x7f386c06e180 2024-05-17T04:09:13.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.834+0000 7f3871af7640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f386c15e5c0 con 0x7f386c0d2a60 2024-05-17T04:09:13.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.834+0000 7f3871af7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f386c15dc90 con 0x7f386c15aeb0 2024-05-17T04:09:13.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.835+0000 7f386b7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c15aeb0 0x7f386c06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.835+0000 7f386bfff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f386c0d2a60 0x7f386c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.835+0000 7f386b7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c15aeb0 0x7f386c06dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:52714/0 (socket says 172.21.15.131:52714) 2024-05-17T04:09:13.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.835+0000 7f386b7fe640 1 -- 172.21.15.131:0/2519850223 learned_addr learned my addr 172.21.15.131:0/2519850223 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:13.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.835+0000 7f386b7fe640 1 -- 172.21.15.131:0/2519850223 >> v2:172.21.15.150:3300/0 conn(0x7f386c0d2a60 msgr2=0x7f386c06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:13.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.835+0000 7f386b7fe640 1 --2- 172.21.15.131:0/2519850223 >> v2:172.21.15.150:3300/0 conn(0x7f386c0d2a60 0x7f386c06fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.835+0000 7f386b7fe640 1 -- 172.21.15.131:0/2519850223 >> v1:172.21.15.150:6789/0 conn(0x7f386c06e180 legacy=0x7f386c0d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.835+0000 7f386b7fe640 1 -- 172.21.15.131:0/2519850223 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c15df70 con 0x7f386c15aeb0 2024-05-17T04:09:13.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.836+0000 7f386b7fe640 1 --2- 172.21.15.131:0/2519850223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c15aeb0 0x7f386c06dc40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3864009e80 tx=0x7f386402a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c1b95e55dae7562 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:13.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.836+0000 7f386a7fc640 1 -- 172.21.15.131:0/2519850223 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864036070 con 0x7f386c15aeb0 2024-05-17T04:09:13.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.836+0000 7f386a7fc640 1 -- 172.21.15.131:0/2519850223 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3864031600 con 0x7f386c15aeb0 2024-05-17T04:09:13.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.836+0000 7f386a7fc640 1 -- 172.21.15.131:0/2519850223 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38640319d0 con 0x7f386c15aeb0 2024-05-17T04:09:13.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.837+0000 7f3871af7640 1 -- 172.21.15.131:0/2519850223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c15aeb0 msgr2=0x7f386c06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.837+0000 7f3871af7640 1 --2- 172.21.15.131:0/2519850223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c15aeb0 0x7f386c06dc40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3864009e80 tx=0x7f386402a750 comp rx=0 tx=0).stop 2024-05-17T04:09:13.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.837+0000 7f3871af7640 1 -- 172.21.15.131:0/2519850223 shutdown_connections 2024-05-17T04:09:13.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.837+0000 7f3871af7640 1 --2- 172.21.15.131:0/2519850223 >> v2:172.21.15.150:3300/0 conn(0x7f386c0d2a60 0x7f386c06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.837+0000 7f3871af7640 1 --2- 172.21.15.131:0/2519850223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c15aeb0 0x7f386c06dc40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.837+0000 7f3871af7640 1 -- 172.21.15.131:0/2519850223 >> 172.21.15.131:0/2519850223 conn(0x7f386c0b4250 msgr2=0x7f386c0b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:13.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.837+0000 7f3871af7640 1 -- 172.21.15.131:0/2519850223 shutdown_connections 2024-05-17T04:09:13.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.837+0000 7f3871af7640 1 -- 172.21.15.131:0/2519850223 wait complete. 2024-05-17T04:09:13.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.838+0000 7f3871af7640 1 Processor -- start 2024-05-17T04:09:13.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.839+0000 7f3871af7640 1 -- start start 2024-05-17T04:09:13.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f3871af7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f386c15aeb0 0x7f386c0b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f3871af7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f386c151f60 0x7f386c0b3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f3871af7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0b3670 0x7f386c156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f3871af7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f386c0b59c0 con 0x7f386c151f60 2024-05-17T04:09:13.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f3871af7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f386c15b2c0 con 0x7f386c15aeb0 2024-05-17T04:09:13.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f3871af7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f386c0b5b40 con 0x7f386c0b3670 2024-05-17T04:09:13.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f386affd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f386c151f60 0x7f386c0b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f386affd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f386c151f60 0x7f386c0b3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34192/0 (socket says 172.21.15.131:34192) 2024-05-17T04:09:13.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f386affd640 1 -- 172.21.15.131:0/213694797 learned_addr learned my addr 172.21.15.131:0/213694797 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:13.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f386b7fe640 1 --2- 172.21.15.131:0/213694797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f386c15aeb0 0x7f386c0b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f386bfff640 1 --2- 172.21.15.131:0/213694797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0b3670 0x7f386c156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f386affd640 1 -- 172.21.15.131:0/213694797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0b3670 msgr2=0x7f386c156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f386affd640 1 --2- 172.21.15.131:0/213694797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0b3670 0x7f386c156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f386affd640 1 -- 172.21.15.131:0/213694797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f386c15aeb0 msgr2=0x7f386c0b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:13.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f386affd640 1 --2- 172.21.15.131:0/213694797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f386c15aeb0 0x7f386c0b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:13.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.840+0000 7f386affd640 1 -- 172.21.15.131:0/213694797 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c0b02a0 con 0x7f386c151f60 2024-05-17T04:09:13.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.841+0000 7f386affd640 1 --2- 172.21.15.131:0/213694797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f386c151f60 0x7f386c0b3130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f385400c370 tx=0x7f385400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:13.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.841+0000 7f3863fff640 1 -- 172.21.15.131:0/213694797 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854017070 con 0x7f386c151f60 2024-05-17T04:09:13.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.841+0000 7f3863fff640 1 -- 172.21.15.131:0/213694797 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38540052d0 con 0x7f386c151f60 2024-05-17T04:09:13.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.841+0000 7f3871af7640 1 -- 172.21.15.131:0/213694797 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386c0b0580 con 0x7f386c151f60 2024-05-17T04:09:13.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.841+0000 7f3863fff640 1 -- 172.21.15.131:0/213694797 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854003830 con 0x7f386c151f60 2024-05-17T04:09:13.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.841+0000 7f3871af7640 1 -- 172.21.15.131:0/213694797 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386c0b0b40 con 0x7f386c151f60 2024-05-17T04:09:13.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.842+0000 7f3871af7640 1 -- 172.21.15.131:0/213694797 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f386c161de0 con 0x7f386c151f60 2024-05-17T04:09:13.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.842+0000 7f3863fff640 1 -- 172.21.15.131:0/213694797 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f385401a070 con 0x7f386c151f60 2024-05-17T04:09:13.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.843+0000 7f3863fff640 1 --2- 172.21.15.131:0/213694797 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f384c076300 0x7f384c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:13.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.843+0000 7f386b7fe640 1 --2- 172.21.15.131:0/213694797 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f384c076300 0x7f384c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:13.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.843+0000 7f3863fff640 1 -- 172.21.15.131:0/213694797 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3854096b90 con 0x7f386c151f60 2024-05-17T04:09:13.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.843+0000 7f386b7fe640 1 --2- 172.21.15.131:0/213694797 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f384c076300 0x7f384c078810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3864033000 tx=0x7f3864009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:13.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:13.847+0000 7f3863fff640 1 -- 172.21.15.131:0/213694797 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f386c15da10 con 0x7f386c151f60 2024-05-17T04:09:14.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14.068+0000 7f3871af7640 1 -- 172.21.15.131:0/213694797 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f386c0b16e0 con 0x7f386c151f60 2024-05-17T04:09:14.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14.068+0000 7f3863fff640 1 -- 172.21.15.131:0/213694797 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f38540681a0 con 0x7f386c151f60 2024-05-17T04:09:14.069 INFO:teuthology.orchestra.run.smithi131.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-17T04:09:14.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14.070+0000 7f3871af7640 1 -- 172.21.15.131:0/213694797 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f384c076300 msgr2=0x7f384c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:14.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14.070+0000 7f3871af7640 1 --2- 172.21.15.131:0/213694797 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f384c076300 0x7f384c078810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3864033000 tx=0x7f3864009000 comp rx=0 tx=0).stop 2024-05-17T04:09:14.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14.070+0000 7f3871af7640 1 -- 172.21.15.131:0/213694797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f386c151f60 msgr2=0x7f386c0b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:14.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14.070+0000 7f3871af7640 1 --2- 172.21.15.131:0/213694797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f386c151f60 0x7f386c0b3130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f385400c370 tx=0x7f385400c830 comp rx=0 tx=0).stop 2024-05-17T04:09:14.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14.070+0000 7f3871af7640 1 -- 172.21.15.131:0/213694797 shutdown_connections 2024-05-17T04:09:14.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14.070+0000 7f3871af7640 1 --2- 172.21.15.131:0/213694797 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f384c076300 0x7f384c078810 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:14.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14.070+0000 7f3871af7640 1 --2- 172.21.15.131:0/213694797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f386c151f60 0x7f386c0b3130 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:14.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14.070+0000 7f3871af7640 1 --2- 172.21.15.131:0/213694797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0b3670 0x7f386c156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:14.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14.070+0000 7f3871af7640 1 --2- 172.21.15.131:0/213694797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f386c15aeb0 0x7f386c0b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:14.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14.070+0000 7f3871af7640 1 -- 172.21.15.131:0/213694797 >> 172.21.15.131:0/213694797 conn(0x7f386c0b4250 msgr2=0x7f386c0b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:14.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14.070+0000 7f3871af7640 1 -- 172.21.15.131:0/213694797 shutdown_connections 2024-05-17T04:09:14.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14.070+0000 7f3871af7640 1 -- 172.21.15.131:0/213694797 wait complete. 2024-05-17T04:09:14.083 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-17T04:09:14.083 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-17T04:09:14.083 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-05-17T04:09:14.083 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-17T04:09:14.083 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-17T04:09:14.083 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-17T04:09:14.083 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-17T04:09:14.083 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-17T04:09:14.083 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-17T04:09:14.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:14.084 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-05-17T04:09:14.099 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-17T04:09:14.099 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-17T04:09:14.099 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-05-17T04:09:14.099 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:14.099 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-05-17T04:09:14.100 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:14.100 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:09:14.100 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:14.100 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-05-17T04:09:14.100 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:09:14.100 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:14.100 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-05-17T04:09:14.100 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:09:14.100 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:14.100 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-17T04:09:14.100 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:14.100 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-17T04:09:14.100 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42679sec preferred_lft 42679sec 2024-05-17T04:09:14.101 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2024-05-17T04:09:14.101 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:14.101 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-17T04:09:14.101 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:14.101 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-05-17T04:09:14.102 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add name ceph-brx type bridge 2024-05-17T04:09:14.102 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr flush dev ceph-brx 2024-05-17T04:09:14.102 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set ceph-brx up 2024-05-17T04:09:14.102 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-17T04:09:14.102 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-05-17T04:09:14.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:14.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:14.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:14.320 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-17T04:09:14.345 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-05-17T04:09:14.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:14.346 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-05-17T04:09:14.410 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-05-17T04:09:14.410 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-17T04:09:14.410 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-17T04:09:14.411 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-17T04:09:14.411 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-17T04:09:14.411 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:14.411 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-05-17T04:09:14.411 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-17T04:09:14.411 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-17T04:09:14.411 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-17T04:09:14.411 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-05-17T04:09:14.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:14.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:14.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:14.707 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-05-17T04:09:14.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:14.723 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2024-05-17T04:09:14.779 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:14.779 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-05-17T04:09:14.779 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-17T04:09:14.779 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-17T04:09:14.779 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-05-17T04:09:14.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:14.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:14.896 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-17T04:09:14.896 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:14.896 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-05-17T04:09:14.897 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-17T04:09:14.897 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-17T04:09:14.897 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-17T04:09:14.897 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-17T04:09:14.897 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-17T04:09:14.897 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-05-17T04:09:14.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:15.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:15.021 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:15.021 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-05-17T04:09:15.021 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2024-05-17T04:09:15.021 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.0 master ceph-brx 2024-05-17T04:09:15.022 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-05-17T04:09:15.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:15.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:15.099 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-17T04:09:15.099 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-17T04:09:15.099 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-17T04:09:15.115 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-17T04:09:15.115 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-17T04:09:15.115 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-17T04:09:15.170 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-05-17T04:09:15.236 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-05-17T04:09:15.292 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-05-17T04:09:15.292 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-05-17T04:09:15.292 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-05-17T04:09:15.292 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-05-17T04:09:15.292 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-05-17T04:09:15.292 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-05-17T04:09:15.292 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-05-17T04:09:15.293 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-05-17T04:09:15.293 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-05-17T04:09:15.293 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-05-17T04:09:15.293 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-05-17T04:09:15.293 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/selinux 2024-05-17T04:09:15.293 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-05-17T04:09:15.293 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-05-17T04:09:15.293 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-05-17T04:09:15.293 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-05-17T04:09:15.293 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-05-17T04:09:15.293 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-05-17T04:09:15.293 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-05-17T04:09:15.293 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysctl.service 2024-05-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/nfs/rpc_pipefs 2024-05-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-05-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-05-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-0 2024-05-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-1 2024-05-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-2 2024-05-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-3 2024-05-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-05-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-17T04:09:15.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:15.295 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-05-17T04:09:15.347 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-17T04:09:15.348 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-17T04:09:15.392 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-05-17T04:09:15.416 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-05-17T04:09:15.472 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-05-17T04:09:15.472 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-05-17T04:09:15.472 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-05-17T04:09:15.472 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-05-17T04:09:15.472 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-05-17T04:09:15.472 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-05-17T04:09:15.472 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-05-17T04:09:15.472 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-05-17T04:09:15.472 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-05-17T04:09:15.473 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-05-17T04:09:15.473 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-05-17T04:09:15.473 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/selinux 2024-05-17T04:09:15.473 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-05-17T04:09:15.473 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-05-17T04:09:15.473 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-05-17T04:09:15.473 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-05-17T04:09:15.473 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-05-17T04:09:15.473 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-05-17T04:09:15.473 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-05-17T04:09:15.473 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysctl.service 2024-05-17T04:09:15.473 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-17T04:09:15.473 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-17T04:09:15.474 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/nfs/rpc_pipefs 2024-05-17T04:09:15.474 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-05-17T04:09:15.474 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-05-17T04:09:15.474 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-0 2024-05-17T04:09:15.474 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-1 2024-05-17T04:09:15.474 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-2 2024-05-17T04:09:15.474 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-3 2024-05-17T04:09:15.474 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-05-17T04:09:15.474 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-17T04:09:15.474 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-17T04:09:15.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:15.475 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-05-17T04:09:15.511 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi131.stderr:2024-05-17T04:09:15.509+0000 7f0136529480 -1 init, newargv = 0x560800f3f680 newargc=15 2024-05-17T04:09:15.511 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi131.stderr:ceph-fuse[43926]: starting ceph client 2024-05-17T04:09:15.518 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi131.stderr:ceph-fuse[43926]: starting fuse 2024-05-17T04:09:15.526 INFO:teuthology.orchestra.run.smithi131.stdout:41 2024-05-17T04:09:15.527 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-05-17T04:09:15.527 DEBUG:teuthology.orchestra.run.smithi131:> sudo stdin-killer -- python3 -c ' 2024-05-17T04:09:15.527 DEBUG:teuthology.orchestra.run.smithi131:> import glob 2024-05-17T04:09:15.527 DEBUG:teuthology.orchestra.run.smithi131:> import re 2024-05-17T04:09:15.527 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-05-17T04:09:15.527 DEBUG:teuthology.orchestra.run.smithi131:> import subprocess 2024-05-17T04:09:15.527 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:09:15.527 DEBUG:teuthology.orchestra.run.smithi131:> def _find_admin_socket(client_name): 2024-05-17T04:09:15.527 DEBUG:teuthology.orchestra.run.smithi131:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-17T04:09:15.527 DEBUG:teuthology.orchestra.run.smithi131:> files = glob.glob(asok_path) 2024-05-17T04:09:15.527 DEBUG:teuthology.orchestra.run.smithi131:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-17T04:09:15.527 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> # Given a non-glob path, it better be there 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> if "*" not in asok_path: 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> assert(len(files) == 1) 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> return files[0] 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> for f in files: 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> contents = proc_f.read() 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> if mountpoint in contents: 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> return f 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> print(_find_admin_socket("client.admin")) 2024-05-17T04:09:15.528 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-05-17T04:09:15.645 INFO:teuthology.orchestra.run.smithi131.stdout:/var/run/ceph/ceph-client.admin.43926.asok 2024-05-17T04:09:15.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:15.655 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43926.asok 2024-05-17T04:09:15.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:15.655 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43926.asok status 2024-05-17T04:09:15.799 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T04:09:15.800 INFO:teuthology.orchestra.run.smithi131.stdout: "metadata": { 2024-05-17T04:09:15.800 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_sha1": "931809a9e5d295bd61984693cac44fe131ded4bc", 2024-05-17T04:09:15.800 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_version": "ceph version 19.0.0-3794-g931809a9 (931809a9e5d295bd61984693cac44fe131ded4bc) squid (dev)", 2024-05-17T04:09:15.800 INFO:teuthology.orchestra.run.smithi131.stdout: "entity_id": "admin", 2024-05-17T04:09:15.800 INFO:teuthology.orchestra.run.smithi131.stdout: "hostname": "smithi131", 2024-05-17T04:09:15.800 INFO:teuthology.orchestra.run.smithi131.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-17T04:09:15.800 INFO:teuthology.orchestra.run.smithi131.stdout: "pid": "43926", 2024-05-17T04:09:15.800 INFO:teuthology.orchestra.run.smithi131.stdout: "root": "/" 2024-05-17T04:09:15.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:15.800 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_count": 0, 2024-05-17T04:09:15.800 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_pinned_count": 0, 2024-05-17T04:09:15.801 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4413, 2024-05-17T04:09:15.801 INFO:teuthology.orchestra.run.smithi131.stdout: "inst": { 2024-05-17T04:09:15.801 INFO:teuthology.orchestra.run.smithi131.stdout: "name": { 2024-05-17T04:09:15.801 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "client", 2024-05-17T04:09:15.801 INFO:teuthology.orchestra.run.smithi131.stdout: "num": 4413 2024-05-17T04:09:15.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:15.801 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-05-17T04:09:15.801 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-05-17T04:09:15.801 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.1:0", 2024-05-17T04:09:15.801 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 2917267330 2024-05-17T04:09:15.801 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:15.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:15.801 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-05-17T04:09:15.802 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-05-17T04:09:15.802 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.1:0", 2024-05-17T04:09:15.802 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 2917267330 2024-05-17T04:09:15.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:15.802 INFO:teuthology.orchestra.run.smithi131.stdout: "inst_str": "client.4413 192.168.0.1:0/2917267330", 2024-05-17T04:09:15.802 INFO:teuthology.orchestra.run.smithi131.stdout: "addr_str": "192.168.0.1:0/2917267330", 2024-05-17T04:09:15.802 INFO:teuthology.orchestra.run.smithi131.stdout: "inode_count": 1, 2024-05-17T04:09:15.802 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_epoch": 6, 2024-05-17T04:09:15.802 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch": 24, 2024-05-17T04:09:15.802 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch_barrier": 0, 2024-05-17T04:09:15.802 INFO:teuthology.orchestra.run.smithi131.stdout: "blocklisted": false, 2024-05-17T04:09:15.802 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs" 2024-05-17T04:09:15.802 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T04:09:15.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:15.808 DEBUG:teuthology.orchestra.run.smithi131:> stat --file-system '--printf=%T 2024-05-17T04:09:15.808 DEBUG:teuthology.orchestra.run.smithi131:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-17T04:09:15.824 INFO:teuthology.orchestra.run.smithi131.stdout:fuseblk 2024-05-17T04:09:15.825 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-17T04:09:15.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:15.825 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-17T04:09:15.891 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-17T04:09:15.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-17T04:09:15.995 INFO:teuthology.orchestra.run.smithi131.stdout:# file: . 2024-05-17T04:09:15.995 INFO:teuthology.orchestra.run.smithi131.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-17T04:09:15.996 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:15.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:16.001 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:09:16.002 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T04:09:16.017 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-17T04:09:16.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.167+0000 7f6a90c2a640 1 Processor -- start 2024-05-17T04:09:16.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.167+0000 7f6a90c2a640 1 -- start start 2024-05-17T04:09:16.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a90c2a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a8c0b5e00 0x7f6a8c0ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:16.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a90c2a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a8c0b3f00 con 0x7f6a8c0b4970 2024-05-17T04:09:16.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a90c2a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a8c0d0820 con 0x7f6a8c0d02f0 2024-05-17T04:09:16.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a90c2a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6a8c0b4170 con 0x7f6a8c0b5e00 2024-05-17T04:09:16.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a89d9b640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f6a8c0b4970 0x7f6a8c0b56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34532/0 (socket says 172.21.15.131:34532) 2024-05-17T04:09:16.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a89d9b640 1 -- 172.21.15.131:0/87643457 learned_addr learned my addr 172.21.15.131:0/87643457 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:16.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a8ad9d640 1 --2- 172.21.15.131:0/87643457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a8c0b5e00 0x7f6a8c0ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:16.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a8959a640 1 -- 172.21.15.131:0/87643457 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3892612775 0 0) 0x7f6a8c0b3f00 con 0x7f6a8c0b4970 2024-05-17T04:09:16.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a8959a640 1 -- 172.21.15.131:0/87643457 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a74003520 con 0x7f6a8c0b4970 2024-05-17T04:09:16.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a8959a640 1 -- 172.21.15.131:0/87643457 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2216616873 0 0) 0x7f6a74003520 con 0x7f6a8c0b4970 2024-05-17T04:09:16.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a8959a640 1 -- 172.21.15.131:0/87643457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a8c0b5e00 msgr2=0x7f6a8c0ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:16.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a8959a640 1 --2- 172.21.15.131:0/87643457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a8c0b5e00 0x7f6a8c0ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a8959a640 1 -- 172.21.15.131:0/87643457 >> v1:172.21.15.150:6789/0 conn(0x7f6a8c0d02f0 legacy=0x7f6a8c15d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:16.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a8959a640 1 -- 172.21.15.131:0/87643457 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a8c0b4450 con 0x7f6a8c0b4970 2024-05-17T04:09:16.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a8959a640 1 -- 172.21.15.131:0/87643457 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7f6a800016f0 con 0x7f6a8c0b4970 2024-05-17T04:09:16.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.169+0000 7f6a8959a640 1 -- 172.21.15.131:0/87643457 >> v1:172.21.15.131:6789/0 conn(0x7f6a8c0b4970 legacy=0x7f6a8c0b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:16.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.170+0000 7f6a8959a640 1 --2- 172.21.15.131:0/87643457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a74003a30 0x7f6a74003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:16.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.170+0000 7f6a8959a640 1 --2- 172.21.15.131:0/87643457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a74004800 0x7f6a74004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:16.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.170+0000 7f6a8959a640 1 --2- 172.21.15.131:0/87643457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a74005350 0x7f6a7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:16.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.170+0000 7f6a8959a640 1 -- 172.21.15.131:0/87643457 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8c0b4170 con 0x7f6a74003a30 2024-05-17T04:09:16.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.170+0000 7f6a8959a640 1 -- 172.21.15.131:0/87643457 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7400c090 con 0x7f6a74004800 2024-05-17T04:09:16.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.170+0000 7f6a8959a640 1 -- 172.21.15.131:0/87643457 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6a7400e450 con 0x7f6a74005350 2024-05-17T04:09:16.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.170+0000 7f6a8a59c640 1 --2- 172.21.15.131:0/87643457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a74003a30 0x7f6a74003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:16.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.170+0000 7f6a89d9b640 1 --2- 172.21.15.131:0/87643457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a74004800 0x7f6a74004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:16.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.170+0000 7f6a8ad9d640 1 --2- 172.21.15.131:0/87643457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a74005350 0x7f6a7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:16.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.170+0000 7f6a8a59c640 1 -- 172.21.15.131:0/87643457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a74005350 msgr2=0x7f6a7400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:16.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.170+0000 7f6a8a59c640 1 --2- 172.21.15.131:0/87643457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a74005350 0x7f6a7400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.170+0000 7f6a8a59c640 1 -- 172.21.15.131:0/87643457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a74004800 msgr2=0x7f6a74004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:16.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.170+0000 7f6a8a59c640 1 --2- 172.21.15.131:0/87643457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a74004800 0x7f6a74004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.170+0000 7f6a8a59c640 1 -- 172.21.15.131:0/87643457 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a74003520 con 0x7f6a74003a30 2024-05-17T04:09:16.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.171+0000 7f6a8a59c640 1 --2- 172.21.15.131:0/87643457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a74003a30 0x7f6a74003ea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c001790 tx=0x7f6a74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b97dfab315dd538 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:16.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.171+0000 7f6a8959a640 1 -- 172.21.15.131:0/87643457 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c0013b0 con 0x7f6a74003a30 2024-05-17T04:09:16.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.171+0000 7f6a8959a640 1 -- 172.21.15.131:0/87643457 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a7c0052d0 con 0x7f6a74003a30 2024-05-17T04:09:16.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.171+0000 7f6a8959a640 1 -- 172.21.15.131:0/87643457 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c02aae0 con 0x7f6a74003a30 2024-05-17T04:09:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.171+0000 7f6a90c2a640 1 -- 172.21.15.131:0/87643457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a74003a30 msgr2=0x7f6a74003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.171+0000 7f6a90c2a640 1 --2- 172.21.15.131:0/87643457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a74003a30 0x7f6a74003ea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c001790 tx=0x7f6a74005830 comp rx=0 tx=0).stop 2024-05-17T04:09:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.171+0000 7f6a8ad9d640 1 -- 172.21.15.131:0/87643457 reap_dead start 2024-05-17T04:09:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.172+0000 7f6a90c2a640 1 -- 172.21.15.131:0/87643457 shutdown_connections 2024-05-17T04:09:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.172+0000 7f6a90c2a640 1 -- 172.21.15.131:0/87643457 >> 172.21.15.131:0/87643457 conn(0x7f6a8c0b36d0 msgr2=0x7f6a8c0d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.172+0000 7f6a90c2a640 1 -- 172.21.15.131:0/87643457 shutdown_connections 2024-05-17T04:09:16.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.172+0000 7f6a90c2a640 1 -- 172.21.15.131:0/87643457 wait complete. 2024-05-17T04:09:16.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.174+0000 7f6a90c2a640 1 Processor -- start 2024-05-17T04:09:16.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.174+0000 7f6a90c2a640 1 -- start start 2024-05-17T04:09:16.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a90c2a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a74003a30 0x7f6a8c1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:16.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a90c2a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a8c0b0140 0x7f6a8c157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:16.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a90c2a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a8c154ce0 0x7f6a8c158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:16.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a90c2a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8c0cd940 con 0x7f6a74003a30 2024-05-17T04:09:16.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a90c2a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8c0cd7c0 con 0x7f6a8c154ce0 2024-05-17T04:09:16.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a90c2a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6a8c0b5e00 con 0x7f6a8c0b0140 2024-05-17T04:09:16.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a8a59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a74003a30 0x7f6a8c1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:16.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a8a59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a74003a30 0x7f6a8c1545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43244/0 (socket says 172.21.15.131:43244) 2024-05-17T04:09:16.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a8a59c640 1 -- 172.21.15.131:0/2166206095 learned_addr learned my addr 172.21.15.131:0/2166206095 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:16.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a89d9b640 1 --2- 172.21.15.131:0/2166206095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a8c0b0140 0x7f6a8c157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:16.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a8ad9d640 1 --2- 172.21.15.131:0/2166206095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a8c154ce0 0x7f6a8c158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:16.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a8a59c640 1 -- 172.21.15.131:0/2166206095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a8c0b0140 msgr2=0x7f6a8c157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:16.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a8a59c640 1 --2- 172.21.15.131:0/2166206095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a8c0b0140 0x7f6a8c157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a8a59c640 1 -- 172.21.15.131:0/2166206095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a8c154ce0 msgr2=0x7f6a8c158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:16.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a8a59c640 1 --2- 172.21.15.131:0/2166206095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a8c154ce0 0x7f6a8c158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.175+0000 7f6a8a59c640 1 -- 172.21.15.131:0/2166206095 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a8c15c9c0 con 0x7f6a74003a30 2024-05-17T04:09:16.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.176+0000 7f6a8a59c640 1 --2- 172.21.15.131:0/2166206095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a74003a30 0x7f6a8c1545c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c001790 tx=0x7f6a7c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:16.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.176+0000 7f6a7affd640 1 -- 172.21.15.131:0/2166206095 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c037040 con 0x7f6a74003a30 2024-05-17T04:09:16.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.176+0000 7f6a7affd640 1 -- 172.21.15.131:0/2166206095 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a7c005480 con 0x7f6a74003a30 2024-05-17T04:09:16.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.176+0000 7f6a90c2a640 1 -- 172.21.15.131:0/2166206095 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a8c15cca0 con 0x7f6a74003a30 2024-05-17T04:09:16.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.176+0000 7f6a7affd640 1 -- 172.21.15.131:0/2166206095 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c0013b0 con 0x7f6a74003a30 2024-05-17T04:09:16.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.176+0000 7f6a90c2a640 1 -- 172.21.15.131:0/2166206095 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a8c15d260 con 0x7f6a74003a30 2024-05-17T04:09:16.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.177+0000 7f6a90c2a640 1 -- 172.21.15.131:0/2166206095 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a8c0b2980 con 0x7f6a74003a30 2024-05-17T04:09:16.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.178+0000 7f6a7affd640 1 -- 172.21.15.131:0/2166206095 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6a7c044020 con 0x7f6a74003a30 2024-05-17T04:09:16.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.178+0000 7f6a7affd640 1 --2- 172.21.15.131:0/2166206095 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6a6c076300 0x7f6a6c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:16.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.178+0000 7f6a7affd640 1 -- 172.21.15.131:0/2166206095 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6a7c0b72a0 con 0x7f6a74003a30 2024-05-17T04:09:16.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.178+0000 7f6a89d9b640 1 --2- 172.21.15.131:0/2166206095 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6a6c076300 0x7f6a6c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:16.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.179+0000 7f6a89d9b640 1 --2- 172.21.15.131:0/2166206095 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6a6c076300 0x7f6a6c078810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c15fbd0 tx=0x7f6a800078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:16.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.183+0000 7f6a7affd640 1 -- 172.21.15.131:0/2166206095 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6a8c0b2980 con 0x7f6a74003a30 2024-05-17T04:09:16.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.376+0000 7f6a90c2a640 1 -- 172.21.15.131:0/2166206095 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6a8c0cde10 con 0x7f6a74003a30 2024-05-17T04:09:16.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.376+0000 7f6a7affd640 1 -- 172.21.15.131:0/2166206095 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f6a8c0cde10 con 0x7f6a74003a30 2024-05-17T04:09:16.378 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-05-17T04:09:16.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.378+0000 7f6a90c2a640 1 -- 172.21.15.131:0/2166206095 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6a6c076300 msgr2=0x7f6a6c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:16.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.378+0000 7f6a90c2a640 1 --2- 172.21.15.131:0/2166206095 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6a6c076300 0x7f6a6c078810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c15fbd0 tx=0x7f6a800078f0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.378+0000 7f6a90c2a640 1 -- 172.21.15.131:0/2166206095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a74003a30 msgr2=0x7f6a8c1545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:16.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.378+0000 7f6a90c2a640 1 --2- 172.21.15.131:0/2166206095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a74003a30 0x7f6a8c1545c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c001790 tx=0x7f6a7c001120 comp rx=0 tx=0).stop 2024-05-17T04:09:16.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.378+0000 7f6a90c2a640 1 -- 172.21.15.131:0/2166206095 shutdown_connections 2024-05-17T04:09:16.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.378+0000 7f6a90c2a640 1 --2- 172.21.15.131:0/2166206095 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6a6c076300 0x7f6a6c078810 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.378+0000 7f6a90c2a640 1 --2- 172.21.15.131:0/2166206095 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a8c154ce0 0x7f6a8c158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.378+0000 7f6a90c2a640 1 --2- 172.21.15.131:0/2166206095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a8c0b0140 0x7f6a8c157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.378+0000 7f6a90c2a640 1 --2- 172.21.15.131:0/2166206095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a74003a30 0x7f6a8c1545c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.379+0000 7f6a90c2a640 1 -- 172.21.15.131:0/2166206095 >> 172.21.15.131:0/2166206095 conn(0x7f6a8c0b36d0 msgr2=0x7f6a8c0b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:16.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.379+0000 7f6a90c2a640 1 -- 172.21.15.131:0/2166206095 shutdown_connections 2024-05-17T04:09:16.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.379+0000 7f6a90c2a640 1 -- 172.21.15.131:0/2166206095 wait complete. 2024-05-17T04:09:16.391 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:09:16.391 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T04:09:16.407 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-17T04:09:16.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.557+0000 7fd8e4247640 1 Processor -- start 2024-05-17T04:09:16.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.557+0000 7fd8e4247640 1 -- start start 2024-05-17T04:09:16.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.558+0000 7fd8e4247640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd8dc160d00 0x7fd8dc0d3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:16.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.558+0000 7fd8e4247640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8dc161110 0x7fd8dc0d42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:16.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.558+0000 7fd8e4247640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8dc06c6f0 0x7fd8dc06cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:16.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.558+0000 7fd8e4247640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd8dc0d1730 con 0x7fd8dc160d00 2024-05-17T04:09:16.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.558+0000 7fd8e4247640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd8dc06d040 con 0x7fd8dc161110 2024-05-17T04:09:16.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.558+0000 7fd8e4247640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd8dc06d2d0 con 0x7fd8dc06c6f0 2024-05-17T04:09:16.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.558+0000 7fd8e1fe3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd8dc160d00 0x7fd8dc0d3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:16.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.558+0000 7fd8e1fe3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd8dc160d00 0x7fd8dc0d3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43246/0 (socket says 172.21.15.131:43246) 2024-05-17T04:09:16.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.559+0000 7fd8e1fe3640 1 -- 172.21.15.131:0/1131024253 learned_addr learned my addr 172.21.15.131:0/1131024253 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:16.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.559+0000 7fd8e27e4640 1 --2- 172.21.15.131:0/1131024253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8dc06c6f0 0x7fd8dc06cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:16.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.559+0000 7fd8e17e2640 1 --2- 172.21.15.131:0/1131024253 >> v2:172.21.15.150:3300/0 conn(0x7fd8dc161110 0x7fd8dc0d42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:16.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.559+0000 7fd8e1fe3640 1 -- 172.21.15.131:0/1131024253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8dc06c6f0 msgr2=0x7fd8dc06cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:16.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.559+0000 7fd8e1fe3640 1 --2- 172.21.15.131:0/1131024253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8dc06c6f0 0x7fd8dc06cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.559+0000 7fd8e1fe3640 1 -- 172.21.15.131:0/1131024253 >> v2:172.21.15.150:3300/0 conn(0x7fd8dc161110 msgr2=0x7fd8dc0d42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:16.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.559+0000 7fd8e1fe3640 1 --2- 172.21.15.131:0/1131024253 >> v2:172.21.15.150:3300/0 conn(0x7fd8dc161110 0x7fd8dc0d42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.559+0000 7fd8e1fe3640 1 -- 172.21.15.131:0/1131024253 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8dc06d5b0 con 0x7fd8dc160d00 2024-05-17T04:09:16.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.559+0000 7fd8e17e2640 1 --2- 172.21.15.131:0/1131024253 >> v2:172.21.15.150:3300/0 conn(0x7fd8dc161110 0x7fd8dc0d42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:16.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.559+0000 7fd8e27e4640 1 --2- 172.21.15.131:0/1131024253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8dc06c6f0 0x7fd8dc06cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:16.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.559+0000 7fd8e1fe3640 1 --2- 172.21.15.131:0/1131024253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc160d00 0x7fd8dc0d3d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0b82a0 tx=0x7fd8d802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4db7113326a74f server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:16.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.560+0000 7fd8e0fe1640 1 -- 172.21.15.131:0/1131024253 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8037070 con 0x7fd8dc160d00 2024-05-17T04:09:16.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.560+0000 7fd8e0fe1640 1 -- 172.21.15.131:0/1131024253 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d8032440 con 0x7fd8dc160d00 2024-05-17T04:09:16.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.560+0000 7fd8e0fe1640 1 -- 172.21.15.131:0/1131024253 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8032810 con 0x7fd8dc160d00 2024-05-17T04:09:16.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.560+0000 7fd8e4247640 1 -- 172.21.15.131:0/1131024253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc160d00 msgr2=0x7fd8dc0d3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:16.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.560+0000 7fd8e4247640 1 --2- 172.21.15.131:0/1131024253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc160d00 0x7fd8dc0d3d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0b82a0 tx=0x7fd8d802a140 comp rx=0 tx=0).stop 2024-05-17T04:09:16.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.560+0000 7fd8e4247640 1 -- 172.21.15.131:0/1131024253 shutdown_connections 2024-05-17T04:09:16.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.560+0000 7fd8e4247640 1 --2- 172.21.15.131:0/1131024253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8dc06c6f0 0x7fd8dc06cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.560+0000 7fd8e4247640 1 --2- 172.21.15.131:0/1131024253 >> v2:172.21.15.150:3300/0 conn(0x7fd8dc161110 0x7fd8dc0d42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.560+0000 7fd8e4247640 1 --2- 172.21.15.131:0/1131024253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc160d00 0x7fd8dc0d3d80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.560+0000 7fd8e4247640 1 -- 172.21.15.131:0/1131024253 >> 172.21.15.131:0/1131024253 conn(0x7fd8dc0d57d0 msgr2=0x7fd8dc0d1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:16.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.561+0000 7fd8e4247640 1 -- 172.21.15.131:0/1131024253 shutdown_connections 2024-05-17T04:09:16.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.561+0000 7fd8e4247640 1 -- 172.21.15.131:0/1131024253 wait complete. 2024-05-17T04:09:16.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.562+0000 7fd8e4247640 1 Processor -- start 2024-05-17T04:09:16.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.562+0000 7fd8e4247640 1 -- start start 2024-05-17T04:09:16.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e4247640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8dc06c6f0 0x7fd8dc0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:16.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e4247640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8dc160d00 0x7fd8dc0d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:16.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e4247640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc161110 0x7fd8dc156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:16.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e4247640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc0cfe50 con 0x7fd8dc161110 2024-05-17T04:09:16.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e4247640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc0cfb70 con 0x7fd8dc160d00 2024-05-17T04:09:16.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e4247640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd8dc0d0370 con 0x7fd8dc06c6f0 2024-05-17T04:09:16.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e27e4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc161110 0x7fd8dc156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:16.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e27e4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc161110 0x7fd8dc156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43258/0 (socket says 172.21.15.131:43258) 2024-05-17T04:09:16.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e27e4640 1 -- 172.21.15.131:0/3360446505 learned_addr learned my addr 172.21.15.131:0/3360446505 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:16.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e17e2640 1 --2- 172.21.15.131:0/3360446505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8dc160d00 0x7fd8dc0d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:16.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e1fe3640 1 --2- 172.21.15.131:0/3360446505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8dc06c6f0 0x7fd8dc0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:16.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e27e4640 1 -- 172.21.15.131:0/3360446505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8dc06c6f0 msgr2=0x7fd8dc0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:16.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e27e4640 1 --2- 172.21.15.131:0/3360446505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8dc06c6f0 0x7fd8dc0ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e27e4640 1 -- 172.21.15.131:0/3360446505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8dc160d00 msgr2=0x7fd8dc0d3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:16.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e27e4640 1 --2- 172.21.15.131:0/3360446505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8dc160d00 0x7fd8dc0d3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e27e4640 1 -- 172.21.15.131:0/3360446505 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8dc0ccb80 con 0x7fd8dc161110 2024-05-17T04:09:16.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e17e2640 1 --2- 172.21.15.131:0/3360446505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8dc160d00 0x7fd8dc0d3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:16.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e27e4640 1 --2- 172.21.15.131:0/3360446505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc161110 0x7fd8dc156670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400ccd0 tx=0x7fd8d400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:16.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8d27fc640 1 -- 172.21.15.131:0/3360446505 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d400f680 con 0x7fd8dc161110 2024-05-17T04:09:16.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8d27fc640 1 -- 172.21.15.131:0/3360446505 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d400f840 con 0x7fd8dc161110 2024-05-17T04:09:16.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e4247640 1 -- 172.21.15.131:0/3360446505 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8dc0cce60 con 0x7fd8dc161110 2024-05-17T04:09:16.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8d27fc640 1 -- 172.21.15.131:0/3360446505 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d400fc30 con 0x7fd8dc161110 2024-05-17T04:09:16.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.564+0000 7fd8e4247640 1 -- 172.21.15.131:0/3360446505 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8dc0cd420 con 0x7fd8dc161110 2024-05-17T04:09:16.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.566+0000 7fd8e4247640 1 -- 172.21.15.131:0/3360446505 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8dc0cc8f0 con 0x7fd8dc161110 2024-05-17T04:09:16.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.566+0000 7fd8d27fc640 1 -- 172.21.15.131:0/3360446505 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd8d40213f0 con 0x7fd8dc161110 2024-05-17T04:09:16.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.567+0000 7fd8d27fc640 1 --2- 172.21.15.131:0/3360446505 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd8c00762d0 0x7fd8c00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:16.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.567+0000 7fd8e1fe3640 1 --2- 172.21.15.131:0/3360446505 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd8c00762d0 0x7fd8c00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:16.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.567+0000 7fd8d27fc640 1 -- 172.21.15.131:0/3360446505 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd8d4098630 con 0x7fd8dc161110 2024-05-17T04:09:16.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.567+0000 7fd8e1fe3640 1 --2- 172.21.15.131:0/3360446505 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd8c00762d0 0x7fd8c00787e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8034000 tx=0x7fd8d802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:16.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.571+0000 7fd8d27fc640 1 -- 172.21.15.131:0/3360446505 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd8d4014030 con 0x7fd8dc161110 2024-05-17T04:09:16.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.763+0000 7fd8e4247640 1 -- 172.21.15.131:0/3360446505 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd8dc06cb00 con 0x7fd8dc161110 2024-05-17T04:09:16.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.763+0000 7fd8d27fc640 1 -- 172.21.15.131:0/3360446505 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fd8d4061bc0 con 0x7fd8dc161110 2024-05-17T04:09:16.764 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-05-17T04:09:16.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.766+0000 7fd8e4247640 1 -- 172.21.15.131:0/3360446505 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd8c00762d0 msgr2=0x7fd8c00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:16.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.766+0000 7fd8e4247640 1 --2- 172.21.15.131:0/3360446505 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd8c00762d0 0x7fd8c00787e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8034000 tx=0x7fd8d802e000 comp rx=0 tx=0).stop 2024-05-17T04:09:16.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.766+0000 7fd8e4247640 1 -- 172.21.15.131:0/3360446505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc161110 msgr2=0x7fd8dc156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:16.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.766+0000 7fd8e4247640 1 --2- 172.21.15.131:0/3360446505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc161110 0x7fd8dc156670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400ccd0 tx=0x7fd8d400a650 comp rx=0 tx=0).stop 2024-05-17T04:09:16.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.766+0000 7fd8e4247640 1 -- 172.21.15.131:0/3360446505 shutdown_connections 2024-05-17T04:09:16.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.766+0000 7fd8e4247640 1 --2- 172.21.15.131:0/3360446505 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd8c00762d0 0x7fd8c00787e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.766+0000 7fd8e4247640 1 --2- 172.21.15.131:0/3360446505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8dc161110 0x7fd8dc156670 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.766+0000 7fd8e4247640 1 --2- 172.21.15.131:0/3360446505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8dc160d00 0x7fd8dc0d3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.766+0000 7fd8e4247640 1 --2- 172.21.15.131:0/3360446505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8dc06c6f0 0x7fd8dc0ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:16.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.766+0000 7fd8e4247640 1 -- 172.21.15.131:0/3360446505 >> 172.21.15.131:0/3360446505 conn(0x7fd8dc0d57d0 msgr2=0x7fd8dc0b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:16.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.766+0000 7fd8e4247640 1 -- 172.21.15.131:0/3360446505 shutdown_connections 2024-05-17T04:09:16.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:16.766+0000 7fd8e4247640 1 -- 172.21.15.131:0/3360446505 wait complete. 2024-05-17T04:09:16.778 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi131.front.sepia.ceph.com... 2024-05-17T04:09:16.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:16.778 DEBUG:teuthology.orchestra.run.smithi131:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-17T04:09:16.801 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi131.stderr:ceph-fuse[43926]: fuse finished with error 0 and tester_r 0 2024-05-17T04:09:16.803 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T04:09:16.888 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-05-17T04:09:16.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:16.888 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-17T04:09:16.914 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:09:17.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.062+0000 7fe8a039a640 1 Processor -- start 2024-05-17T04:09:17.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.063+0000 7fe8a039a640 1 -- start start 2024-05-17T04:09:17.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.064+0000 7fe8a039a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe8980d3e10 0x7fe8980d4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.064+0000 7fe8a039a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe89806c6f0 0x7fe89806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.064+0000 7fe8a039a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8980b8f00 con 0x7fe89815f7e0 2024-05-17T04:09:17.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.064+0000 7fe8a039a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe8980d1830 con 0x7fe89806c6f0 2024-05-17T04:09:17.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.064+0000 7fe8a039a640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe8980cfe90 con 0x7fe8980d3e10 2024-05-17T04:09:17.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.064+0000 7fe89e937640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe89806c6f0 0x7fe89806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.064+0000 7fe89e937640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe89806c6f0 0x7fe89806cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43266/0 (socket says 172.21.15.131:43266) 2024-05-17T04:09:17.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.064+0000 7fe89e937640 1 -- 172.21.15.131:0/3547608195 learned_addr learned my addr 172.21.15.131:0/3547608195 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:17.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.064+0000 7fe89d935640 1 --2- 172.21.15.131:0/3547608195 >> v2:172.21.15.150:3300/0 conn(0x7fe8980d3e10 0x7fe8980d4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.065+0000 7fe89e937640 1 -- 172.21.15.131:0/3547608195 >> v2:172.21.15.150:3300/0 conn(0x7fe8980d3e10 msgr2=0x7fe8980d4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:17.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.065+0000 7fe89e937640 1 --2- 172.21.15.131:0/3547608195 >> v2:172.21.15.150:3300/0 conn(0x7fe8980d3e10 0x7fe8980d4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.065+0000 7fe89e937640 1 -- 172.21.15.131:0/3547608195 >> v1:172.21.15.150:6789/0 conn(0x7fe89815f7e0 legacy=0x7fe8980b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.065+0000 7fe89e937640 1 -- 172.21.15.131:0/3547608195 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8980d4760 con 0x7fe89806c6f0 2024-05-17T04:09:17.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.065+0000 7fe89d935640 1 --2- 172.21.15.131:0/3547608195 >> v2:172.21.15.150:3300/0 conn(0x7fe8980d3e10 0x7fe8980d4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:17.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.065+0000 7fe89e937640 1 --2- 172.21.15.131:0/3547608195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe89806c6f0 0x7fe89806cb00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe89806f210 tx=0x7fe89002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec01662cefb4543a server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:17.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.065+0000 7fe89d134640 1 -- 172.21.15.131:0/3547608195 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890036070 con 0x7fe89806c6f0 2024-05-17T04:09:17.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.066+0000 7fe89d134640 1 -- 172.21.15.131:0/3547608195 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe890031600 con 0x7fe89806c6f0 2024-05-17T04:09:17.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.066+0000 7fe89d134640 1 -- 172.21.15.131:0/3547608195 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900319d0 con 0x7fe89806c6f0 2024-05-17T04:09:17.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.066+0000 7fe8a039a640 1 -- 172.21.15.131:0/3547608195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe89806c6f0 msgr2=0x7fe89806cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.066+0000 7fe8a039a640 1 --2- 172.21.15.131:0/3547608195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe89806c6f0 0x7fe89806cb00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe89806f210 tx=0x7fe89002a730 comp rx=0 tx=0).stop 2024-05-17T04:09:17.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.066+0000 7fe8a039a640 1 -- 172.21.15.131:0/3547608195 shutdown_connections 2024-05-17T04:09:17.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.066+0000 7fe8a039a640 1 --2- 172.21.15.131:0/3547608195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe89806c6f0 0x7fe89806cb00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.066+0000 7fe8a039a640 1 --2- 172.21.15.131:0/3547608195 >> v2:172.21.15.150:3300/0 conn(0x7fe8980d3e10 0x7fe8980d4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.066+0000 7fe8a039a640 1 -- 172.21.15.131:0/3547608195 >> 172.21.15.131:0/3547608195 conn(0x7fe8980d5860 msgr2=0x7fe8980d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:17.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.066+0000 7fe8a039a640 1 -- 172.21.15.131:0/3547608195 shutdown_connections 2024-05-17T04:09:17.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.066+0000 7fe8a039a640 1 -- 172.21.15.131:0/3547608195 wait complete. 2024-05-17T04:09:17.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.068+0000 7fe8a039a640 1 Processor -- start 2024-05-17T04:09:17.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.068+0000 7fe8a039a640 1 -- start start 2024-05-17T04:09:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.069+0000 7fe8a039a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89806c6f0 0x7fe8980cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.069+0000 7fe8a039a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8980d3e10 0x7fe89815c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.069+0000 7fe8a039a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe89815f7e0 0x7fe8980ce920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.069+0000 7fe8a039a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe8980cf880 con 0x7fe89815f7e0 2024-05-17T04:09:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.069+0000 7fe8a039a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe89806d040 con 0x7fe8980d3e10 2024-05-17T04:09:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.069+0000 7fe8a039a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe89806d5b0 con 0x7fe89806c6f0 2024-05-17T04:09:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.069+0000 7fe89e937640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe89815f7e0 0x7fe8980ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe89e937640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe89815f7e0 0x7fe8980ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43270/0 (socket says 172.21.15.131:43270) 2024-05-17T04:09:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe89e937640 1 -- 172.21.15.131:0/4113457717 learned_addr learned my addr 172.21.15.131:0/4113457717 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe89e136640 1 --2- 172.21.15.131:0/4113457717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89806c6f0 0x7fe8980cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe89d935640 1 --2- 172.21.15.131:0/4113457717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8980d3e10 0x7fe89815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe89e937640 1 -- 172.21.15.131:0/4113457717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89806c6f0 msgr2=0x7fe8980cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe89e937640 1 --2- 172.21.15.131:0/4113457717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89806c6f0 0x7fe8980cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe89e937640 1 -- 172.21.15.131:0/4113457717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8980d3e10 msgr2=0x7fe89815c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe89e937640 1 --2- 172.21.15.131:0/4113457717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8980d3e10 0x7fe89815c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe89e937640 1 -- 172.21.15.131:0/4113457717 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8980cdd30 con 0x7fe89815f7e0 2024-05-17T04:09:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe89d935640 1 --2- 172.21.15.131:0/4113457717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8980d3e10 0x7fe89815c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe89e937640 1 --2- 172.21.15.131:0/4113457717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe89815f7e0 0x7fe8980ce920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe89002ad20 tx=0x7fe890004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe88effd640 1 -- 172.21.15.131:0/4113457717 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89003f020 con 0x7fe89815f7e0 2024-05-17T04:09:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe88effd640 1 -- 172.21.15.131:0/4113457717 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe890037040 con 0x7fe89815f7e0 2024-05-17T04:09:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe88effd640 1 -- 172.21.15.131:0/4113457717 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890036070 con 0x7fe89815f7e0 2024-05-17T04:09:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe8a039a640 1 -- 172.21.15.131:0/4113457717 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8980ccc90 con 0x7fe89815f7e0 2024-05-17T04:09:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.070+0000 7fe8a039a640 1 -- 172.21.15.131:0/4113457717 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8980cd250 con 0x7fe89815f7e0 2024-05-17T04:09:17.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.071+0000 7fe8a039a640 1 -- 172.21.15.131:0/4113457717 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe89806cb00 con 0x7fe89815f7e0 2024-05-17T04:09:17.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.072+0000 7fe88effd640 1 -- 172.21.15.131:0/4113457717 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe890042020 con 0x7fe89815f7e0 2024-05-17T04:09:17.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.072+0000 7fe88effd640 1 --2- 172.21.15.131:0/4113457717 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe87c0762d0 0x7fe87c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.072+0000 7fe89e136640 1 --2- 172.21.15.131:0/4113457717 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe87c0762d0 0x7fe87c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.072+0000 7fe88effd640 1 -- 172.21.15.131:0/4113457717 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe8900b7e00 con 0x7fe89815f7e0 2024-05-17T04:09:17.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.073+0000 7fe89e136640 1 --2- 172.21.15.131:0/4113457717 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe87c0762d0 0x7fe87c0787e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8940015e0 tx=0x7fe894009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:17.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.077+0000 7fe88effd640 1 -- 172.21.15.131:0/4113457717 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe890049030 con 0x7fe89815f7e0 2024-05-17T04:09:17.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.257+0000 7fe8a039a640 1 -- 172.21.15.131:0/4113457717 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe89806d8d0 con 0x7fe89815f7e0 2024-05-17T04:09:17.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.258+0000 7fe88effd640 1 -- 172.21.15.131:0/4113457717 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fe8980d4760 con 0x7fe89815f7e0 2024-05-17T04:09:17.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:17.259 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":24,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:09:10.777455+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:03.633460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:04.707669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-17T04:09:08.400498+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:09:17.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.260+0000 7fe8a039a640 1 -- 172.21.15.131:0/4113457717 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe87c0762d0 msgr2=0x7fe87c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.260+0000 7fe8a039a640 1 --2- 172.21.15.131:0/4113457717 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe87c0762d0 0x7fe87c0787e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8940015e0 tx=0x7fe894009040 comp rx=0 tx=0).stop 2024-05-17T04:09:17.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.260+0000 7fe8a039a640 1 -- 172.21.15.131:0/4113457717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe89815f7e0 msgr2=0x7fe8980ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.260+0000 7fe8a039a640 1 --2- 172.21.15.131:0/4113457717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe89815f7e0 0x7fe8980ce920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe89002ad20 tx=0x7fe890004a40 comp rx=0 tx=0).stop 2024-05-17T04:09:17.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.260+0000 7fe8a039a640 1 -- 172.21.15.131:0/4113457717 shutdown_connections 2024-05-17T04:09:17.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.260+0000 7fe8a039a640 1 --2- 172.21.15.131:0/4113457717 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe87c0762d0 0x7fe87c0787e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.260+0000 7fe8a039a640 1 --2- 172.21.15.131:0/4113457717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe89815f7e0 0x7fe8980ce920 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.260+0000 7fe8a039a640 1 --2- 172.21.15.131:0/4113457717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8980d3e10 0x7fe89815c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.260+0000 7fe8a039a640 1 --2- 172.21.15.131:0/4113457717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89806c6f0 0x7fe8980cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.260+0000 7fe8a039a640 1 -- 172.21.15.131:0/4113457717 >> 172.21.15.131:0/4113457717 conn(0x7fe8980d5860 msgr2=0x7fe89815e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:17.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.260+0000 7fe8a039a640 1 -- 172.21.15.131:0/4113457717 shutdown_connections 2024-05-17T04:09:17.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.260+0000 7fe8a039a640 1 -- 172.21.15.131:0/4113457717 wait complete. 2024-05-17T04:09:17.272 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:09:17.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.383+0000 7f325c3d2640 1 Processor -- start 2024-05-17T04:09:17.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.383+0000 7f325c3d2640 1 -- start start 2024-05-17T04:09:17.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325c3d2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f325415f7e0 0x7f32540b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325c3d2640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f325406c6f0 0x7f325406cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325c3d2640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f325406d040 con 0x7f32540d3e10 2024-05-17T04:09:17.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325c3d2640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f32540d1830 con 0x7f325406c6f0 2024-05-17T04:09:17.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325c3d2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f32540cfe90 con 0x7f325415f7e0 2024-05-17T04:09:17.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325996d640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f32540d3e10 0x7f32540d4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34536/0 (socket says 172.21.15.131:34536) 2024-05-17T04:09:17.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325996d640 1 -- 172.21.15.131:0/3448681880 learned_addr learned my addr 172.21.15.131:0/3448681880 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:17.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325a16e640 1 --2- 172.21.15.131:0/3448681880 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f325415f7e0 0x7f32540b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325a96f640 1 --2- 172.21.15.131:0/3448681880 >> v2:172.21.15.150:3300/0 conn(0x7f325406c6f0 0x7f325406cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325916c640 1 -- 172.21.15.131:0/3448681880 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3997650997 0 0) 0x7f325406d040 con 0x7f32540d3e10 2024-05-17T04:09:17.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325916c640 1 -- 172.21.15.131:0/3448681880 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3240003520 con 0x7f32540d3e10 2024-05-17T04:09:17.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325a16e640 1 -- 172.21.15.131:0/3448681880 >> v2:172.21.15.150:3300/0 conn(0x7f325406c6f0 msgr2=0x7f325406cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:17.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325a16e640 1 --2- 172.21.15.131:0/3448681880 >> v2:172.21.15.150:3300/0 conn(0x7f325406c6f0 0x7f325406cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325a16e640 1 -- 172.21.15.131:0/3448681880 >> v1:172.21.15.131:6789/0 conn(0x7f32540d3e10 legacy=0x7f32540d4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325a16e640 1 -- 172.21.15.131:0/3448681880 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32540cf880 con 0x7f325415f7e0 2024-05-17T04:09:17.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.385+0000 7f325a96f640 1 --2- 172.21.15.131:0/3448681880 >> v2:172.21.15.150:3300/0 conn(0x7f325406c6f0 0x7f325406cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:17.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.386+0000 7f325a16e640 1 --2- 172.21.15.131:0/3448681880 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f325415f7e0 0x7f32540b87f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f32500097a0 tx=0x7f325002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dba03fd27cfe9c1e server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:17.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.386+0000 7f325916c640 1 -- 172.21.15.131:0/3448681880 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3250037070 con 0x7f325415f7e0 2024-05-17T04:09:17.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.386+0000 7f325916c640 1 -- 172.21.15.131:0/3448681880 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3250032440 con 0x7f325415f7e0 2024-05-17T04:09:17.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.386+0000 7f325916c640 1 -- 172.21.15.131:0/3448681880 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32500327f0 con 0x7f325415f7e0 2024-05-17T04:09:17.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.387+0000 7f325c3d2640 1 -- 172.21.15.131:0/3448681880 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f325415f7e0 msgr2=0x7f32540b87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.387+0000 7f325c3d2640 1 --2- 172.21.15.131:0/3448681880 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f325415f7e0 0x7f32540b87f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f32500097a0 tx=0x7f325002a180 comp rx=0 tx=0).stop 2024-05-17T04:09:17.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.387+0000 7f325c3d2640 1 -- 172.21.15.131:0/3448681880 shutdown_connections 2024-05-17T04:09:17.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.387+0000 7f325c3d2640 1 --2- 172.21.15.131:0/3448681880 >> v2:172.21.15.150:3300/0 conn(0x7f325406c6f0 0x7f325406cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.387+0000 7f325c3d2640 1 --2- 172.21.15.131:0/3448681880 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f325415f7e0 0x7f32540b87f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.387+0000 7f325c3d2640 1 -- 172.21.15.131:0/3448681880 >> 172.21.15.131:0/3448681880 conn(0x7f32540d5860 msgr2=0x7f32540d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:17.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.387+0000 7f325c3d2640 1 -- 172.21.15.131:0/3448681880 shutdown_connections 2024-05-17T04:09:17.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.387+0000 7f325c3d2640 1 -- 172.21.15.131:0/3448681880 wait complete. 2024-05-17T04:09:17.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.389+0000 7f325c3d2640 1 Processor -- start 2024-05-17T04:09:17.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.389+0000 7f325c3d2640 1 -- start start 2024-05-17T04:09:17.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325c3d2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f325406c6f0 0x7f32541f9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325c3d2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32540d3e10 0x7f32540ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325c3d2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f325415f7e0 0x7f32540ce760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325c3d2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f32540cfb20 con 0x7f325406c6f0 2024-05-17T04:09:17.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325c3d2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f325406d5b0 con 0x7f325415f7e0 2024-05-17T04:09:17.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325c3d2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f32540b8d30 con 0x7f32540d3e10 2024-05-17T04:09:17.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325a16e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f325406c6f0 0x7f32541f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325a16e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f325406c6f0 0x7f32541f9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43274/0 (socket says 172.21.15.131:43274) 2024-05-17T04:09:17.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325a16e640 1 -- 172.21.15.131:0/1613819114 learned_addr learned my addr 172.21.15.131:0/1613819114 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:17.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325a96f640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f325415f7e0 0x7f32540ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325996d640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32540d3e10 0x7f32540ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325a16e640 1 -- 172.21.15.131:0/1613819114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32540d3e10 msgr2=0x7f32540ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325a16e640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32540d3e10 0x7f32540ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325a16e640 1 -- 172.21.15.131:0/1613819114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f325415f7e0 msgr2=0x7f32540ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325a16e640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f325415f7e0 0x7f32540ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325a16e640 1 -- 172.21.15.131:0/1613819114 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32540cf5b0 con 0x7f325406c6f0 2024-05-17T04:09:17.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325a96f640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f325415f7e0 0x7f32540ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:17.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.390+0000 7f325996d640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32540d3e10 0x7f32540ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:17.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.391+0000 7f325a16e640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f325406c6f0 0x7f32541f9750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f32500097a0 tx=0x7f32500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:17.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.391+0000 7f324affd640 1 -- 172.21.15.131:0/1613819114 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3250037050 con 0x7f325406c6f0 2024-05-17T04:09:17.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.391+0000 7f324affd640 1 -- 172.21.15.131:0/1613819114 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3250038040 con 0x7f325406c6f0 2024-05-17T04:09:17.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.391+0000 7f325c3d2640 1 -- 172.21.15.131:0/1613819114 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32541625d0 con 0x7f325406c6f0 2024-05-17T04:09:17.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.391+0000 7f324affd640 1 -- 172.21.15.131:0/1613819114 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3250004490 con 0x7f325406c6f0 2024-05-17T04:09:17.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.391+0000 7f325c3d2640 1 -- 172.21.15.131:0/1613819114 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32540cf2d0 con 0x7f325406c6f0 2024-05-17T04:09:17.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.392+0000 7f325c3d2640 1 -- 172.21.15.131:0/1613819114 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32540b87f0 con 0x7f325406c6f0 2024-05-17T04:09:17.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.393+0000 7f324affd640 1 -- 172.21.15.131:0/1613819114 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f325003c6d0 con 0x7f325406c6f0 2024-05-17T04:09:17.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.393+0000 7f324affd640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f32380762d0 0x7f32380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.393+0000 7f324affd640 1 -- 172.21.15.131:0/1613819114 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f32500b8110 con 0x7f325406c6f0 2024-05-17T04:09:17.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.393+0000 7f325996d640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f32380762d0 0x7f32380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.394+0000 7f325996d640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f32380762d0 0x7f32380787e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3244007fd0 tx=0x7f3244009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:17.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.398+0000 7f324affd640 1 -- 172.21.15.131:0/1613819114 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f32500816b0 con 0x7f325406c6f0 2024-05-17T04:09:17.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.582+0000 7f325c3d2640 1 -- 172.21.15.131:0/1613819114 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f325406d8d0 con 0x7f325406c6f0 2024-05-17T04:09:17.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.583+0000 7f324affd640 1 -- 172.21.15.131:0/1613819114 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f3250080fb0 con 0x7f325406c6f0 2024-05-17T04:09:17.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:17.585 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":24,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:09:10.777455+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:03.633460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:04.707669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-17T04:09:08.400498+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:09:17.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.585+0000 7f325c3d2640 1 -- 172.21.15.131:0/1613819114 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f32380762d0 msgr2=0x7f32380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.585+0000 7f325c3d2640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f32380762d0 0x7f32380787e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3244007fd0 tx=0x7f3244009040 comp rx=0 tx=0).stop 2024-05-17T04:09:17.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.585+0000 7f325c3d2640 1 -- 172.21.15.131:0/1613819114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f325406c6f0 msgr2=0x7f32541f9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.585+0000 7f325c3d2640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f325406c6f0 0x7f32541f9750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f32500097a0 tx=0x7f32500046c0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.585+0000 7f325c3d2640 1 -- 172.21.15.131:0/1613819114 shutdown_connections 2024-05-17T04:09:17.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.585+0000 7f325c3d2640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f32380762d0 0x7f32380787e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.585+0000 7f325c3d2640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f325415f7e0 0x7f32540ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.585+0000 7f325c3d2640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32540d3e10 0x7f32540ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.585+0000 7f325c3d2640 1 --2- 172.21.15.131:0/1613819114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f325406c6f0 0x7f32541f9750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.585+0000 7f325c3d2640 1 -- 172.21.15.131:0/1613819114 >> 172.21.15.131:0/1613819114 conn(0x7f32540d5860 msgr2=0x7f32540d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:17.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.585+0000 7f325c3d2640 1 -- 172.21.15.131:0/1613819114 shutdown_connections 2024-05-17T04:09:17.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.585+0000 7f325c3d2640 1 -- 172.21.15.131:0/1613819114 wait complete. 2024-05-17T04:09:17.598 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-17T04:09:17.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.710+0000 7fd2b8e47640 1 Processor -- start 2024-05-17T04:09:17.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.710+0000 7fd2b8e47640 1 -- start start 2024-05-17T04:09:17.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.712+0000 7fd2b8e47640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd2b406e6f0 0x7fd2b415fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.712+0000 7fd2b8e47640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b415a0d0 con 0x7fd2b4159cc0 2024-05-17T04:09:17.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.712+0000 7fd2b8e47640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b4160260 con 0x7fd2b40d2bf0 2024-05-17T04:09:17.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.712+0000 7fd2b8e47640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd2b40d0e10 con 0x7fd2b406e6f0 2024-05-17T04:09:17.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.712+0000 7fd2b259c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd2b406e6f0 0x7fd2b415fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.712+0000 7fd2b1d9b640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd2b4159cc0 0x7fd2b40d24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34546/0 (socket says 172.21.15.131:34546) 2024-05-17T04:09:17.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.712+0000 7fd2b1d9b640 1 -- 172.21.15.131:0/3295964129 learned_addr learned my addr 172.21.15.131:0/3295964129 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:17.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.712+0000 7fd2b259c640 1 -- 172.21.15.131:0/3295964129 >> v1:172.21.15.150:6789/0 conn(0x7fd2b40d2bf0 legacy=0x7fd2b40d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.712+0000 7fd2b259c640 1 -- 172.21.15.131:0/3295964129 >> v1:172.21.15.131:6789/0 conn(0x7fd2b4159cc0 legacy=0x7fd2b40d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.712+0000 7fd2b259c640 1 -- 172.21.15.131:0/3295964129 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b4160540 con 0x7fd2b406e6f0 2024-05-17T04:09:17.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.712+0000 7fd2b159a640 1 -- 172.21.15.131:0/3295964129 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4025995484 0 0) 0x7fd2b415a0d0 con 0x7fd2b4159cc0 2024-05-17T04:09:17.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.713+0000 7fd2b259c640 1 --2- 172.21.15.131:0/3295964129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b406e6f0 0x7fd2b415fc30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009d90 tx=0x7fd2a402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d18a8e467901be server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:17.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.713+0000 7fd2b159a640 1 -- 172.21.15.131:0/3295964129 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4007740 con 0x7fd2b406e6f0 2024-05-17T04:09:17.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.713+0000 7fd2b159a640 1 -- 172.21.15.131:0/3295964129 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a40078e0 con 0x7fd2b406e6f0 2024-05-17T04:09:17.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.713+0000 7fd2b159a640 1 -- 172.21.15.131:0/3295964129 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4007cb0 con 0x7fd2b406e6f0 2024-05-17T04:09:17.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.714+0000 7fd2b8e47640 1 -- 172.21.15.131:0/3295964129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b406e6f0 msgr2=0x7fd2b415fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.714+0000 7fd2b8e47640 1 --2- 172.21.15.131:0/3295964129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b406e6f0 0x7fd2b415fc30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009d90 tx=0x7fd2a402a6f0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.714+0000 7fd2b8e47640 1 -- 172.21.15.131:0/3295964129 shutdown_connections 2024-05-17T04:09:17.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.714+0000 7fd2b8e47640 1 --2- 172.21.15.131:0/3295964129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b406e6f0 0x7fd2b415fc30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.714+0000 7fd2b8e47640 1 -- 172.21.15.131:0/3295964129 >> 172.21.15.131:0/3295964129 conn(0x7fd2b40b4e40 msgr2=0x7fd2b40b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:17.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.714+0000 7fd2b8e47640 1 -- 172.21.15.131:0/3295964129 shutdown_connections 2024-05-17T04:09:17.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.714+0000 7fd2b8e47640 1 -- 172.21.15.131:0/3295964129 wait complete. 2024-05-17T04:09:17.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.716+0000 7fd2b8e47640 1 Processor -- start 2024-05-17T04:09:17.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.716+0000 7fd2b8e47640 1 -- start start 2024-05-17T04:09:17.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.717+0000 7fd2b8e47640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b406e6f0 0x7fd2b40ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.717+0000 7fd2b8e47640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2b4159cc0 0x7fd2b40b7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.717+0000 7fd2b8e47640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2b40b7a60 0x7fd2b40d2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.717+0000 7fd2b8e47640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b40c87e0 con 0x7fd2b406e6f0 2024-05-17T04:09:17.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.717+0000 7fd2b8e47640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b4160b00 con 0x7fd2b40b7a60 2024-05-17T04:09:17.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.717+0000 7fd2b8e47640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b40c8960 con 0x7fd2b4159cc0 2024-05-17T04:09:17.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.717+0000 7fd2b259c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b406e6f0 0x7fd2b40ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.717+0000 7fd2b259c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b406e6f0 0x7fd2b40ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43302/0 (socket says 172.21.15.131:43302) 2024-05-17T04:09:17.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.717+0000 7fd2b259c640 1 -- 172.21.15.131:0/172365278 learned_addr learned my addr 172.21.15.131:0/172365278 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:17.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.717+0000 7fd2b2d9d640 1 --2- 172.21.15.131:0/172365278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2b40b7a60 0x7fd2b40d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.717+0000 7fd2b1d9b640 1 --2- 172.21.15.131:0/172365278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2b4159cc0 0x7fd2b40b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.718+0000 7fd2b259c640 1 -- 172.21.15.131:0/172365278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2b4159cc0 msgr2=0x7fd2b40b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.718+0000 7fd2b259c640 1 --2- 172.21.15.131:0/172365278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2b4159cc0 0x7fd2b40b7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.718+0000 7fd2b259c640 1 -- 172.21.15.131:0/172365278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2b40b7a60 msgr2=0x7fd2b40d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:17.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.718+0000 7fd2b259c640 1 --2- 172.21.15.131:0/172365278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2b40b7a60 0x7fd2b40d2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:17.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.718+0000 7fd2b259c640 1 -- 172.21.15.131:0/172365278 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b40b8170 con 0x7fd2b406e6f0 2024-05-17T04:09:17.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.718+0000 7fd2b1d9b640 1 --2- 172.21.15.131:0/172365278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2b4159cc0 0x7fd2b40b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:17.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.718+0000 7fd2b259c640 1 --2- 172.21.15.131:0/172365278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b406e6f0 0x7fd2b40ccd60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009eb0 tx=0x7fd2a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:17.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.718+0000 7fd2aaffd640 1 -- 172.21.15.131:0/172365278 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a403f070 con 0x7fd2b406e6f0 2024-05-17T04:09:17.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.718+0000 7fd2aaffd640 1 -- 172.21.15.131:0/172365278 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a4031d00 con 0x7fd2b406e6f0 2024-05-17T04:09:17.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.718+0000 7fd2b8e47640 1 -- 172.21.15.131:0/172365278 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b40b8450 con 0x7fd2b406e6f0 2024-05-17T04:09:17.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.718+0000 7fd2aaffd640 1 -- 172.21.15.131:0/172365278 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4044660 con 0x7fd2b406e6f0 2024-05-17T04:09:17.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.718+0000 7fd2b8e47640 1 -- 172.21.15.131:0/172365278 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b40b8a10 con 0x7fd2b406e6f0 2024-05-17T04:09:17.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.719+0000 7fd2b8e47640 1 -- 172.21.15.131:0/172365278 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b415fc30 con 0x7fd2b406e6f0 2024-05-17T04:09:17.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.720+0000 7fd2aaffd640 1 -- 172.21.15.131:0/172365278 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd2a403b410 con 0x7fd2b406e6f0 2024-05-17T04:09:17.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.720+0000 7fd2aaffd640 1 --2- 172.21.15.131:0/172365278 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd2940762d0 0x7fd2940787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:17.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.720+0000 7fd2aaffd640 1 -- 172.21.15.131:0/172365278 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd2a40b9410 con 0x7fd2b406e6f0 2024-05-17T04:09:17.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.720+0000 7fd2b1d9b640 1 --2- 172.21.15.131:0/172365278 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd2940762d0 0x7fd2940787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:17.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.721+0000 7fd2b1d9b640 1 --2- 172.21.15.131:0/172365278 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd2940762d0 0x7fd2940787e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4072270 tx=0x7fd29c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:17.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.725+0000 7fd2aaffd640 1 -- 172.21.15.131:0/172365278 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd2a40829a0 con 0x7fd2b406e6f0 2024-05-17T04:09:17.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:17.941+0000 7fd2b8e47640 1 -- 172.21.15.131:0/172365278 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd2b406e220 con 0x7fd2b406e6f0 2024-05-17T04:09:18.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.446+0000 7fd2aaffd640 1 -- 172.21.15.131:0/172365278 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fd2a40822a0 con 0x7fd2b406e6f0 2024-05-17T04:09:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.448+0000 7fd2b8e47640 1 -- 172.21.15.131:0/172365278 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd2940762d0 msgr2=0x7fd2940787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.448+0000 7fd2b8e47640 1 --2- 172.21.15.131:0/172365278 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd2940762d0 0x7fd2940787e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4072270 tx=0x7fd29c009040 comp rx=0 tx=0).stop 2024-05-17T04:09:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.448+0000 7fd2b8e47640 1 -- 172.21.15.131:0/172365278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b406e6f0 msgr2=0x7fd2b40ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.448+0000 7fd2b8e47640 1 --2- 172.21.15.131:0/172365278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b406e6f0 0x7fd2b40ccd60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009eb0 tx=0x7fd2a4004a40 comp rx=0 tx=0).stop 2024-05-17T04:09:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.448+0000 7fd2b8e47640 1 -- 172.21.15.131:0/172365278 shutdown_connections 2024-05-17T04:09:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.448+0000 7fd2b8e47640 1 --2- 172.21.15.131:0/172365278 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd2940762d0 0x7fd2940787e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.448+0000 7fd2b8e47640 1 --2- 172.21.15.131:0/172365278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2b40b7a60 0x7fd2b40d2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:18.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.448+0000 7fd2b8e47640 1 --2- 172.21.15.131:0/172365278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2b4159cc0 0x7fd2b40b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:18.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.448+0000 7fd2b8e47640 1 --2- 172.21.15.131:0/172365278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b406e6f0 0x7fd2b40ccd60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:18.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.448+0000 7fd2b8e47640 1 -- 172.21.15.131:0/172365278 >> 172.21.15.131:0/172365278 conn(0x7fd2b40b4e40 msgr2=0x7fd2b406eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:18.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.448+0000 7fd2b8e47640 1 -- 172.21.15.131:0/172365278 shutdown_connections 2024-05-17T04:09:18.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.449+0000 7fd2b8e47640 1 -- 172.21.15.131:0/172365278 wait complete. 2024-05-17T04:09:18.462 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-05-17T04:09:18.462 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-17T04:09:18.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.578+0000 7f8cf34ba640 1 Processor -- start 2024-05-17T04:09:18.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.578+0000 7f8cf34ba640 1 -- start start 2024-05-17T04:09:18.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.580+0000 7f8cf34ba640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8cec0b0da0 0x7f8cec0b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:18.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.580+0000 7f8cf34ba640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cec0b16f0 con 0x7f8cec148c90 2024-05-17T04:09:18.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.580+0000 7f8cf34ba640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cec0b0110 con 0x7f8cec06c6f0 2024-05-17T04:09:18.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.580+0000 7f8cf34ba640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f8cec0ae960 con 0x7f8cec0b0da0 2024-05-17T04:09:18.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.580+0000 7f8cf0a55640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8cec0b0da0 0x7f8cec0b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:18.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.580+0000 7f8cf1256640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f8cec148c90 0x7f8cec0afa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34562/0 (socket says 172.21.15.131:34562) 2024-05-17T04:09:18.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.580+0000 7f8cf1256640 1 -- 172.21.15.131:0/3985398372 learned_addr learned my addr 172.21.15.131:0/3985398372 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:18.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.580+0000 7f8cf0a55640 1 -- 172.21.15.131:0/3985398372 >> v1:172.21.15.150:6789/0 conn(0x7f8cec06c6f0 legacy=0x7f8cec06cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:18.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.580+0000 7f8cf0a55640 1 -- 172.21.15.131:0/3985398372 >> v1:172.21.15.131:6789/0 conn(0x7f8cec148c90 legacy=0x7f8cec0afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:18.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.580+0000 7f8cf0a55640 1 -- 172.21.15.131:0/3985398372 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cec0aec40 con 0x7f8cec0b0da0 2024-05-17T04:09:18.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.580+0000 7f8ce3fff640 1 -- 172.21.15.131:0/3985398372 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1618304417 0 0) 0x7f8ce8001110 con 0x7f8cec148c90 2024-05-17T04:09:18.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.581+0000 7f8cf0a55640 1 --2- 172.21.15.131:0/3985398372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec0b0da0 0x7f8cec0b11b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0097a0 tx=0x7f8cdc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6208e4dfe3b233e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:18.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.581+0000 7f8ce3fff640 1 -- 172.21.15.131:0/3985398372 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc037070 con 0x7f8cec0b0da0 2024-05-17T04:09:18.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.581+0000 7f8ce3fff640 1 -- 172.21.15.131:0/3985398372 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cdc032440 con 0x7f8cec0b0da0 2024-05-17T04:09:18.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.581+0000 7f8ce3fff640 1 -- 172.21.15.131:0/3985398372 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc032810 con 0x7f8cec0b0da0 2024-05-17T04:09:18.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.582+0000 7f8cf34ba640 1 -- 172.21.15.131:0/3985398372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec0b0da0 msgr2=0x7f8cec0b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:18.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.582+0000 7f8cf34ba640 1 --2- 172.21.15.131:0/3985398372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec0b0da0 0x7f8cec0b11b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0097a0 tx=0x7f8cdc02a180 comp rx=0 tx=0).stop 2024-05-17T04:09:18.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.582+0000 7f8cf34ba640 1 -- 172.21.15.131:0/3985398372 shutdown_connections 2024-05-17T04:09:18.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.582+0000 7f8cf34ba640 1 --2- 172.21.15.131:0/3985398372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec0b0da0 0x7f8cec0b11b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:18.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.582+0000 7f8cf34ba640 1 -- 172.21.15.131:0/3985398372 >> 172.21.15.131:0/3985398372 conn(0x7f8cec073170 msgr2=0x7f8cec073580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:18.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.582+0000 7f8cf34ba640 1 -- 172.21.15.131:0/3985398372 shutdown_connections 2024-05-17T04:09:18.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.582+0000 7f8cf34ba640 1 -- 172.21.15.131:0/3985398372 wait complete. 2024-05-17T04:09:18.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.584+0000 7f8cf34ba640 1 Processor -- start 2024-05-17T04:09:18.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.584+0000 7f8cf34ba640 1 -- start start 2024-05-17T04:09:18.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf34ba640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec06c6f0 0x7f8cec1421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:18.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf34ba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cec0b0da0 0x7f8cec161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:18.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf34ba640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cec148c90 0x7f8cec161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:18.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf34ba640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec0af4e0 con 0x7f8cec06c6f0 2024-05-17T04:09:18.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf34ba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec0af200 con 0x7f8cec0b0da0 2024-05-17T04:09:18.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf34ba640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8cec0b3940 con 0x7f8cec148c90 2024-05-17T04:09:18.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf1256640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec06c6f0 0x7f8cec1421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:18.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf1256640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec06c6f0 0x7f8cec1421e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43326/0 (socket says 172.21.15.131:43326) 2024-05-17T04:09:18.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf1256640 1 -- 172.21.15.131:0/3996329070 learned_addr learned my addr 172.21.15.131:0/3996329070 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:18.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf1a57640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cec148c90 0x7f8cec161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:18.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf0a55640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cec0b0da0 0x7f8cec161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:18.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf1256640 1 -- 172.21.15.131:0/3996329070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cec148c90 msgr2=0x7f8cec161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:18.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf1256640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cec148c90 0x7f8cec161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:18.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf1256640 1 -- 172.21.15.131:0/3996329070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cec0b0da0 msgr2=0x7f8cec161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:18.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf1256640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cec0b0da0 0x7f8cec161150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:18.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf1256640 1 -- 172.21.15.131:0/3996329070 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cec1418b0 con 0x7f8cec06c6f0 2024-05-17T04:09:18.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.585+0000 7f8cf1a57640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cec148c90 0x7f8cec161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:18.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.586+0000 7f8cf0a55640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cec0b0da0 0x7f8cec161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:18.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.586+0000 7f8cf1256640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec06c6f0 0x7f8cec1421e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c3e0 tx=0x7f8ce800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:18.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.586+0000 7f8ce1ffb640 1 -- 172.21.15.131:0/3996329070 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce80074e0 con 0x7f8cec06c6f0 2024-05-17T04:09:18.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.586+0000 7f8ce1ffb640 1 -- 172.21.15.131:0/3996329070 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce80047e0 con 0x7f8cec06c6f0 2024-05-17T04:09:18.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.586+0000 7f8ce1ffb640 1 -- 172.21.15.131:0/3996329070 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8004bd0 con 0x7f8cec06c6f0 2024-05-17T04:09:18.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.586+0000 7f8cf34ba640 1 -- 172.21.15.131:0/3996329070 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cec145580 con 0x7f8cec06c6f0 2024-05-17T04:09:18.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.586+0000 7f8cf34ba640 1 -- 172.21.15.131:0/3996329070 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cec145b40 con 0x7f8cec06c6f0 2024-05-17T04:09:18.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.587+0000 7f8cf34ba640 1 -- 172.21.15.131:0/3996329070 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cec0b11b0 con 0x7f8cec06c6f0 2024-05-17T04:09:18.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.588+0000 7f8ce1ffb640 1 -- 172.21.15.131:0/3996329070 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ce8011070 con 0x7f8cec06c6f0 2024-05-17T04:09:18.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.588+0000 7f8ce1ffb640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cd00762d0 0x7f8cd00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:18.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.588+0000 7f8ce1ffb640 1 -- 172.21.15.131:0/3996329070 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8ce8097590 con 0x7f8cec06c6f0 2024-05-17T04:09:18.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.588+0000 7f8cf0a55640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cd00762d0 0x7f8cd00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:18.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.589+0000 7f8cf0a55640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cd00762d0 0x7f8cd00787e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc034000 tx=0x7f8cdc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:18.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.593+0000 7f8ce1ffb640 1 -- 172.21.15.131:0/3996329070 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8cec0b16f0 con 0x7f8cec06c6f0 2024-05-17T04:09:18.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:18.812+0000 7f8cf34ba640 1 -- 172.21.15.131:0/3996329070 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8cec0b7720 con 0x7f8cec06c6f0 2024-05-17T04:09:19.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.451+0000 7f8ce1ffb640 1 -- 172.21.15.131:0/3996329070 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f8ce8060bb0 con 0x7f8cec06c6f0 2024-05-17T04:09:19.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.454+0000 7f8cf34ba640 1 -- 172.21.15.131:0/3996329070 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cd00762d0 msgr2=0x7f8cd00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:19.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.454+0000 7f8cf34ba640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cd00762d0 0x7f8cd00787e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc034000 tx=0x7f8cdc02e000 comp rx=0 tx=0).stop 2024-05-17T04:09:19.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.454+0000 7f8cf34ba640 1 -- 172.21.15.131:0/3996329070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec06c6f0 msgr2=0x7f8cec1421e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:19.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.454+0000 7f8cf34ba640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec06c6f0 0x7f8cec1421e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c3e0 tx=0x7f8ce800c8a0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.454+0000 7f8cf34ba640 1 -- 172.21.15.131:0/3996329070 shutdown_connections 2024-05-17T04:09:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.454+0000 7f8cf34ba640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cd00762d0 0x7f8cd00787e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.454+0000 7f8cf34ba640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cec148c90 0x7f8cec161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.454+0000 7f8cf34ba640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cec0b0da0 0x7f8cec161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.454+0000 7f8cf34ba640 1 --2- 172.21.15.131:0/3996329070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec06c6f0 0x7f8cec1421e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.454+0000 7f8cf34ba640 1 -- 172.21.15.131:0/3996329070 >> 172.21.15.131:0/3996329070 conn(0x7f8cec073170 msgr2=0x7f8cec0b6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.454+0000 7f8cf34ba640 1 -- 172.21.15.131:0/3996329070 shutdown_connections 2024-05-17T04:09:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.454+0000 7f8cf34ba640 1 -- 172.21.15.131:0/3996329070 wait complete. 2024-05-17T04:09:19.467 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-17T04:09:19.468 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T04:09:19.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.577+0000 7f2bb32fd640 1 Processor -- start 2024-05-17T04:09:19.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.578+0000 7f2bb32fd640 1 -- start start 2024-05-17T04:09:19.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.579+0000 7f2bb32fd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2bac0d1750 0x7f2bac06f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:19.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.579+0000 7f2bb32fd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2bac06f890 0x7f2bac06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:19.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.579+0000 7f2bb32fd640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bac160930 con 0x7f2bac0cd720 2024-05-17T04:09:19.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.579+0000 7f2bb32fd640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f2bac06e870 con 0x7f2bac06f890 2024-05-17T04:09:19.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.579+0000 7f2bb32fd640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f2bac06eb50 con 0x7f2bac0d1750 2024-05-17T04:09:19.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.579+0000 7f2bb189a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2bac06f890 0x7f2bac06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:19.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.579+0000 7f2bb1099640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f2bac0cd720 0x7f2bac0d1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34570/0 (socket says 172.21.15.131:34570) 2024-05-17T04:09:19.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.579+0000 7f2bb189a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2bac06f890 0x7f2bac06fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43338/0 (socket says 172.21.15.131:43338) 2024-05-17T04:09:19.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.579+0000 7f2bb1099640 1 -- 172.21.15.131:0/480389763 learned_addr learned my addr 172.21.15.131:0/480389763 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:19.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.579+0000 7f2bb0898640 1 --2- 172.21.15.131:0/480389763 >> v2:172.21.15.150:3300/0 conn(0x7f2bac0d1750 0x7f2bac06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:19.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.579+0000 7f2bb189a640 1 -- 172.21.15.131:0/480389763 >> v2:172.21.15.150:3300/0 conn(0x7f2bac0d1750 msgr2=0x7f2bac06f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:19.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.579+0000 7f2bb189a640 1 --2- 172.21.15.131:0/480389763 >> v2:172.21.15.150:3300/0 conn(0x7f2bac0d1750 0x7f2bac06f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.579+0000 7f2bb189a640 1 -- 172.21.15.131:0/480389763 >> v1:172.21.15.131:6789/0 conn(0x7f2bac0cd720 legacy=0x7f2bac0d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:19.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.580+0000 7f2bb189a640 1 -- 172.21.15.131:0/480389763 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bac06ee30 con 0x7f2bac06f890 2024-05-17T04:09:19.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.580+0000 7f2bb189a640 1 --2- 172.21.15.131:0/480389763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bac06f890 0x7f2bac06fca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0d2960 tx=0x7f2ba402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48dd1dfa367c5ae server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:19.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.580+0000 7f2ba3fff640 1 -- 172.21.15.131:0/480389763 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4037070 con 0x7f2bac06f890 2024-05-17T04:09:19.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.580+0000 7f2ba3fff640 1 -- 172.21.15.131:0/480389763 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba4032440 con 0x7f2bac06f890 2024-05-17T04:09:19.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.580+0000 7f2ba3fff640 1 -- 172.21.15.131:0/480389763 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4032810 con 0x7f2bac06f890 2024-05-17T04:09:19.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.581+0000 7f2bb32fd640 1 -- 172.21.15.131:0/480389763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bac06f890 msgr2=0x7f2bac06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:19.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.581+0000 7f2bb32fd640 1 --2- 172.21.15.131:0/480389763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bac06f890 0x7f2bac06fca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0d2960 tx=0x7f2ba402a1a0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.581+0000 7f2bb32fd640 1 -- 172.21.15.131:0/480389763 shutdown_connections 2024-05-17T04:09:19.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.581+0000 7f2bb32fd640 1 --2- 172.21.15.131:0/480389763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bac06f890 0x7f2bac06fca0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.581+0000 7f2bb32fd640 1 --2- 172.21.15.131:0/480389763 >> v2:172.21.15.150:3300/0 conn(0x7f2bac0d1750 0x7f2bac06f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.581+0000 7f2bb32fd640 1 -- 172.21.15.131:0/480389763 >> 172.21.15.131:0/480389763 conn(0x7f2bac0b4e40 msgr2=0x7f2bac0b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:19.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.581+0000 7f2bb32fd640 1 -- 172.21.15.131:0/480389763 shutdown_connections 2024-05-17T04:09:19.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.581+0000 7f2bb32fd640 1 -- 172.21.15.131:0/480389763 wait complete. 2024-05-17T04:09:19.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.583+0000 7f2bb32fd640 1 Processor -- start 2024-05-17T04:09:19.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.583+0000 7f2bb32fd640 1 -- start start 2024-05-17T04:09:19.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.584+0000 7f2bb32fd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bac06f890 0x7f2bac0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:19.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.584+0000 7f2bb32fd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bac0cd720 0x7f2bac0b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:19.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.584+0000 7f2bb32fd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bac15a530 0x7f2bac15e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:19.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.584+0000 7f2bb32fd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac15fac0 con 0x7f2bac06f890 2024-05-17T04:09:19.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.584+0000 7f2bb32fd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac15f940 con 0x7f2bac0cd720 2024-05-17T04:09:19.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.584+0000 7f2bb32fd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2bac15fc40 con 0x7f2bac15a530 2024-05-17T04:09:19.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.584+0000 7f2bb1099640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bac06f890 0x7f2bac0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:19.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.584+0000 7f2bb1099640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bac06f890 0x7f2bac0cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43340/0 (socket says 172.21.15.131:43340) 2024-05-17T04:09:19.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.584+0000 7f2bb1099640 1 -- 172.21.15.131:0/2350973689 learned_addr learned my addr 172.21.15.131:0/2350973689 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:19.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.585+0000 7f2bb0898640 1 --2- 172.21.15.131:0/2350973689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bac0cd720 0x7f2bac0b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:19.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.585+0000 7f2bb189a640 1 --2- 172.21.15.131:0/2350973689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bac15a530 0x7f2bac15e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:19.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.585+0000 7f2bb1099640 1 -- 172.21.15.131:0/2350973689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bac15a530 msgr2=0x7f2bac15e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:19.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.585+0000 7f2bb1099640 1 --2- 172.21.15.131:0/2350973689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bac15a530 0x7f2bac15e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.585+0000 7f2bb1099640 1 -- 172.21.15.131:0/2350973689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bac0cd720 msgr2=0x7f2bac0b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:19.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.585+0000 7f2bb1099640 1 --2- 172.21.15.131:0/2350973689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bac0cd720 0x7f2bac0b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.585+0000 7f2bb1099640 1 -- 172.21.15.131:0/2350973689 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bac0b67f0 con 0x7f2bac06f890 2024-05-17T04:09:19.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.585+0000 7f2bb189a640 1 --2- 172.21.15.131:0/2350973689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bac15a530 0x7f2bac15e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:19.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.585+0000 7f2bb1099640 1 --2- 172.21.15.131:0/2350973689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bac06f890 0x7f2bac0cce70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800ca80 tx=0x7f2ba800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:19.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.585+0000 7f2ba1ffb640 1 -- 172.21.15.131:0/2350973689 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8017070 con 0x7f2bac06f890 2024-05-17T04:09:19.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.585+0000 7f2ba1ffb640 1 -- 172.21.15.131:0/2350973689 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba800ac30 con 0x7f2bac06f890 2024-05-17T04:09:19.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.585+0000 7f2bb32fd640 1 -- 172.21.15.131:0/2350973689 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bac0b6ad0 con 0x7f2bac06f890 2024-05-17T04:09:19.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.585+0000 7f2ba1ffb640 1 -- 172.21.15.131:0/2350973689 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8012400 con 0x7f2bac06f890 2024-05-17T04:09:19.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.585+0000 7f2bb32fd640 1 -- 172.21.15.131:0/2350973689 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bac0b73c0 con 0x7f2bac06f890 2024-05-17T04:09:19.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.586+0000 7f2bb32fd640 1 -- 172.21.15.131:0/2350973689 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bac0b6ff0 con 0x7f2bac06f890 2024-05-17T04:09:19.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.587+0000 7f2ba1ffb640 1 -- 172.21.15.131:0/2350973689 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2ba801a070 con 0x7f2bac06f890 2024-05-17T04:09:19.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.587+0000 7f2ba1ffb640 1 --2- 172.21.15.131:0/2350973689 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b900762d0 0x7f2b900787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:19.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.588+0000 7f2ba1ffb640 1 -- 172.21.15.131:0/2350973689 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2ba8097630 con 0x7f2bac06f890 2024-05-17T04:09:19.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.588+0000 7f2bb0898640 1 --2- 172.21.15.131:0/2350973689 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b900762d0 0x7f2b900787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:19.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.588+0000 7f2bb0898640 1 --2- 172.21.15.131:0/2350973689 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b900762d0 0x7f2b900787e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2bac071ba0 tx=0x7f2b9c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:19.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.592+0000 7f2ba1ffb640 1 -- 172.21.15.131:0/2350973689 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2ba8060570 con 0x7f2bac06f890 2024-05-17T04:09:19.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.811+0000 7f2bb32fd640 1 -- 172.21.15.131:0/2350973689 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bac06f350 con 0x7f2bac06f890 2024-05-17T04:09:19.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.811+0000 7f2ba1ffb640 1 -- 172.21.15.131:0/2350973689 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5189 (secure 0 0 0) 0x7f2ba8064870 con 0x7f2bac06f890 2024-05-17T04:09:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:19.813 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2897828294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2897828294},{"type":"v1","addr":"172.21.15.131:6837","nonce":2897828294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/4068751282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4068751282},{"type":"v1","addr":"172.21.15.131:6836","nonce":4068751282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2776700884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2776700884},{"type":"v1","addr":"172.21.15.150:6834","nonce":2776700884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:05.755541+0000","modified":"2024-05-17T04:09:18.813988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2635477484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2635477484},{"type":"v1","addr":"172.21.15.150:6835","nonce":2635477484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-05-17T04:09:19.813 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-05-17T04:09:19.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.813+0000 7f2bb32fd640 1 -- 172.21.15.131:0/2350973689 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b900762d0 msgr2=0x7f2b900787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:19.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.813+0000 7f2bb32fd640 1 --2- 172.21.15.131:0/2350973689 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b900762d0 0x7f2b900787e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2bac071ba0 tx=0x7f2b9c008040 comp rx=0 tx=0).stop 2024-05-17T04:09:19.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.813+0000 7f2bb32fd640 1 -- 172.21.15.131:0/2350973689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bac06f890 msgr2=0x7f2bac0cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:19.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.813+0000 7f2bb32fd640 1 --2- 172.21.15.131:0/2350973689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bac06f890 0x7f2bac0cce70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800ca80 tx=0x7f2ba800cf40 comp rx=0 tx=0).stop 2024-05-17T04:09:19.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.813+0000 7f2bb32fd640 1 -- 172.21.15.131:0/2350973689 shutdown_connections 2024-05-17T04:09:19.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.813+0000 7f2bb32fd640 1 --2- 172.21.15.131:0/2350973689 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b900762d0 0x7f2b900787e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.813+0000 7f2bb32fd640 1 --2- 172.21.15.131:0/2350973689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bac15a530 0x7f2bac15e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.813+0000 7f2bb32fd640 1 --2- 172.21.15.131:0/2350973689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bac0cd720 0x7f2bac0b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.813+0000 7f2bb32fd640 1 --2- 172.21.15.131:0/2350973689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bac06f890 0x7f2bac0cce70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.813+0000 7f2bb32fd640 1 -- 172.21.15.131:0/2350973689 >> 172.21.15.131:0/2350973689 conn(0x7f2bac0b4e40 msgr2=0x7f2bac0d2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:19.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.813+0000 7f2bb32fd640 1 -- 172.21.15.131:0/2350973689 shutdown_connections 2024-05-17T04:09:19.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.813+0000 7f2bb32fd640 1 -- 172.21.15.131:0/2350973689 wait complete. 2024-05-17T04:09:19.826 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:09:19.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.936+0000 7fa760f39640 1 Processor -- start 2024-05-17T04:09:19.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.936+0000 7fa760f39640 1 -- start start 2024-05-17T04:09:19.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.937+0000 7fa760f39640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c073a00 0x7fa75c15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:19.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.937+0000 7fa760f39640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa75c0d1180 0x7fa75c06df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:19.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.937+0000 7fa760f39640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75c06e8e0 con 0x7fa75c06e4d0 2024-05-17T04:09:19.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.937+0000 7fa760f39640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa75c0ce350 con 0x7fa75c0d1180 2024-05-17T04:09:19.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.937+0000 7fa760f39640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa75c0ce630 con 0x7fa75c073a00 2024-05-17T04:09:19.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.937+0000 7fa751d9b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa75c0d1180 0x7fa75c06df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:19.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.937+0000 7fa75ad9d640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa75c06e4d0 0x7fa75c160f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34578/0 (socket says 172.21.15.131:34578) 2024-05-17T04:09:19.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.938+0000 7fa75ad9d640 1 -- 172.21.15.131:0/1466440498 learned_addr learned my addr 172.21.15.131:0/1466440498 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:19.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.938+0000 7fa75a59c640 1 --2- 172.21.15.131:0/1466440498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c073a00 0x7fa75c15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:19.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.938+0000 7fa751d9b640 1 -- 172.21.15.131:0/1466440498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c073a00 msgr2=0x7fa75c15d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:19.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.938+0000 7fa751d9b640 1 --2- 172.21.15.131:0/1466440498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c073a00 0x7fa75c15d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.938+0000 7fa751d9b640 1 -- 172.21.15.131:0/1466440498 >> v1:172.21.15.131:6789/0 conn(0x7fa75c06e4d0 legacy=0x7fa75c160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:19.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.938+0000 7fa759d9b640 1 -- 172.21.15.131:0/1466440498 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2056634618 0 0) 0x7fa754001490 con 0x7fa75c06e4d0 2024-05-17T04:09:19.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.938+0000 7fa751d9b640 1 -- 172.21.15.131:0/1466440498 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c0ce910 con 0x7fa75c0d1180 2024-05-17T04:09:19.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.938+0000 7fa75a59c640 1 --2- 172.21.15.131:0/1466440498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c073a00 0x7fa75c15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:19.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.939+0000 7fa751d9b640 1 --2- 172.21.15.131:0/1466440498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c0d1180 0x7fa75c06df90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa7440097a0 tx=0x7fa74402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6513b13c4ba1e94 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:19.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.939+0000 7fa759d9b640 1 -- 172.21.15.131:0/1466440498 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744037070 con 0x7fa75c0d1180 2024-05-17T04:09:19.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.939+0000 7fa759d9b640 1 -- 172.21.15.131:0/1466440498 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa744032440 con 0x7fa75c0d1180 2024-05-17T04:09:19.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.939+0000 7fa759d9b640 1 -- 172.21.15.131:0/1466440498 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744032810 con 0x7fa75c0d1180 2024-05-17T04:09:19.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.939+0000 7fa760f39640 1 -- 172.21.15.131:0/1466440498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c0d1180 msgr2=0x7fa75c06df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:19.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.939+0000 7fa760f39640 1 --2- 172.21.15.131:0/1466440498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c0d1180 0x7fa75c06df90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa7440097a0 tx=0x7fa74402a180 comp rx=0 tx=0).stop 2024-05-17T04:09:19.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.939+0000 7fa760f39640 1 -- 172.21.15.131:0/1466440498 shutdown_connections 2024-05-17T04:09:19.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.939+0000 7fa760f39640 1 --2- 172.21.15.131:0/1466440498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c0d1180 0x7fa75c06df90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.939+0000 7fa760f39640 1 --2- 172.21.15.131:0/1466440498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c073a00 0x7fa75c15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.939+0000 7fa760f39640 1 -- 172.21.15.131:0/1466440498 >> 172.21.15.131:0/1466440498 conn(0x7fa75c0d2140 msgr2=0x7fa75c072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:19.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.939+0000 7fa760f39640 1 -- 172.21.15.131:0/1466440498 shutdown_connections 2024-05-17T04:09:19.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.939+0000 7fa760f39640 1 -- 172.21.15.131:0/1466440498 wait complete. 2024-05-17T04:09:19.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.941+0000 7fa760f39640 1 Processor -- start 2024-05-17T04:09:19.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.942+0000 7fa760f39640 1 -- start start 2024-05-17T04:09:19.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa760f39640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c06e4d0 0x7fa75c0b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:19.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa760f39640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c073a00 0x7fa75c150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:19.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa760f39640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c0d1180 0x7fa75c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:19.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa760f39640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c0d1590 con 0x7fa75c0d1180 2024-05-17T04:09:19.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa760f39640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c0ceed0 con 0x7fa75c073a00 2024-05-17T04:09:19.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa760f39640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa75c0d1710 con 0x7fa75c06e4d0 2024-05-17T04:09:19.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa75ad9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c0d1180 0x7fa75c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:19.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa75ad9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c0d1180 0x7fa75c1514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43368/0 (socket says 172.21.15.131:43368) 2024-05-17T04:09:19.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa75ad9d640 1 -- 172.21.15.131:0/3611847873 learned_addr learned my addr 172.21.15.131:0/3611847873 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:19.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa75a59c640 1 --2- 172.21.15.131:0/3611847873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c06e4d0 0x7fa75c0b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:19.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa751d9b640 1 --2- 172.21.15.131:0/3611847873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c073a00 0x7fa75c150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:19.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa75ad9d640 1 -- 172.21.15.131:0/3611847873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c06e4d0 msgr2=0x7fa75c0b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:19.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa75ad9d640 1 --2- 172.21.15.131:0/3611847873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c06e4d0 0x7fa75c0b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa75ad9d640 1 -- 172.21.15.131:0/3611847873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c073a00 msgr2=0x7fa75c150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:19.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa75ad9d640 1 --2- 172.21.15.131:0/3611847873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c073a00 0x7fa75c150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:19.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa75ad9d640 1 -- 172.21.15.131:0/3611847873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c154ea0 con 0x7fa75c0d1180 2024-05-17T04:09:19.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.943+0000 7fa75ad9d640 1 --2- 172.21.15.131:0/3611847873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c0d1180 0x7fa75c1514a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa75400c6b0 tx=0x7fa75400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:19.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.944+0000 7fa7537fe640 1 -- 172.21.15.131:0/3611847873 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa754018070 con 0x7fa75c0d1180 2024-05-17T04:09:19.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.944+0000 7fa7537fe640 1 -- 172.21.15.131:0/3611847873 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa754004da0 con 0x7fa75c0d1180 2024-05-17T04:09:19.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.944+0000 7fa760f39640 1 -- 172.21.15.131:0/3611847873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75c1f3e10 con 0x7fa75c0d1180 2024-05-17T04:09:19.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.944+0000 7fa7537fe640 1 -- 172.21.15.131:0/3611847873 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75400a880 con 0x7fa75c0d1180 2024-05-17T04:09:19.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.944+0000 7fa760f39640 1 -- 172.21.15.131:0/3611847873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75c1f43d0 con 0x7fa75c0d1180 2024-05-17T04:09:19.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.945+0000 7fa760f39640 1 -- 172.21.15.131:0/3611847873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa75c1f4d60 con 0x7fa75c0d1180 2024-05-17T04:09:19.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.945+0000 7fa7537fe640 1 -- 172.21.15.131:0/3611847873 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa75401b070 con 0x7fa75c0d1180 2024-05-17T04:09:19.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.946+0000 7fa7537fe640 1 --2- 172.21.15.131:0/3611847873 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa73c0762d0 0x7fa73c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:19.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.946+0000 7fa7537fe640 1 -- 172.21.15.131:0/3611847873 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa754096ea0 con 0x7fa75c0d1180 2024-05-17T04:09:19.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.946+0000 7fa75a59c640 1 --2- 172.21.15.131:0/3611847873 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa73c0762d0 0x7fa73c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:19.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.946+0000 7fa75a59c640 1 --2- 172.21.15.131:0/3611847873 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa73c0762d0 0x7fa73c0787e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa74c006e80 tx=0x7fa74c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:19.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:19.950+0000 7fa7537fe640 1 -- 172.21.15.131:0/3611847873 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa75c06e8e0 con 0x7fa75c0d1180 2024-05-17T04:09:20.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.133+0000 7fa760f39640 1 -- 172.21.15.131:0/3611847873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa75c0b6530 con 0x7fa75c0d1180 2024-05-17T04:09:20.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.134+0000 7fa7537fe640 1 -- 172.21.15.131:0/3611847873 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fa75405fde0 con 0x7fa75c0d1180 2024-05-17T04:09:20.136 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:20.136 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":24,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:09:10.777455+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:03.633460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:04.707669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-17T04:09:08.400498+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:09:20.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.137+0000 7fa760f39640 1 -- 172.21.15.131:0/3611847873 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa73c0762d0 msgr2=0x7fa73c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.137+0000 7fa760f39640 1 --2- 172.21.15.131:0/3611847873 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa73c0762d0 0x7fa73c0787e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa74c006e80 tx=0x7fa74c008040 comp rx=0 tx=0).stop 2024-05-17T04:09:20.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.137+0000 7fa760f39640 1 -- 172.21.15.131:0/3611847873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c0d1180 msgr2=0x7fa75c1514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.137+0000 7fa760f39640 1 --2- 172.21.15.131:0/3611847873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c0d1180 0x7fa75c1514a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa75400c6b0 tx=0x7fa75400cb70 comp rx=0 tx=0).stop 2024-05-17T04:09:20.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.137+0000 7fa760f39640 1 -- 172.21.15.131:0/3611847873 shutdown_connections 2024-05-17T04:09:20.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.137+0000 7fa760f39640 1 --2- 172.21.15.131:0/3611847873 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa73c0762d0 0x7fa73c0787e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.137+0000 7fa760f39640 1 --2- 172.21.15.131:0/3611847873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa75c0d1180 0x7fa75c1514a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.137+0000 7fa760f39640 1 --2- 172.21.15.131:0/3611847873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c073a00 0x7fa75c150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.137+0000 7fa760f39640 1 --2- 172.21.15.131:0/3611847873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c06e4d0 0x7fa75c0b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.137+0000 7fa760f39640 1 -- 172.21.15.131:0/3611847873 >> 172.21.15.131:0/3611847873 conn(0x7fa75c0d2140 msgr2=0x7fa75c15ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:20.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.137+0000 7fa760f39640 1 -- 172.21.15.131:0/3611847873 shutdown_connections 2024-05-17T04:09:20.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.137+0000 7fa760f39640 1 -- 172.21.15.131:0/3611847873 wait complete. 2024-05-17T04:09:20.150 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-17T04:09:20.150 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-17T04:09:20.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.260+0000 7f919a570640 1 Processor -- start 2024-05-17T04:09:20.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.260+0000 7f919a570640 1 -- start start 2024-05-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.261+0000 7f919a570640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f91940d13b0 0x7f91940d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.261+0000 7f919a570640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f919415e0e0 con 0x7f9194071d90 2024-05-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.261+0000 7f919a570640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f919415e3c0 con 0x7f919415db00 2024-05-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.261+0000 7f919a570640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f9194158010 con 0x7f91940d13b0 2024-05-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.261+0000 7f9193fff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f9194071d90 0x7f919415ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34582/0 (socket says 172.21.15.131:34582) 2024-05-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.261+0000 7f9193fff640 1 -- 172.21.15.131:0/3040731236 learned_addr learned my addr 172.21.15.131:0/3040731236 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.262+0000 7f9198b0d640 1 --2- 172.21.15.131:0/3040731236 >> v2:172.21.15.150:3300/0 conn(0x7f91940d13b0 0x7f91940d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.262+0000 7f9192ffd640 1 -- 172.21.15.131:0/3040731236 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2060833826 0 0) 0x7f919415e0e0 con 0x7f9194071d90 2024-05-17T04:09:20.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.262+0000 7f9192ffd640 1 -- 172.21.15.131:0/3040731236 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f917c003520 con 0x7f9194071d90 2024-05-17T04:09:20.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.262+0000 7f9198b0d640 1 -- 172.21.15.131:0/3040731236 >> v1:172.21.15.150:6789/0 conn(0x7f919415db00 legacy=0x7f91940cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.262+0000 7f9198b0d640 1 -- 172.21.15.131:0/3040731236 >> v1:172.21.15.131:6789/0 conn(0x7f9194071d90 legacy=0x7f919415ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.262+0000 7f9198b0d640 1 -- 172.21.15.131:0/3040731236 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919415e6a0 con 0x7f91940d13b0 2024-05-17T04:09:20.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.263+0000 7f9198b0d640 1 --2- 172.21.15.131:0/3040731236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91940d13b0 0x7f91940d17c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f918c009d90 tx=0x7f918c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e394d1ebf073ec26 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:20.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.263+0000 7f9192ffd640 1 -- 172.21.15.131:0/3040731236 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c007740 con 0x7f91940d13b0 2024-05-17T04:09:20.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.263+0000 7f9192ffd640 1 -- 172.21.15.131:0/3040731236 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918c0078e0 con 0x7f91940d13b0 2024-05-17T04:09:20.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.263+0000 7f9192ffd640 1 -- 172.21.15.131:0/3040731236 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c007c90 con 0x7f91940d13b0 2024-05-17T04:09:20.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.263+0000 7f919a570640 1 -- 172.21.15.131:0/3040731236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91940d13b0 msgr2=0x7f91940d17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.263+0000 7f919a570640 1 --2- 172.21.15.131:0/3040731236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91940d13b0 0x7f91940d17c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f918c009d90 tx=0x7f918c02a6f0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.263+0000 7f919a570640 1 -- 172.21.15.131:0/3040731236 shutdown_connections 2024-05-17T04:09:20.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.264+0000 7f919a570640 1 --2- 172.21.15.131:0/3040731236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91940d13b0 0x7f91940d17c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.264+0000 7f919a570640 1 -- 172.21.15.131:0/3040731236 >> 172.21.15.131:0/3040731236 conn(0x7f91940d2fd0 msgr2=0x7f91940d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:20.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.264+0000 7f919a570640 1 -- 172.21.15.131:0/3040731236 shutdown_connections 2024-05-17T04:09:20.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.264+0000 7f919a570640 1 -- 172.21.15.131:0/3040731236 wait complete. 2024-05-17T04:09:20.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.265+0000 7f919a570640 1 Processor -- start 2024-05-17T04:09:20.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.266+0000 7f919a570640 1 -- start start 2024-05-17T04:09:20.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f919a570640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9194071d90 0x7f9194155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f919a570640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91940d13b0 0x7f91941f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f919a570640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f919415db00 0x7f919414d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f919a570640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f91940d1d00 con 0x7f919415db00 2024-05-17T04:09:20.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f919a570640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f91940cdf10 con 0x7f91940d13b0 2024-05-17T04:09:20.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f919a570640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f91940d28d0 con 0x7f9194071d90 2024-05-17T04:09:20.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f9198b0d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f919415db00 0x7f919414d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f9198b0d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f919415db00 0x7f919414d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43378/0 (socket says 172.21.15.131:43378) 2024-05-17T04:09:20.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f9198b0d640 1 -- 172.21.15.131:0/518486400 learned_addr learned my addr 172.21.15.131:0/518486400 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:20.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f91937fe640 1 --2- 172.21.15.131:0/518486400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91940d13b0 0x7f91941f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f9193fff640 1 --2- 172.21.15.131:0/518486400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9194071d90 0x7f9194155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f9198b0d640 1 -- 172.21.15.131:0/518486400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9194071d90 msgr2=0x7f9194155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f9198b0d640 1 --2- 172.21.15.131:0/518486400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9194071d90 0x7f9194155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f9198b0d640 1 -- 172.21.15.131:0/518486400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91940d13b0 msgr2=0x7f91941f3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f9198b0d640 1 --2- 172.21.15.131:0/518486400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91940d13b0 0x7f91941f3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f9198b0d640 1 -- 172.21.15.131:0/518486400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91940c9e10 con 0x7f919415db00 2024-05-17T04:09:20.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.267+0000 7f9198b0d640 1 --2- 172.21.15.131:0/518486400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f919415db00 0x7f919414d460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f918c009d90 tx=0x7f918c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:20.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.268+0000 7f9190ff9640 1 -- 172.21.15.131:0/518486400 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c03f070 con 0x7f919415db00 2024-05-17T04:09:20.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.268+0000 7f9190ff9640 1 -- 172.21.15.131:0/518486400 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918c031c40 con 0x7f919415db00 2024-05-17T04:09:20.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.268+0000 7f919a570640 1 -- 172.21.15.131:0/518486400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919414d9a0 con 0x7f919415db00 2024-05-17T04:09:20.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.268+0000 7f9190ff9640 1 -- 172.21.15.131:0/518486400 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c009450 con 0x7f919415db00 2024-05-17T04:09:20.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.268+0000 7f919a570640 1 -- 172.21.15.131:0/518486400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91940c7a50 con 0x7f919415db00 2024-05-17T04:09:20.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.269+0000 7f919a570640 1 -- 172.21.15.131:0/518486400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91940d17c0 con 0x7f919415db00 2024-05-17T04:09:20.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.269+0000 7f9190ff9640 1 -- 172.21.15.131:0/518486400 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f918c003990 con 0x7f919415db00 2024-05-17T04:09:20.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.270+0000 7f9190ff9640 1 --2- 172.21.15.131:0/518486400 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9180076300 0x7f9180078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.270+0000 7f9190ff9640 1 -- 172.21.15.131:0/518486400 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f918c0b88f0 con 0x7f919415db00 2024-05-17T04:09:20.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.270+0000 7f9193fff640 1 --2- 172.21.15.131:0/518486400 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9180076300 0x7f9180078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.270+0000 7f9193fff640 1 --2- 172.21.15.131:0/518486400 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9180076300 0x7f9180078810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9184005880 tx=0x7f9184007cd0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:20.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.274+0000 7f9190ff9640 1 -- 172.21.15.131:0/518486400 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f918c081950 con 0x7f919415db00 2024-05-17T04:09:20.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.452+0000 7f919a570640 1 -- 172.21.15.131:0/518486400 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f91940b2710 con 0x7f9180076300 2024-05-17T04:09:20.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.458+0000 7f9190ff9640 1 -- 172.21.15.131:0/518486400 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332631 (secure 0 0 0) 0x7f91940b2710 con 0x7f9180076300 2024-05-17T04:09:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:20.465 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-05-17T04:09:20.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.462+0000 7f919a570640 1 -- 172.21.15.131:0/518486400 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9180076300 msgr2=0x7f9180078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.462+0000 7f919a570640 1 --2- 172.21.15.131:0/518486400 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9180076300 0x7f9180078810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9184005880 tx=0x7f9184007cd0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.462+0000 7f919a570640 1 -- 172.21.15.131:0/518486400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f919415db00 msgr2=0x7f919414d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.462+0000 7f919a570640 1 --2- 172.21.15.131:0/518486400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f919415db00 0x7f919414d460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f918c009d90 tx=0x7f918c004a40 comp rx=0 tx=0).stop 2024-05-17T04:09:20.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.462+0000 7f919a570640 1 -- 172.21.15.131:0/518486400 shutdown_connections 2024-05-17T04:09:20.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.462+0000 7f919a570640 1 --2- 172.21.15.131:0/518486400 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9180076300 0x7f9180078810 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.462+0000 7f919a570640 1 --2- 172.21.15.131:0/518486400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f919415db00 0x7f919414d460 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.462+0000 7f919a570640 1 --2- 172.21.15.131:0/518486400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91940d13b0 0x7f91941f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.462+0000 7f919a570640 1 --2- 172.21.15.131:0/518486400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9194071d90 0x7f9194155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.462+0000 7f919a570640 1 -- 172.21.15.131:0/518486400 >> 172.21.15.131:0/518486400 conn(0x7f91940d2fd0 msgr2=0x7f91940d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:20.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.462+0000 7f919a570640 1 -- 172.21.15.131:0/518486400 shutdown_connections 2024-05-17T04:09:20.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.462+0000 7f919a570640 1 -- 172.21.15.131:0/518486400 wait complete. 2024-05-17T04:09:20.475 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-05-17T04:09:18.710307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":308,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1987604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.310446"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608267+0000","last_change":"2024-05-17T04:09:05.395971+0000","last_active":"2024-05-17T04:09:11.608267+0000","last_peered":"2024-05-17T04:09:11.608267+0000","last_clean":"2024-05-17T04:09:11.608267+0000","last_became_active":"2024-05-17T04:09:05.395651+0000","last_became_peered":"2024-05-17T04:09:05.395651+0000","last_unstale":"2024-05-17T04:09:11.608267+0000","last_undegraded":"2024-05-17T04:09:11.608267+0000","last_fullsized":"2024-05-17T04:09:11.608267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:57:11.208612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608153+0000","last_change":"2024-05-17T04:09:06.397289+0000","last_active":"2024-05-17T04:09:11.608153+0000","last_peered":"2024-05-17T04:09:11.608153+0000","last_clean":"2024-05-17T04:09:11.608153+0000","last_became_active":"2024-05-17T04:09:06.396997+0000","last_became_peered":"2024-05-17T04:09:06.396997+0000","last_unstale":"2024-05-17T04:09:11.608153+0000","last_undegraded":"2024-05-17T04:09:11.608153+0000","last_fullsized":"2024-05-17T04:09:11.608153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607109+0000","last_change":"2024-05-17T04:09:10.610399+0000","last_active":"2024-05-17T04:09:11.607109+0000","last_peered":"2024-05-17T04:09:11.607109+0000","last_clean":"2024-05-17T04:09:11.607109+0000","last_became_active":"2024-05-17T04:09:10.609922+0000","last_became_peered":"2024-05-17T04:09:10.609922+0000","last_unstale":"2024-05-17T04:09:11.607109+0000","last_undegraded":"2024-05-17T04:09:11.607109+0000","last_fullsized":"2024-05-17T04:09:11.607109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:31:14.568941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608463+0000","last_change":"2024-05-17T04:09:05.395919+0000","last_active":"2024-05-17T04:09:11.608463+0000","last_peered":"2024-05-17T04:09:11.608463+0000","last_clean":"2024-05-17T04:09:11.608463+0000","last_became_active":"2024-05-17T04:09:05.395589+0000","last_became_peered":"2024-05-17T04:09:05.395589+0000","last_unstale":"2024-05-17T04:09:11.608463+0000","last_undegraded":"2024-05-17T04:09:11.608463+0000","last_fullsized":"2024-05-17T04:09:11.608463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:41:33.830645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607815+0000","last_change":"2024-05-17T04:09:06.414579+0000","last_active":"2024-05-17T04:09:11.607815+0000","last_peered":"2024-05-17T04:09:11.607815+0000","last_clean":"2024-05-17T04:09:11.607815+0000","last_became_active":"2024-05-17T04:09:06.414199+0000","last_became_peered":"2024-05-17T04:09:06.414199+0000","last_unstale":"2024-05-17T04:09:11.607815+0000","last_undegraded":"2024-05-17T04:09:11.607815+0000","last_fullsized":"2024-05-17T04:09:11.607815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424690+0000","last_change":"2024-05-17T04:09:10.422768+0000","last_active":"2024-05-17T04:09:11.424690+0000","last_peered":"2024-05-17T04:09:11.424690+0000","last_clean":"2024-05-17T04:09:11.424690+0000","last_became_active":"2024-05-17T04:09:10.422303+0000","last_became_peered":"2024-05-17T04:09:10.422303+0000","last_unstale":"2024-05-17T04:09:11.424690+0000","last_undegraded":"2024-05-17T04:09:11.424690+0000","last_fullsized":"2024-05-17T04:09:11.424690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:12.808010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608697+0000","last_change":"2024-05-17T04:09:05.398049+0000","last_active":"2024-05-17T04:09:11.608697+0000","last_peered":"2024-05-17T04:09:11.608697+0000","last_clean":"2024-05-17T04:09:11.608697+0000","last_became_active":"2024-05-17T04:09:05.397723+0000","last_became_peered":"2024-05-17T04:09:05.397723+0000","last_unstale":"2024-05-17T04:09:11.608697+0000","last_undegraded":"2024-05-17T04:09:11.608697+0000","last_fullsized":"2024-05-17T04:09:11.608697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:13:02.014037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426420+0000","last_change":"2024-05-17T04:09:06.410885+0000","last_active":"2024-05-17T04:09:11.426420+0000","last_peered":"2024-05-17T04:09:11.426420+0000","last_clean":"2024-05-17T04:09:11.426420+0000","last_became_active":"2024-05-17T04:09:06.410301+0000","last_became_peered":"2024-05-17T04:09:06.410301+0000","last_unstale":"2024-05-17T04:09:11.426420+0000","last_undegraded":"2024-05-17T04:09:11.426420+0000","last_fullsized":"2024-05-17T04:09:11.426420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:31.927628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425517+0000","last_change":"2024-05-17T04:09:10.424849+0000","last_active":"2024-05-17T04:09:11.425517+0000","last_peered":"2024-05-17T04:09:11.425517+0000","last_clean":"2024-05-17T04:09:11.425517+0000","last_became_active":"2024-05-17T04:09:10.423933+0000","last_became_peered":"2024-05-17T04:09:10.423933+0000","last_unstale":"2024-05-17T04:09:11.425517+0000","last_undegraded":"2024-05-17T04:09:11.425517+0000","last_fullsized":"2024-05-17T04:09:11.425517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:35.952081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608158+0000","last_change":"2024-05-17T04:09:05.398656+0000","last_active":"2024-05-17T04:09:11.608158+0000","last_peered":"2024-05-17T04:09:11.608158+0000","last_clean":"2024-05-17T04:09:11.608158+0000","last_became_active":"2024-05-17T04:09:05.398331+0000","last_became_peered":"2024-05-17T04:09:05.398331+0000","last_unstale":"2024-05-17T04:09:11.608158+0000","last_undegraded":"2024-05-17T04:09:11.608158+0000","last_fullsized":"2024-05-17T04:09:11.608158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426238+0000","last_change":"2024-05-17T04:09:06.406845+0000","last_active":"2024-05-17T04:09:11.426238+0000","last_peered":"2024-05-17T04:09:11.426238+0000","last_clean":"2024-05-17T04:09:11.426238+0000","last_became_active":"2024-05-17T04:09:06.406340+0000","last_became_peered":"2024-05-17T04:09:06.406340+0000","last_unstale":"2024-05-17T04:09:11.426238+0000","last_undegraded":"2024-05-17T04:09:11.426238+0000","last_fullsized":"2024-05-17T04:09:11.426238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:34.167127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425448+0000","last_change":"2024-05-17T04:09:10.422002+0000","last_active":"2024-05-17T04:09:11.425448+0000","last_peered":"2024-05-17T04:09:11.425448+0000","last_clean":"2024-05-17T04:09:11.425448+0000","last_became_active":"2024-05-17T04:09:10.421382+0000","last_became_peered":"2024-05-17T04:09:10.421382+0000","last_unstale":"2024-05-17T04:09:11.425448+0000","last_undegraded":"2024-05-17T04:09:11.425448+0000","last_fullsized":"2024-05-17T04:09:11.425448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:03:00.539137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607249+0000","last_change":"2024-05-17T04:09:06.405110+0000","last_active":"2024-05-17T04:09:11.607249+0000","last_peered":"2024-05-17T04:09:11.607249+0000","last_clean":"2024-05-17T04:09:11.607249+0000","last_became_active":"2024-05-17T04:09:06.404776+0000","last_became_peered":"2024-05-17T04:09:06.404776+0000","last_unstale":"2024-05-17T04:09:11.607249+0000","last_undegraded":"2024-05-17T04:09:11.607249+0000","last_fullsized":"2024-05-17T04:09:11.607249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608023+0000","last_change":"2024-05-17T04:09:05.399818+0000","last_active":"2024-05-17T04:09:11.608023+0000","last_peered":"2024-05-17T04:09:11.608023+0000","last_clean":"2024-05-17T04:09:11.608023+0000","last_became_active":"2024-05-17T04:09:05.399507+0000","last_became_peered":"2024-05-17T04:09:05.399507+0000","last_unstale":"2024-05-17T04:09:11.608023+0000","last_undegraded":"2024-05-17T04:09:11.608023+0000","last_fullsized":"2024-05-17T04:09:11.608023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:34.821170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426755+0000","last_change":"2024-05-17T04:09:10.420268+0000","last_active":"2024-05-17T04:09:11.426755+0000","last_peered":"2024-05-17T04:09:11.426755+0000","last_clean":"2024-05-17T04:09:11.426755+0000","last_became_active":"2024-05-17T04:09:10.419850+0000","last_became_peered":"2024-05-17T04:09:10.419850+0000","last_unstale":"2024-05-17T04:09:11.426755+0000","last_undegraded":"2024-05-17T04:09:11.426755+0000","last_fullsized":"2024-05-17T04:09:11.426755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:43.859624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608320+0000","last_change":"2024-05-17T04:09:06.395791+0000","last_active":"2024-05-17T04:09:11.608320+0000","last_peered":"2024-05-17T04:09:11.608320+0000","last_clean":"2024-05-17T04:09:11.608320+0000","last_became_active":"2024-05-17T04:09:06.395479+0000","last_became_peered":"2024-05-17T04:09:06.395479+0000","last_unstale":"2024-05-17T04:09:11.608320+0000","last_undegraded":"2024-05-17T04:09:11.608320+0000","last_fullsized":"2024-05-17T04:09:11.608320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515550+0000","last_change":"2024-05-17T04:09:05.396843+0000","last_active":"2024-05-17T04:09:11.515550+0000","last_peered":"2024-05-17T04:09:11.515550+0000","last_clean":"2024-05-17T04:09:11.515550+0000","last_became_active":"2024-05-17T04:09:05.396540+0000","last_became_peered":"2024-05-17T04:09:05.396540+0000","last_unstale":"2024-05-17T04:09:11.515550+0000","last_undegraded":"2024-05-17T04:09:11.515550+0000","last_fullsized":"2024-05-17T04:09:11.515550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:00.457470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425672+0000","last_change":"2024-05-17T04:09:10.423569+0000","last_active":"2024-05-17T04:09:11.425672+0000","last_peered":"2024-05-17T04:09:11.425672+0000","last_clean":"2024-05-17T04:09:11.425672+0000","last_became_active":"2024-05-17T04:09:10.423055+0000","last_became_peered":"2024-05-17T04:09:10.423055+0000","last_unstale":"2024-05-17T04:09:11.425672+0000","last_undegraded":"2024-05-17T04:09:11.425672+0000","last_fullsized":"2024-05-17T04:09:11.425672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:38.191579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607983+0000","last_change":"2024-05-17T04:09:06.402857+0000","last_active":"2024-05-17T04:09:11.607983+0000","last_peered":"2024-05-17T04:09:11.607983+0000","last_clean":"2024-05-17T04:09:11.607983+0000","last_became_active":"2024-05-17T04:09:06.402555+0000","last_became_peered":"2024-05-17T04:09:06.402555+0000","last_unstale":"2024-05-17T04:09:11.607983+0000","last_undegraded":"2024-05-17T04:09:11.607983+0000","last_fullsized":"2024-05-17T04:09:11.607983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514978+0000","last_change":"2024-05-17T04:09:05.395456+0000","last_active":"2024-05-17T04:09:11.514978+0000","last_peered":"2024-05-17T04:09:11.514978+0000","last_clean":"2024-05-17T04:09:11.514978+0000","last_became_active":"2024-05-17T04:09:05.394962+0000","last_became_peered":"2024-05-17T04:09:05.394962+0000","last_unstale":"2024-05-17T04:09:11.514978+0000","last_undegraded":"2024-05-17T04:09:11.514978+0000","last_fullsized":"2024-05-17T04:09:11.514978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515619+0000","last_change":"2024-05-17T04:09:10.611575+0000","last_active":"2024-05-17T04:09:11.515619+0000","last_peered":"2024-05-17T04:09:11.515619+0000","last_clean":"2024-05-17T04:09:11.515619+0000","last_became_active":"2024-05-17T04:09:10.610851+0000","last_became_peered":"2024-05-17T04:09:10.610851+0000","last_unstale":"2024-05-17T04:09:11.515619+0000","last_undegraded":"2024-05-17T04:09:11.515619+0000","last_fullsized":"2024-05-17T04:09:11.515619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:53:08.507830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425259+0000","last_change":"2024-05-17T04:09:06.394990+0000","last_active":"2024-05-17T04:09:11.425259+0000","last_peered":"2024-05-17T04:09:11.425259+0000","last_clean":"2024-05-17T04:09:11.425259+0000","last_became_active":"2024-05-17T04:09:06.394578+0000","last_became_peered":"2024-05-17T04:09:06.394578+0000","last_unstale":"2024-05-17T04:09:11.425259+0000","last_undegraded":"2024-05-17T04:09:11.425259+0000","last_fullsized":"2024-05-17T04:09:11.425259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:05.815923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607236+0000","last_change":"2024-05-17T04:09:05.403173+0000","last_active":"2024-05-17T04:09:11.607236+0000","last_peered":"2024-05-17T04:09:11.607236+0000","last_clean":"2024-05-17T04:09:11.607236+0000","last_became_active":"2024-05-17T04:09:05.402862+0000","last_became_peered":"2024-05-17T04:09:05.402862+0000","last_unstale":"2024-05-17T04:09:11.607236+0000","last_undegraded":"2024-05-17T04:09:11.607236+0000","last_fullsized":"2024-05-17T04:09:11.607236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:00.457470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425484+0000","last_change":"2024-05-17T04:09:10.424841+0000","last_active":"2024-05-17T04:09:11.425484+0000","last_peered":"2024-05-17T04:09:11.425484+0000","last_clean":"2024-05-17T04:09:11.425484+0000","last_became_active":"2024-05-17T04:09:10.423871+0000","last_became_peered":"2024-05-17T04:09:10.423871+0000","last_unstale":"2024-05-17T04:09:11.425484+0000","last_undegraded":"2024-05-17T04:09:11.425484+0000","last_fullsized":"2024-05-17T04:09:11.425484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:46.008630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608200+0000","last_change":"2024-05-17T04:09:06.397726+0000","last_active":"2024-05-17T04:09:11.608200+0000","last_peered":"2024-05-17T04:09:11.608200+0000","last_clean":"2024-05-17T04:09:11.608200+0000","last_became_active":"2024-05-17T04:09:06.396138+0000","last_became_peered":"2024-05-17T04:09:06.396138+0000","last_unstale":"2024-05-17T04:09:11.608200+0000","last_undegraded":"2024-05-17T04:09:11.608200+0000","last_fullsized":"2024-05-17T04:09:11.608200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608451+0000","last_change":"2024-05-17T04:09:05.395429+0000","last_active":"2024-05-17T04:09:11.608451+0000","last_peered":"2024-05-17T04:09:11.608451+0000","last_clean":"2024-05-17T04:09:11.608451+0000","last_became_active":"2024-05-17T04:09:05.394265+0000","last_became_peered":"2024-05-17T04:09:05.394265+0000","last_unstale":"2024-05-17T04:09:11.608451+0000","last_undegraded":"2024-05-17T04:09:11.608451+0000","last_fullsized":"2024-05-17T04:09:11.608451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425112+0000","last_change":"2024-05-17T04:09:10.608056+0000","last_active":"2024-05-17T04:09:11.425112+0000","last_peered":"2024-05-17T04:09:11.425112+0000","last_clean":"2024-05-17T04:09:11.425112+0000","last_became_active":"2024-05-17T04:09:10.607528+0000","last_became_peered":"2024-05-17T04:09:10.607528+0000","last_unstale":"2024-05-17T04:09:11.425112+0000","last_undegraded":"2024-05-17T04:09:11.425112+0000","last_fullsized":"2024-05-17T04:09:11.425112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:13.074744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607552+0000","last_change":"2024-05-17T04:09:06.403004+0000","last_active":"2024-05-17T04:09:11.607552+0000","last_peered":"2024-05-17T04:09:11.607552+0000","last_clean":"2024-05-17T04:09:11.607552+0000","last_became_active":"2024-05-17T04:09:06.402507+0000","last_became_peered":"2024-05-17T04:09:06.402507+0000","last_unstale":"2024-05-17T04:09:11.607552+0000","last_undegraded":"2024-05-17T04:09:11.607552+0000","last_fullsized":"2024-05-17T04:09:11.607552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:41.984177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515570+0000","last_change":"2024-05-17T04:09:05.399350+0000","last_active":"2024-05-17T04:09:11.515570+0000","last_peered":"2024-05-17T04:09:11.515570+0000","last_clean":"2024-05-17T04:09:11.515570+0000","last_became_active":"2024-05-17T04:09:05.399049+0000","last_became_peered":"2024-05-17T04:09:05.399049+0000","last_unstale":"2024-05-17T04:09:11.515570+0000","last_undegraded":"2024-05-17T04:09:11.515570+0000","last_fullsized":"2024-05-17T04:09:11.515570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607786+0000","last_change":"2024-05-17T04:09:10.611499+0000","last_active":"2024-05-17T04:09:11.607786+0000","last_peered":"2024-05-17T04:09:11.607786+0000","last_clean":"2024-05-17T04:09:11.607786+0000","last_became_active":"2024-05-17T04:09:10.611068+0000","last_became_peered":"2024-05-17T04:09:10.611068+0000","last_unstale":"2024-05-17T04:09:11.607786+0000","last_undegraded":"2024-05-17T04:09:11.607786+0000","last_fullsized":"2024-05-17T04:09:11.607786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:32:16.388318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515650+0000","last_change":"2024-05-17T04:09:06.399281+0000","last_active":"2024-05-17T04:09:11.515650+0000","last_peered":"2024-05-17T04:09:11.515650+0000","last_clean":"2024-05-17T04:09:11.515650+0000","last_became_active":"2024-05-17T04:09:06.398973+0000","last_became_peered":"2024-05-17T04:09:06.398973+0000","last_unstale":"2024-05-17T04:09:11.515650+0000","last_undegraded":"2024-05-17T04:09:11.515650+0000","last_fullsized":"2024-05-17T04:09:11.515650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608834+0000","last_change":"2024-05-17T04:09:05.402787+0000","last_active":"2024-05-17T04:09:11.608834+0000","last_peered":"2024-05-17T04:09:11.608834+0000","last_clean":"2024-05-17T04:09:11.608834+0000","last_became_active":"2024-05-17T04:09:05.402451+0000","last_became_peered":"2024-05-17T04:09:05.402451+0000","last_unstale":"2024-05-17T04:09:11.608834+0000","last_undegraded":"2024-05-17T04:09:11.608834+0000","last_fullsized":"2024-05-17T04:09:11.608834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607456+0000","last_change":"2024-05-17T04:09:10.608220+0000","last_active":"2024-05-17T04:09:11.607456+0000","last_peered":"2024-05-17T04:09:11.607456+0000","last_clean":"2024-05-17T04:09:11.607456+0000","last_became_active":"2024-05-17T04:09:10.607719+0000","last_became_peered":"2024-05-17T04:09:10.607719+0000","last_unstale":"2024-05-17T04:09:11.607456+0000","last_undegraded":"2024-05-17T04:09:11.607456+0000","last_fullsized":"2024-05-17T04:09:11.607456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:53:08.507830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426361+0000","last_change":"2024-05-17T04:09:06.406634+0000","last_active":"2024-05-17T04:09:11.426361+0000","last_peered":"2024-05-17T04:09:11.426361+0000","last_clean":"2024-05-17T04:09:11.426361+0000","last_became_active":"2024-05-17T04:09:06.406011+0000","last_became_peered":"2024-05-17T04:09:06.406011+0000","last_unstale":"2024-05-17T04:09:11.426361+0000","last_undegraded":"2024-05-17T04:09:11.426361+0000","last_fullsized":"2024-05-17T04:09:11.426361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:49.079670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515733+0000","last_change":"2024-05-17T04:09:05.395393+0000","last_active":"2024-05-17T04:09:11.515733+0000","last_peered":"2024-05-17T04:09:11.515733+0000","last_clean":"2024-05-17T04:09:11.515733+0000","last_became_active":"2024-05-17T04:09:05.395026+0000","last_became_peered":"2024-05-17T04:09:05.395026+0000","last_unstale":"2024-05-17T04:09:11.515733+0000","last_undegraded":"2024-05-17T04:09:11.515733+0000","last_fullsized":"2024-05-17T04:09:11.515733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514970+0000","last_change":"2024-05-17T04:09:10.426127+0000","last_active":"2024-05-17T04:09:11.514970+0000","last_peered":"2024-05-17T04:09:11.514970+0000","last_clean":"2024-05-17T04:09:11.514970+0000","last_became_active":"2024-05-17T04:09:10.425310+0000","last_became_peered":"2024-05-17T04:09:10.425310+0000","last_unstale":"2024-05-17T04:09:11.514970+0000","last_undegraded":"2024-05-17T04:09:11.514970+0000","last_fullsized":"2024-05-17T04:09:11.514970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:05:01.660626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426527+0000","last_change":"2024-05-17T04:09:06.396617+0000","last_active":"2024-05-17T04:09:11.426527+0000","last_peered":"2024-05-17T04:09:11.426527+0000","last_clean":"2024-05-17T04:09:11.426527+0000","last_became_active":"2024-05-17T04:09:06.396314+0000","last_became_peered":"2024-05-17T04:09:06.396314+0000","last_unstale":"2024-05-17T04:09:11.426527+0000","last_undegraded":"2024-05-17T04:09:11.426527+0000","last_fullsized":"2024-05-17T04:09:11.426527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:07.188086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425216+0000","last_change":"2024-05-17T04:09:05.394393+0000","last_active":"2024-05-17T04:09:11.425216+0000","last_peered":"2024-05-17T04:09:11.425216+0000","last_clean":"2024-05-17T04:09:11.425216+0000","last_became_active":"2024-05-17T04:09:05.393756+0000","last_became_peered":"2024-05-17T04:09:05.393756+0000","last_unstale":"2024-05-17T04:09:11.425216+0000","last_undegraded":"2024-05-17T04:09:11.425216+0000","last_fullsized":"2024-05-17T04:09:11.425216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515309+0000","last_change":"2024-05-17T04:09:10.419986+0000","last_active":"2024-05-17T04:09:11.515309+0000","last_peered":"2024-05-17T04:09:11.515309+0000","last_clean":"2024-05-17T04:09:11.515309+0000","last_became_active":"2024-05-17T04:09:10.419116+0000","last_became_peered":"2024-05-17T04:09:10.419116+0000","last_unstale":"2024-05-17T04:09:11.515309+0000","last_undegraded":"2024-05-17T04:09:11.515309+0000","last_fullsized":"2024-05-17T04:09:11.515309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:28.367001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514954+0000","last_change":"2024-05-17T04:09:06.407059+0000","last_active":"2024-05-17T04:09:11.514954+0000","last_peered":"2024-05-17T04:09:11.514954+0000","last_clean":"2024-05-17T04:09:11.514954+0000","last_became_active":"2024-05-17T04:09:06.406752+0000","last_became_peered":"2024-05-17T04:09:06.406752+0000","last_unstale":"2024-05-17T04:09:11.514954+0000","last_undegraded":"2024-05-17T04:09:11.514954+0000","last_fullsized":"2024-05-17T04:09:11.514954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.423948+0000","last_change":"2024-05-17T04:09:05.390296+0000","last_active":"2024-05-17T04:09:11.423948+0000","last_peered":"2024-05-17T04:09:11.423948+0000","last_clean":"2024-05-17T04:09:11.423948+0000","last_became_active":"2024-05-17T04:09:05.389917+0000","last_became_peered":"2024-05-17T04:09:05.389917+0000","last_unstale":"2024-05-17T04:09:11.423948+0000","last_undegraded":"2024-05-17T04:09:11.423948+0000","last_fullsized":"2024-05-17T04:09:11.423948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515762+0000","last_change":"2024-05-17T04:09:10.429919+0000","last_active":"2024-05-17T04:09:11.515762+0000","last_peered":"2024-05-17T04:09:11.515762+0000","last_clean":"2024-05-17T04:09:11.515762+0000","last_became_active":"2024-05-17T04:09:10.429394+0000","last_became_peered":"2024-05-17T04:09:10.429394+0000","last_unstale":"2024-05-17T04:09:11.515762+0000","last_undegraded":"2024-05-17T04:09:11.515762+0000","last_fullsized":"2024-05-17T04:09:11.515762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:44.081339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.606952+0000","last_change":"2024-05-17T04:09:06.403836+0000","last_active":"2024-05-17T04:09:11.606952+0000","last_peered":"2024-05-17T04:09:11.606952+0000","last_clean":"2024-05-17T04:09:11.606952+0000","last_became_active":"2024-05-17T04:09:06.403514+0000","last_became_peered":"2024-05-17T04:09:06.403514+0000","last_unstale":"2024-05-17T04:09:11.606952+0000","last_undegraded":"2024-05-17T04:09:11.606952+0000","last_fullsized":"2024-05-17T04:09:11.606952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:01:05.018624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607372+0000","last_change":"2024-05-17T04:09:05.401167+0000","last_active":"2024-05-17T04:09:11.607372+0000","last_peered":"2024-05-17T04:09:11.607372+0000","last_clean":"2024-05-17T04:09:11.607372+0000","last_became_active":"2024-05-17T04:09:05.400797+0000","last_became_peered":"2024-05-17T04:09:05.400797+0000","last_unstale":"2024-05-17T04:09:11.607372+0000","last_undegraded":"2024-05-17T04:09:11.607372+0000","last_fullsized":"2024-05-17T04:09:11.607372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:23:01.826205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607778+0000","last_change":"2024-05-17T04:09:10.607420+0000","last_active":"2024-05-17T04:09:11.607778+0000","last_peered":"2024-05-17T04:09:11.607778+0000","last_clean":"2024-05-17T04:09:11.607778+0000","last_became_active":"2024-05-17T04:09:10.606963+0000","last_became_peered":"2024-05-17T04:09:10.606963+0000","last_unstale":"2024-05-17T04:09:11.607778+0000","last_undegraded":"2024-05-17T04:09:11.607778+0000","last_fullsized":"2024-05-17T04:09:11.607778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:28.367001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607186+0000","last_change":"2024-05-17T04:09:06.414099+0000","last_active":"2024-05-17T04:09:11.607186+0000","last_peered":"2024-05-17T04:09:11.607186+0000","last_clean":"2024-05-17T04:09:11.607186+0000","last_became_active":"2024-05-17T04:09:06.413727+0000","last_became_peered":"2024-05-17T04:09:06.413727+0000","last_unstale":"2024-05-17T04:09:11.607186+0000","last_undegraded":"2024-05-17T04:09:11.607186+0000","last_fullsized":"2024-05-17T04:09:11.607186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424782+0000","last_change":"2024-05-17T04:09:05.395595+0000","last_active":"2024-05-17T04:09:11.424782+0000","last_peered":"2024-05-17T04:09:11.424782+0000","last_clean":"2024-05-17T04:09:11.424782+0000","last_became_active":"2024-05-17T04:09:05.395288+0000","last_became_peered":"2024-05-17T04:09:05.395288+0000","last_unstale":"2024-05-17T04:09:11.424782+0000","last_undegraded":"2024-05-17T04:09:11.424782+0000","last_fullsized":"2024-05-17T04:09:11.424782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607476+0000","last_change":"2024-05-17T04:08:56.447797+0000","last_active":"2024-05-17T04:09:11.607476+0000","last_peered":"2024-05-17T04:09:11.607476+0000","last_clean":"2024-05-17T04:09:11.607476+0000","last_became_active":"2024-05-17T04:08:56.446705+0000","last_became_peered":"2024-05-17T04:08:56.446705+0000","last_unstale":"2024-05-17T04:09:11.607476+0000","last_undegraded":"2024-05-17T04:09:11.607476+0000","last_fullsized":"2024-05-17T04:09:11.607476+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_clean_scrub_stamp":"2024-05-17T04:08:54.847367+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:40:00.515431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608157+0000","last_change":"2024-05-17T04:09:10.608442+0000","last_active":"2024-05-17T04:09:11.608157+0000","last_peered":"2024-05-17T04:09:11.608157+0000","last_clean":"2024-05-17T04:09:11.608157+0000","last_became_active":"2024-05-17T04:09:10.607993+0000","last_became_peered":"2024-05-17T04:09:10.607993+0000","last_unstale":"2024-05-17T04:09:11.608157+0000","last_undegraded":"2024-05-17T04:09:11.608157+0000","last_fullsized":"2024-05-17T04:09:11.608157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:53.104122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608435+0000","last_change":"2024-05-17T04:09:06.414021+0000","last_active":"2024-05-17T04:09:11.608435+0000","last_peered":"2024-05-17T04:09:11.608435+0000","last_clean":"2024-05-17T04:09:11.608435+0000","last_became_active":"2024-05-17T04:09:06.413481+0000","last_became_peered":"2024-05-17T04:09:06.413481+0000","last_unstale":"2024-05-17T04:09:11.608435+0000","last_undegraded":"2024-05-17T04:09:11.608435+0000","last_fullsized":"2024-05-17T04:09:11.608435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:31.927628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424257+0000","last_change":"2024-05-17T04:09:05.394878+0000","last_active":"2024-05-17T04:09:11.424257+0000","last_peered":"2024-05-17T04:09:11.424257+0000","last_clean":"2024-05-17T04:09:11.424257+0000","last_became_active":"2024-05-17T04:09:05.394529+0000","last_became_peered":"2024-05-17T04:09:05.394529+0000","last_unstale":"2024-05-17T04:09:11.424257+0000","last_undegraded":"2024-05-17T04:09:11.424257+0000","last_fullsized":"2024-05-17T04:09:11.424257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:41:33.830645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607795+0000","last_change":"2024-05-17T04:09:10.607640+0000","last_active":"2024-05-17T04:09:11.607795+0000","last_peered":"2024-05-17T04:09:11.607795+0000","last_clean":"2024-05-17T04:09:11.607795+0000","last_became_active":"2024-05-17T04:09:10.607137+0000","last_became_peered":"2024-05-17T04:09:10.607137+0000","last_unstale":"2024-05-17T04:09:11.607795+0000","last_undegraded":"2024-05-17T04:09:11.607795+0000","last_fullsized":"2024-05-17T04:09:11.607795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:35.952081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426630+0000","last_change":"2024-05-17T04:09:06.399777+0000","last_active":"2024-05-17T04:09:11.426630+0000","last_peered":"2024-05-17T04:09:11.426630+0000","last_clean":"2024-05-17T04:09:11.426630+0000","last_became_active":"2024-05-17T04:09:06.399443+0000","last_became_peered":"2024-05-17T04:09:06.399443+0000","last_unstale":"2024-05-17T04:09:11.426630+0000","last_undegraded":"2024-05-17T04:09:11.426630+0000","last_fullsized":"2024-05-17T04:09:11.426630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:39.835171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515423+0000","last_change":"2024-05-17T04:09:05.397664+0000","last_active":"2024-05-17T04:09:11.515423+0000","last_peered":"2024-05-17T04:09:11.515423+0000","last_clean":"2024-05-17T04:09:11.515423+0000","last_became_active":"2024-05-17T04:09:05.397386+0000","last_became_peered":"2024-05-17T04:09:05.397386+0000","last_unstale":"2024-05-17T04:09:11.515423+0000","last_undegraded":"2024-05-17T04:09:11.515423+0000","last_fullsized":"2024-05-17T04:09:11.515423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607683+0000","last_change":"2024-05-17T04:09:10.424457+0000","last_active":"2024-05-17T04:09:11.607683+0000","last_peered":"2024-05-17T04:09:11.607683+0000","last_clean":"2024-05-17T04:09:11.607683+0000","last_became_active":"2024-05-17T04:09:10.423487+0000","last_became_peered":"2024-05-17T04:09:10.423487+0000","last_unstale":"2024-05-17T04:09:11.607683+0000","last_undegraded":"2024-05-17T04:09:11.607683+0000","last_fullsized":"2024-05-17T04:09:11.607683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:14.612103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.609012+0000","last_change":"2024-05-17T04:09:06.411544+0000","last_active":"2024-05-17T04:09:11.609012+0000","last_peered":"2024-05-17T04:09:11.609012+0000","last_clean":"2024-05-17T04:09:11.609012+0000","last_became_active":"2024-05-17T04:09:06.411193+0000","last_became_peered":"2024-05-17T04:09:06.411193+0000","last_unstale":"2024-05-17T04:09:11.609012+0000","last_undegraded":"2024-05-17T04:09:11.609012+0000","last_fullsized":"2024-05-17T04:09:11.609012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:40.056886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424170+0000","last_change":"2024-05-17T04:09:05.390395+0000","last_active":"2024-05-17T04:09:11.424170+0000","last_peered":"2024-05-17T04:09:11.424170+0000","last_clean":"2024-05-17T04:09:11.424170+0000","last_became_active":"2024-05-17T04:09:05.389769+0000","last_became_peered":"2024-05-17T04:09:05.389769+0000","last_unstale":"2024-05-17T04:09:11.424170+0000","last_undegraded":"2024-05-17T04:09:11.424170+0000","last_fullsized":"2024-05-17T04:09:11.424170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424395+0000","last_change":"2024-05-17T04:09:10.610765+0000","last_active":"2024-05-17T04:09:11.424395+0000","last_peered":"2024-05-17T04:09:11.424395+0000","last_clean":"2024-05-17T04:09:11.424395+0000","last_became_active":"2024-05-17T04:09:10.610286+0000","last_became_peered":"2024-05-17T04:09:10.610286+0000","last_unstale":"2024-05-17T04:09:11.424395+0000","last_undegraded":"2024-05-17T04:09:11.424395+0000","last_fullsized":"2024-05-17T04:09:11.424395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:31:14.568941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608756+0000","last_change":"2024-05-17T04:09:06.408406+0000","last_active":"2024-05-17T04:09:11.608756+0000","last_peered":"2024-05-17T04:09:11.608756+0000","last_clean":"2024-05-17T04:09:11.608756+0000","last_became_active":"2024-05-17T04:09:06.405343+0000","last_became_peered":"2024-05-17T04:09:06.405343+0000","last_unstale":"2024-05-17T04:09:11.608756+0000","last_undegraded":"2024-05-17T04:09:11.608756+0000","last_fullsized":"2024-05-17T04:09:11.608756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:49.079670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426903+0000","last_change":"2024-05-17T04:09:05.396149+0000","last_active":"2024-05-17T04:09:11.426903+0000","last_peered":"2024-05-17T04:09:11.426903+0000","last_clean":"2024-05-17T04:09:11.426903+0000","last_became_active":"2024-05-17T04:09:05.395640+0000","last_became_peered":"2024-05-17T04:09:05.395640+0000","last_unstale":"2024-05-17T04:09:11.426903+0000","last_undegraded":"2024-05-17T04:09:11.426903+0000","last_fullsized":"2024-05-17T04:09:11.426903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:36:25.869388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424730+0000","last_change":"2024-05-17T04:09:10.420386+0000","last_active":"2024-05-17T04:09:11.424730+0000","last_peered":"2024-05-17T04:09:11.424730+0000","last_clean":"2024-05-17T04:09:11.424730+0000","last_became_active":"2024-05-17T04:09:10.419914+0000","last_became_peered":"2024-05-17T04:09:10.419914+0000","last_unstale":"2024-05-17T04:09:11.424730+0000","last_undegraded":"2024-05-17T04:09:11.424730+0000","last_fullsized":"2024-05-17T04:09:11.424730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:06.408047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607581+0000","last_change":"2024-05-17T04:09:06.408118+0000","last_active":"2024-05-17T04:09:11.607581+0000","last_peered":"2024-05-17T04:09:11.607581+0000","last_clean":"2024-05-17T04:09:11.607581+0000","last_became_active":"2024-05-17T04:09:06.406680+0000","last_became_peered":"2024-05-17T04:09:06.406680+0000","last_unstale":"2024-05-17T04:09:11.607581+0000","last_undegraded":"2024-05-17T04:09:11.607581+0000","last_fullsized":"2024-05-17T04:09:11.607581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:34.167127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.423794+0000","last_change":"2024-05-17T04:09:05.397048+0000","last_active":"2024-05-17T04:09:11.423794+0000","last_peered":"2024-05-17T04:09:11.423794+0000","last_clean":"2024-05-17T04:09:11.423794+0000","last_became_active":"2024-05-17T04:09:05.396745+0000","last_became_peered":"2024-05-17T04:09:05.396745+0000","last_unstale":"2024-05-17T04:09:11.423794+0000","last_undegraded":"2024-05-17T04:09:11.423794+0000","last_fullsized":"2024-05-17T04:09:11.423794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607578+0000","last_change":"2024-05-17T04:09:10.427098+0000","last_active":"2024-05-17T04:09:11.607578+0000","last_peered":"2024-05-17T04:09:11.607578+0000","last_clean":"2024-05-17T04:09:11.607578+0000","last_became_active":"2024-05-17T04:09:10.426559+0000","last_became_peered":"2024-05-17T04:09:10.426559+0000","last_unstale":"2024-05-17T04:09:11.607578+0000","last_undegraded":"2024-05-17T04:09:11.607578+0000","last_fullsized":"2024-05-17T04:09:11.607578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:44.081339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607896+0000","last_change":"2024-05-17T04:09:06.394018+0000","last_active":"2024-05-17T04:09:11.607896+0000","last_peered":"2024-05-17T04:09:11.607896+0000","last_clean":"2024-05-17T04:09:11.607896+0000","last_became_active":"2024-05-17T04:09:06.393664+0000","last_became_peered":"2024-05-17T04:09:06.393664+0000","last_unstale":"2024-05-17T04:09:11.607896+0000","last_undegraded":"2024-05-17T04:09:11.607896+0000","last_fullsized":"2024-05-17T04:09:11.607896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:07:56.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607640+0000","last_change":"2024-05-17T04:09:05.395140+0000","last_active":"2024-05-17T04:09:11.607640+0000","last_peered":"2024-05-17T04:09:11.607640+0000","last_clean":"2024-05-17T04:09:11.607640+0000","last_became_active":"2024-05-17T04:09:05.394556+0000","last_became_peered":"2024-05-17T04:09:05.394556+0000","last_unstale":"2024-05-17T04:09:11.607640+0000","last_undegraded":"2024-05-17T04:09:11.607640+0000","last_fullsized":"2024-05-17T04:09:11.607640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607361+0000","last_change":"2024-05-17T04:09:10.608635+0000","last_active":"2024-05-17T04:09:11.607361+0000","last_peered":"2024-05-17T04:09:11.607361+0000","last_clean":"2024-05-17T04:09:11.607361+0000","last_became_active":"2024-05-17T04:09:10.608151+0000","last_became_peered":"2024-05-17T04:09:10.608151+0000","last_unstale":"2024-05-17T04:09:11.607361+0000","last_undegraded":"2024-05-17T04:09:11.607361+0000","last_fullsized":"2024-05-17T04:09:11.607361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:32:44.289047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607892+0000","last_change":"2024-05-17T04:09:06.407790+0000","last_active":"2024-05-17T04:09:11.607892+0000","last_peered":"2024-05-17T04:09:11.607892+0000","last_clean":"2024-05-17T04:09:11.607892+0000","last_became_active":"2024-05-17T04:09:06.407484+0000","last_became_peered":"2024-05-17T04:09:06.407484+0000","last_unstale":"2024-05-17T04:09:11.607892+0000","last_undegraded":"2024-05-17T04:09:11.607892+0000","last_fullsized":"2024-05-17T04:09:11.607892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:39.835171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425090+0000","last_change":"2024-05-17T04:09:05.393381+0000","last_active":"2024-05-17T04:09:11.425090+0000","last_peered":"2024-05-17T04:09:11.425090+0000","last_clean":"2024-05-17T04:09:11.425090+0000","last_became_active":"2024-05-17T04:09:05.392480+0000","last_became_peered":"2024-05-17T04:09:05.392480+0000","last_unstale":"2024-05-17T04:09:11.425090+0000","last_undegraded":"2024-05-17T04:09:11.425090+0000","last_fullsized":"2024-05-17T04:09:11.425090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608339+0000","last_change":"2024-05-17T04:09:10.607929+0000","last_active":"2024-05-17T04:09:11.608339+0000","last_peered":"2024-05-17T04:09:11.608339+0000","last_clean":"2024-05-17T04:09:11.608339+0000","last_became_active":"2024-05-17T04:09:10.606975+0000","last_became_peered":"2024-05-17T04:09:10.606975+0000","last_unstale":"2024-05-17T04:09:11.608339+0000","last_undegraded":"2024-05-17T04:09:11.608339+0000","last_fullsized":"2024-05-17T04:09:11.608339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:36:14.040927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607173+0000","last_change":"2024-05-17T04:09:06.399704+0000","last_active":"2024-05-17T04:09:11.607173+0000","last_peered":"2024-05-17T04:09:11.607173+0000","last_clean":"2024-05-17T04:09:11.607173+0000","last_became_active":"2024-05-17T04:09:06.399395+0000","last_became_peered":"2024-05-17T04:09:06.399395+0000","last_unstale":"2024-05-17T04:09:11.607173+0000","last_undegraded":"2024-05-17T04:09:11.607173+0000","last_fullsized":"2024-05-17T04:09:11.607173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:33:02.204060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608048+0000","last_change":"2024-05-17T04:09:05.394133+0000","last_active":"2024-05-17T04:09:11.608048+0000","last_peered":"2024-05-17T04:09:11.608048+0000","last_clean":"2024-05-17T04:09:11.608048+0000","last_became_active":"2024-05-17T04:09:05.393854+0000","last_became_peered":"2024-05-17T04:09:05.393854+0000","last_unstale":"2024-05-17T04:09:11.608048+0000","last_undegraded":"2024-05-17T04:09:11.608048+0000","last_fullsized":"2024-05-17T04:09:11.608048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:41:33.830645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426113+0000","last_change":"2024-05-17T04:09:10.607826+0000","last_active":"2024-05-17T04:09:11.426113+0000","last_peered":"2024-05-17T04:09:11.426113+0000","last_clean":"2024-05-17T04:09:11.426113+0000","last_became_active":"2024-05-17T04:09:10.607382+0000","last_became_peered":"2024-05-17T04:09:10.607382+0000","last_unstale":"2024-05-17T04:09:11.426113+0000","last_undegraded":"2024-05-17T04:09:11.426113+0000","last_fullsized":"2024-05-17T04:09:11.426113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:55:48.002918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608335+0000","last_change":"2024-05-17T04:09:06.403425+0000","last_active":"2024-05-17T04:09:11.608335+0000","last_peered":"2024-05-17T04:09:11.608335+0000","last_clean":"2024-05-17T04:09:11.608335+0000","last_became_active":"2024-05-17T04:09:06.403093+0000","last_became_peered":"2024-05-17T04:09:06.403093+0000","last_unstale":"2024-05-17T04:09:11.608335+0000","last_undegraded":"2024-05-17T04:09:11.608335+0000","last_fullsized":"2024-05-17T04:09:11.608335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:41.984177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608629+0000","last_change":"2024-05-17T04:09:05.393968+0000","last_active":"2024-05-17T04:09:11.608629+0000","last_peered":"2024-05-17T04:09:11.608629+0000","last_clean":"2024-05-17T04:09:11.608629+0000","last_became_active":"2024-05-17T04:09:05.393641+0000","last_became_peered":"2024-05-17T04:09:05.393641+0000","last_unstale":"2024-05-17T04:09:11.608629+0000","last_undegraded":"2024-05-17T04:09:11.608629+0000","last_fullsized":"2024-05-17T04:09:11.608629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515095+0000","last_change":"2024-05-17T04:09:10.424091+0000","last_active":"2024-05-17T04:09:11.515095+0000","last_peered":"2024-05-17T04:09:11.515095+0000","last_clean":"2024-05-17T04:09:11.515095+0000","last_became_active":"2024-05-17T04:09:10.423669+0000","last_became_peered":"2024-05-17T04:09:10.423669+0000","last_unstale":"2024-05-17T04:09:11.515095+0000","last_undegraded":"2024-05-17T04:09:11.515095+0000","last_fullsized":"2024-05-17T04:09:11.515095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:14.612103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425973+0000","last_change":"2024-05-17T04:09:06.395242+0000","last_active":"2024-05-17T04:09:11.425973+0000","last_peered":"2024-05-17T04:09:11.425973+0000","last_clean":"2024-05-17T04:09:11.425973+0000","last_became_active":"2024-05-17T04:09:06.394956+0000","last_became_peered":"2024-05-17T04:09:06.394956+0000","last_unstale":"2024-05-17T04:09:11.425973+0000","last_undegraded":"2024-05-17T04:09:11.425973+0000","last_fullsized":"2024-05-17T04:09:11.425973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:35.828470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515417+0000","last_change":"2024-05-17T04:09:05.395871+0000","last_active":"2024-05-17T04:09:11.515417+0000","last_peered":"2024-05-17T04:09:11.515417+0000","last_clean":"2024-05-17T04:09:11.515417+0000","last_became_active":"2024-05-17T04:09:05.395565+0000","last_became_peered":"2024-05-17T04:09:05.395565+0000","last_unstale":"2024-05-17T04:09:11.515417+0000","last_undegraded":"2024-05-17T04:09:11.515417+0000","last_fullsized":"2024-05-17T04:09:11.515417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:34.821170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425594+0000","last_change":"2024-05-17T04:09:10.422395+0000","last_active":"2024-05-17T04:09:11.425594+0000","last_peered":"2024-05-17T04:09:11.425594+0000","last_clean":"2024-05-17T04:09:11.425594+0000","last_became_active":"2024-05-17T04:09:10.421563+0000","last_became_peered":"2024-05-17T04:09:10.421563+0000","last_unstale":"2024-05-17T04:09:11.425594+0000","last_undegraded":"2024-05-17T04:09:11.425594+0000","last_fullsized":"2024-05-17T04:09:11.425594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:53.104122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608163+0000","last_change":"2024-05-17T04:09:06.407304+0000","last_active":"2024-05-17T04:09:11.608163+0000","last_peered":"2024-05-17T04:09:11.608163+0000","last_clean":"2024-05-17T04:09:11.608163+0000","last_became_active":"2024-05-17T04:09:06.406969+0000","last_became_peered":"2024-05-17T04:09:06.406969+0000","last_unstale":"2024-05-17T04:09:11.608163+0000","last_undegraded":"2024-05-17T04:09:11.608163+0000","last_fullsized":"2024-05-17T04:09:11.608163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426091+0000","last_change":"2024-05-17T04:09:05.396508+0000","last_active":"2024-05-17T04:09:11.426091+0000","last_peered":"2024-05-17T04:09:11.426091+0000","last_clean":"2024-05-17T04:09:11.426091+0000","last_became_active":"2024-05-17T04:09:05.396175+0000","last_became_peered":"2024-05-17T04:09:05.396175+0000","last_unstale":"2024-05-17T04:09:11.426091+0000","last_undegraded":"2024-05-17T04:09:11.426091+0000","last_fullsized":"2024-05-17T04:09:11.426091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607951+0000","last_change":"2024-05-17T04:09:10.426973+0000","last_active":"2024-05-17T04:09:11.607951+0000","last_peered":"2024-05-17T04:09:11.607951+0000","last_clean":"2024-05-17T04:09:11.607951+0000","last_became_active":"2024-05-17T04:09:10.426412+0000","last_became_peered":"2024-05-17T04:09:10.426412+0000","last_unstale":"2024-05-17T04:09:11.607951+0000","last_undegraded":"2024-05-17T04:09:11.607951+0000","last_fullsized":"2024-05-17T04:09:11.607951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:12:14.748809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425895+0000","last_change":"2024-05-17T04:09:06.403005+0000","last_active":"2024-05-17T04:09:11.425895+0000","last_peered":"2024-05-17T04:09:11.425895+0000","last_clean":"2024-05-17T04:09:11.425895+0000","last_became_active":"2024-05-17T04:09:06.402234+0000","last_became_peered":"2024-05-17T04:09:06.402234+0000","last_unstale":"2024-05-17T04:09:11.425895+0000","last_undegraded":"2024-05-17T04:09:11.425895+0000","last_fullsized":"2024-05-17T04:09:11.425895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:02:56.514685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608325+0000","last_change":"2024-05-17T04:09:05.398997+0000","last_active":"2024-05-17T04:09:11.608325+0000","last_peered":"2024-05-17T04:09:11.608325+0000","last_clean":"2024-05-17T04:09:11.608325+0000","last_became_active":"2024-05-17T04:09:05.398311+0000","last_became_peered":"2024-05-17T04:09:05.398311+0000","last_unstale":"2024-05-17T04:09:11.608325+0000","last_undegraded":"2024-05-17T04:09:11.608325+0000","last_fullsized":"2024-05-17T04:09:11.608325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607285+0000","last_change":"2024-05-17T04:09:10.611442+0000","last_active":"2024-05-17T04:09:11.607285+0000","last_peered":"2024-05-17T04:09:11.607285+0000","last_clean":"2024-05-17T04:09:11.607285+0000","last_became_active":"2024-05-17T04:09:10.610948+0000","last_became_peered":"2024-05-17T04:09:10.610948+0000","last_unstale":"2024-05-17T04:09:11.607285+0000","last_undegraded":"2024-05-17T04:09:11.607285+0000","last_fullsized":"2024-05-17T04:09:11.607285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:55:48.002918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607426+0000","last_change":"2024-05-17T04:09:10.610609+0000","last_active":"2024-05-17T04:09:11.607426+0000","last_peered":"2024-05-17T04:09:11.607426+0000","last_clean":"2024-05-17T04:09:11.607426+0000","last_became_active":"2024-05-17T04:09:10.610158+0000","last_became_peered":"2024-05-17T04:09:10.610158+0000","last_unstale":"2024-05-17T04:09:11.607426+0000","last_undegraded":"2024-05-17T04:09:11.607426+0000","last_fullsized":"2024-05-17T04:09:11.607426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:05:01.660626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514846+0000","last_change":"2024-05-17T04:09:06.405815+0000","last_active":"2024-05-17T04:09:11.514846+0000","last_peered":"2024-05-17T04:09:11.514846+0000","last_clean":"2024-05-17T04:09:11.514846+0000","last_became_active":"2024-05-17T04:09:06.405516+0000","last_became_peered":"2024-05-17T04:09:06.405516+0000","last_unstale":"2024-05-17T04:09:11.514846+0000","last_undegraded":"2024-05-17T04:09:11.514846+0000","last_fullsized":"2024-05-17T04:09:11.514846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426561+0000","last_change":"2024-05-17T04:09:05.392753+0000","last_active":"2024-05-17T04:09:11.426561+0000","last_peered":"2024-05-17T04:09:11.426561+0000","last_clean":"2024-05-17T04:09:11.426561+0000","last_became_active":"2024-05-17T04:09:05.392392+0000","last_became_peered":"2024-05-17T04:09:05.392392+0000","last_unstale":"2024-05-17T04:09:11.426561+0000","last_undegraded":"2024-05-17T04:09:11.426561+0000","last_fullsized":"2024-05-17T04:09:11.426561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608054+0000","last_change":"2024-05-17T04:09:10.425375+0000","last_active":"2024-05-17T04:09:11.608054+0000","last_peered":"2024-05-17T04:09:11.608054+0000","last_clean":"2024-05-17T04:09:11.608054+0000","last_became_active":"2024-05-17T04:09:10.424219+0000","last_became_peered":"2024-05-17T04:09:10.424219+0000","last_unstale":"2024-05-17T04:09:11.608054+0000","last_undegraded":"2024-05-17T04:09:11.608054+0000","last_fullsized":"2024-05-17T04:09:11.608054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:43.859624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607887+0000","last_change":"2024-05-17T04:09:06.398505+0000","last_active":"2024-05-17T04:09:11.607887+0000","last_peered":"2024-05-17T04:09:11.607887+0000","last_clean":"2024-05-17T04:09:11.607887+0000","last_became_active":"2024-05-17T04:09:06.398135+0000","last_became_peered":"2024-05-17T04:09:06.398135+0000","last_unstale":"2024-05-17T04:09:11.607887+0000","last_undegraded":"2024-05-17T04:09:11.607887+0000","last_fullsized":"2024-05-17T04:09:11.607887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:07:56.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607594+0000","last_change":"2024-05-17T04:09:05.396795+0000","last_active":"2024-05-17T04:09:11.607594+0000","last_peered":"2024-05-17T04:09:11.607594+0000","last_clean":"2024-05-17T04:09:11.607594+0000","last_became_active":"2024-05-17T04:09:05.396335+0000","last_became_peered":"2024-05-17T04:09:05.396335+0000","last_unstale":"2024-05-17T04:09:11.607594+0000","last_undegraded":"2024-05-17T04:09:11.607594+0000","last_fullsized":"2024-05-17T04:09:11.607594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:57:11.208612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607531+0000","last_change":"2024-05-17T04:09:05.393287+0000","last_active":"2024-05-17T04:09:11.607531+0000","last_peered":"2024-05-17T04:09:11.607531+0000","last_clean":"2024-05-17T04:09:11.607531+0000","last_became_active":"2024-05-17T04:09:05.392948+0000","last_became_peered":"2024-05-17T04:09:05.392948+0000","last_unstale":"2024-05-17T04:09:11.607531+0000","last_undegraded":"2024-05-17T04:09:11.607531+0000","last_fullsized":"2024-05-17T04:09:11.607531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607875+0000","last_change":"2024-05-17T04:09:06.403950+0000","last_active":"2024-05-17T04:09:11.607875+0000","last_peered":"2024-05-17T04:09:11.607875+0000","last_clean":"2024-05-17T04:09:11.607875+0000","last_became_active":"2024-05-17T04:09:06.403257+0000","last_became_peered":"2024-05-17T04:09:06.403257+0000","last_unstale":"2024-05-17T04:09:11.607875+0000","last_undegraded":"2024-05-17T04:09:11.607875+0000","last_fullsized":"2024-05-17T04:09:11.607875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424114+0000","last_change":"2024-05-17T04:09:10.424315+0000","last_active":"2024-05-17T04:09:11.424114+0000","last_peered":"2024-05-17T04:09:11.424114+0000","last_clean":"2024-05-17T04:09:11.424114+0000","last_became_active":"2024-05-17T04:09:10.423838+0000","last_became_peered":"2024-05-17T04:09:10.423838+0000","last_unstale":"2024-05-17T04:09:11.424114+0000","last_undegraded":"2024-05-17T04:09:11.424114+0000","last_fullsized":"2024-05-17T04:09:11.424114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:39:27.123196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608419+0000","last_change":"2024-05-17T04:09:05.398565+0000","last_active":"2024-05-17T04:09:11.608419+0000","last_peered":"2024-05-17T04:09:11.608419+0000","last_clean":"2024-05-17T04:09:11.608419+0000","last_became_active":"2024-05-17T04:09:05.398229+0000","last_became_peered":"2024-05-17T04:09:05.398229+0000","last_unstale":"2024-05-17T04:09:11.608419+0000","last_undegraded":"2024-05-17T04:09:11.608419+0000","last_fullsized":"2024-05-17T04:09:11.608419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425580+0000","last_change":"2024-05-17T04:09:06.400725+0000","last_active":"2024-05-17T04:09:11.425580+0000","last_peered":"2024-05-17T04:09:11.425580+0000","last_clean":"2024-05-17T04:09:11.425580+0000","last_became_active":"2024-05-17T04:09:06.400391+0000","last_became_peered":"2024-05-17T04:09:06.400391+0000","last_unstale":"2024-05-17T04:09:11.425580+0000","last_undegraded":"2024-05-17T04:09:11.425580+0000","last_fullsized":"2024-05-17T04:09:11.425580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:09.290308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607875+0000","last_change":"2024-05-17T04:09:10.420250+0000","last_active":"2024-05-17T04:09:11.607875+0000","last_peered":"2024-05-17T04:09:11.607875+0000","last_clean":"2024-05-17T04:09:11.607875+0000","last_became_active":"2024-05-17T04:09:10.419846+0000","last_became_peered":"2024-05-17T04:09:10.419846+0000","last_unstale":"2024-05-17T04:09:11.607875+0000","last_undegraded":"2024-05-17T04:09:11.607875+0000","last_fullsized":"2024-05-17T04:09:11.607875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:21:44.098959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607925+0000","last_change":"2024-05-17T04:09:06.395888+0000","last_active":"2024-05-17T04:09:11.607925+0000","last_peered":"2024-05-17T04:09:11.607925+0000","last_clean":"2024-05-17T04:09:11.607925+0000","last_became_active":"2024-05-17T04:09:06.395422+0000","last_became_peered":"2024-05-17T04:09:06.395422+0000","last_unstale":"2024-05-17T04:09:11.607925+0000","last_undegraded":"2024-05-17T04:09:11.607925+0000","last_fullsized":"2024-05-17T04:09:11.607925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:33:02.204060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.423823+0000","last_change":"2024-05-17T04:09:06.413727+0000","last_active":"2024-05-17T04:09:11.423823+0000","last_peered":"2024-05-17T04:09:11.423823+0000","last_clean":"2024-05-17T04:09:11.423823+0000","last_became_active":"2024-05-17T04:09:06.413402+0000","last_became_peered":"2024-05-17T04:09:06.413402+0000","last_unstale":"2024-05-17T04:09:11.423823+0000","last_undegraded":"2024-05-17T04:09:11.423823+0000","last_fullsized":"2024-05-17T04:09:11.423823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:01.464770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424975+0000","last_change":"2024-05-17T04:09:06.408357+0000","last_active":"2024-05-17T04:09:11.424975+0000","last_peered":"2024-05-17T04:09:11.424975+0000","last_clean":"2024-05-17T04:09:11.424975+0000","last_became_active":"2024-05-17T04:09:06.407758+0000","last_became_peered":"2024-05-17T04:09:06.407758+0000","last_unstale":"2024-05-17T04:09:11.424975+0000","last_undegraded":"2024-05-17T04:09:11.424975+0000","last_fullsized":"2024-05-17T04:09:11.424975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:24.342548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607783+0000","last_change":"2024-05-17T04:09:06.392141+0000","last_active":"2024-05-17T04:09:11.607783+0000","last_peered":"2024-05-17T04:09:11.607783+0000","last_clean":"2024-05-17T04:09:11.607783+0000","last_became_active":"2024-05-17T04:09:06.391676+0000","last_became_peered":"2024-05-17T04:09:06.391676+0000","last_unstale":"2024-05-17T04:09:11.607783+0000","last_undegraded":"2024-05-17T04:09:11.607783+0000","last_fullsized":"2024-05-17T04:09:11.607783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608443+0000","last_change":"2024-05-17T04:09:06.395595+0000","last_active":"2024-05-17T04:09:11.608443+0000","last_peered":"2024-05-17T04:09:11.608443+0000","last_clean":"2024-05-17T04:09:11.608443+0000","last_became_active":"2024-05-17T04:09:06.394124+0000","last_became_peered":"2024-05-17T04:09:06.394124+0000","last_unstale":"2024-05-17T04:09:11.608443+0000","last_undegraded":"2024-05-17T04:09:11.608443+0000","last_fullsized":"2024-05-17T04:09:11.608443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:34.167127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515269+0000","last_change":"2024-05-17T04:09:06.404994+0000","last_active":"2024-05-17T04:09:11.515269+0000","last_peered":"2024-05-17T04:09:11.515269+0000","last_clean":"2024-05-17T04:09:11.515269+0000","last_became_active":"2024-05-17T04:09:06.404667+0000","last_became_peered":"2024-05-17T04:09:06.404667+0000","last_unstale":"2024-05-17T04:09:11.515269+0000","last_undegraded":"2024-05-17T04:09:11.515269+0000","last_fullsized":"2024-05-17T04:09:11.515269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607898+0000","last_change":"2024-05-17T04:09:06.402279+0000","last_active":"2024-05-17T04:09:11.607898+0000","last_peered":"2024-05-17T04:09:11.607898+0000","last_clean":"2024-05-17T04:09:11.607898+0000","last_became_active":"2024-05-17T04:09:06.401947+0000","last_became_peered":"2024-05-17T04:09:06.401947+0000","last_unstale":"2024-05-17T04:09:11.607898+0000","last_undegraded":"2024-05-17T04:09:11.607898+0000","last_fullsized":"2024-05-17T04:09:11.607898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607463+0000","last_change":"2024-05-17T04:09:06.407232+0000","last_active":"2024-05-17T04:09:11.607463+0000","last_peered":"2024-05-17T04:09:11.607463+0000","last_clean":"2024-05-17T04:09:11.607463+0000","last_became_active":"2024-05-17T04:09:06.406929+0000","last_became_peered":"2024-05-17T04:09:06.406929+0000","last_unstale":"2024-05-17T04:09:11.607463+0000","last_undegraded":"2024-05-17T04:09:11.607463+0000","last_fullsized":"2024-05-17T04:09:11.607463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:02:56.514685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426472+0000","last_change":"2024-05-17T04:09:06.402162+0000","last_active":"2024-05-17T04:09:11.426472+0000","last_peered":"2024-05-17T04:09:11.426472+0000","last_clean":"2024-05-17T04:09:11.426472+0000","last_became_active":"2024-05-17T04:09:06.401853+0000","last_became_peered":"2024-05-17T04:09:06.401853+0000","last_unstale":"2024-05-17T04:09:11.426472+0000","last_undegraded":"2024-05-17T04:09:11.426472+0000","last_fullsized":"2024-05-17T04:09:11.426472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607445+0000","last_change":"2024-05-17T04:09:06.405967+0000","last_active":"2024-05-17T04:09:11.607445+0000","last_peered":"2024-05-17T04:09:11.607445+0000","last_clean":"2024-05-17T04:09:11.607445+0000","last_became_active":"2024-05-17T04:09:06.405658+0000","last_became_peered":"2024-05-17T04:09:06.405658+0000","last_unstale":"2024-05-17T04:09:11.607445+0000","last_undegraded":"2024-05-17T04:09:11.607445+0000","last_fullsized":"2024-05-17T04:09:11.607445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424870+0000","last_change":"2024-05-17T04:09:06.402392+0000","last_active":"2024-05-17T04:09:11.424870+0000","last_peered":"2024-05-17T04:09:11.424870+0000","last_clean":"2024-05-17T04:09:11.424870+0000","last_became_active":"2024-05-17T04:09:06.401547+0000","last_became_peered":"2024-05-17T04:09:06.401547+0000","last_unstale":"2024-05-17T04:09:11.424870+0000","last_undegraded":"2024-05-17T04:09:11.424870+0000","last_fullsized":"2024-05-17T04:09:11.424870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:04:57.636173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607524+0000","last_change":"2024-05-17T04:09:06.403901+0000","last_active":"2024-05-17T04:09:11.607524+0000","last_peered":"2024-05-17T04:09:11.607524+0000","last_clean":"2024-05-17T04:09:11.607524+0000","last_became_active":"2024-05-17T04:09:06.402890+0000","last_became_peered":"2024-05-17T04:09:06.402890+0000","last_unstale":"2024-05-17T04:09:11.607524+0000","last_undegraded":"2024-05-17T04:09:11.607524+0000","last_fullsized":"2024-05-17T04:09:11.607524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:07:56.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608474+0000","last_change":"2024-05-17T04:09:06.405422+0000","last_active":"2024-05-17T04:09:11.608474+0000","last_peered":"2024-05-17T04:09:11.608474+0000","last_clean":"2024-05-17T04:09:11.608474+0000","last_became_active":"2024-05-17T04:09:06.405094+0000","last_became_peered":"2024-05-17T04:09:06.405094+0000","last_unstale":"2024-05-17T04:09:11.608474+0000","last_undegraded":"2024-05-17T04:09:11.608474+0000","last_fullsized":"2024-05-17T04:09:11.608474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608609+0000","last_change":"2024-05-17T04:09:06.409849+0000","last_active":"2024-05-17T04:09:11.608609+0000","last_peered":"2024-05-17T04:09:11.608609+0000","last_clean":"2024-05-17T04:09:11.608609+0000","last_became_active":"2024-05-17T04:09:06.409168+0000","last_became_peered":"2024-05-17T04:09:06.409168+0000","last_unstale":"2024-05-17T04:09:11.608609+0000","last_undegraded":"2024-05-17T04:09:11.608609+0000","last_fullsized":"2024-05-17T04:09:11.608609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:04:57.636173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424161+0000","last_change":"2024-05-17T04:09:06.396066+0000","last_active":"2024-05-17T04:09:11.424161+0000","last_peered":"2024-05-17T04:09:11.424161+0000","last_clean":"2024-05-17T04:09:11.424161+0000","last_became_active":"2024-05-17T04:09:06.394962+0000","last_became_peered":"2024-05-17T04:09:06.394962+0000","last_unstale":"2024-05-17T04:09:11.424161+0000","last_undegraded":"2024-05-17T04:09:11.424161+0000","last_fullsized":"2024-05-17T04:09:11.424161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:35.828470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426434+0000","last_change":"2024-05-17T04:09:06.405156+0000","last_active":"2024-05-17T04:09:11.426434+0000","last_peered":"2024-05-17T04:09:11.426434+0000","last_clean":"2024-05-17T04:09:11.426434+0000","last_became_active":"2024-05-17T04:09:06.404857+0000","last_became_peered":"2024-05-17T04:09:06.404857+0000","last_unstale":"2024-05-17T04:09:11.426434+0000","last_undegraded":"2024-05-17T04:09:11.426434+0000","last_fullsized":"2024-05-17T04:09:11.426434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:10.587650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425653+0000","last_change":"2024-05-17T04:09:06.404527+0000","last_active":"2024-05-17T04:09:11.425653+0000","last_peered":"2024-05-17T04:09:11.425653+0000","last_clean":"2024-05-17T04:09:11.425653+0000","last_became_active":"2024-05-17T04:09:06.404215+0000","last_became_peered":"2024-05-17T04:09:06.404215+0000","last_unstale":"2024-05-17T04:09:11.425653+0000","last_undegraded":"2024-05-17T04:09:11.425653+0000","last_fullsized":"2024-05-17T04:09:11.425653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514907+0000","last_change":"2024-05-17T04:09:06.404828+0000","last_active":"2024-05-17T04:09:11.514907+0000","last_peered":"2024-05-17T04:09:11.514907+0000","last_clean":"2024-05-17T04:09:11.514907+0000","last_became_active":"2024-05-17T04:09:06.404512+0000","last_became_peered":"2024-05-17T04:09:06.404512+0000","last_unstale":"2024-05-17T04:09:11.514907+0000","last_undegraded":"2024-05-17T04:09:11.514907+0000","last_fullsized":"2024-05-17T04:09:11.514907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607167+0000","last_change":"2024-05-17T04:09:06.395825+0000","last_active":"2024-05-17T04:09:11.607167+0000","last_peered":"2024-05-17T04:09:11.607167+0000","last_clean":"2024-05-17T04:09:11.607167+0000","last_became_active":"2024-05-17T04:09:06.395519+0000","last_became_peered":"2024-05-17T04:09:06.395519+0000","last_unstale":"2024-05-17T04:09:11.607167+0000","last_undegraded":"2024-05-17T04:09:11.607167+0000","last_fullsized":"2024-05-17T04:09:11.607167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:24:33.148839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608216+0000","last_change":"2024-05-17T04:09:06.397289+0000","last_active":"2024-05-17T04:09:11.608216+0000","last_peered":"2024-05-17T04:09:11.608216+0000","last_clean":"2024-05-17T04:09:11.608216+0000","last_became_active":"2024-05-17T04:09:06.396970+0000","last_became_peered":"2024-05-17T04:09:06.396970+0000","last_unstale":"2024-05-17T04:09:11.608216+0000","last_undegraded":"2024-05-17T04:09:11.608216+0000","last_fullsized":"2024-05-17T04:09:11.608216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425858+0000","last_change":"2024-05-17T04:09:06.395813+0000","last_active":"2024-05-17T04:09:11.425858+0000","last_peered":"2024-05-17T04:09:11.425858+0000","last_clean":"2024-05-17T04:09:11.425858+0000","last_became_active":"2024-05-17T04:09:06.395523+0000","last_became_peered":"2024-05-17T04:09:06.395523+0000","last_unstale":"2024-05-17T04:09:11.425858+0000","last_undegraded":"2024-05-17T04:09:11.425858+0000","last_fullsized":"2024-05-17T04:09:11.425858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:01.464770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608123+0000","last_change":"2024-05-17T04:09:06.415051+0000","last_active":"2024-05-17T04:09:11.608123+0000","last_peered":"2024-05-17T04:09:11.608123+0000","last_clean":"2024-05-17T04:09:11.608123+0000","last_became_active":"2024-05-17T04:09:06.414567+0000","last_became_peered":"2024-05-17T04:09:06.414567+0000","last_unstale":"2024-05-17T04:09:11.608123+0000","last_undegraded":"2024-05-17T04:09:11.608123+0000","last_fullsized":"2024-05-17T04:09:11.608123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607819+0000","last_change":"2024-05-17T04:09:06.414418+0000","last_active":"2024-05-17T04:09:11.607819+0000","last_peered":"2024-05-17T04:09:11.607819+0000","last_clean":"2024-05-17T04:09:11.607819+0000","last_became_active":"2024-05-17T04:09:06.414073+0000","last_became_peered":"2024-05-17T04:09:06.414073+0000","last_unstale":"2024-05-17T04:09:11.607819+0000","last_undegraded":"2024-05-17T04:09:11.607819+0000","last_fullsized":"2024-05-17T04:09:11.607819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608958+0000","last_change":"2024-05-17T04:09:06.415334+0000","last_active":"2024-05-17T04:09:11.608958+0000","last_peered":"2024-05-17T04:09:11.608958+0000","last_clean":"2024-05-17T04:09:11.608958+0000","last_became_active":"2024-05-17T04:09:06.414983+0000","last_became_peered":"2024-05-17T04:09:06.414983+0000","last_unstale":"2024-05-17T04:09:11.608958+0000","last_undegraded":"2024-05-17T04:09:11.608958+0000","last_fullsized":"2024-05-17T04:09:11.608958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:24.342548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607791+0000","last_change":"2024-05-17T04:09:06.411128+0000","last_active":"2024-05-17T04:09:11.607791+0000","last_peered":"2024-05-17T04:09:11.607791+0000","last_clean":"2024-05-17T04:09:11.607791+0000","last_became_active":"2024-05-17T04:09:06.410770+0000","last_became_peered":"2024-05-17T04:09:06.410770+0000","last_unstale":"2024-05-17T04:09:11.607791+0000","last_undegraded":"2024-05-17T04:09:11.607791+0000","last_fullsized":"2024-05-17T04:09:11.607791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:33:02.204060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607458+0000","last_change":"2024-05-17T04:09:06.408726+0000","last_active":"2024-05-17T04:09:11.607458+0000","last_peered":"2024-05-17T04:09:11.607458+0000","last_clean":"2024-05-17T04:09:11.607458+0000","last_became_active":"2024-05-17T04:09:06.404912+0000","last_became_peered":"2024-05-17T04:09:06.404912+0000","last_unstale":"2024-05-17T04:09:11.607458+0000","last_undegraded":"2024-05-17T04:09:11.607458+0000","last_fullsized":"2024-05-17T04:09:11.607458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:02:56.514685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424735+0000","last_change":"2024-05-17T04:09:06.408616+0000","last_active":"2024-05-17T04:09:11.424735+0000","last_peered":"2024-05-17T04:09:11.424735+0000","last_clean":"2024-05-17T04:09:11.424735+0000","last_became_active":"2024-05-17T04:09:06.408066+0000","last_became_peered":"2024-05-17T04:09:06.408066+0000","last_unstale":"2024-05-17T04:09:11.424735+0000","last_undegraded":"2024-05-17T04:09:11.424735+0000","last_fullsized":"2024-05-17T04:09:11.424735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607652+0000","last_change":"2024-05-17T04:09:06.402593+0000","last_active":"2024-05-17T04:09:11.607652+0000","last_peered":"2024-05-17T04:09:11.607652+0000","last_clean":"2024-05-17T04:09:11.607652+0000","last_became_active":"2024-05-17T04:09:06.402279+0000","last_became_peered":"2024-05-17T04:09:06.402279+0000","last_unstale":"2024-05-17T04:09:11.607652+0000","last_undegraded":"2024-05-17T04:09:11.607652+0000","last_fullsized":"2024-05-17T04:09:11.607652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:10.587650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425778+0000","last_change":"2024-05-17T04:09:06.410616+0000","last_active":"2024-05-17T04:09:11.425778+0000","last_peered":"2024-05-17T04:09:11.425778+0000","last_clean":"2024-05-17T04:09:11.425778+0000","last_became_active":"2024-05-17T04:09:06.409954+0000","last_became_peered":"2024-05-17T04:09:06.409954+0000","last_unstale":"2024-05-17T04:09:11.425778+0000","last_undegraded":"2024-05-17T04:09:11.425778+0000","last_fullsized":"2024-05-17T04:09:11.425778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:41.984177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607553+0000","last_change":"2024-05-17T04:09:06.386066+0000","last_active":"2024-05-17T04:09:11.607553+0000","last_peered":"2024-05-17T04:09:11.607553+0000","last_clean":"2024-05-17T04:09:11.607553+0000","last_became_active":"2024-05-17T04:09:06.385689+0000","last_became_peered":"2024-05-17T04:09:06.385689+0000","last_unstale":"2024-05-17T04:09:11.607553+0000","last_undegraded":"2024-05-17T04:09:11.607553+0000","last_fullsized":"2024-05-17T04:09:11.607553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515522+0000","last_change":"2024-05-17T04:09:06.395571+0000","last_active":"2024-05-17T04:09:11.515522+0000","last_peered":"2024-05-17T04:09:11.515522+0000","last_clean":"2024-05-17T04:09:11.515522+0000","last_became_active":"2024-05-17T04:09:06.394746+0000","last_became_peered":"2024-05-17T04:09:06.394746+0000","last_unstale":"2024-05-17T04:09:11.515522+0000","last_undegraded":"2024-05-17T04:09:11.515522+0000","last_fullsized":"2024-05-17T04:09:11.515522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608880+0000","last_change":"2024-05-17T04:09:06.409444+0000","last_active":"2024-05-17T04:09:11.608880+0000","last_peered":"2024-05-17T04:09:11.608880+0000","last_clean":"2024-05-17T04:09:11.608880+0000","last_became_active":"2024-05-17T04:09:06.409107+0000","last_became_peered":"2024-05-17T04:09:06.409107+0000","last_unstale":"2024-05-17T04:09:11.608880+0000","last_undegraded":"2024-05-17T04:09:11.608880+0000","last_fullsized":"2024-05-17T04:09:11.608880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:53:04.483377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":101868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":101868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-17T04:09:20.481 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-17T04:09:20.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.625+0000 7f93df503640 1 Processor -- start 2024-05-17T04:09:20.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.625+0000 7f93df503640 1 -- start start 2024-05-17T04:09:20.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.626+0000 7f93df503640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f93d815db00 0x7f93d80cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.626+0000 7f93df503640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f93d80cdd40 0x7f93d80d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.626+0000 7f93df503640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93d815e0e0 con 0x7f93d8071d90 2024-05-17T04:09:20.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.626+0000 7f93df503640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f93d8158010 con 0x7f93d80cdd40 2024-05-17T04:09:20.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.626+0000 7f93df503640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f93d815e3c0 con 0x7f93d815db00 2024-05-17T04:09:20.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.626+0000 7f93ddaa0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f93d80cdd40 0x7f93d80d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.626+0000 7f93ddaa0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f93d80cdd40 0x7f93d80d13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43384/0 (socket says 172.21.15.131:43384) 2024-05-17T04:09:20.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.626+0000 7f93ddaa0640 1 -- 172.21.15.131:0/2445752113 learned_addr learned my addr 172.21.15.131:0/2445752113 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:20.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.627+0000 7f93dca9e640 1 --2- 172.21.15.131:0/2445752113 >> v2:172.21.15.150:3300/0 conn(0x7f93d815db00 0x7f93d80cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.627+0000 7f93ddaa0640 1 -- 172.21.15.131:0/2445752113 >> v2:172.21.15.150:3300/0 conn(0x7f93d815db00 msgr2=0x7f93d80cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:20.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.627+0000 7f93ddaa0640 1 --2- 172.21.15.131:0/2445752113 >> v2:172.21.15.150:3300/0 conn(0x7f93d815db00 0x7f93d80cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.627+0000 7f93ddaa0640 1 -- 172.21.15.131:0/2445752113 >> v1:172.21.15.150:6789/0 conn(0x7f93d8071d90 legacy=0x7f93d815ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:20.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.627+0000 7f93ddaa0640 1 -- 172.21.15.131:0/2445752113 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d815e6a0 con 0x7f93d80cdd40 2024-05-17T04:09:20.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.627+0000 7f93ddaa0640 1 --2- 172.21.15.131:0/2445752113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93d80cdd40 0x7f93d80d13b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f93d8073b20 tx=0x7f93d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebcb923954e75c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:20.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.628+0000 7f93d7fff640 1 -- 172.21.15.131:0/2445752113 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0037070 con 0x7f93d80cdd40 2024-05-17T04:09:20.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.628+0000 7f93d7fff640 1 -- 172.21.15.131:0/2445752113 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d0032440 con 0x7f93d80cdd40 2024-05-17T04:09:20.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.628+0000 7f93d7fff640 1 -- 172.21.15.131:0/2445752113 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0032810 con 0x7f93d80cdd40 2024-05-17T04:09:20.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.628+0000 7f93df503640 1 -- 172.21.15.131:0/2445752113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93d80cdd40 msgr2=0x7f93d80d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.628+0000 7f93df503640 1 --2- 172.21.15.131:0/2445752113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93d80cdd40 0x7f93d80d13b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f93d8073b20 tx=0x7f93d002a270 comp rx=0 tx=0).stop 2024-05-17T04:09:20.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.628+0000 7f93df503640 1 -- 172.21.15.131:0/2445752113 shutdown_connections 2024-05-17T04:09:20.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.628+0000 7f93df503640 1 --2- 172.21.15.131:0/2445752113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93d80cdd40 0x7f93d80d13b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.628+0000 7f93df503640 1 --2- 172.21.15.131:0/2445752113 >> v2:172.21.15.150:3300/0 conn(0x7f93d815db00 0x7f93d80cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.628+0000 7f93df503640 1 -- 172.21.15.131:0/2445752113 >> 172.21.15.131:0/2445752113 conn(0x7f93d80d2fd0 msgr2=0x7f93d80d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:20.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.628+0000 7f93df503640 1 -- 172.21.15.131:0/2445752113 shutdown_connections 2024-05-17T04:09:20.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.628+0000 7f93df503640 1 -- 172.21.15.131:0/2445752113 wait complete. 2024-05-17T04:09:20.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.630+0000 7f93df503640 1 Processor -- start 2024-05-17T04:09:20.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.630+0000 7f93df503640 1 -- start start 2024-05-17T04:09:20.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.631+0000 7f93df503640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93d8071d90 0x7f93d8154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.631+0000 7f93df503640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d80cdd40 0x7f93d81f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.631+0000 7f93df503640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93d815db00 0x7f93d80b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.631+0000 7f93df503640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f93d80d2a50 con 0x7f93d815db00 2024-05-17T04:09:20.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.631+0000 7f93df503640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f93d80d28d0 con 0x7f93d8071d90 2024-05-17T04:09:20.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.631+0000 7f93df503640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f93d80d18f0 con 0x7f93d80cdd40 2024-05-17T04:09:20.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93ddaa0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93d815db00 0x7f93d80b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93ddaa0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93d815db00 0x7f93d80b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43396/0 (socket says 172.21.15.131:43396) 2024-05-17T04:09:20.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93ddaa0640 1 -- 172.21.15.131:0/3906093197 learned_addr learned my addr 172.21.15.131:0/3906093197 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:20.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93dca9e640 1 --2- 172.21.15.131:0/3906093197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d80cdd40 0x7f93d81f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93dd29f640 1 --2- 172.21.15.131:0/3906093197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93d8071d90 0x7f93d8154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93ddaa0640 1 -- 172.21.15.131:0/3906093197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d80cdd40 msgr2=0x7f93d81f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93ddaa0640 1 --2- 172.21.15.131:0/3906093197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d80cdd40 0x7f93d81f46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93ddaa0640 1 -- 172.21.15.131:0/3906093197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93d8071d90 msgr2=0x7f93d8154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93ddaa0640 1 --2- 172.21.15.131:0/3906093197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93d8071d90 0x7f93d8154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93ddaa0640 1 -- 172.21.15.131:0/3906093197 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d81f4c30 con 0x7f93d815db00 2024-05-17T04:09:20.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93dca9e640 1 --2- 172.21.15.131:0/3906093197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d80cdd40 0x7f93d81f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:20.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93ddaa0640 1 --2- 172.21.15.131:0/3906093197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93d815db00 0x7f93d80b3980 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f93d002a2b0 tx=0x7f93d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:20.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93d5ffb640 1 -- 172.21.15.131:0/3906093197 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0037040 con 0x7f93d815db00 2024-05-17T04:09:20.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93d5ffb640 1 -- 172.21.15.131:0/3906093197 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d0042070 con 0x7f93d815db00 2024-05-17T04:09:20.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93d5ffb640 1 -- 172.21.15.131:0/3906093197 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0030920 con 0x7f93d815db00 2024-05-17T04:09:20.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.632+0000 7f93df503640 1 -- 172.21.15.131:0/3906093197 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d80cb4a0 con 0x7f93d815db00 2024-05-17T04:09:20.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.633+0000 7f93df503640 1 -- 172.21.15.131:0/3906093197 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d81e6740 con 0x7f93d815db00 2024-05-17T04:09:20.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.634+0000 7f93df503640 1 -- 172.21.15.131:0/3906093197 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93d81e61d0 con 0x7f93d815db00 2024-05-17T04:09:20.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.634+0000 7f93d5ffb640 1 -- 172.21.15.131:0/3906093197 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f93d0030ac0 con 0x7f93d815db00 2024-05-17T04:09:20.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.635+0000 7f93d5ffb640 1 --2- 172.21.15.131:0/3906093197 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f93c40762d0 0x7f93c40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.635+0000 7f93d5ffb640 1 -- 172.21.15.131:0/3906093197 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f93d00b8310 con 0x7f93d815db00 2024-05-17T04:09:20.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.635+0000 7f93dd29f640 1 --2- 172.21.15.131:0/3906093197 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f93c40762d0 0x7f93c40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.635+0000 7f93dd29f640 1 --2- 172.21.15.131:0/3906093197 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f93c40762d0 0x7f93c40787e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f93d80cef40 tx=0x7f93c8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:20.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.639+0000 7f93d5ffb640 1 -- 172.21.15.131:0/3906093197 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f93d81f4c30 con 0x7f93d815db00 2024-05-17T04:09:20.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.816+0000 7f93df503640 1 -- 172.21.15.131:0/3906093197 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f93d8154b40 con 0x7f93c40762d0 2024-05-17T04:09:20.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.822+0000 7f93d5ffb640 1 -- 172.21.15.131:0/3906093197 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f93c8003970 con 0x7f93c40762d0 2024-05-17T04:09:20.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:20.828 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-05-17T04:09:20.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.825+0000 7f93df503640 1 -- 172.21.15.131:0/3906093197 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f93c40762d0 msgr2=0x7f93c40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.825+0000 7f93df503640 1 --2- 172.21.15.131:0/3906093197 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f93c40762d0 0x7f93c40787e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f93d80cef40 tx=0x7f93c8009040 comp rx=0 tx=0).stop 2024-05-17T04:09:20.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.825+0000 7f93df503640 1 -- 172.21.15.131:0/3906093197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93d815db00 msgr2=0x7f93d80b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.825+0000 7f93df503640 1 --2- 172.21.15.131:0/3906093197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93d815db00 0x7f93d80b3980 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f93d002a2b0 tx=0x7f93d00046c0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.825+0000 7f93df503640 1 -- 172.21.15.131:0/3906093197 shutdown_connections 2024-05-17T04:09:20.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.825+0000 7f93df503640 1 --2- 172.21.15.131:0/3906093197 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f93c40762d0 0x7f93c40787e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.825+0000 7f93df503640 1 --2- 172.21.15.131:0/3906093197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93d815db00 0x7f93d80b3980 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.825+0000 7f93df503640 1 --2- 172.21.15.131:0/3906093197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d80cdd40 0x7f93d81f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.825+0000 7f93df503640 1 --2- 172.21.15.131:0/3906093197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93d8071d90 0x7f93d8154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.825+0000 7f93df503640 1 -- 172.21.15.131:0/3906093197 >> 172.21.15.131:0/3906093197 conn(0x7f93d80d2fd0 msgr2=0x7f93d80b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:20.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.825+0000 7f93df503640 1 -- 172.21.15.131:0/3906093197 shutdown_connections 2024-05-17T04:09:20.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.825+0000 7f93df503640 1 -- 172.21.15.131:0/3906093197 wait complete. 2024-05-17T04:09:20.838 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-05-17T04:09:20.710629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001989"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608267+0000","last_change":"2024-05-17T04:09:05.395971+0000","last_active":"2024-05-17T04:09:11.608267+0000","last_peered":"2024-05-17T04:09:11.608267+0000","last_clean":"2024-05-17T04:09:11.608267+0000","last_became_active":"2024-05-17T04:09:05.395651+0000","last_became_peered":"2024-05-17T04:09:05.395651+0000","last_unstale":"2024-05-17T04:09:11.608267+0000","last_undegraded":"2024-05-17T04:09:11.608267+0000","last_fullsized":"2024-05-17T04:09:11.608267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:57:11.208612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608153+0000","last_change":"2024-05-17T04:09:06.397289+0000","last_active":"2024-05-17T04:09:11.608153+0000","last_peered":"2024-05-17T04:09:11.608153+0000","last_clean":"2024-05-17T04:09:11.608153+0000","last_became_active":"2024-05-17T04:09:06.396997+0000","last_became_peered":"2024-05-17T04:09:06.396997+0000","last_unstale":"2024-05-17T04:09:11.608153+0000","last_undegraded":"2024-05-17T04:09:11.608153+0000","last_fullsized":"2024-05-17T04:09:11.608153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607109+0000","last_change":"2024-05-17T04:09:10.610399+0000","last_active":"2024-05-17T04:09:11.607109+0000","last_peered":"2024-05-17T04:09:11.607109+0000","last_clean":"2024-05-17T04:09:11.607109+0000","last_became_active":"2024-05-17T04:09:10.609922+0000","last_became_peered":"2024-05-17T04:09:10.609922+0000","last_unstale":"2024-05-17T04:09:11.607109+0000","last_undegraded":"2024-05-17T04:09:11.607109+0000","last_fullsized":"2024-05-17T04:09:11.607109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:31:14.568941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608463+0000","last_change":"2024-05-17T04:09:05.395919+0000","last_active":"2024-05-17T04:09:11.608463+0000","last_peered":"2024-05-17T04:09:11.608463+0000","last_clean":"2024-05-17T04:09:11.608463+0000","last_became_active":"2024-05-17T04:09:05.395589+0000","last_became_peered":"2024-05-17T04:09:05.395589+0000","last_unstale":"2024-05-17T04:09:11.608463+0000","last_undegraded":"2024-05-17T04:09:11.608463+0000","last_fullsized":"2024-05-17T04:09:11.608463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:41:33.830645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607815+0000","last_change":"2024-05-17T04:09:06.414579+0000","last_active":"2024-05-17T04:09:11.607815+0000","last_peered":"2024-05-17T04:09:11.607815+0000","last_clean":"2024-05-17T04:09:11.607815+0000","last_became_active":"2024-05-17T04:09:06.414199+0000","last_became_peered":"2024-05-17T04:09:06.414199+0000","last_unstale":"2024-05-17T04:09:11.607815+0000","last_undegraded":"2024-05-17T04:09:11.607815+0000","last_fullsized":"2024-05-17T04:09:11.607815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424690+0000","last_change":"2024-05-17T04:09:10.422768+0000","last_active":"2024-05-17T04:09:11.424690+0000","last_peered":"2024-05-17T04:09:11.424690+0000","last_clean":"2024-05-17T04:09:11.424690+0000","last_became_active":"2024-05-17T04:09:10.422303+0000","last_became_peered":"2024-05-17T04:09:10.422303+0000","last_unstale":"2024-05-17T04:09:11.424690+0000","last_undegraded":"2024-05-17T04:09:11.424690+0000","last_fullsized":"2024-05-17T04:09:11.424690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:12.808010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608697+0000","last_change":"2024-05-17T04:09:05.398049+0000","last_active":"2024-05-17T04:09:11.608697+0000","last_peered":"2024-05-17T04:09:11.608697+0000","last_clean":"2024-05-17T04:09:11.608697+0000","last_became_active":"2024-05-17T04:09:05.397723+0000","last_became_peered":"2024-05-17T04:09:05.397723+0000","last_unstale":"2024-05-17T04:09:11.608697+0000","last_undegraded":"2024-05-17T04:09:11.608697+0000","last_fullsized":"2024-05-17T04:09:11.608697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:13:02.014037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426420+0000","last_change":"2024-05-17T04:09:06.410885+0000","last_active":"2024-05-17T04:09:11.426420+0000","last_peered":"2024-05-17T04:09:11.426420+0000","last_clean":"2024-05-17T04:09:11.426420+0000","last_became_active":"2024-05-17T04:09:06.410301+0000","last_became_peered":"2024-05-17T04:09:06.410301+0000","last_unstale":"2024-05-17T04:09:11.426420+0000","last_undegraded":"2024-05-17T04:09:11.426420+0000","last_fullsized":"2024-05-17T04:09:11.426420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:31.927628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425517+0000","last_change":"2024-05-17T04:09:10.424849+0000","last_active":"2024-05-17T04:09:11.425517+0000","last_peered":"2024-05-17T04:09:11.425517+0000","last_clean":"2024-05-17T04:09:11.425517+0000","last_became_active":"2024-05-17T04:09:10.423933+0000","last_became_peered":"2024-05-17T04:09:10.423933+0000","last_unstale":"2024-05-17T04:09:11.425517+0000","last_undegraded":"2024-05-17T04:09:11.425517+0000","last_fullsized":"2024-05-17T04:09:11.425517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:35.952081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608158+0000","last_change":"2024-05-17T04:09:05.398656+0000","last_active":"2024-05-17T04:09:11.608158+0000","last_peered":"2024-05-17T04:09:11.608158+0000","last_clean":"2024-05-17T04:09:11.608158+0000","last_became_active":"2024-05-17T04:09:05.398331+0000","last_became_peered":"2024-05-17T04:09:05.398331+0000","last_unstale":"2024-05-17T04:09:11.608158+0000","last_undegraded":"2024-05-17T04:09:11.608158+0000","last_fullsized":"2024-05-17T04:09:11.608158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426238+0000","last_change":"2024-05-17T04:09:06.406845+0000","last_active":"2024-05-17T04:09:11.426238+0000","last_peered":"2024-05-17T04:09:11.426238+0000","last_clean":"2024-05-17T04:09:11.426238+0000","last_became_active":"2024-05-17T04:09:06.406340+0000","last_became_peered":"2024-05-17T04:09:06.406340+0000","last_unstale":"2024-05-17T04:09:11.426238+0000","last_undegraded":"2024-05-17T04:09:11.426238+0000","last_fullsized":"2024-05-17T04:09:11.426238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:34.167127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425448+0000","last_change":"2024-05-17T04:09:10.422002+0000","last_active":"2024-05-17T04:09:11.425448+0000","last_peered":"2024-05-17T04:09:11.425448+0000","last_clean":"2024-05-17T04:09:11.425448+0000","last_became_active":"2024-05-17T04:09:10.421382+0000","last_became_peered":"2024-05-17T04:09:10.421382+0000","last_unstale":"2024-05-17T04:09:11.425448+0000","last_undegraded":"2024-05-17T04:09:11.425448+0000","last_fullsized":"2024-05-17T04:09:11.425448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:03:00.539137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607249+0000","last_change":"2024-05-17T04:09:06.405110+0000","last_active":"2024-05-17T04:09:11.607249+0000","last_peered":"2024-05-17T04:09:11.607249+0000","last_clean":"2024-05-17T04:09:11.607249+0000","last_became_active":"2024-05-17T04:09:06.404776+0000","last_became_peered":"2024-05-17T04:09:06.404776+0000","last_unstale":"2024-05-17T04:09:11.607249+0000","last_undegraded":"2024-05-17T04:09:11.607249+0000","last_fullsized":"2024-05-17T04:09:11.607249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608023+0000","last_change":"2024-05-17T04:09:05.399818+0000","last_active":"2024-05-17T04:09:11.608023+0000","last_peered":"2024-05-17T04:09:11.608023+0000","last_clean":"2024-05-17T04:09:11.608023+0000","last_became_active":"2024-05-17T04:09:05.399507+0000","last_became_peered":"2024-05-17T04:09:05.399507+0000","last_unstale":"2024-05-17T04:09:11.608023+0000","last_undegraded":"2024-05-17T04:09:11.608023+0000","last_fullsized":"2024-05-17T04:09:11.608023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:34.821170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426755+0000","last_change":"2024-05-17T04:09:10.420268+0000","last_active":"2024-05-17T04:09:11.426755+0000","last_peered":"2024-05-17T04:09:11.426755+0000","last_clean":"2024-05-17T04:09:11.426755+0000","last_became_active":"2024-05-17T04:09:10.419850+0000","last_became_peered":"2024-05-17T04:09:10.419850+0000","last_unstale":"2024-05-17T04:09:11.426755+0000","last_undegraded":"2024-05-17T04:09:11.426755+0000","last_fullsized":"2024-05-17T04:09:11.426755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:43.859624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608320+0000","last_change":"2024-05-17T04:09:06.395791+0000","last_active":"2024-05-17T04:09:11.608320+0000","last_peered":"2024-05-17T04:09:11.608320+0000","last_clean":"2024-05-17T04:09:11.608320+0000","last_became_active":"2024-05-17T04:09:06.395479+0000","last_became_peered":"2024-05-17T04:09:06.395479+0000","last_unstale":"2024-05-17T04:09:11.608320+0000","last_undegraded":"2024-05-17T04:09:11.608320+0000","last_fullsized":"2024-05-17T04:09:11.608320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515550+0000","last_change":"2024-05-17T04:09:05.396843+0000","last_active":"2024-05-17T04:09:11.515550+0000","last_peered":"2024-05-17T04:09:11.515550+0000","last_clean":"2024-05-17T04:09:11.515550+0000","last_became_active":"2024-05-17T04:09:05.396540+0000","last_became_peered":"2024-05-17T04:09:05.396540+0000","last_unstale":"2024-05-17T04:09:11.515550+0000","last_undegraded":"2024-05-17T04:09:11.515550+0000","last_fullsized":"2024-05-17T04:09:11.515550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:00.457470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425672+0000","last_change":"2024-05-17T04:09:10.423569+0000","last_active":"2024-05-17T04:09:11.425672+0000","last_peered":"2024-05-17T04:09:11.425672+0000","last_clean":"2024-05-17T04:09:11.425672+0000","last_became_active":"2024-05-17T04:09:10.423055+0000","last_became_peered":"2024-05-17T04:09:10.423055+0000","last_unstale":"2024-05-17T04:09:11.425672+0000","last_undegraded":"2024-05-17T04:09:11.425672+0000","last_fullsized":"2024-05-17T04:09:11.425672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:38.191579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607983+0000","last_change":"2024-05-17T04:09:06.402857+0000","last_active":"2024-05-17T04:09:11.607983+0000","last_peered":"2024-05-17T04:09:11.607983+0000","last_clean":"2024-05-17T04:09:11.607983+0000","last_became_active":"2024-05-17T04:09:06.402555+0000","last_became_peered":"2024-05-17T04:09:06.402555+0000","last_unstale":"2024-05-17T04:09:11.607983+0000","last_undegraded":"2024-05-17T04:09:11.607983+0000","last_fullsized":"2024-05-17T04:09:11.607983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514978+0000","last_change":"2024-05-17T04:09:05.395456+0000","last_active":"2024-05-17T04:09:11.514978+0000","last_peered":"2024-05-17T04:09:11.514978+0000","last_clean":"2024-05-17T04:09:11.514978+0000","last_became_active":"2024-05-17T04:09:05.394962+0000","last_became_peered":"2024-05-17T04:09:05.394962+0000","last_unstale":"2024-05-17T04:09:11.514978+0000","last_undegraded":"2024-05-17T04:09:11.514978+0000","last_fullsized":"2024-05-17T04:09:11.514978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515619+0000","last_change":"2024-05-17T04:09:10.611575+0000","last_active":"2024-05-17T04:09:11.515619+0000","last_peered":"2024-05-17T04:09:11.515619+0000","last_clean":"2024-05-17T04:09:11.515619+0000","last_became_active":"2024-05-17T04:09:10.610851+0000","last_became_peered":"2024-05-17T04:09:10.610851+0000","last_unstale":"2024-05-17T04:09:11.515619+0000","last_undegraded":"2024-05-17T04:09:11.515619+0000","last_fullsized":"2024-05-17T04:09:11.515619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:53:08.507830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425259+0000","last_change":"2024-05-17T04:09:06.394990+0000","last_active":"2024-05-17T04:09:11.425259+0000","last_peered":"2024-05-17T04:09:11.425259+0000","last_clean":"2024-05-17T04:09:11.425259+0000","last_became_active":"2024-05-17T04:09:06.394578+0000","last_became_peered":"2024-05-17T04:09:06.394578+0000","last_unstale":"2024-05-17T04:09:11.425259+0000","last_undegraded":"2024-05-17T04:09:11.425259+0000","last_fullsized":"2024-05-17T04:09:11.425259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:05.815923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607236+0000","last_change":"2024-05-17T04:09:05.403173+0000","last_active":"2024-05-17T04:09:11.607236+0000","last_peered":"2024-05-17T04:09:11.607236+0000","last_clean":"2024-05-17T04:09:11.607236+0000","last_became_active":"2024-05-17T04:09:05.402862+0000","last_became_peered":"2024-05-17T04:09:05.402862+0000","last_unstale":"2024-05-17T04:09:11.607236+0000","last_undegraded":"2024-05-17T04:09:11.607236+0000","last_fullsized":"2024-05-17T04:09:11.607236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:00.457470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425484+0000","last_change":"2024-05-17T04:09:10.424841+0000","last_active":"2024-05-17T04:09:11.425484+0000","last_peered":"2024-05-17T04:09:11.425484+0000","last_clean":"2024-05-17T04:09:11.425484+0000","last_became_active":"2024-05-17T04:09:10.423871+0000","last_became_peered":"2024-05-17T04:09:10.423871+0000","last_unstale":"2024-05-17T04:09:11.425484+0000","last_undegraded":"2024-05-17T04:09:11.425484+0000","last_fullsized":"2024-05-17T04:09:11.425484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:46.008630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608200+0000","last_change":"2024-05-17T04:09:06.397726+0000","last_active":"2024-05-17T04:09:11.608200+0000","last_peered":"2024-05-17T04:09:11.608200+0000","last_clean":"2024-05-17T04:09:11.608200+0000","last_became_active":"2024-05-17T04:09:06.396138+0000","last_became_peered":"2024-05-17T04:09:06.396138+0000","last_unstale":"2024-05-17T04:09:11.608200+0000","last_undegraded":"2024-05-17T04:09:11.608200+0000","last_fullsized":"2024-05-17T04:09:11.608200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608451+0000","last_change":"2024-05-17T04:09:05.395429+0000","last_active":"2024-05-17T04:09:11.608451+0000","last_peered":"2024-05-17T04:09:11.608451+0000","last_clean":"2024-05-17T04:09:11.608451+0000","last_became_active":"2024-05-17T04:09:05.394265+0000","last_became_peered":"2024-05-17T04:09:05.394265+0000","last_unstale":"2024-05-17T04:09:11.608451+0000","last_undegraded":"2024-05-17T04:09:11.608451+0000","last_fullsized":"2024-05-17T04:09:11.608451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425112+0000","last_change":"2024-05-17T04:09:10.608056+0000","last_active":"2024-05-17T04:09:11.425112+0000","last_peered":"2024-05-17T04:09:11.425112+0000","last_clean":"2024-05-17T04:09:11.425112+0000","last_became_active":"2024-05-17T04:09:10.607528+0000","last_became_peered":"2024-05-17T04:09:10.607528+0000","last_unstale":"2024-05-17T04:09:11.425112+0000","last_undegraded":"2024-05-17T04:09:11.425112+0000","last_fullsized":"2024-05-17T04:09:11.425112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:13.074744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607552+0000","last_change":"2024-05-17T04:09:06.403004+0000","last_active":"2024-05-17T04:09:11.607552+0000","last_peered":"2024-05-17T04:09:11.607552+0000","last_clean":"2024-05-17T04:09:11.607552+0000","last_became_active":"2024-05-17T04:09:06.402507+0000","last_became_peered":"2024-05-17T04:09:06.402507+0000","last_unstale":"2024-05-17T04:09:11.607552+0000","last_undegraded":"2024-05-17T04:09:11.607552+0000","last_fullsized":"2024-05-17T04:09:11.607552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:41.984177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515570+0000","last_change":"2024-05-17T04:09:05.399350+0000","last_active":"2024-05-17T04:09:11.515570+0000","last_peered":"2024-05-17T04:09:11.515570+0000","last_clean":"2024-05-17T04:09:11.515570+0000","last_became_active":"2024-05-17T04:09:05.399049+0000","last_became_peered":"2024-05-17T04:09:05.399049+0000","last_unstale":"2024-05-17T04:09:11.515570+0000","last_undegraded":"2024-05-17T04:09:11.515570+0000","last_fullsized":"2024-05-17T04:09:11.515570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607786+0000","last_change":"2024-05-17T04:09:10.611499+0000","last_active":"2024-05-17T04:09:11.607786+0000","last_peered":"2024-05-17T04:09:11.607786+0000","last_clean":"2024-05-17T04:09:11.607786+0000","last_became_active":"2024-05-17T04:09:10.611068+0000","last_became_peered":"2024-05-17T04:09:10.611068+0000","last_unstale":"2024-05-17T04:09:11.607786+0000","last_undegraded":"2024-05-17T04:09:11.607786+0000","last_fullsized":"2024-05-17T04:09:11.607786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:32:16.388318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515650+0000","last_change":"2024-05-17T04:09:06.399281+0000","last_active":"2024-05-17T04:09:11.515650+0000","last_peered":"2024-05-17T04:09:11.515650+0000","last_clean":"2024-05-17T04:09:11.515650+0000","last_became_active":"2024-05-17T04:09:06.398973+0000","last_became_peered":"2024-05-17T04:09:06.398973+0000","last_unstale":"2024-05-17T04:09:11.515650+0000","last_undegraded":"2024-05-17T04:09:11.515650+0000","last_fullsized":"2024-05-17T04:09:11.515650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608834+0000","last_change":"2024-05-17T04:09:05.402787+0000","last_active":"2024-05-17T04:09:11.608834+0000","last_peered":"2024-05-17T04:09:11.608834+0000","last_clean":"2024-05-17T04:09:11.608834+0000","last_became_active":"2024-05-17T04:09:05.402451+0000","last_became_peered":"2024-05-17T04:09:05.402451+0000","last_unstale":"2024-05-17T04:09:11.608834+0000","last_undegraded":"2024-05-17T04:09:11.608834+0000","last_fullsized":"2024-05-17T04:09:11.608834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607456+0000","last_change":"2024-05-17T04:09:10.608220+0000","last_active":"2024-05-17T04:09:11.607456+0000","last_peered":"2024-05-17T04:09:11.607456+0000","last_clean":"2024-05-17T04:09:11.607456+0000","last_became_active":"2024-05-17T04:09:10.607719+0000","last_became_peered":"2024-05-17T04:09:10.607719+0000","last_unstale":"2024-05-17T04:09:11.607456+0000","last_undegraded":"2024-05-17T04:09:11.607456+0000","last_fullsized":"2024-05-17T04:09:11.607456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:53:08.507830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426361+0000","last_change":"2024-05-17T04:09:06.406634+0000","last_active":"2024-05-17T04:09:11.426361+0000","last_peered":"2024-05-17T04:09:11.426361+0000","last_clean":"2024-05-17T04:09:11.426361+0000","last_became_active":"2024-05-17T04:09:06.406011+0000","last_became_peered":"2024-05-17T04:09:06.406011+0000","last_unstale":"2024-05-17T04:09:11.426361+0000","last_undegraded":"2024-05-17T04:09:11.426361+0000","last_fullsized":"2024-05-17T04:09:11.426361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:49.079670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515733+0000","last_change":"2024-05-17T04:09:05.395393+0000","last_active":"2024-05-17T04:09:11.515733+0000","last_peered":"2024-05-17T04:09:11.515733+0000","last_clean":"2024-05-17T04:09:11.515733+0000","last_became_active":"2024-05-17T04:09:05.395026+0000","last_became_peered":"2024-05-17T04:09:05.395026+0000","last_unstale":"2024-05-17T04:09:11.515733+0000","last_undegraded":"2024-05-17T04:09:11.515733+0000","last_fullsized":"2024-05-17T04:09:11.515733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514970+0000","last_change":"2024-05-17T04:09:10.426127+0000","last_active":"2024-05-17T04:09:11.514970+0000","last_peered":"2024-05-17T04:09:11.514970+0000","last_clean":"2024-05-17T04:09:11.514970+0000","last_became_active":"2024-05-17T04:09:10.425310+0000","last_became_peered":"2024-05-17T04:09:10.425310+0000","last_unstale":"2024-05-17T04:09:11.514970+0000","last_undegraded":"2024-05-17T04:09:11.514970+0000","last_fullsized":"2024-05-17T04:09:11.514970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:05:01.660626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426527+0000","last_change":"2024-05-17T04:09:06.396617+0000","last_active":"2024-05-17T04:09:11.426527+0000","last_peered":"2024-05-17T04:09:11.426527+0000","last_clean":"2024-05-17T04:09:11.426527+0000","last_became_active":"2024-05-17T04:09:06.396314+0000","last_became_peered":"2024-05-17T04:09:06.396314+0000","last_unstale":"2024-05-17T04:09:11.426527+0000","last_undegraded":"2024-05-17T04:09:11.426527+0000","last_fullsized":"2024-05-17T04:09:11.426527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:07.188086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425216+0000","last_change":"2024-05-17T04:09:05.394393+0000","last_active":"2024-05-17T04:09:11.425216+0000","last_peered":"2024-05-17T04:09:11.425216+0000","last_clean":"2024-05-17T04:09:11.425216+0000","last_became_active":"2024-05-17T04:09:05.393756+0000","last_became_peered":"2024-05-17T04:09:05.393756+0000","last_unstale":"2024-05-17T04:09:11.425216+0000","last_undegraded":"2024-05-17T04:09:11.425216+0000","last_fullsized":"2024-05-17T04:09:11.425216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515309+0000","last_change":"2024-05-17T04:09:10.419986+0000","last_active":"2024-05-17T04:09:11.515309+0000","last_peered":"2024-05-17T04:09:11.515309+0000","last_clean":"2024-05-17T04:09:11.515309+0000","last_became_active":"2024-05-17T04:09:10.419116+0000","last_became_peered":"2024-05-17T04:09:10.419116+0000","last_unstale":"2024-05-17T04:09:11.515309+0000","last_undegraded":"2024-05-17T04:09:11.515309+0000","last_fullsized":"2024-05-17T04:09:11.515309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:28.367001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514954+0000","last_change":"2024-05-17T04:09:06.407059+0000","last_active":"2024-05-17T04:09:11.514954+0000","last_peered":"2024-05-17T04:09:11.514954+0000","last_clean":"2024-05-17T04:09:11.514954+0000","last_became_active":"2024-05-17T04:09:06.406752+0000","last_became_peered":"2024-05-17T04:09:06.406752+0000","last_unstale":"2024-05-17T04:09:11.514954+0000","last_undegraded":"2024-05-17T04:09:11.514954+0000","last_fullsized":"2024-05-17T04:09:11.514954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.423948+0000","last_change":"2024-05-17T04:09:05.390296+0000","last_active":"2024-05-17T04:09:11.423948+0000","last_peered":"2024-05-17T04:09:11.423948+0000","last_clean":"2024-05-17T04:09:11.423948+0000","last_became_active":"2024-05-17T04:09:05.389917+0000","last_became_peered":"2024-05-17T04:09:05.389917+0000","last_unstale":"2024-05-17T04:09:11.423948+0000","last_undegraded":"2024-05-17T04:09:11.423948+0000","last_fullsized":"2024-05-17T04:09:11.423948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515762+0000","last_change":"2024-05-17T04:09:10.429919+0000","last_active":"2024-05-17T04:09:11.515762+0000","last_peered":"2024-05-17T04:09:11.515762+0000","last_clean":"2024-05-17T04:09:11.515762+0000","last_became_active":"2024-05-17T04:09:10.429394+0000","last_became_peered":"2024-05-17T04:09:10.429394+0000","last_unstale":"2024-05-17T04:09:11.515762+0000","last_undegraded":"2024-05-17T04:09:11.515762+0000","last_fullsized":"2024-05-17T04:09:11.515762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:44.081339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.606952+0000","last_change":"2024-05-17T04:09:06.403836+0000","last_active":"2024-05-17T04:09:11.606952+0000","last_peered":"2024-05-17T04:09:11.606952+0000","last_clean":"2024-05-17T04:09:11.606952+0000","last_became_active":"2024-05-17T04:09:06.403514+0000","last_became_peered":"2024-05-17T04:09:06.403514+0000","last_unstale":"2024-05-17T04:09:11.606952+0000","last_undegraded":"2024-05-17T04:09:11.606952+0000","last_fullsized":"2024-05-17T04:09:11.606952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:01:05.018624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607372+0000","last_change":"2024-05-17T04:09:05.401167+0000","last_active":"2024-05-17T04:09:11.607372+0000","last_peered":"2024-05-17T04:09:11.607372+0000","last_clean":"2024-05-17T04:09:11.607372+0000","last_became_active":"2024-05-17T04:09:05.400797+0000","last_became_peered":"2024-05-17T04:09:05.400797+0000","last_unstale":"2024-05-17T04:09:11.607372+0000","last_undegraded":"2024-05-17T04:09:11.607372+0000","last_fullsized":"2024-05-17T04:09:11.607372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:23:01.826205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607778+0000","last_change":"2024-05-17T04:09:10.607420+0000","last_active":"2024-05-17T04:09:11.607778+0000","last_peered":"2024-05-17T04:09:11.607778+0000","last_clean":"2024-05-17T04:09:11.607778+0000","last_became_active":"2024-05-17T04:09:10.606963+0000","last_became_peered":"2024-05-17T04:09:10.606963+0000","last_unstale":"2024-05-17T04:09:11.607778+0000","last_undegraded":"2024-05-17T04:09:11.607778+0000","last_fullsized":"2024-05-17T04:09:11.607778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:28.367001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607186+0000","last_change":"2024-05-17T04:09:06.414099+0000","last_active":"2024-05-17T04:09:11.607186+0000","last_peered":"2024-05-17T04:09:11.607186+0000","last_clean":"2024-05-17T04:09:11.607186+0000","last_became_active":"2024-05-17T04:09:06.413727+0000","last_became_peered":"2024-05-17T04:09:06.413727+0000","last_unstale":"2024-05-17T04:09:11.607186+0000","last_undegraded":"2024-05-17T04:09:11.607186+0000","last_fullsized":"2024-05-17T04:09:11.607186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424782+0000","last_change":"2024-05-17T04:09:05.395595+0000","last_active":"2024-05-17T04:09:11.424782+0000","last_peered":"2024-05-17T04:09:11.424782+0000","last_clean":"2024-05-17T04:09:11.424782+0000","last_became_active":"2024-05-17T04:09:05.395288+0000","last_became_peered":"2024-05-17T04:09:05.395288+0000","last_unstale":"2024-05-17T04:09:11.424782+0000","last_undegraded":"2024-05-17T04:09:11.424782+0000","last_fullsized":"2024-05-17T04:09:11.424782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607476+0000","last_change":"2024-05-17T04:08:56.447797+0000","last_active":"2024-05-17T04:09:11.607476+0000","last_peered":"2024-05-17T04:09:11.607476+0000","last_clean":"2024-05-17T04:09:11.607476+0000","last_became_active":"2024-05-17T04:08:56.446705+0000","last_became_peered":"2024-05-17T04:08:56.446705+0000","last_unstale":"2024-05-17T04:09:11.607476+0000","last_undegraded":"2024-05-17T04:09:11.607476+0000","last_fullsized":"2024-05-17T04:09:11.607476+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_clean_scrub_stamp":"2024-05-17T04:08:54.847367+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:40:00.515431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608157+0000","last_change":"2024-05-17T04:09:10.608442+0000","last_active":"2024-05-17T04:09:11.608157+0000","last_peered":"2024-05-17T04:09:11.608157+0000","last_clean":"2024-05-17T04:09:11.608157+0000","last_became_active":"2024-05-17T04:09:10.607993+0000","last_became_peered":"2024-05-17T04:09:10.607993+0000","last_unstale":"2024-05-17T04:09:11.608157+0000","last_undegraded":"2024-05-17T04:09:11.608157+0000","last_fullsized":"2024-05-17T04:09:11.608157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:53.104122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608435+0000","last_change":"2024-05-17T04:09:06.414021+0000","last_active":"2024-05-17T04:09:11.608435+0000","last_peered":"2024-05-17T04:09:11.608435+0000","last_clean":"2024-05-17T04:09:11.608435+0000","last_became_active":"2024-05-17T04:09:06.413481+0000","last_became_peered":"2024-05-17T04:09:06.413481+0000","last_unstale":"2024-05-17T04:09:11.608435+0000","last_undegraded":"2024-05-17T04:09:11.608435+0000","last_fullsized":"2024-05-17T04:09:11.608435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:31.927628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424257+0000","last_change":"2024-05-17T04:09:05.394878+0000","last_active":"2024-05-17T04:09:11.424257+0000","last_peered":"2024-05-17T04:09:11.424257+0000","last_clean":"2024-05-17T04:09:11.424257+0000","last_became_active":"2024-05-17T04:09:05.394529+0000","last_became_peered":"2024-05-17T04:09:05.394529+0000","last_unstale":"2024-05-17T04:09:11.424257+0000","last_undegraded":"2024-05-17T04:09:11.424257+0000","last_fullsized":"2024-05-17T04:09:11.424257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:41:33.830645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607795+0000","last_change":"2024-05-17T04:09:10.607640+0000","last_active":"2024-05-17T04:09:11.607795+0000","last_peered":"2024-05-17T04:09:11.607795+0000","last_clean":"2024-05-17T04:09:11.607795+0000","last_became_active":"2024-05-17T04:09:10.607137+0000","last_became_peered":"2024-05-17T04:09:10.607137+0000","last_unstale":"2024-05-17T04:09:11.607795+0000","last_undegraded":"2024-05-17T04:09:11.607795+0000","last_fullsized":"2024-05-17T04:09:11.607795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:35.952081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426630+0000","last_change":"2024-05-17T04:09:06.399777+0000","last_active":"2024-05-17T04:09:11.426630+0000","last_peered":"2024-05-17T04:09:11.426630+0000","last_clean":"2024-05-17T04:09:11.426630+0000","last_became_active":"2024-05-17T04:09:06.399443+0000","last_became_peered":"2024-05-17T04:09:06.399443+0000","last_unstale":"2024-05-17T04:09:11.426630+0000","last_undegraded":"2024-05-17T04:09:11.426630+0000","last_fullsized":"2024-05-17T04:09:11.426630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:39.835171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515423+0000","last_change":"2024-05-17T04:09:05.397664+0000","last_active":"2024-05-17T04:09:11.515423+0000","last_peered":"2024-05-17T04:09:11.515423+0000","last_clean":"2024-05-17T04:09:11.515423+0000","last_became_active":"2024-05-17T04:09:05.397386+0000","last_became_peered":"2024-05-17T04:09:05.397386+0000","last_unstale":"2024-05-17T04:09:11.515423+0000","last_undegraded":"2024-05-17T04:09:11.515423+0000","last_fullsized":"2024-05-17T04:09:11.515423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607683+0000","last_change":"2024-05-17T04:09:10.424457+0000","last_active":"2024-05-17T04:09:11.607683+0000","last_peered":"2024-05-17T04:09:11.607683+0000","last_clean":"2024-05-17T04:09:11.607683+0000","last_became_active":"2024-05-17T04:09:10.423487+0000","last_became_peered":"2024-05-17T04:09:10.423487+0000","last_unstale":"2024-05-17T04:09:11.607683+0000","last_undegraded":"2024-05-17T04:09:11.607683+0000","last_fullsized":"2024-05-17T04:09:11.607683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:14.612103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.609012+0000","last_change":"2024-05-17T04:09:06.411544+0000","last_active":"2024-05-17T04:09:11.609012+0000","last_peered":"2024-05-17T04:09:11.609012+0000","last_clean":"2024-05-17T04:09:11.609012+0000","last_became_active":"2024-05-17T04:09:06.411193+0000","last_became_peered":"2024-05-17T04:09:06.411193+0000","last_unstale":"2024-05-17T04:09:11.609012+0000","last_undegraded":"2024-05-17T04:09:11.609012+0000","last_fullsized":"2024-05-17T04:09:11.609012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:40.056886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424170+0000","last_change":"2024-05-17T04:09:05.390395+0000","last_active":"2024-05-17T04:09:11.424170+0000","last_peered":"2024-05-17T04:09:11.424170+0000","last_clean":"2024-05-17T04:09:11.424170+0000","last_became_active":"2024-05-17T04:09:05.389769+0000","last_became_peered":"2024-05-17T04:09:05.389769+0000","last_unstale":"2024-05-17T04:09:11.424170+0000","last_undegraded":"2024-05-17T04:09:11.424170+0000","last_fullsized":"2024-05-17T04:09:11.424170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424395+0000","last_change":"2024-05-17T04:09:10.610765+0000","last_active":"2024-05-17T04:09:11.424395+0000","last_peered":"2024-05-17T04:09:11.424395+0000","last_clean":"2024-05-17T04:09:11.424395+0000","last_became_active":"2024-05-17T04:09:10.610286+0000","last_became_peered":"2024-05-17T04:09:10.610286+0000","last_unstale":"2024-05-17T04:09:11.424395+0000","last_undegraded":"2024-05-17T04:09:11.424395+0000","last_fullsized":"2024-05-17T04:09:11.424395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:31:14.568941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608756+0000","last_change":"2024-05-17T04:09:06.408406+0000","last_active":"2024-05-17T04:09:11.608756+0000","last_peered":"2024-05-17T04:09:11.608756+0000","last_clean":"2024-05-17T04:09:11.608756+0000","last_became_active":"2024-05-17T04:09:06.405343+0000","last_became_peered":"2024-05-17T04:09:06.405343+0000","last_unstale":"2024-05-17T04:09:11.608756+0000","last_undegraded":"2024-05-17T04:09:11.608756+0000","last_fullsized":"2024-05-17T04:09:11.608756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:49.079670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426903+0000","last_change":"2024-05-17T04:09:05.396149+0000","last_active":"2024-05-17T04:09:11.426903+0000","last_peered":"2024-05-17T04:09:11.426903+0000","last_clean":"2024-05-17T04:09:11.426903+0000","last_became_active":"2024-05-17T04:09:05.395640+0000","last_became_peered":"2024-05-17T04:09:05.395640+0000","last_unstale":"2024-05-17T04:09:11.426903+0000","last_undegraded":"2024-05-17T04:09:11.426903+0000","last_fullsized":"2024-05-17T04:09:11.426903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:36:25.869388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424730+0000","last_change":"2024-05-17T04:09:10.420386+0000","last_active":"2024-05-17T04:09:11.424730+0000","last_peered":"2024-05-17T04:09:11.424730+0000","last_clean":"2024-05-17T04:09:11.424730+0000","last_became_active":"2024-05-17T04:09:10.419914+0000","last_became_peered":"2024-05-17T04:09:10.419914+0000","last_unstale":"2024-05-17T04:09:11.424730+0000","last_undegraded":"2024-05-17T04:09:11.424730+0000","last_fullsized":"2024-05-17T04:09:11.424730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:06.408047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607581+0000","last_change":"2024-05-17T04:09:06.408118+0000","last_active":"2024-05-17T04:09:11.607581+0000","last_peered":"2024-05-17T04:09:11.607581+0000","last_clean":"2024-05-17T04:09:11.607581+0000","last_became_active":"2024-05-17T04:09:06.406680+0000","last_became_peered":"2024-05-17T04:09:06.406680+0000","last_unstale":"2024-05-17T04:09:11.607581+0000","last_undegraded":"2024-05-17T04:09:11.607581+0000","last_fullsized":"2024-05-17T04:09:11.607581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:34.167127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.423794+0000","last_change":"2024-05-17T04:09:05.397048+0000","last_active":"2024-05-17T04:09:11.423794+0000","last_peered":"2024-05-17T04:09:11.423794+0000","last_clean":"2024-05-17T04:09:11.423794+0000","last_became_active":"2024-05-17T04:09:05.396745+0000","last_became_peered":"2024-05-17T04:09:05.396745+0000","last_unstale":"2024-05-17T04:09:11.423794+0000","last_undegraded":"2024-05-17T04:09:11.423794+0000","last_fullsized":"2024-05-17T04:09:11.423794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607578+0000","last_change":"2024-05-17T04:09:10.427098+0000","last_active":"2024-05-17T04:09:11.607578+0000","last_peered":"2024-05-17T04:09:11.607578+0000","last_clean":"2024-05-17T04:09:11.607578+0000","last_became_active":"2024-05-17T04:09:10.426559+0000","last_became_peered":"2024-05-17T04:09:10.426559+0000","last_unstale":"2024-05-17T04:09:11.607578+0000","last_undegraded":"2024-05-17T04:09:11.607578+0000","last_fullsized":"2024-05-17T04:09:11.607578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:44.081339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607896+0000","last_change":"2024-05-17T04:09:06.394018+0000","last_active":"2024-05-17T04:09:11.607896+0000","last_peered":"2024-05-17T04:09:11.607896+0000","last_clean":"2024-05-17T04:09:11.607896+0000","last_became_active":"2024-05-17T04:09:06.393664+0000","last_became_peered":"2024-05-17T04:09:06.393664+0000","last_unstale":"2024-05-17T04:09:11.607896+0000","last_undegraded":"2024-05-17T04:09:11.607896+0000","last_fullsized":"2024-05-17T04:09:11.607896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:07:56.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607640+0000","last_change":"2024-05-17T04:09:05.395140+0000","last_active":"2024-05-17T04:09:11.607640+0000","last_peered":"2024-05-17T04:09:11.607640+0000","last_clean":"2024-05-17T04:09:11.607640+0000","last_became_active":"2024-05-17T04:09:05.394556+0000","last_became_peered":"2024-05-17T04:09:05.394556+0000","last_unstale":"2024-05-17T04:09:11.607640+0000","last_undegraded":"2024-05-17T04:09:11.607640+0000","last_fullsized":"2024-05-17T04:09:11.607640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607361+0000","last_change":"2024-05-17T04:09:10.608635+0000","last_active":"2024-05-17T04:09:11.607361+0000","last_peered":"2024-05-17T04:09:11.607361+0000","last_clean":"2024-05-17T04:09:11.607361+0000","last_became_active":"2024-05-17T04:09:10.608151+0000","last_became_peered":"2024-05-17T04:09:10.608151+0000","last_unstale":"2024-05-17T04:09:11.607361+0000","last_undegraded":"2024-05-17T04:09:11.607361+0000","last_fullsized":"2024-05-17T04:09:11.607361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:32:44.289047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607892+0000","last_change":"2024-05-17T04:09:06.407790+0000","last_active":"2024-05-17T04:09:11.607892+0000","last_peered":"2024-05-17T04:09:11.607892+0000","last_clean":"2024-05-17T04:09:11.607892+0000","last_became_active":"2024-05-17T04:09:06.407484+0000","last_became_peered":"2024-05-17T04:09:06.407484+0000","last_unstale":"2024-05-17T04:09:11.607892+0000","last_undegraded":"2024-05-17T04:09:11.607892+0000","last_fullsized":"2024-05-17T04:09:11.607892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:39.835171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425090+0000","last_change":"2024-05-17T04:09:05.393381+0000","last_active":"2024-05-17T04:09:11.425090+0000","last_peered":"2024-05-17T04:09:11.425090+0000","last_clean":"2024-05-17T04:09:11.425090+0000","last_became_active":"2024-05-17T04:09:05.392480+0000","last_became_peered":"2024-05-17T04:09:05.392480+0000","last_unstale":"2024-05-17T04:09:11.425090+0000","last_undegraded":"2024-05-17T04:09:11.425090+0000","last_fullsized":"2024-05-17T04:09:11.425090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608339+0000","last_change":"2024-05-17T04:09:10.607929+0000","last_active":"2024-05-17T04:09:11.608339+0000","last_peered":"2024-05-17T04:09:11.608339+0000","last_clean":"2024-05-17T04:09:11.608339+0000","last_became_active":"2024-05-17T04:09:10.606975+0000","last_became_peered":"2024-05-17T04:09:10.606975+0000","last_unstale":"2024-05-17T04:09:11.608339+0000","last_undegraded":"2024-05-17T04:09:11.608339+0000","last_fullsized":"2024-05-17T04:09:11.608339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:36:14.040927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607173+0000","last_change":"2024-05-17T04:09:06.399704+0000","last_active":"2024-05-17T04:09:11.607173+0000","last_peered":"2024-05-17T04:09:11.607173+0000","last_clean":"2024-05-17T04:09:11.607173+0000","last_became_active":"2024-05-17T04:09:06.399395+0000","last_became_peered":"2024-05-17T04:09:06.399395+0000","last_unstale":"2024-05-17T04:09:11.607173+0000","last_undegraded":"2024-05-17T04:09:11.607173+0000","last_fullsized":"2024-05-17T04:09:11.607173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:33:02.204060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608048+0000","last_change":"2024-05-17T04:09:05.394133+0000","last_active":"2024-05-17T04:09:11.608048+0000","last_peered":"2024-05-17T04:09:11.608048+0000","last_clean":"2024-05-17T04:09:11.608048+0000","last_became_active":"2024-05-17T04:09:05.393854+0000","last_became_peered":"2024-05-17T04:09:05.393854+0000","last_unstale":"2024-05-17T04:09:11.608048+0000","last_undegraded":"2024-05-17T04:09:11.608048+0000","last_fullsized":"2024-05-17T04:09:11.608048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:41:33.830645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426113+0000","last_change":"2024-05-17T04:09:10.607826+0000","last_active":"2024-05-17T04:09:11.426113+0000","last_peered":"2024-05-17T04:09:11.426113+0000","last_clean":"2024-05-17T04:09:11.426113+0000","last_became_active":"2024-05-17T04:09:10.607382+0000","last_became_peered":"2024-05-17T04:09:10.607382+0000","last_unstale":"2024-05-17T04:09:11.426113+0000","last_undegraded":"2024-05-17T04:09:11.426113+0000","last_fullsized":"2024-05-17T04:09:11.426113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:55:48.002918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608335+0000","last_change":"2024-05-17T04:09:06.403425+0000","last_active":"2024-05-17T04:09:11.608335+0000","last_peered":"2024-05-17T04:09:11.608335+0000","last_clean":"2024-05-17T04:09:11.608335+0000","last_became_active":"2024-05-17T04:09:06.403093+0000","last_became_peered":"2024-05-17T04:09:06.403093+0000","last_unstale":"2024-05-17T04:09:11.608335+0000","last_undegraded":"2024-05-17T04:09:11.608335+0000","last_fullsized":"2024-05-17T04:09:11.608335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:41.984177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:15.993336+0000","last_change":"2024-05-17T04:09:05.393968+0000","last_active":"2024-05-17T04:09:15.993336+0000","last_peered":"2024-05-17T04:09:15.993336+0000","last_clean":"2024-05-17T04:09:15.993336+0000","last_became_active":"2024-05-17T04:09:05.393641+0000","last_became_peered":"2024-05-17T04:09:05.393641+0000","last_unstale":"2024-05-17T04:09:15.993336+0000","last_undegraded":"2024-05-17T04:09:15.993336+0000","last_fullsized":"2024-05-17T04:09:15.993336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515095+0000","last_change":"2024-05-17T04:09:10.424091+0000","last_active":"2024-05-17T04:09:11.515095+0000","last_peered":"2024-05-17T04:09:11.515095+0000","last_clean":"2024-05-17T04:09:11.515095+0000","last_became_active":"2024-05-17T04:09:10.423669+0000","last_became_peered":"2024-05-17T04:09:10.423669+0000","last_unstale":"2024-05-17T04:09:11.515095+0000","last_undegraded":"2024-05-17T04:09:11.515095+0000","last_fullsized":"2024-05-17T04:09:11.515095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:14.612103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425973+0000","last_change":"2024-05-17T04:09:06.395242+0000","last_active":"2024-05-17T04:09:11.425973+0000","last_peered":"2024-05-17T04:09:11.425973+0000","last_clean":"2024-05-17T04:09:11.425973+0000","last_became_active":"2024-05-17T04:09:06.394956+0000","last_became_peered":"2024-05-17T04:09:06.394956+0000","last_unstale":"2024-05-17T04:09:11.425973+0000","last_undegraded":"2024-05-17T04:09:11.425973+0000","last_fullsized":"2024-05-17T04:09:11.425973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:35.828470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515417+0000","last_change":"2024-05-17T04:09:05.395871+0000","last_active":"2024-05-17T04:09:11.515417+0000","last_peered":"2024-05-17T04:09:11.515417+0000","last_clean":"2024-05-17T04:09:11.515417+0000","last_became_active":"2024-05-17T04:09:05.395565+0000","last_became_peered":"2024-05-17T04:09:05.395565+0000","last_unstale":"2024-05-17T04:09:11.515417+0000","last_undegraded":"2024-05-17T04:09:11.515417+0000","last_fullsized":"2024-05-17T04:09:11.515417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:34.821170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425594+0000","last_change":"2024-05-17T04:09:10.422395+0000","last_active":"2024-05-17T04:09:11.425594+0000","last_peered":"2024-05-17T04:09:11.425594+0000","last_clean":"2024-05-17T04:09:11.425594+0000","last_became_active":"2024-05-17T04:09:10.421563+0000","last_became_peered":"2024-05-17T04:09:10.421563+0000","last_unstale":"2024-05-17T04:09:11.425594+0000","last_undegraded":"2024-05-17T04:09:11.425594+0000","last_fullsized":"2024-05-17T04:09:11.425594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:53.104122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608163+0000","last_change":"2024-05-17T04:09:06.407304+0000","last_active":"2024-05-17T04:09:11.608163+0000","last_peered":"2024-05-17T04:09:11.608163+0000","last_clean":"2024-05-17T04:09:11.608163+0000","last_became_active":"2024-05-17T04:09:06.406969+0000","last_became_peered":"2024-05-17T04:09:06.406969+0000","last_unstale":"2024-05-17T04:09:11.608163+0000","last_undegraded":"2024-05-17T04:09:11.608163+0000","last_fullsized":"2024-05-17T04:09:11.608163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426091+0000","last_change":"2024-05-17T04:09:05.396508+0000","last_active":"2024-05-17T04:09:11.426091+0000","last_peered":"2024-05-17T04:09:11.426091+0000","last_clean":"2024-05-17T04:09:11.426091+0000","last_became_active":"2024-05-17T04:09:05.396175+0000","last_became_peered":"2024-05-17T04:09:05.396175+0000","last_unstale":"2024-05-17T04:09:11.426091+0000","last_undegraded":"2024-05-17T04:09:11.426091+0000","last_fullsized":"2024-05-17T04:09:11.426091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607951+0000","last_change":"2024-05-17T04:09:10.426973+0000","last_active":"2024-05-17T04:09:11.607951+0000","last_peered":"2024-05-17T04:09:11.607951+0000","last_clean":"2024-05-17T04:09:11.607951+0000","last_became_active":"2024-05-17T04:09:10.426412+0000","last_became_peered":"2024-05-17T04:09:10.426412+0000","last_unstale":"2024-05-17T04:09:11.607951+0000","last_undegraded":"2024-05-17T04:09:11.607951+0000","last_fullsized":"2024-05-17T04:09:11.607951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:12:14.748809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425895+0000","last_change":"2024-05-17T04:09:06.403005+0000","last_active":"2024-05-17T04:09:11.425895+0000","last_peered":"2024-05-17T04:09:11.425895+0000","last_clean":"2024-05-17T04:09:11.425895+0000","last_became_active":"2024-05-17T04:09:06.402234+0000","last_became_peered":"2024-05-17T04:09:06.402234+0000","last_unstale":"2024-05-17T04:09:11.425895+0000","last_undegraded":"2024-05-17T04:09:11.425895+0000","last_fullsized":"2024-05-17T04:09:11.425895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:02:56.514685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608325+0000","last_change":"2024-05-17T04:09:05.398997+0000","last_active":"2024-05-17T04:09:11.608325+0000","last_peered":"2024-05-17T04:09:11.608325+0000","last_clean":"2024-05-17T04:09:11.608325+0000","last_became_active":"2024-05-17T04:09:05.398311+0000","last_became_peered":"2024-05-17T04:09:05.398311+0000","last_unstale":"2024-05-17T04:09:11.608325+0000","last_undegraded":"2024-05-17T04:09:11.608325+0000","last_fullsized":"2024-05-17T04:09:11.608325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607285+0000","last_change":"2024-05-17T04:09:10.611442+0000","last_active":"2024-05-17T04:09:11.607285+0000","last_peered":"2024-05-17T04:09:11.607285+0000","last_clean":"2024-05-17T04:09:11.607285+0000","last_became_active":"2024-05-17T04:09:10.610948+0000","last_became_peered":"2024-05-17T04:09:10.610948+0000","last_unstale":"2024-05-17T04:09:11.607285+0000","last_undegraded":"2024-05-17T04:09:11.607285+0000","last_fullsized":"2024-05-17T04:09:11.607285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:55:48.002918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607426+0000","last_change":"2024-05-17T04:09:10.610609+0000","last_active":"2024-05-17T04:09:11.607426+0000","last_peered":"2024-05-17T04:09:11.607426+0000","last_clean":"2024-05-17T04:09:11.607426+0000","last_became_active":"2024-05-17T04:09:10.610158+0000","last_became_peered":"2024-05-17T04:09:10.610158+0000","last_unstale":"2024-05-17T04:09:11.607426+0000","last_undegraded":"2024-05-17T04:09:11.607426+0000","last_fullsized":"2024-05-17T04:09:11.607426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:05:01.660626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514846+0000","last_change":"2024-05-17T04:09:06.405815+0000","last_active":"2024-05-17T04:09:11.514846+0000","last_peered":"2024-05-17T04:09:11.514846+0000","last_clean":"2024-05-17T04:09:11.514846+0000","last_became_active":"2024-05-17T04:09:06.405516+0000","last_became_peered":"2024-05-17T04:09:06.405516+0000","last_unstale":"2024-05-17T04:09:11.514846+0000","last_undegraded":"2024-05-17T04:09:11.514846+0000","last_fullsized":"2024-05-17T04:09:11.514846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426561+0000","last_change":"2024-05-17T04:09:05.392753+0000","last_active":"2024-05-17T04:09:11.426561+0000","last_peered":"2024-05-17T04:09:11.426561+0000","last_clean":"2024-05-17T04:09:11.426561+0000","last_became_active":"2024-05-17T04:09:05.392392+0000","last_became_peered":"2024-05-17T04:09:05.392392+0000","last_unstale":"2024-05-17T04:09:11.426561+0000","last_undegraded":"2024-05-17T04:09:11.426561+0000","last_fullsized":"2024-05-17T04:09:11.426561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608054+0000","last_change":"2024-05-17T04:09:10.425375+0000","last_active":"2024-05-17T04:09:11.608054+0000","last_peered":"2024-05-17T04:09:11.608054+0000","last_clean":"2024-05-17T04:09:11.608054+0000","last_became_active":"2024-05-17T04:09:10.424219+0000","last_became_peered":"2024-05-17T04:09:10.424219+0000","last_unstale":"2024-05-17T04:09:11.608054+0000","last_undegraded":"2024-05-17T04:09:11.608054+0000","last_fullsized":"2024-05-17T04:09:11.608054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:43.859624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607887+0000","last_change":"2024-05-17T04:09:06.398505+0000","last_active":"2024-05-17T04:09:11.607887+0000","last_peered":"2024-05-17T04:09:11.607887+0000","last_clean":"2024-05-17T04:09:11.607887+0000","last_became_active":"2024-05-17T04:09:06.398135+0000","last_became_peered":"2024-05-17T04:09:06.398135+0000","last_unstale":"2024-05-17T04:09:11.607887+0000","last_undegraded":"2024-05-17T04:09:11.607887+0000","last_fullsized":"2024-05-17T04:09:11.607887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:07:56.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607594+0000","last_change":"2024-05-17T04:09:05.396795+0000","last_active":"2024-05-17T04:09:11.607594+0000","last_peered":"2024-05-17T04:09:11.607594+0000","last_clean":"2024-05-17T04:09:11.607594+0000","last_became_active":"2024-05-17T04:09:05.396335+0000","last_became_peered":"2024-05-17T04:09:05.396335+0000","last_unstale":"2024-05-17T04:09:11.607594+0000","last_undegraded":"2024-05-17T04:09:11.607594+0000","last_fullsized":"2024-05-17T04:09:11.607594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:57:11.208612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607531+0000","last_change":"2024-05-17T04:09:05.393287+0000","last_active":"2024-05-17T04:09:11.607531+0000","last_peered":"2024-05-17T04:09:11.607531+0000","last_clean":"2024-05-17T04:09:11.607531+0000","last_became_active":"2024-05-17T04:09:05.392948+0000","last_became_peered":"2024-05-17T04:09:05.392948+0000","last_unstale":"2024-05-17T04:09:11.607531+0000","last_undegraded":"2024-05-17T04:09:11.607531+0000","last_fullsized":"2024-05-17T04:09:11.607531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607875+0000","last_change":"2024-05-17T04:09:06.403950+0000","last_active":"2024-05-17T04:09:11.607875+0000","last_peered":"2024-05-17T04:09:11.607875+0000","last_clean":"2024-05-17T04:09:11.607875+0000","last_became_active":"2024-05-17T04:09:06.403257+0000","last_became_peered":"2024-05-17T04:09:06.403257+0000","last_unstale":"2024-05-17T04:09:11.607875+0000","last_undegraded":"2024-05-17T04:09:11.607875+0000","last_fullsized":"2024-05-17T04:09:11.607875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424114+0000","last_change":"2024-05-17T04:09:10.424315+0000","last_active":"2024-05-17T04:09:11.424114+0000","last_peered":"2024-05-17T04:09:11.424114+0000","last_clean":"2024-05-17T04:09:11.424114+0000","last_became_active":"2024-05-17T04:09:10.423838+0000","last_became_peered":"2024-05-17T04:09:10.423838+0000","last_unstale":"2024-05-17T04:09:11.424114+0000","last_undegraded":"2024-05-17T04:09:11.424114+0000","last_fullsized":"2024-05-17T04:09:11.424114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:39:27.123196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608419+0000","last_change":"2024-05-17T04:09:05.398565+0000","last_active":"2024-05-17T04:09:11.608419+0000","last_peered":"2024-05-17T04:09:11.608419+0000","last_clean":"2024-05-17T04:09:11.608419+0000","last_became_active":"2024-05-17T04:09:05.398229+0000","last_became_peered":"2024-05-17T04:09:05.398229+0000","last_unstale":"2024-05-17T04:09:11.608419+0000","last_undegraded":"2024-05-17T04:09:11.608419+0000","last_fullsized":"2024-05-17T04:09:11.608419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425580+0000","last_change":"2024-05-17T04:09:06.400725+0000","last_active":"2024-05-17T04:09:11.425580+0000","last_peered":"2024-05-17T04:09:11.425580+0000","last_clean":"2024-05-17T04:09:11.425580+0000","last_became_active":"2024-05-17T04:09:06.400391+0000","last_became_peered":"2024-05-17T04:09:06.400391+0000","last_unstale":"2024-05-17T04:09:11.425580+0000","last_undegraded":"2024-05-17T04:09:11.425580+0000","last_fullsized":"2024-05-17T04:09:11.425580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:09.290308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607875+0000","last_change":"2024-05-17T04:09:10.420250+0000","last_active":"2024-05-17T04:09:11.607875+0000","last_peered":"2024-05-17T04:09:11.607875+0000","last_clean":"2024-05-17T04:09:11.607875+0000","last_became_active":"2024-05-17T04:09:10.419846+0000","last_became_peered":"2024-05-17T04:09:10.419846+0000","last_unstale":"2024-05-17T04:09:11.607875+0000","last_undegraded":"2024-05-17T04:09:11.607875+0000","last_fullsized":"2024-05-17T04:09:11.607875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:21:44.098959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607925+0000","last_change":"2024-05-17T04:09:06.395888+0000","last_active":"2024-05-17T04:09:11.607925+0000","last_peered":"2024-05-17T04:09:11.607925+0000","last_clean":"2024-05-17T04:09:11.607925+0000","last_became_active":"2024-05-17T04:09:06.395422+0000","last_became_peered":"2024-05-17T04:09:06.395422+0000","last_unstale":"2024-05-17T04:09:11.607925+0000","last_undegraded":"2024-05-17T04:09:11.607925+0000","last_fullsized":"2024-05-17T04:09:11.607925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:33:02.204060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.423823+0000","last_change":"2024-05-17T04:09:06.413727+0000","last_active":"2024-05-17T04:09:11.423823+0000","last_peered":"2024-05-17T04:09:11.423823+0000","last_clean":"2024-05-17T04:09:11.423823+0000","last_became_active":"2024-05-17T04:09:06.413402+0000","last_became_peered":"2024-05-17T04:09:06.413402+0000","last_unstale":"2024-05-17T04:09:11.423823+0000","last_undegraded":"2024-05-17T04:09:11.423823+0000","last_fullsized":"2024-05-17T04:09:11.423823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:01.464770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424975+0000","last_change":"2024-05-17T04:09:06.408357+0000","last_active":"2024-05-17T04:09:11.424975+0000","last_peered":"2024-05-17T04:09:11.424975+0000","last_clean":"2024-05-17T04:09:11.424975+0000","last_became_active":"2024-05-17T04:09:06.407758+0000","last_became_peered":"2024-05-17T04:09:06.407758+0000","last_unstale":"2024-05-17T04:09:11.424975+0000","last_undegraded":"2024-05-17T04:09:11.424975+0000","last_fullsized":"2024-05-17T04:09:11.424975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:24.342548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607783+0000","last_change":"2024-05-17T04:09:06.392141+0000","last_active":"2024-05-17T04:09:11.607783+0000","last_peered":"2024-05-17T04:09:11.607783+0000","last_clean":"2024-05-17T04:09:11.607783+0000","last_became_active":"2024-05-17T04:09:06.391676+0000","last_became_peered":"2024-05-17T04:09:06.391676+0000","last_unstale":"2024-05-17T04:09:11.607783+0000","last_undegraded":"2024-05-17T04:09:11.607783+0000","last_fullsized":"2024-05-17T04:09:11.607783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608443+0000","last_change":"2024-05-17T04:09:06.395595+0000","last_active":"2024-05-17T04:09:11.608443+0000","last_peered":"2024-05-17T04:09:11.608443+0000","last_clean":"2024-05-17T04:09:11.608443+0000","last_became_active":"2024-05-17T04:09:06.394124+0000","last_became_peered":"2024-05-17T04:09:06.394124+0000","last_unstale":"2024-05-17T04:09:11.608443+0000","last_undegraded":"2024-05-17T04:09:11.608443+0000","last_fullsized":"2024-05-17T04:09:11.608443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:34.167127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515269+0000","last_change":"2024-05-17T04:09:06.404994+0000","last_active":"2024-05-17T04:09:11.515269+0000","last_peered":"2024-05-17T04:09:11.515269+0000","last_clean":"2024-05-17T04:09:11.515269+0000","last_became_active":"2024-05-17T04:09:06.404667+0000","last_became_peered":"2024-05-17T04:09:06.404667+0000","last_unstale":"2024-05-17T04:09:11.515269+0000","last_undegraded":"2024-05-17T04:09:11.515269+0000","last_fullsized":"2024-05-17T04:09:11.515269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607898+0000","last_change":"2024-05-17T04:09:06.402279+0000","last_active":"2024-05-17T04:09:11.607898+0000","last_peered":"2024-05-17T04:09:11.607898+0000","last_clean":"2024-05-17T04:09:11.607898+0000","last_became_active":"2024-05-17T04:09:06.401947+0000","last_became_peered":"2024-05-17T04:09:06.401947+0000","last_unstale":"2024-05-17T04:09:11.607898+0000","last_undegraded":"2024-05-17T04:09:11.607898+0000","last_fullsized":"2024-05-17T04:09:11.607898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607463+0000","last_change":"2024-05-17T04:09:06.407232+0000","last_active":"2024-05-17T04:09:11.607463+0000","last_peered":"2024-05-17T04:09:11.607463+0000","last_clean":"2024-05-17T04:09:11.607463+0000","last_became_active":"2024-05-17T04:09:06.406929+0000","last_became_peered":"2024-05-17T04:09:06.406929+0000","last_unstale":"2024-05-17T04:09:11.607463+0000","last_undegraded":"2024-05-17T04:09:11.607463+0000","last_fullsized":"2024-05-17T04:09:11.607463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:02:56.514685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426472+0000","last_change":"2024-05-17T04:09:06.402162+0000","last_active":"2024-05-17T04:09:11.426472+0000","last_peered":"2024-05-17T04:09:11.426472+0000","last_clean":"2024-05-17T04:09:11.426472+0000","last_became_active":"2024-05-17T04:09:06.401853+0000","last_became_peered":"2024-05-17T04:09:06.401853+0000","last_unstale":"2024-05-17T04:09:11.426472+0000","last_undegraded":"2024-05-17T04:09:11.426472+0000","last_fullsized":"2024-05-17T04:09:11.426472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607445+0000","last_change":"2024-05-17T04:09:06.405967+0000","last_active":"2024-05-17T04:09:11.607445+0000","last_peered":"2024-05-17T04:09:11.607445+0000","last_clean":"2024-05-17T04:09:11.607445+0000","last_became_active":"2024-05-17T04:09:06.405658+0000","last_became_peered":"2024-05-17T04:09:06.405658+0000","last_unstale":"2024-05-17T04:09:11.607445+0000","last_undegraded":"2024-05-17T04:09:11.607445+0000","last_fullsized":"2024-05-17T04:09:11.607445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424870+0000","last_change":"2024-05-17T04:09:06.402392+0000","last_active":"2024-05-17T04:09:11.424870+0000","last_peered":"2024-05-17T04:09:11.424870+0000","last_clean":"2024-05-17T04:09:11.424870+0000","last_became_active":"2024-05-17T04:09:06.401547+0000","last_became_peered":"2024-05-17T04:09:06.401547+0000","last_unstale":"2024-05-17T04:09:11.424870+0000","last_undegraded":"2024-05-17T04:09:11.424870+0000","last_fullsized":"2024-05-17T04:09:11.424870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:04:57.636173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607524+0000","last_change":"2024-05-17T04:09:06.403901+0000","last_active":"2024-05-17T04:09:11.607524+0000","last_peered":"2024-05-17T04:09:11.607524+0000","last_clean":"2024-05-17T04:09:11.607524+0000","last_became_active":"2024-05-17T04:09:06.402890+0000","last_became_peered":"2024-05-17T04:09:06.402890+0000","last_unstale":"2024-05-17T04:09:11.607524+0000","last_undegraded":"2024-05-17T04:09:11.607524+0000","last_fullsized":"2024-05-17T04:09:11.607524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:07:56.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608474+0000","last_change":"2024-05-17T04:09:06.405422+0000","last_active":"2024-05-17T04:09:11.608474+0000","last_peered":"2024-05-17T04:09:11.608474+0000","last_clean":"2024-05-17T04:09:11.608474+0000","last_became_active":"2024-05-17T04:09:06.405094+0000","last_became_peered":"2024-05-17T04:09:06.405094+0000","last_unstale":"2024-05-17T04:09:11.608474+0000","last_undegraded":"2024-05-17T04:09:11.608474+0000","last_fullsized":"2024-05-17T04:09:11.608474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608609+0000","last_change":"2024-05-17T04:09:06.409849+0000","last_active":"2024-05-17T04:09:11.608609+0000","last_peered":"2024-05-17T04:09:11.608609+0000","last_clean":"2024-05-17T04:09:11.608609+0000","last_became_active":"2024-05-17T04:09:06.409168+0000","last_became_peered":"2024-05-17T04:09:06.409168+0000","last_unstale":"2024-05-17T04:09:11.608609+0000","last_undegraded":"2024-05-17T04:09:11.608609+0000","last_fullsized":"2024-05-17T04:09:11.608609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:04:57.636173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424161+0000","last_change":"2024-05-17T04:09:06.396066+0000","last_active":"2024-05-17T04:09:11.424161+0000","last_peered":"2024-05-17T04:09:11.424161+0000","last_clean":"2024-05-17T04:09:11.424161+0000","last_became_active":"2024-05-17T04:09:06.394962+0000","last_became_peered":"2024-05-17T04:09:06.394962+0000","last_unstale":"2024-05-17T04:09:11.424161+0000","last_undegraded":"2024-05-17T04:09:11.424161+0000","last_fullsized":"2024-05-17T04:09:11.424161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:35.828470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426434+0000","last_change":"2024-05-17T04:09:06.405156+0000","last_active":"2024-05-17T04:09:11.426434+0000","last_peered":"2024-05-17T04:09:11.426434+0000","last_clean":"2024-05-17T04:09:11.426434+0000","last_became_active":"2024-05-17T04:09:06.404857+0000","last_became_peered":"2024-05-17T04:09:06.404857+0000","last_unstale":"2024-05-17T04:09:11.426434+0000","last_undegraded":"2024-05-17T04:09:11.426434+0000","last_fullsized":"2024-05-17T04:09:11.426434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:10.587650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425653+0000","last_change":"2024-05-17T04:09:06.404527+0000","last_active":"2024-05-17T04:09:11.425653+0000","last_peered":"2024-05-17T04:09:11.425653+0000","last_clean":"2024-05-17T04:09:11.425653+0000","last_became_active":"2024-05-17T04:09:06.404215+0000","last_became_peered":"2024-05-17T04:09:06.404215+0000","last_unstale":"2024-05-17T04:09:11.425653+0000","last_undegraded":"2024-05-17T04:09:11.425653+0000","last_fullsized":"2024-05-17T04:09:11.425653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514907+0000","last_change":"2024-05-17T04:09:06.404828+0000","last_active":"2024-05-17T04:09:11.514907+0000","last_peered":"2024-05-17T04:09:11.514907+0000","last_clean":"2024-05-17T04:09:11.514907+0000","last_became_active":"2024-05-17T04:09:06.404512+0000","last_became_peered":"2024-05-17T04:09:06.404512+0000","last_unstale":"2024-05-17T04:09:11.514907+0000","last_undegraded":"2024-05-17T04:09:11.514907+0000","last_fullsized":"2024-05-17T04:09:11.514907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607167+0000","last_change":"2024-05-17T04:09:06.395825+0000","last_active":"2024-05-17T04:09:11.607167+0000","last_peered":"2024-05-17T04:09:11.607167+0000","last_clean":"2024-05-17T04:09:11.607167+0000","last_became_active":"2024-05-17T04:09:06.395519+0000","last_became_peered":"2024-05-17T04:09:06.395519+0000","last_unstale":"2024-05-17T04:09:11.607167+0000","last_undegraded":"2024-05-17T04:09:11.607167+0000","last_fullsized":"2024-05-17T04:09:11.607167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:24:33.148839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608216+0000","last_change":"2024-05-17T04:09:06.397289+0000","last_active":"2024-05-17T04:09:11.608216+0000","last_peered":"2024-05-17T04:09:11.608216+0000","last_clean":"2024-05-17T04:09:11.608216+0000","last_became_active":"2024-05-17T04:09:06.396970+0000","last_became_peered":"2024-05-17T04:09:06.396970+0000","last_unstale":"2024-05-17T04:09:11.608216+0000","last_undegraded":"2024-05-17T04:09:11.608216+0000","last_fullsized":"2024-05-17T04:09:11.608216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425858+0000","last_change":"2024-05-17T04:09:06.395813+0000","last_active":"2024-05-17T04:09:11.425858+0000","last_peered":"2024-05-17T04:09:11.425858+0000","last_clean":"2024-05-17T04:09:11.425858+0000","last_became_active":"2024-05-17T04:09:06.395523+0000","last_became_peered":"2024-05-17T04:09:06.395523+0000","last_unstale":"2024-05-17T04:09:11.425858+0000","last_undegraded":"2024-05-17T04:09:11.425858+0000","last_fullsized":"2024-05-17T04:09:11.425858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:01.464770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608123+0000","last_change":"2024-05-17T04:09:06.415051+0000","last_active":"2024-05-17T04:09:11.608123+0000","last_peered":"2024-05-17T04:09:11.608123+0000","last_clean":"2024-05-17T04:09:11.608123+0000","last_became_active":"2024-05-17T04:09:06.414567+0000","last_became_peered":"2024-05-17T04:09:06.414567+0000","last_unstale":"2024-05-17T04:09:11.608123+0000","last_undegraded":"2024-05-17T04:09:11.608123+0000","last_fullsized":"2024-05-17T04:09:11.608123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607819+0000","last_change":"2024-05-17T04:09:06.414418+0000","last_active":"2024-05-17T04:09:11.607819+0000","last_peered":"2024-05-17T04:09:11.607819+0000","last_clean":"2024-05-17T04:09:11.607819+0000","last_became_active":"2024-05-17T04:09:06.414073+0000","last_became_peered":"2024-05-17T04:09:06.414073+0000","last_unstale":"2024-05-17T04:09:11.607819+0000","last_undegraded":"2024-05-17T04:09:11.607819+0000","last_fullsized":"2024-05-17T04:09:11.607819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608958+0000","last_change":"2024-05-17T04:09:06.415334+0000","last_active":"2024-05-17T04:09:11.608958+0000","last_peered":"2024-05-17T04:09:11.608958+0000","last_clean":"2024-05-17T04:09:11.608958+0000","last_became_active":"2024-05-17T04:09:06.414983+0000","last_became_peered":"2024-05-17T04:09:06.414983+0000","last_unstale":"2024-05-17T04:09:11.608958+0000","last_undegraded":"2024-05-17T04:09:11.608958+0000","last_fullsized":"2024-05-17T04:09:11.608958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:24.342548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607791+0000","last_change":"2024-05-17T04:09:06.411128+0000","last_active":"2024-05-17T04:09:11.607791+0000","last_peered":"2024-05-17T04:09:11.607791+0000","last_clean":"2024-05-17T04:09:11.607791+0000","last_became_active":"2024-05-17T04:09:06.410770+0000","last_became_peered":"2024-05-17T04:09:06.410770+0000","last_unstale":"2024-05-17T04:09:11.607791+0000","last_undegraded":"2024-05-17T04:09:11.607791+0000","last_fullsized":"2024-05-17T04:09:11.607791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:33:02.204060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607458+0000","last_change":"2024-05-17T04:09:06.408726+0000","last_active":"2024-05-17T04:09:11.607458+0000","last_peered":"2024-05-17T04:09:11.607458+0000","last_clean":"2024-05-17T04:09:11.607458+0000","last_became_active":"2024-05-17T04:09:06.404912+0000","last_became_peered":"2024-05-17T04:09:06.404912+0000","last_unstale":"2024-05-17T04:09:11.607458+0000","last_undegraded":"2024-05-17T04:09:11.607458+0000","last_fullsized":"2024-05-17T04:09:11.607458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:02:56.514685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424735+0000","last_change":"2024-05-17T04:09:06.408616+0000","last_active":"2024-05-17T04:09:11.424735+0000","last_peered":"2024-05-17T04:09:11.424735+0000","last_clean":"2024-05-17T04:09:11.424735+0000","last_became_active":"2024-05-17T04:09:06.408066+0000","last_became_peered":"2024-05-17T04:09:06.408066+0000","last_unstale":"2024-05-17T04:09:11.424735+0000","last_undegraded":"2024-05-17T04:09:11.424735+0000","last_fullsized":"2024-05-17T04:09:11.424735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607652+0000","last_change":"2024-05-17T04:09:06.402593+0000","last_active":"2024-05-17T04:09:11.607652+0000","last_peered":"2024-05-17T04:09:11.607652+0000","last_clean":"2024-05-17T04:09:11.607652+0000","last_became_active":"2024-05-17T04:09:06.402279+0000","last_became_peered":"2024-05-17T04:09:06.402279+0000","last_unstale":"2024-05-17T04:09:11.607652+0000","last_undegraded":"2024-05-17T04:09:11.607652+0000","last_fullsized":"2024-05-17T04:09:11.607652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:10.587650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425778+0000","last_change":"2024-05-17T04:09:06.410616+0000","last_active":"2024-05-17T04:09:11.425778+0000","last_peered":"2024-05-17T04:09:11.425778+0000","last_clean":"2024-05-17T04:09:11.425778+0000","last_became_active":"2024-05-17T04:09:06.409954+0000","last_became_peered":"2024-05-17T04:09:06.409954+0000","last_unstale":"2024-05-17T04:09:11.425778+0000","last_undegraded":"2024-05-17T04:09:11.425778+0000","last_fullsized":"2024-05-17T04:09:11.425778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:41.984177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607553+0000","last_change":"2024-05-17T04:09:06.386066+0000","last_active":"2024-05-17T04:09:11.607553+0000","last_peered":"2024-05-17T04:09:11.607553+0000","last_clean":"2024-05-17T04:09:11.607553+0000","last_became_active":"2024-05-17T04:09:06.385689+0000","last_became_peered":"2024-05-17T04:09:06.385689+0000","last_unstale":"2024-05-17T04:09:11.607553+0000","last_undegraded":"2024-05-17T04:09:11.607553+0000","last_fullsized":"2024-05-17T04:09:11.607553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515522+0000","last_change":"2024-05-17T04:09:06.395571+0000","last_active":"2024-05-17T04:09:11.515522+0000","last_peered":"2024-05-17T04:09:11.515522+0000","last_clean":"2024-05-17T04:09:11.515522+0000","last_became_active":"2024-05-17T04:09:06.394746+0000","last_became_peered":"2024-05-17T04:09:06.394746+0000","last_unstale":"2024-05-17T04:09:11.515522+0000","last_undegraded":"2024-05-17T04:09:11.515522+0000","last_fullsized":"2024-05-17T04:09:11.515522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608880+0000","last_change":"2024-05-17T04:09:06.409444+0000","last_active":"2024-05-17T04:09:11.608880+0000","last_peered":"2024-05-17T04:09:11.608880+0000","last_clean":"2024-05-17T04:09:11.608880+0000","last_became_active":"2024-05-17T04:09:06.409107+0000","last_became_peered":"2024-05-17T04:09:06.409107+0000","last_unstale":"2024-05-17T04:09:11.608880+0000","last_undegraded":"2024-05-17T04:09:11.608880+0000","last_fullsized":"2024-05-17T04:09:11.608880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:53:04.483377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-17T04:09:20.843 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-17T04:09:20.843 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-17T04:09:20.843 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-17T04:09:20.843 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-17T04:09:20.844 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-17T04:09:20.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.988+0000 7fa36f68c640 1 Processor -- start 2024-05-17T04:09:20.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.988+0000 7fa36f68c640 1 -- start start 2024-05-17T04:09:20.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.989+0000 7fa36f68c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa368142650 0x7fa36815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.989+0000 7fa36f68c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa368071aa0 0x7fa368143660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.989+0000 7fa36f68c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa368160750 con 0x7fa3681601d0 2024-05-17T04:09:20.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.989+0000 7fa36f68c640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa368142a60 con 0x7fa368071aa0 2024-05-17T04:09:20.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.989+0000 7fa36f68c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa3681431d0 con 0x7fa368142650 2024-05-17T04:09:20.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.990+0000 7fa36cc27640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa3681601d0 0x7fa368071390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34592/0 (socket says 172.21.15.131:34592) 2024-05-17T04:09:20.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.990+0000 7fa36cc27640 1 -- 172.21.15.131:0/898009546 learned_addr learned my addr 172.21.15.131:0/898009546 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:20.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.990+0000 7fa36dc29640 1 --2- 172.21.15.131:0/898009546 >> v2:172.21.15.150:3300/0 conn(0x7fa368071aa0 0x7fa368143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.990+0000 7fa36d428640 1 --2- 172.21.15.131:0/898009546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa368142650 0x7fa36815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.990+0000 7fa35ffff640 1 -- 172.21.15.131:0/898009546 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412740800 0 0) 0x7fa368160750 con 0x7fa3681601d0 2024-05-17T04:09:20.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.990+0000 7fa35ffff640 1 -- 172.21.15.131:0/898009546 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa354003520 con 0x7fa3681601d0 2024-05-17T04:09:20.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.990+0000 7fa35ffff640 1 -- 172.21.15.131:0/898009546 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3511342564 0 0) 0x7fa354003520 con 0x7fa3681601d0 2024-05-17T04:09:20.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.990+0000 7fa36dc29640 1 -- 172.21.15.131:0/898009546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa368142650 msgr2=0x7fa36815fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:20.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.990+0000 7fa36dc29640 1 --2- 172.21.15.131:0/898009546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa368142650 0x7fa36815fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.990+0000 7fa36dc29640 1 -- 172.21.15.131:0/898009546 >> v1:172.21.15.131:6789/0 conn(0x7fa3681601d0 legacy=0x7fa368071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.990+0000 7fa36dc29640 1 -- 172.21.15.131:0/898009546 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa368160a30 con 0x7fa368071aa0 2024-05-17T04:09:20.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.990+0000 7fa36d428640 1 --2- 172.21.15.131:0/898009546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa368142650 0x7fa36815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:20.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.991+0000 7fa36dc29640 1 --2- 172.21.15.131:0/898009546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa368071aa0 0x7fa368143660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa360009d90 tx=0x7fa36002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92726bd2e24285c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:20.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.991+0000 7fa35ffff640 1 -- 172.21.15.131:0/898009546 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3580016f0 con 0x7fa368071aa0 2024-05-17T04:09:20.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.991+0000 7fa35ffff640 1 -- 172.21.15.131:0/898009546 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa360007540 con 0x7fa368071aa0 2024-05-17T04:09:20.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.991+0000 7fa35ffff640 1 -- 172.21.15.131:0/898009546 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3600078f0 con 0x7fa368071aa0 2024-05-17T04:09:20.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.992+0000 7fa36f68c640 1 -- 172.21.15.131:0/898009546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa368071aa0 msgr2=0x7fa368143660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.992+0000 7fa36f68c640 1 --2- 172.21.15.131:0/898009546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa368071aa0 0x7fa368143660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa360009d90 tx=0x7fa36002a5f0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.992+0000 7fa36f68c640 1 -- 172.21.15.131:0/898009546 shutdown_connections 2024-05-17T04:09:20.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.992+0000 7fa36f68c640 1 --2- 172.21.15.131:0/898009546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa368071aa0 0x7fa368143660 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.992+0000 7fa36f68c640 1 --2- 172.21.15.131:0/898009546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa368142650 0x7fa36815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.992+0000 7fa36f68c640 1 -- 172.21.15.131:0/898009546 >> 172.21.15.131:0/898009546 conn(0x7fa3680735d0 msgr2=0x7fa3680739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:20.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.992+0000 7fa36f68c640 1 -- 172.21.15.131:0/898009546 shutdown_connections 2024-05-17T04:09:20.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.992+0000 7fa36f68c640 1 -- 172.21.15.131:0/898009546 wait complete. 2024-05-17T04:09:20.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.994+0000 7fa36f68c640 1 Processor -- start 2024-05-17T04:09:20.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.994+0000 7fa36f68c640 1 -- start start 2024-05-17T04:09:20.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36f68c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa368142650 0x7fa3681f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36f68c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3681601d0 0x7fa3681f91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36f68c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3681f9890 0x7fa3680ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:20.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36f68c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa3680d1560 con 0x7fa368142650 2024-05-17T04:09:20.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36f68c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa3680d13e0 con 0x7fa3681f9890 2024-05-17T04:09:20.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36f68c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa368143ba0 con 0x7fa3681601d0 2024-05-17T04:09:20.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36d428640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa368142650 0x7fa3681f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36d428640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa368142650 0x7fa3681f8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43402/0 (socket says 172.21.15.131:43402) 2024-05-17T04:09:20.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36d428640 1 -- 172.21.15.131:0/3926319232 learned_addr learned my addr 172.21.15.131:0/3926319232 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:20.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36dc29640 1 --2- 172.21.15.131:0/3926319232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3681f9890 0x7fa3680ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36d428640 1 -- 172.21.15.131:0/3926319232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3681601d0 msgr2=0x7fa3681f91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36cc27640 1 --2- 172.21.15.131:0/3926319232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3681601d0 0x7fa3681f91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:20.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36d428640 1 --2- 172.21.15.131:0/3926319232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3681601d0 0x7fa3681f91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36d428640 1 -- 172.21.15.131:0/3926319232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3681f9890 msgr2=0x7fa3680ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:20.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36d428640 1 --2- 172.21.15.131:0/3926319232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3681f9890 0x7fa3680ad050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:20.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.995+0000 7fa36d428640 1 -- 172.21.15.131:0/3926319232 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa368148bb0 con 0x7fa368142650 2024-05-17T04:09:20.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.996+0000 7fa36d428640 1 --2- 172.21.15.131:0/3926319232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa368142650 0x7fa3681f8c80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa36400e990 tx=0x7fa36400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:20.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.996+0000 7fa35dffb640 1 -- 172.21.15.131:0/3926319232 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa364017070 con 0x7fa368142650 2024-05-17T04:09:20.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.996+0000 7fa35dffb640 1 -- 172.21.15.131:0/3926319232 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36400c9e0 con 0x7fa368142650 2024-05-17T04:09:20.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.996+0000 7fa35dffb640 1 -- 172.21.15.131:0/3926319232 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36400cdb0 con 0x7fa368142650 2024-05-17T04:09:20.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.996+0000 7fa36f68c640 1 -- 172.21.15.131:0/3926319232 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3680ac570 con 0x7fa368142650 2024-05-17T04:09:20.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.996+0000 7fa36f68c640 1 -- 172.21.15.131:0/3926319232 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3680ae0d0 con 0x7fa368142650 2024-05-17T04:09:21.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.997+0000 7fa36f68c640 1 -- 172.21.15.131:0/3926319232 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3680ae330 con 0x7fa368142650 2024-05-17T04:09:21.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.998+0000 7fa35dffb640 1 -- 172.21.15.131:0/3926319232 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa36401a070 con 0x7fa368142650 2024-05-17T04:09:21.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.998+0000 7fa35dffb640 1 --2- 172.21.15.131:0/3926319232 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa34c0762d0 0x7fa34c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:21.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.998+0000 7fa36cc27640 1 --2- 172.21.15.131:0/3926319232 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa34c0762d0 0x7fa34c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:21.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.998+0000 7fa35dffb640 1 -- 172.21.15.131:0/3926319232 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa364097820 con 0x7fa368142650 2024-05-17T04:09:21.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:20.999+0000 7fa36cc27640 1 --2- 172.21.15.131:0/3926319232 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa34c0762d0 0x7fa34c0787e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa358001220 tx=0x7fa358009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:21.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.003+0000 7fa35dffb640 1 -- 172.21.15.131:0/3926319232 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa364060e40 con 0x7fa368142650 2024-05-17T04:09:21.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.229+0000 7fa36f68c640 1 -- 172.21.15.131:0/3926319232 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa3680b3600 con 0x7fa368142650 2024-05-17T04:09:21.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.232+0000 7fa35dffb640 1 -- 172.21.15.131:0/3926319232 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189527 (secure 0 0 0) 0x7fa364060740 con 0x7fa368142650 2024-05-17T04:09:21.235 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:21.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.234+0000 7fa36f68c640 1 -- 172.21.15.131:0/3926319232 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa34c0762d0 msgr2=0x7fa34c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:21.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.234+0000 7fa36f68c640 1 --2- 172.21.15.131:0/3926319232 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa34c0762d0 0x7fa34c0787e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa358001220 tx=0x7fa358009040 comp rx=0 tx=0).stop 2024-05-17T04:09:21.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.234+0000 7fa36f68c640 1 -- 172.21.15.131:0/3926319232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa368142650 msgr2=0x7fa3681f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:21.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.234+0000 7fa36f68c640 1 --2- 172.21.15.131:0/3926319232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa368142650 0x7fa3681f8c80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa36400e990 tx=0x7fa36400ee50 comp rx=0 tx=0).stop 2024-05-17T04:09:21.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.234+0000 7fa36f68c640 1 -- 172.21.15.131:0/3926319232 shutdown_connections 2024-05-17T04:09:21.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.234+0000 7fa36f68c640 1 --2- 172.21.15.131:0/3926319232 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa34c0762d0 0x7fa34c0787e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.234+0000 7fa36f68c640 1 --2- 172.21.15.131:0/3926319232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3681f9890 0x7fa3680ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.234+0000 7fa36f68c640 1 --2- 172.21.15.131:0/3926319232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3681601d0 0x7fa3681f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.234+0000 7fa36f68c640 1 --2- 172.21.15.131:0/3926319232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa368142650 0x7fa3681f8c80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.234+0000 7fa36f68c640 1 -- 172.21.15.131:0/3926319232 >> 172.21.15.131:0/3926319232 conn(0x7fa3680735d0 msgr2=0x7fa368141690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:21.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.235+0000 7fa36f68c640 1 -- 172.21.15.131:0/3926319232 shutdown_connections 2024-05-17T04:09:21.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.235+0000 7fa36f68c640 1 -- 172.21.15.131:0/3926319232 wait complete. 2024-05-17T04:09:21.247 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3533746931},{"type":"v1","addr":"172.21.15.131:6833","nonce":3533746931}]},"active_addr":"172.21.15.131:6833/3533746931","active_change":"2024-05-17T04:08:46.698423+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":1470079487}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":1772339056}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":722244360}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":3060206490}]}]} 2024-05-17T04:09:21.250 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-17T04:09:21.250 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-17T04:09:21.251 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:09:21.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.360+0000 7fb697471640 1 Processor -- start 2024-05-17T04:09:21.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.360+0000 7fb697471640 1 -- start start 2024-05-17T04:09:21.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.361+0000 7fb697471640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb6900d02f0 0x7fb69015f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:21.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.361+0000 7fb697471640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6900cd8c0 con 0x7fb6900d0ca0 2024-05-17T04:09:21.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.361+0000 7fb697471640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb69006e830 con 0x7fb69006e090 2024-05-17T04:09:21.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.361+0000 7fb697471640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fb69006f0d0 con 0x7fb6900d02f0 2024-05-17T04:09:21.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.362+0000 7fb69520d640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb6900d0ca0 0x7fb6900cfbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34594/0 (socket says 172.21.15.131:34594) 2024-05-17T04:09:21.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.362+0000 7fb69520d640 1 -- 172.21.15.131:0/3729453241 learned_addr learned my addr 172.21.15.131:0/3729453241 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:21.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.362+0000 7fb694a0c640 1 --2- 172.21.15.131:0/3729453241 >> v2:172.21.15.150:3300/0 conn(0x7fb6900d02f0 0x7fb69015f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:21.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.362+0000 7fb687fff640 1 -- 172.21.15.131:0/3729453241 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 256541615 0 0) 0x7fb6900cd8c0 con 0x7fb6900d0ca0 2024-05-17T04:09:21.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.362+0000 7fb687fff640 1 -- 172.21.15.131:0/3729453241 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb67c003520 con 0x7fb6900d0ca0 2024-05-17T04:09:21.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.362+0000 7fb694a0c640 1 -- 172.21.15.131:0/3729453241 >> v1:172.21.15.150:6789/0 conn(0x7fb69006e090 legacy=0x7fb6900cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:21.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.362+0000 7fb694a0c640 1 -- 172.21.15.131:0/3729453241 >> v1:172.21.15.131:6789/0 conn(0x7fb6900d0ca0 legacy=0x7fb6900cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:21.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.362+0000 7fb694a0c640 1 -- 172.21.15.131:0/3729453241 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69006eb10 con 0x7fb6900d02f0 2024-05-17T04:09:21.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.363+0000 7fb694a0c640 1 --2- 172.21.15.131:0/3729453241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6900d02f0 0x7fb69015f7c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6800097a0 tx=0x7fb68002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7efc9715f655b8dc server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:21.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.363+0000 7fb687fff640 1 -- 172.21.15.131:0/3729453241 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680037070 con 0x7fb6900d02f0 2024-05-17T04:09:21.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.363+0000 7fb687fff640 1 -- 172.21.15.131:0/3729453241 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb680032440 con 0x7fb6900d02f0 2024-05-17T04:09:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.363+0000 7fb687fff640 1 -- 172.21.15.131:0/3729453241 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680032810 con 0x7fb6900d02f0 2024-05-17T04:09:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.364+0000 7fb697471640 1 -- 172.21.15.131:0/3729453241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6900d02f0 msgr2=0x7fb69015f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.364+0000 7fb697471640 1 --2- 172.21.15.131:0/3729453241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6900d02f0 0x7fb69015f7c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6800097a0 tx=0x7fb68002a1a0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.364+0000 7fb697471640 1 -- 172.21.15.131:0/3729453241 shutdown_connections 2024-05-17T04:09:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.364+0000 7fb697471640 1 --2- 172.21.15.131:0/3729453241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6900d02f0 0x7fb69015f7c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.364+0000 7fb697471640 1 -- 172.21.15.131:0/3729453241 >> 172.21.15.131:0/3729453241 conn(0x7fb6900b4e40 msgr2=0x7fb6900b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.364+0000 7fb697471640 1 -- 172.21.15.131:0/3729453241 shutdown_connections 2024-05-17T04:09:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.364+0000 7fb697471640 1 -- 172.21.15.131:0/3729453241 wait complete. 2024-05-17T04:09:21.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.365+0000 7fb697471640 1 Processor -- start 2024-05-17T04:09:21.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.366+0000 7fb697471640 1 -- start start 2024-05-17T04:09:21.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb697471640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb69006e090 0x7fb690159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:21.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb697471640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6900d0ca0 0x7fb6900ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:21.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb697471640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6900b76c0 0x7fb6900b7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:21.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb697471640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb6900ce4b0 con 0x7fb69006e090 2024-05-17T04:09:21.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb697471640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb69006e4a0 con 0x7fb6900b76c0 2024-05-17T04:09:21.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb697471640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb6900ce630 con 0x7fb6900d0ca0 2024-05-17T04:09:21.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb69520d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb69006e090 0x7fb690159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:21.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb69520d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb69006e090 0x7fb690159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43416/0 (socket says 172.21.15.131:43416) 2024-05-17T04:09:21.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb69520d640 1 -- 172.21.15.131:0/2295289653 learned_addr learned my addr 172.21.15.131:0/2295289653 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:21.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb695a0e640 1 --2- 172.21.15.131:0/2295289653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6900b76c0 0x7fb6900b7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:21.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb694a0c640 1 --2- 172.21.15.131:0/2295289653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6900d0ca0 0x7fb6900ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:21.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb69520d640 1 -- 172.21.15.131:0/2295289653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6900d0ca0 msgr2=0x7fb6900ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:21.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb69520d640 1 --2- 172.21.15.131:0/2295289653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6900d0ca0 0x7fb6900ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb69520d640 1 -- 172.21.15.131:0/2295289653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6900b76c0 msgr2=0x7fb6900b7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:21.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb69520d640 1 --2- 172.21.15.131:0/2295289653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6900b76c0 0x7fb6900b7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb69520d640 1 -- 172.21.15.131:0/2295289653 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6900b8010 con 0x7fb69006e090 2024-05-17T04:09:21.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.367+0000 7fb69520d640 1 --2- 172.21.15.131:0/2295289653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb69006e090 0x7fb690159060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00c440 tx=0x7fb68c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:21.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.368+0000 7fb685ffb640 1 -- 172.21.15.131:0/2295289653 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c017070 con 0x7fb69006e090 2024-05-17T04:09:21.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.368+0000 7fb685ffb640 1 -- 172.21.15.131:0/2295289653 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c005ce0 con 0x7fb69006e090 2024-05-17T04:09:21.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.368+0000 7fb697471640 1 -- 172.21.15.131:0/2295289653 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb690162de0 con 0x7fb69006e090 2024-05-17T04:09:21.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.368+0000 7fb685ffb640 1 -- 172.21.15.131:0/2295289653 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c007270 con 0x7fb69006e090 2024-05-17T04:09:21.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.368+0000 7fb697471640 1 -- 172.21.15.131:0/2295289653 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb690162260 con 0x7fb69006e090 2024-05-17T04:09:21.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.369+0000 7fb697471640 1 -- 172.21.15.131:0/2295289653 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb69015f7c0 con 0x7fb69006e090 2024-05-17T04:09:21.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.369+0000 7fb685ffb640 1 -- 172.21.15.131:0/2295289653 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb68c01a070 con 0x7fb69006e090 2024-05-17T04:09:21.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.370+0000 7fb685ffb640 1 --2- 172.21.15.131:0/2295289653 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb6740762d0 0x7fb6740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:21.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.370+0000 7fb685ffb640 1 -- 172.21.15.131:0/2295289653 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb68c096aa0 con 0x7fb69006e090 2024-05-17T04:09:21.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.370+0000 7fb694a0c640 1 --2- 172.21.15.131:0/2295289653 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb6740762d0 0x7fb6740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:21.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.370+0000 7fb694a0c640 1 --2- 172.21.15.131:0/2295289653 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb6740762d0 0x7fb6740787e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb680034000 tx=0x7fb68002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:21.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.374+0000 7fb685ffb640 1 -- 172.21.15.131:0/2295289653 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb6900b8010 con 0x7fb69006e090 2024-05-17T04:09:21.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.557+0000 7fb697471640 1 -- 172.21.15.131:0/2295289653 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6900c68f0 con 0x7fb69006e090 2024-05-17T04:09:21.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.558+0000 7fb685ffb640 1 -- 172.21.15.131:0/2295289653 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fb68c05fa70 con 0x7fb69006e090 2024-05-17T04:09:21.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:21.560 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":24,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:09:10.777455+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:03.633460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:04.707669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-17T04:09:08.400498+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:09:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.560+0000 7fb697471640 1 -- 172.21.15.131:0/2295289653 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb6740762d0 msgr2=0x7fb6740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.560+0000 7fb697471640 1 --2- 172.21.15.131:0/2295289653 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb6740762d0 0x7fb6740787e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb680034000 tx=0x7fb68002e000 comp rx=0 tx=0).stop 2024-05-17T04:09:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.560+0000 7fb697471640 1 -- 172.21.15.131:0/2295289653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb69006e090 msgr2=0x7fb690159060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.560+0000 7fb697471640 1 --2- 172.21.15.131:0/2295289653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb69006e090 0x7fb690159060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00c440 tx=0x7fb68c00c900 comp rx=0 tx=0).stop 2024-05-17T04:09:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.560+0000 7fb697471640 1 -- 172.21.15.131:0/2295289653 shutdown_connections 2024-05-17T04:09:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.560+0000 7fb697471640 1 --2- 172.21.15.131:0/2295289653 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb6740762d0 0x7fb6740787e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.560+0000 7fb697471640 1 --2- 172.21.15.131:0/2295289653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6900b76c0 0x7fb6900b7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.560+0000 7fb697471640 1 --2- 172.21.15.131:0/2295289653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6900d0ca0 0x7fb6900ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.560+0000 7fb697471640 1 --2- 172.21.15.131:0/2295289653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb69006e090 0x7fb690159060 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.560+0000 7fb697471640 1 -- 172.21.15.131:0/2295289653 >> 172.21.15.131:0/2295289653 conn(0x7fb6900b4e40 msgr2=0x7fb6900cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:21.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.560+0000 7fb697471640 1 -- 172.21.15.131:0/2295289653 shutdown_connections 2024-05-17T04:09:21.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.560+0000 7fb697471640 1 -- 172.21.15.131:0/2295289653 wait complete. 2024-05-17T04:09:21.573 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-17T04:09:21.573 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:09:21.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.682+0000 7fa614e9c640 1 Processor -- start 2024-05-17T04:09:21.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.682+0000 7fa614e9c640 1 -- start start 2024-05-17T04:09:21.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.683+0000 7fa614e9c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa610071390 0x7fa6100717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:21.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.683+0000 7fa614e9c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa6100b74c0 0x7fa6100b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:21.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.683+0000 7fa614e9c640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa610071ce0 con 0x7fa610163630 2024-05-17T04:09:21.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.683+0000 7fa614e9c640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa6100d0b90 con 0x7fa610071390 2024-05-17T04:09:21.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.683+0000 7fa614e9c640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa6100d1ba0 con 0x7fa6100b74c0 2024-05-17T04:09:21.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.683+0000 7fa60e59c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa610071390 0x7fa6100717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:21.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.683+0000 7fa60e59c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa610071390 0x7fa6100717a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43418/0 (socket says 172.21.15.131:43418) 2024-05-17T04:09:21.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.683+0000 7fa60e59c640 1 -- 172.21.15.131:0/1325891375 learned_addr learned my addr 172.21.15.131:0/1325891375 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:21.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.683+0000 7fa607fff640 1 --2- 172.21.15.131:0/1325891375 >> v2:172.21.15.150:3300/0 conn(0x7fa6100b74c0 0x7fa6100b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:21.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.683+0000 7fa60e59c640 1 -- 172.21.15.131:0/1325891375 >> v2:172.21.15.150:3300/0 conn(0x7fa6100b74c0 msgr2=0x7fa6100b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:21.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.683+0000 7fa60e59c640 1 --2- 172.21.15.131:0/1325891375 >> v2:172.21.15.150:3300/0 conn(0x7fa6100b74c0 0x7fa6100b78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.683+0000 7fa60e59c640 1 -- 172.21.15.131:0/1325891375 >> v1:172.21.15.150:6789/0 conn(0x7fa610163630 legacy=0x7fa610163a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:21.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.683+0000 7fa60e59c640 1 -- 172.21.15.131:0/1325891375 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6100d0de0 con 0x7fa610071390 2024-05-17T04:09:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.684+0000 7fa60e59c640 1 --2- 172.21.15.131:0/1325891375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa610071390 0x7fa6100717a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa6100745a0 tx=0x7fa60002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7001f13d5f2aea0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.684+0000 7fa60dd9b640 1 -- 172.21.15.131:0/1325891375 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600037070 con 0x7fa610071390 2024-05-17T04:09:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.684+0000 7fa60dd9b640 1 -- 172.21.15.131:0/1325891375 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa600032440 con 0x7fa610071390 2024-05-17T04:09:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.684+0000 7fa60dd9b640 1 -- 172.21.15.131:0/1325891375 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600032810 con 0x7fa610071390 2024-05-17T04:09:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.685+0000 7fa614e9c640 1 -- 172.21.15.131:0/1325891375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa610071390 msgr2=0x7fa6100717a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.685+0000 7fa614e9c640 1 --2- 172.21.15.131:0/1325891375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa610071390 0x7fa6100717a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa6100745a0 tx=0x7fa60002a140 comp rx=0 tx=0).stop 2024-05-17T04:09:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.685+0000 7fa614e9c640 1 -- 172.21.15.131:0/1325891375 shutdown_connections 2024-05-17T04:09:21.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.685+0000 7fa614e9c640 1 --2- 172.21.15.131:0/1325891375 >> v2:172.21.15.150:3300/0 conn(0x7fa6100b74c0 0x7fa6100b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.685+0000 7fa614e9c640 1 --2- 172.21.15.131:0/1325891375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa610071390 0x7fa6100717a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.685+0000 7fa614e9c640 1 -- 172.21.15.131:0/1325891375 >> 172.21.15.131:0/1325891375 conn(0x7fa6100735b0 msgr2=0x7fa6100739c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:21.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.685+0000 7fa614e9c640 1 -- 172.21.15.131:0/1325891375 shutdown_connections 2024-05-17T04:09:21.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.685+0000 7fa614e9c640 1 -- 172.21.15.131:0/1325891375 wait complete. 2024-05-17T04:09:21.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.687+0000 7fa614e9c640 1 Processor -- start 2024-05-17T04:09:21.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.687+0000 7fa614e9c640 1 -- start start 2024-05-17T04:09:21.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.688+0000 7fa614e9c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa610071390 0x7fa610141a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:21.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.688+0000 7fa614e9c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6100b74c0 0x7fa61015af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:21.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.688+0000 7fa614e9c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa610163630 0x7fa61015c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:21.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.688+0000 7fa614e9c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa6100d1680 con 0x7fa610071390 2024-05-17T04:09:21.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.688+0000 7fa614e9c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa6100d13a0 con 0x7fa610163630 2024-05-17T04:09:21.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.688+0000 7fa614e9c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa610142820 con 0x7fa6100b74c0 2024-05-17T04:09:21.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.688+0000 7fa60e59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa610071390 0x7fa610141a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:21.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa60e59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa610071390 0x7fa610141a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43434/0 (socket says 172.21.15.131:43434) 2024-05-17T04:09:21.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa60e59c640 1 -- 172.21.15.131:0/2295356569 learned_addr learned my addr 172.21.15.131:0/2295356569 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:21.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa60ed9d640 1 --2- 172.21.15.131:0/2295356569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa610163630 0x7fa61015c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:21.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa607fff640 1 --2- 172.21.15.131:0/2295356569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6100b74c0 0x7fa61015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:21.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa60e59c640 1 -- 172.21.15.131:0/2295356569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6100b74c0 msgr2=0x7fa61015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:21.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa60e59c640 1 --2- 172.21.15.131:0/2295356569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6100b74c0 0x7fa61015af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa60e59c640 1 -- 172.21.15.131:0/2295356569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa610163630 msgr2=0x7fa61015c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:21.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa60e59c640 1 --2- 172.21.15.131:0/2295356569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa610163630 0x7fa61015c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa60e59c640 1 -- 172.21.15.131:0/2295356569 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa61015be10 con 0x7fa610071390 2024-05-17T04:09:21.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa60ed9d640 1 --2- 172.21.15.131:0/2295356569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa610163630 0x7fa61015c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:21.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa60e59c640 1 --2- 172.21.15.131:0/2295356569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa610071390 0x7fa610141a40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa600000c00 tx=0x7fa6000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:21.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa606ffd640 1 -- 172.21.15.131:0/2295356569 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600041070 con 0x7fa610071390 2024-05-17T04:09:21.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa606ffd640 1 -- 172.21.15.131:0/2295356569 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa60003c870 con 0x7fa610071390 2024-05-17T04:09:21.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa606ffd640 1 -- 172.21.15.131:0/2295356569 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600037040 con 0x7fa610071390 2024-05-17T04:09:21.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa614e9c640 1 -- 172.21.15.131:0/2295356569 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6101e9240 con 0x7fa610071390 2024-05-17T04:09:21.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.689+0000 7fa614e9c640 1 -- 172.21.15.131:0/2295356569 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6101432d0 con 0x7fa610071390 2024-05-17T04:09:21.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.690+0000 7fa614e9c640 1 -- 172.21.15.131:0/2295356569 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6100717a0 con 0x7fa610071390 2024-05-17T04:09:21.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.691+0000 7fa606ffd640 1 -- 172.21.15.131:0/2295356569 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa600044070 con 0x7fa610071390 2024-05-17T04:09:21.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.691+0000 7fa606ffd640 1 --2- 172.21.15.131:0/2295356569 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa5f0076300 0x7fa5f0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:21.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.691+0000 7fa606ffd640 1 -- 172.21.15.131:0/2295356569 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa6000b84e0 con 0x7fa610071390 2024-05-17T04:09:21.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.691+0000 7fa607fff640 1 --2- 172.21.15.131:0/2295356569 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa5f0076300 0x7fa5f0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:21.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.692+0000 7fa607fff640 1 --2- 172.21.15.131:0/2295356569 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa5f0076300 0x7fa5f0078810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8006fd0 tx=0x7fa5f8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:21.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.696+0000 7fa606ffd640 1 -- 172.21.15.131:0/2295356569 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa610071ce0 con 0x7fa610071390 2024-05-17T04:09:21.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.879+0000 7fa614e9c640 1 -- 172.21.15.131:0/2295356569 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6100ce810 con 0x7fa610071390 2024-05-17T04:09:21.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.880+0000 7fa606ffd640 1 -- 172.21.15.131:0/2295356569 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fa600081b00 con 0x7fa610071390 2024-05-17T04:09:21.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:21.881 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":24,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:09:10.777455+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:03.633460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:04.707669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-17T04:09:08.400498+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:09:21.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.882+0000 7fa614e9c640 1 -- 172.21.15.131:0/2295356569 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa5f0076300 msgr2=0x7fa5f0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:21.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.882+0000 7fa614e9c640 1 --2- 172.21.15.131:0/2295356569 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa5f0076300 0x7fa5f0078810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8006fd0 tx=0x7fa5f8008040 comp rx=0 tx=0).stop 2024-05-17T04:09:21.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.882+0000 7fa614e9c640 1 -- 172.21.15.131:0/2295356569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa610071390 msgr2=0x7fa610141a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:21.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.882+0000 7fa614e9c640 1 --2- 172.21.15.131:0/2295356569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa610071390 0x7fa610141a40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa600000c00 tx=0x7fa6000046c0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.882+0000 7fa614e9c640 1 -- 172.21.15.131:0/2295356569 shutdown_connections 2024-05-17T04:09:21.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.882+0000 7fa614e9c640 1 --2- 172.21.15.131:0/2295356569 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa5f0076300 0x7fa5f0078810 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.882+0000 7fa614e9c640 1 --2- 172.21.15.131:0/2295356569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa610163630 0x7fa61015c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.882+0000 7fa614e9c640 1 --2- 172.21.15.131:0/2295356569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6100b74c0 0x7fa61015af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.882+0000 7fa614e9c640 1 --2- 172.21.15.131:0/2295356569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa610071390 0x7fa610141a40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:21.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.882+0000 7fa614e9c640 1 -- 172.21.15.131:0/2295356569 >> 172.21.15.131:0/2295356569 conn(0x7fa6100735b0 msgr2=0x7fa61015df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:21.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.882+0000 7fa614e9c640 1 -- 172.21.15.131:0/2295356569 shutdown_connections 2024-05-17T04:09:21.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:21.882+0000 7fa614e9c640 1 -- 172.21.15.131:0/2295356569 wait complete. 2024-05-17T04:09:21.895 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-17T04:09:21.896 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-17T04:09:21.896 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-17T04:09:21.897 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-17T04:09:21.897 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-17T04:09:21.898 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-17T04:09:21.898 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-17T04:09:21.898 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-17T04:09:22.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.120+0000 7fbf28b8e640 1 Processor -- start 2024-05-17T04:09:22.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.122+0000 7ff7ee4ce640 1 Processor -- start 2024-05-17T04:09:22.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.121+0000 7fbf28b8e640 1 -- start start 2024-05-17T04:09:22.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.123+0000 7fef3e0e1640 1 Processor -- start 2024-05-17T04:09:22.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.122+0000 7ff7ee4ce640 1 -- start start 2024-05-17T04:09:22.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.123+0000 7ff5809eb640 1 Processor -- start 2024-05-17T04:09:22.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.123+0000 7fbf28b8e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c039d10 0x7fbf1c051830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.123+0000 7fbf28b8e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbf1c00a800 0x7fbf1c052f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.123+0000 7fbf23fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbf1c00a800 0x7fbf1c052f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.124+0000 7fbf23fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbf1c00a800 0x7fbf1c052f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43446/0 (socket says 172.21.15.131:43446) 2024-05-17T04:09:22.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.124+0000 7fbf23fff640 1 -- 172.21.15.131:0/2260348721 learned_addr learned my addr 172.21.15.131:0/2260348721 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.124+0000 7f9c9d706640 1 Processor -- start 2024-05-17T04:09:22.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.125+0000 7f9c9d706640 1 -- start start 2024-05-17T04:09:22.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.125+0000 7ff7ee4ce640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff7e80744d0 0x7ff7e80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.125+0000 7ff7ee4ce640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7e806eef0 con 0x7ff7e815c4a0 2024-05-17T04:09:22.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.125+0000 7ff7ee4ce640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7e806f190 con 0x7ff7e80b3470 2024-05-17T04:09:22.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.125+0000 7ff7ee4ce640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff7e8074dc0 con 0x7ff7e80744d0 2024-05-17T04:09:22.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.123+0000 7ff5809eb640 1 -- start start 2024-05-17T04:09:22.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.123+0000 7f1562da8640 1 Processor -- start 2024-05-17T04:09:22.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.123+0000 7f1562da8640 1 -- start start 2024-05-17T04:09:22.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.124+0000 7fbf28b8e640 1 -- 172.21.15.131:0/2260348721 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf1c006860 con 0x7fbf1c033d10 2024-05-17T04:09:22.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.124+0000 7fbf28b8e640 1 -- 172.21.15.131:0/2260348721 --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fbf1c006610 con 0x7fbf1c00a800 2024-05-17T04:09:22.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.124+0000 7fbf28b8e640 1 -- 172.21.15.131:0/2260348721 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbf1c052a90 con 0x7fbf1c039d10 2024-05-17T04:09:22.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.124+0000 7fbf237fe640 1 --2- 172.21.15.131:0/2260348721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c039d10 0x7fbf1c051830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.124+0000 7fbf23fff640 1 -- 172.21.15.131:0/2260348721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c039d10 msgr2=0x7fbf1c051830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.124+0000 7fbf23fff640 1 --2- 172.21.15.131:0/2260348721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c039d10 0x7fbf1c051830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.124+0000 7fbf23fff640 1 -- 172.21.15.131:0/2260348721 >> v1:172.21.15.150:6789/0 conn(0x7fbf1c033d10 legacy=0x7fbf1c00a0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-17T04:09:22.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.124+0000 7fbf23fff640 1 -- 172.21.15.131:0/2260348721 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1c006b40 con 0x7fbf1c00a800 2024-05-17T04:09:22.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.125+0000 7ff7e77fe640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff7e80b3470 0x7ff7e8073dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:40932/0 (socket says 172.21.15.131:40932) 2024-05-17T04:09:22.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.125+0000 7ff7e77fe640 1 -- 172.21.15.131:0/1490119537 learned_addr learned my addr 172.21.15.131:0/1490119537 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:22.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.123+0000 7fef3e0e1640 1 -- start start 2024-05-17T04:09:22.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.125+0000 7ff7eca6b640 1 --2- 172.21.15.131:0/1490119537 >> v2:172.21.15.131:3300/0 conn(0x7ff7e80744d0 0x7ff7e80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.125+0000 7f1664a82640 1 Processor -- start 2024-05-17T04:09:22.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.125+0000 7f1664a82640 1 -- start start 2024-05-17T04:09:22.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7ff7e6ffd640 1 -- 172.21.15.131:0/1490119537 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2056457982 0 0) 0x7ff7e806f190 con 0x7ff7e80b3470 2024-05-17T04:09:22.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7ff7e6ffd640 1 -- 172.21.15.131:0/1490119537 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7d8003520 con 0x7ff7e80b3470 2024-05-17T04:09:22.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7ff5809eb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff57c163920 0x7ff57c06f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7ff5809eb640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff57c06fb60 0x7ff57c0738d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7ff5809eb640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff57c073e10 0x7ff57c167480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7ff5809eb640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff57c06ff70 con 0x7ff57c06fb60 2024-05-17T04:09:22.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7ff5809eb640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7ff57c163d30 con 0x7ff57c073e10 2024-05-17T04:09:22.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7ff5809eb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff57c072400 con 0x7ff57c163920 2024-05-17T04:09:22.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.125+0000 7fef3e0e1640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef3000c000 0x7fef3000c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7fef3d0df640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fef3000dd80 0x7fef30038650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:40946/0 (socket says 172.21.15.131:40946) 2024-05-17T04:09:22.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7f1562da8640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f155400bdf0 0x7f1554053860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7f1562da8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1554006750 0x7f15540dc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7f1562da8640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1554006b60 con 0x7f155401ddc0 2024-05-17T04:09:22.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7f1562da8640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f155400ad60 con 0x7f155400bdf0 2024-05-17T04:09:22.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7f1562da8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f15540533d0 con 0x7f1554006750 2024-05-17T04:09:22.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7f155bfff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f155401ddc0 0x7f1554006040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34610/0 (socket says 172.21.15.131:34610) 2024-05-17T04:09:22.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7f155bfff640 1 -- 172.21.15.131:0/4179866455 learned_addr learned my addr 172.21.15.131:0/4179866455 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:22.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7fef3d0df640 1 -- 172.21.15.131:0/2897919138 learned_addr learned my addr 172.21.15.131:0/2897919138 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:22.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7fef3e0e1640 1 -- 172.21.15.131:0/2897919138 --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef300390c0 con 0x7fef3000c950 2024-05-17T04:09:22.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7ff579d9b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff57c06fb60 0x7ff57c0738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7ff579d9b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff57c06fb60 0x7ff57c0738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43468/0 (socket says 172.21.15.131:43468) 2024-05-17T04:09:22.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7ff579d9b640 1 -- 172.21.15.131:0/3561507668 learned_addr learned my addr 172.21.15.131:0/3561507668 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7f2595101640 1 Processor -- start 2024-05-17T04:09:22.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7ff7eca6b640 1 -- 172.21.15.131:0/1490119537 >> v1:172.21.15.150:6789/0 conn(0x7ff7e80b3470 legacy=0x7ff7e8073dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7ff7eca6b640 1 -- 172.21.15.131:0/1490119537 >> v1:172.21.15.131:6789/0 conn(0x7ff7e815c4a0 legacy=0x7ff7e80b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7ff57a59c640 1 --2- 172.21.15.131:0/3561507668 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff57c163920 0x7ff57c06f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7ff57ad9d640 1 --2- 172.21.15.131:0/3561507668 >> v2:172.21.15.150:3300/0 conn(0x7ff57c073e10 0x7ff57c167480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7f2595101640 1 -- start start 2024-05-17T04:09:22.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7f155b7fe640 1 -- 172.21.15.131:0/4179866455 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2286325524 0 0) 0x7f1554006b60 con 0x7f155401ddc0 2024-05-17T04:09:22.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7f155b7fe640 1 -- 172.21.15.131:0/4179866455 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f154c003520 con 0x7f155401ddc0 2024-05-17T04:09:22.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f1561345640 1 --2- 172.21.15.131:0/4179866455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1554006750 0x7f15540dc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7ff7eca6b640 1 -- 172.21.15.131:0/1490119537 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e8163050 con 0x7ff7e80744d0 2024-05-17T04:09:22.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7fef3e0e1640 1 -- 172.21.15.131:0/2897919138 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef3003c190 con 0x7fef3000dd80 2024-05-17T04:09:22.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7fef3e0e1640 1 -- 172.21.15.131:0/2897919138 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fef30055db0 con 0x7fef3000c000 2024-05-17T04:09:22.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7fef2ffff640 1 -- 172.21.15.131:0/2897919138 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3108397264 0 0) 0x7fef3003c190 con 0x7fef3000dd80 2024-05-17T04:09:22.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.126+0000 7fef2ffff640 1 -- 172.21.15.131:0/2897919138 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef24003520 con 0x7fef3000dd80 2024-05-17T04:09:22.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef3c8de640 1 --2- 172.21.15.131:0/2897919138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef3000c000 0x7fef3000c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef2ffff640 1 -- 172.21.15.131:0/2897919138 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3086699248 0 0) 0x7fef24003520 con 0x7fef3000dd80 2024-05-17T04:09:22.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef2ffff640 1 -- 172.21.15.131:0/2897919138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef3000c000 msgr2=0x7fef3000c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef2ffff640 1 --2- 172.21.15.131:0/2897919138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef3000c000 0x7fef3000c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef2ffff640 1 -- 172.21.15.131:0/2897919138 >> v1:172.21.15.131:6789/0 conn(0x7fef3000c950 legacy=0x7fef3000cd60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-17T04:09:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef2ffff640 1 -- 172.21.15.131:0/2897919138 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef30055a40 con 0x7fef3000dd80 2024-05-17T04:09:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef2ffff640 1 -- 172.21.15.131:0/2897919138 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7fef380508e0 con 0x7fef3000dd80 2024-05-17T04:09:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef2ffff640 1 -- 172.21.15.131:0/2897919138 >> v1:172.21.15.150:6789/0 conn(0x7fef3000dd80 legacy=0x7fef30038650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef2ffff640 1 --2- 172.21.15.131:0/2897919138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef240039b0 0x7fef24003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef2ffff640 1 --2- 172.21.15.131:0/2897919138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef24004800 0x7fef24004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef2ffff640 1 --2- 172.21.15.131:0/2897919138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef24005150 0x7fef2400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef2ffff640 1 -- 172.21.15.131:0/2897919138 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fef2400c070 con 0x7fef24004800 2024-05-17T04:09:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef2ffff640 1 -- 172.21.15.131:0/2897919138 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fef2400c220 con 0x7fef24005150 2024-05-17T04:09:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef2ffff640 1 -- 172.21.15.131:0/2897919138 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fef24010830 con 0x7fef240039b0 2024-05-17T04:09:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef3d0df640 1 --2- 172.21.15.131:0/2897919138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef240039b0 0x7fef24003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7ff579d9b640 1 -- 172.21.15.131:0/3561507668 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff57c163920 msgr2=0x7ff57c06f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7ff579d9b640 1 --2- 172.21.15.131:0/3561507668 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff57c163920 0x7ff57c06f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7ff579d9b640 1 -- 172.21.15.131:0/3561507668 >> v2:172.21.15.150:3300/0 conn(0x7ff57c073e10 msgr2=0x7ff57c167480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7ff579d9b640 1 --2- 172.21.15.131:0/3561507668 >> v2:172.21.15.150:3300/0 conn(0x7ff57c073e10 0x7ff57c167480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7ff579d9b640 1 -- 172.21.15.131:0/3561507668 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57c0726e0 con 0x7ff57c06fb60 2024-05-17T04:09:22.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f155b7fe640 1 -- 172.21.15.131:0/4179866455 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2627646394 0 0) 0x7f154c003520 con 0x7f155401ddc0 2024-05-17T04:09:22.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f155b7fe640 1 -- 172.21.15.131:0/4179866455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1554006750 msgr2=0x7f15540dc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f155b7fe640 1 --2- 172.21.15.131:0/4179866455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1554006750 0x7f15540dc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f155b7fe640 1 -- 172.21.15.131:0/4179866455 >> v2:172.21.15.150:3300/0 conn(0x7f155400bdf0 msgr2=0x7f1554053860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-17T04:09:22.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f155b7fe640 1 --2- 172.21.15.131:0/4179866455 >> v2:172.21.15.150:3300/0 conn(0x7f155400bdf0 0x7f1554053860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f155b7fe640 1 -- 172.21.15.131:0/4179866455 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1554052aa0 con 0x7f155401ddc0 2024-05-17T04:09:22.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f155b7fe640 1 -- 172.21.15.131:0/4179866455 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7f15480016f0 con 0x7f155401ddc0 2024-05-17T04:09:22.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f155b7fe640 1 -- 172.21.15.131:0/4179866455 >> v1:172.21.15.131:6789/0 conn(0x7f155401ddc0 legacy=0x7f1554006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f155b7fe640 1 --2- 172.21.15.131:0/4179866455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f154c003a50 0x7f154c003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f155b7fe640 1 --2- 172.21.15.131:0/4179866455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f154c004800 0x7f154c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f155b7fe640 1 --2- 172.21.15.131:0/4179866455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f154c0053f0 0x7f154c00ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f155b7fe640 1 -- 172.21.15.131:0/4179866455 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f15540533d0 con 0x7f154c003a50 2024-05-17T04:09:22.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f155b7fe640 1 -- 172.21.15.131:0/4179866455 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f154c00c2d0 con 0x7f154c004800 2024-05-17T04:09:22.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f155b7fe640 1 -- 172.21.15.131:0/4179866455 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f154c00c4d0 con 0x7f154c0053f0 2024-05-17T04:09:22.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f9c9d706640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9c980b52c0 0x7f9c98161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f9c9d706640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c98161950 con 0x7f9c98161540 2024-05-17T04:09:22.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f9c9d706640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c980b0040 con 0x7f9c98154480 2024-05-17T04:09:22.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f9c9d706640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9c980b4870 con 0x7f9c980b52c0 2024-05-17T04:09:22.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f9c977fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9c980b52c0 0x7f9c98161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f9c977fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9c980b52c0 0x7f9c98161000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43470/0 (socket says 172.21.15.131:43470) 2024-05-17T04:09:22.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f9c97fff640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9c98154480 0x7f9c9806f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:40962/0 (socket says 172.21.15.131:40962) 2024-05-17T04:09:22.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7f9c977fe640 1 -- 172.21.15.131:0/3812950777 learned_addr learned my addr 172.21.15.131:0/3812950777 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.127+0000 7fef3d8e0640 1 --2- 172.21.15.131:0/2897919138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef24005150 0x7fef2400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7fef3d0df640 1 -- 172.21.15.131:0/2897919138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef24005150 msgr2=0x7fef2400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7fef3d0df640 1 --2- 172.21.15.131:0/2897919138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef24005150 0x7fef2400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7fef3d0df640 1 -- 172.21.15.131:0/2897919138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef24004800 msgr2=0x7fef24004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7fef3c8de640 1 --2- 172.21.15.131:0/2897919138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef24004800 0x7fef24004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f155bfff640 1 --2- 172.21.15.131:0/4179866455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f154c004800 0x7f154c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f9c977fe640 1 -- 172.21.15.131:0/3812950777 >> v1:172.21.15.150:6789/0 conn(0x7f9c98154480 legacy=0x7f9c9806f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f9c977fe640 1 -- 172.21.15.131:0/3812950777 >> v1:172.21.15.131:6789/0 conn(0x7f9c98161540 legacy=0x7f9c980cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f9c97fff640 1 --1- 172.21.15.131:0/3812950777 >> v1:172.21.15.150:6789/0 conn(0x7f9c98154480 0x7f9c9806f830 :-1 s=CLOSED pgs=0 cs=0 l=0).handle_server_banner_and_identify state changed while learned_addr, mark_down or replacing must be happened just now 2024-05-17T04:09:22.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f1664a82640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16600d0340 0x7f16600d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f1664a82640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f166015d500 0x7f166015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f1664a82640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16600d0c90 con 0x7f166006d0d0 2024-05-17T04:09:22.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f1664a82640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f166006d4e0 con 0x7f166015d500 2024-05-17T04:09:22.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f1664a82640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f166006d790 con 0x7f16600d0340 2024-05-17T04:09:22.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f155bfff640 1 -- 172.21.15.131:0/4179866455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f154c0053f0 msgr2=0x7f154c00ba40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-17T04:09:22.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f155bfff640 1 --2- 172.21.15.131:0/4179866455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f154c0053f0 0x7f154c00ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f155bfff640 1 -- 172.21.15.131:0/4179866455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f154c003a50 msgr2=0x7f154c003ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-17T04:09:22.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f9c977fe640 1 -- 172.21.15.131:0/3812950777 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c980b0320 con 0x7f9c980b52c0 2024-05-17T04:09:22.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f165ffff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f166015d500 0x7f166015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f165ffff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f166015d500 0x7f166015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43478/0 (socket says 172.21.15.131:43478) 2024-05-17T04:09:22.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f165ffff640 1 -- 172.21.15.131:0/841397471 learned_addr learned my addr 172.21.15.131:0/841397471 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7fbf23fff640 1 --2- 172.21.15.131:0/2260348721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf1c00a800 0x7fbf1c052f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf2402e230 tx=0x7fbf240a6cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea169c653c94a672 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f165effd640 1 --2- 172.21.15.131:0/841397471 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16600d0340 0x7f16600d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7fbf227fc640 1 -- 172.21.15.131:0/2260348721 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf240b4070 con 0x7fbf1c00a800 2024-05-17T04:09:22.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7fbf227fc640 1 -- 172.21.15.131:0/2260348721 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf240a7830 con 0x7fbf1c00a800 2024-05-17T04:09:22.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7fbf227fc640 1 -- 172.21.15.131:0/2260348721 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf240a7ce0 con 0x7fbf1c00a800 2024-05-17T04:09:22.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7fef3d0df640 1 --2- 172.21.15.131:0/2897919138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef24004800 0x7fef24004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7fef3d0df640 1 -- 172.21.15.131:0/2897919138 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef24003520 con 0x7fef240039b0 2024-05-17T04:09:22.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7fef3c8de640 1 --2- 172.21.15.131:0/2897919138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef24004800 0x7fef24004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:22.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7ff579d9b640 1 --2- 172.21.15.131:0/3561507668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff57c06fb60 0x7ff57c0738d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff57c06e2c0 tx=0x7ff56402a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557aca918b2860d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7fef3d8e0640 1 --2- 172.21.15.131:0/2897919138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef24005150 0x7fef2400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:22.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f2595101640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f25900d1690 0x7f25900d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f2595101640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2590163be0 0x7f25900d4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f2595101640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f25900d45a0 0x7f25901677c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f165ffff640 1 -- 172.21.15.131:0/841397471 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16600d0340 msgr2=0x7f16600d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f165ffff640 1 --2- 172.21.15.131:0/841397471 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16600d0340 0x7f16600d0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f2595101640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f25900d0fa0 con 0x7f25900d1690 2024-05-17T04:09:22.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f2595101640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f25900d49b0 con 0x7f25900d45a0 2024-05-17T04:09:22.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f2595101640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f259006c890 con 0x7f2590163be0 2024-05-17T04:09:22.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7fef3d0df640 1 --2- 172.21.15.131:0/2897919138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef240039b0 0x7fef24003e00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fef38064300 tx=0x7fef24005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10d72848f7cf5307 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f165e7fc640 1 -- 172.21.15.131:0/841397471 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285911210 0 0) 0x7f1658001490 con 0x7f166006d0d0 2024-05-17T04:09:22.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7fef2ffff640 1 -- 172.21.15.131:0/2897919138 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3806aaa0 con 0x7fef240039b0 2024-05-17T04:09:22.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7fef2ffff640 1 -- 172.21.15.131:0/2897919138 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef380ab070 con 0x7fef240039b0 2024-05-17T04:09:22.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7fef2ffff640 1 -- 172.21.15.131:0/2897919138 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3806e290 con 0x7fef240039b0 2024-05-17T04:09:22.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7ff57959a640 1 -- 172.21.15.131:0/3561507668 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff564036070 con 0x7ff57c06fb60 2024-05-17T04:09:22.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7ff57959a640 1 -- 172.21.15.131:0/3561507668 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff564031600 con 0x7ff57c06fb60 2024-05-17T04:09:22.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7ff57959a640 1 -- 172.21.15.131:0/3561507668 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5640319d0 con 0x7ff57c06fb60 2024-05-17T04:09:22.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f1560b44640 1 --2- 172.21.15.131:0/4179866455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f154c003a50 0x7f154c003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f155bfff640 1 --2- 172.21.15.131:0/4179866455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f154c003a50 0x7f154c003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.128+0000 7f155bfff640 1 -- 172.21.15.131:0/4179866455 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1554052aa0 con 0x7f154c004800 2024-05-17T04:09:22.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f165ffff640 1 -- 172.21.15.131:0/841397471 >> v1:172.21.15.150:6789/0 conn(0x7f166006d0d0 legacy=0x7f16600c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f9c977fe640 1 --2- 172.21.15.131:0/3812950777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c980b52c0 0x7f9c98161000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009e50 tx=0x7f9c9002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb114f5deecbed3 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f1560b44640 1 --2- 172.21.15.131:0/4179866455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f154c003a50 0x7f154c003ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:22.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f165ffff640 1 -- 172.21.15.131:0/841397471 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166006da70 con 0x7f166015d500 2024-05-17T04:09:22.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f258ffff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f25900d1690 0x7f25900d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f2594900640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f25900d45a0 0x7f25901677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f258ffff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f25900d1690 0x7f25900d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43506/0 (socket says 172.21.15.131:43506) 2024-05-17T04:09:22.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f258ffff640 1 -- 172.21.15.131:0/717289588 learned_addr learned my addr 172.21.15.131:0/717289588 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f258f7fe640 1 --2- 172.21.15.131:0/717289588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2590163be0 0x7f25900d4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f2594900640 1 -- 172.21.15.131:0/717289588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2590163be0 msgr2=0x7f25900d4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f2594900640 1 --2- 172.21.15.131:0/717289588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2590163be0 0x7f25900d4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f2594900640 1 -- 172.21.15.131:0/717289588 >> v2:172.21.15.131:3300/0 conn(0x7f25900d1690 msgr2=0x7f25900d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f2594900640 1 --2- 172.21.15.131:0/717289588 >> v2:172.21.15.131:3300/0 conn(0x7f25900d1690 0x7f25900d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.129+0000 7f155bfff640 1 --2- 172.21.15.131:0/4179866455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f154c004800 0x7f154c004c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f154800b210 tx=0x7f154c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1c9b4369b88becf server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7ff7eca6b640 1 --2- 172.21.15.131:0/1490119537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e80744d0 0x7ff7e80b4d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0097a0 tx=0x7ff7dc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5f6342cd5e5a26 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7fbf28b8e640 1 -- 172.21.15.131:0/2260348721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf1c00a800 msgr2=0x7fbf1c052f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7f9c96ffd640 1 -- 172.21.15.131:0/3812950777 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c90036070 con 0x7f9c980b52c0 2024-05-17T04:09:22.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7fbf28b8e640 1 --2- 172.21.15.131:0/2260348721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf1c00a800 0x7fbf1c052f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf2402e230 tx=0x7fbf240a6cf0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7f9c96ffd640 1 -- 172.21.15.131:0/3812950777 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c90031600 con 0x7f9c980b52c0 2024-05-17T04:09:22.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7fef3e0e1640 1 -- 172.21.15.131:0/2897919138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef240039b0 msgr2=0x7fef24003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7fef3e0e1640 1 --2- 172.21.15.131:0/2897919138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef240039b0 0x7fef24003e00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fef38064300 tx=0x7fef24005830 comp rx=0 tx=0).stop 2024-05-17T04:09:22.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7ff7e6ffd640 1 -- 172.21.15.131:0/1490119537 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc037070 con 0x7ff7e80744d0 2024-05-17T04:09:22.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7ff7e6ffd640 1 -- 172.21.15.131:0/1490119537 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7dc032440 con 0x7ff7e80744d0 2024-05-17T04:09:22.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7ff7e6ffd640 1 -- 172.21.15.131:0/1490119537 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc032810 con 0x7ff7e80744d0 2024-05-17T04:09:22.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7fef3d8e0640 1 -- 172.21.15.131:0/2897919138 reap_dead start 2024-05-17T04:09:22.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7fef3e0e1640 1 -- 172.21.15.131:0/2897919138 shutdown_connections 2024-05-17T04:09:22.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7fef3e0e1640 1 -- 172.21.15.131:0/2897919138 >> 172.21.15.131:0/2897919138 conn(0x7fef300569f0 msgr2=0x7fef30056e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7f155b7fe640 1 -- 172.21.15.131:0/4179866455 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548006d50 con 0x7f154c004800 2024-05-17T04:09:22.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7f155b7fe640 1 -- 172.21.15.131:0/4179866455 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1548004a70 con 0x7f154c004800 2024-05-17T04:09:22.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7f2594900640 1 -- 172.21.15.131:0/717289588 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25900d0700 con 0x7f25900d45a0 2024-05-17T04:09:22.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.130+0000 7f258ffff640 1 --2- 172.21.15.131:0/717289588 >> v2:172.21.15.131:3300/0 conn(0x7f25900d1690 0x7f25900d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:22.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7ff5809eb640 1 -- 172.21.15.131:0/3561507668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff57c06fb60 msgr2=0x7ff57c0738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f9c96ffd640 1 -- 172.21.15.131:0/3812950777 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c90036070 con 0x7f9c980b52c0 2024-05-17T04:09:22.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7fef3e0e1640 1 -- 172.21.15.131:0/2897919138 shutdown_connections 2024-05-17T04:09:22.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7ff5809eb640 1 --2- 172.21.15.131:0/3561507668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff57c06fb60 0x7ff57c0738d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff57c06e2c0 tx=0x7ff56402a600 comp rx=0 tx=0).stop 2024-05-17T04:09:22.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f2594900640 1 --2- 172.21.15.131:0/717289588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900d45a0 0x7f25901677c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f259008d3d0 tx=0x7f258802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ddb59390010a7d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f1562da8640 1 -- 172.21.15.131:0/4179866455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f154c004800 msgr2=0x7f154c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f1562da8640 1 --2- 172.21.15.131:0/4179866455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f154c004800 0x7f154c004c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f154800b210 tx=0x7f154c005830 comp rx=0 tx=0).stop 2024-05-17T04:09:22.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f165ffff640 1 --2- 172.21.15.131:0/841397471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f166015d500 0x7f166015d910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1654009870 tx=0x7f165402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b753542ea2412c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f258effd640 1 -- 172.21.15.131:0/717289588 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2588007740 con 0x7f25900d45a0 2024-05-17T04:09:22.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f258effd640 1 -- 172.21.15.131:0/717289588 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25880078e0 con 0x7f25900d45a0 2024-05-17T04:09:22.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f258effd640 1 -- 172.21.15.131:0/717289588 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2588007cf0 con 0x7f25900d45a0 2024-05-17T04:09:22.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f9c9d706640 1 -- 172.21.15.131:0/3812950777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c980b52c0 msgr2=0x7f9c98161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f9c9d706640 1 --2- 172.21.15.131:0/3812950777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c980b52c0 0x7f9c98161000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009e50 tx=0x7f9c9002a710 comp rx=0 tx=0).stop 2024-05-17T04:09:22.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7fbf28b8e640 1 -- 172.21.15.131:0/2260348721 shutdown_connections 2024-05-17T04:09:22.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7fbf28b8e640 1 --2- 172.21.15.131:0/2260348721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf1c00a800 0x7fbf1c052f20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7fbf28b8e640 1 --2- 172.21.15.131:0/2260348721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c039d10 0x7fbf1c051830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7fbf28b8e640 1 -- 172.21.15.131:0/2260348721 >> 172.21.15.131:0/2260348721 conn(0x7fbf1c01db60 msgr2=0x7fbf1c039600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7fbf28b8e640 1 -- 172.21.15.131:0/2260348721 shutdown_connections 2024-05-17T04:09:22.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7fbf28b8e640 1 -- 172.21.15.131:0/2260348721 wait complete. 2024-05-17T04:09:22.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f1561345640 1 -- 172.21.15.131:0/4179866455 reap_dead start 2024-05-17T04:09:22.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f165e7fc640 1 -- 172.21.15.131:0/841397471 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654037070 con 0x7f166015d500 2024-05-17T04:09:22.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f165e7fc640 1 -- 172.21.15.131:0/841397471 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1654032440 con 0x7f166015d500 2024-05-17T04:09:22.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f1562da8640 1 -- 172.21.15.131:0/4179866455 shutdown_connections 2024-05-17T04:09:22.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f1562da8640 1 -- 172.21.15.131:0/4179866455 >> 172.21.15.131:0/4179866455 conn(0x7f15540362f0 msgr2=0x7f1554036700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f9c9d706640 1 -- 172.21.15.131:0/3812950777 shutdown_connections 2024-05-17T04:09:22.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f9c9d706640 1 --2- 172.21.15.131:0/3812950777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c980b52c0 0x7f9c98161000 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f9c9d706640 1 -- 172.21.15.131:0/3812950777 >> 172.21.15.131:0/3812950777 conn(0x7f9c9806cd20 msgr2=0x7f9c9806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f165e7fc640 1 -- 172.21.15.131:0/841397471 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654032810 con 0x7f166015d500 2024-05-17T04:09:22.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7fef3e0e1640 1 -- 172.21.15.131:0/2897919138 wait complete. 2024-05-17T04:09:22.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f1562da8640 1 -- 172.21.15.131:0/4179866455 shutdown_connections 2024-05-17T04:09:22.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f9c9d706640 1 -- 172.21.15.131:0/3812950777 shutdown_connections 2024-05-17T04:09:22.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7ff5809eb640 1 -- 172.21.15.131:0/3561507668 shutdown_connections 2024-05-17T04:09:22.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7ff5809eb640 1 --2- 172.21.15.131:0/3561507668 >> v2:172.21.15.150:3300/0 conn(0x7ff57c073e10 0x7ff57c167480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7ff5809eb640 1 --2- 172.21.15.131:0/3561507668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff57c06fb60 0x7ff57c0738d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7ff5809eb640 1 --2- 172.21.15.131:0/3561507668 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff57c163920 0x7ff57c06f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7ff5809eb640 1 -- 172.21.15.131:0/3561507668 >> 172.21.15.131:0/3561507668 conn(0x7ff57c06d710 msgr2=0x7ff57c06db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/1490119537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e80744d0 msgr2=0x7ff7e80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7ff7ee4ce640 1 --2- 172.21.15.131:0/1490119537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e80744d0 0x7ff7e80b4d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0097a0 tx=0x7ff7dc02a1a0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/1490119537 shutdown_connections 2024-05-17T04:09:22.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7f2595101640 1 -- 172.21.15.131:0/717289588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900d45a0 msgr2=0x7f25901677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.131+0000 7f1562da8640 1 -- 172.21.15.131:0/4179866455 wait complete. 2024-05-17T04:09:22.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7ff7ee4ce640 1 --2- 172.21.15.131:0/1490119537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e80744d0 0x7ff7e80b4d90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7f2595101640 1 --2- 172.21.15.131:0/717289588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900d45a0 0x7f25901677c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f259008d3d0 tx=0x7f258802a5f0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/1490119537 >> 172.21.15.131:0/1490119537 conn(0x7ff7e80d1e80 msgr2=0x7ff7e80d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7ff5809eb640 1 -- 172.21.15.131:0/3561507668 shutdown_connections 2024-05-17T04:09:22.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/1490119537 shutdown_connections 2024-05-17T04:09:22.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/1490119537 wait complete. 2024-05-17T04:09:22.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7f9c9d706640 1 -- 172.21.15.131:0/3812950777 wait complete. 2024-05-17T04:09:22.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7f1664a82640 1 -- 172.21.15.131:0/841397471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f166015d500 msgr2=0x7f166015d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7f1664a82640 1 --2- 172.21.15.131:0/841397471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f166015d500 0x7f166015d910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1654009870 tx=0x7f165402a270 comp rx=0 tx=0).stop 2024-05-17T04:09:22.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.133+0000 7f2595101640 1 -- 172.21.15.131:0/717289588 shutdown_connections 2024-05-17T04:09:22.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.133+0000 7f2595101640 1 --2- 172.21.15.131:0/717289588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900d45a0 0x7f25901677c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.133+0000 7f2595101640 1 --2- 172.21.15.131:0/717289588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2590163be0 0x7f25900d4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.133+0000 7f2595101640 1 --2- 172.21.15.131:0/717289588 >> v2:172.21.15.131:3300/0 conn(0x7f25900d1690 0x7f25900d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.133+0000 7f2595101640 1 -- 172.21.15.131:0/717289588 >> 172.21.15.131:0/717289588 conn(0x7f25900b6c40 msgr2=0x7f25900b7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.133+0000 7f2595101640 1 -- 172.21.15.131:0/717289588 shutdown_connections 2024-05-17T04:09:22.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.133+0000 7f2595101640 1 -- 172.21.15.131:0/717289588 wait complete. 2024-05-17T04:09:22.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.132+0000 7ff5809eb640 1 -- 172.21.15.131:0/3561507668 wait complete. 2024-05-17T04:09:22.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.133+0000 7f1664a82640 1 -- 172.21.15.131:0/841397471 shutdown_connections 2024-05-17T04:09:22.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.133+0000 7f1664a82640 1 --2- 172.21.15.131:0/841397471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f166015d500 0x7f166015d910 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.133+0000 7f1664a82640 1 --2- 172.21.15.131:0/841397471 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16600d0340 0x7f16600d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.134+0000 7fef3e0e1640 1 Processor -- start 2024-05-17T04:09:22.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.133+0000 7f1664a82640 1 -- 172.21.15.131:0/841397471 >> 172.21.15.131:0/841397471 conn(0x7f166006f6d0 msgr2=0x7f166006fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.134+0000 7fef3e0e1640 1 -- start start 2024-05-17T04:09:22.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.134+0000 7f1562da8640 1 Processor -- start 2024-05-17T04:09:22.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.134+0000 7fbf28b8e640 1 Processor -- start 2024-05-17T04:09:22.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.134+0000 7fbf28b8e640 1 -- start start 2024-05-17T04:09:22.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.135+0000 7f9c9d706640 1 Processor -- start 2024-05-17T04:09:22.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.134+0000 7f1562da8640 1 -- start start 2024-05-17T04:09:22.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.135+0000 7f1664a82640 1 -- 172.21.15.131:0/841397471 shutdown_connections 2024-05-17T04:09:22.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.135+0000 7f9c9d706640 1 -- start start 2024-05-17T04:09:22.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.136+0000 7ff7ee4ce640 1 Processor -- start 2024-05-17T04:09:22.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.136+0000 7ff5809eb640 1 Processor -- start 2024-05-17T04:09:22.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.136+0000 7ff7ee4ce640 1 -- start start 2024-05-17T04:09:22.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.136+0000 7ff5809eb640 1 -- start start 2024-05-17T04:09:22.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.136+0000 7f2595101640 1 Processor -- start 2024-05-17T04:09:22.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.136+0000 7fef3e0e1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef240039b0 0x7fef30164bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.136+0000 7fef3e0e1640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef3004e3f0 0x7fef3004fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7f2595101640 1 -- start start 2024-05-17T04:09:22.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7fef3e0e1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef30008100 0x7fef30008510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7f1562da8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15540dbe70 0x7f15540dc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7f1562da8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f155404fe90 0x7f15540502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7f1562da8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15540507e0 0x7f1554037fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7fef3d8e0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef30008100 0x7fef30008510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7fef3d8e0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef30008100 0x7fef30008510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43520/0 (socket says 172.21.15.131:43520) 2024-05-17T04:09:22.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7fef3d8e0640 1 -- 172.21.15.131:0/1400125880 learned_addr learned my addr 172.21.15.131:0/1400125880 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7fbf28b8e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c033d10 0x7fbf1c1743a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7fef3e0e1640 1 -- 172.21.15.131:0/1400125880 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fef3003bb10 con 0x7fef30008100 2024-05-17T04:09:22.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7fef3e0e1640 1 -- 172.21.15.131:0/1400125880 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fef3003be80 con 0x7fef240039b0 2024-05-17T04:09:22.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7f1561345640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15540507e0 0x7f1554037fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7f1561345640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15540507e0 0x7f1554037fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43522/0 (socket says 172.21.15.131:43522) 2024-05-17T04:09:22.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7f9c9d706640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c98154480 0x7f9c98158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7fef3e0e1640 1 -- 172.21.15.131:0/1400125880 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fef30054980 con 0x7fef3004e3f0 2024-05-17T04:09:22.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7f1561345640 1 -- 172.21.15.131:0/896883189 learned_addr learned my addr 172.21.15.131:0/896883189 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7f1562da8640 1 -- 172.21.15.131:0/896883189 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1554053060 con 0x7f15540507e0 2024-05-17T04:09:22.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7fef3d0df640 1 --2- 172.21.15.131:0/1400125880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef240039b0 0x7fef30164bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7f9c9d706640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c98161540 0x7f9c981431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7f1562da8640 1 -- 172.21.15.131:0/896883189 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1554053da0 con 0x7f155404fe90 2024-05-17T04:09:22.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7fef3c8de640 1 --2- 172.21.15.131:0/1400125880 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef3004e3f0 0x7fef3004fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7f9c9d706640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c981f9180 0x7f9c981f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.137+0000 7f1562da8640 1 -- 172.21.15.131:0/896883189 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f15540e06c0 con 0x7f15540dbe70 2024-05-17T04:09:22.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7f9c9d706640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9c980b4ac0 con 0x7f9c981f9180 2024-05-17T04:09:22.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7f9c97fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c98154480 0x7f9c98158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7f9c9d706640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9c980b4e30 con 0x7f9c98161540 2024-05-17T04:09:22.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7f9c977fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c98161540 0x7f9c981431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7f9c9d706640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9c98154890 con 0x7f9c98154480 2024-05-17T04:09:22.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7f9c97fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c98154480 0x7f9c98158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:48458/0 (socket says 172.21.15.131:48458) 2024-05-17T04:09:22.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7f9c97fff640 1 -- 172.21.15.131:0/3881700871 learned_addr learned my addr 172.21.15.131:0/3881700871 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7f9c977fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c98161540 0x7f9c981431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:60342/0 (socket says 172.21.15.131:60342) 2024-05-17T04:09:22.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7fbf28b8e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf1c039d10 0x7fbf1c04c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.135+0000 7f1664a82640 1 -- 172.21.15.131:0/841397471 wait complete. 2024-05-17T04:09:22.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7f1664a82640 1 Processor -- start 2024-05-17T04:09:22.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7fbf28b8e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf1c178060 0x7fbf1c178470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7f9c9cf05640 1 --2- 172.21.15.131:0/3881700871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c981f9180 0x7f9c981f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7fbf28b8e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c0337c0 con 0x7fbf1c039d10 2024-05-17T04:09:22.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7f1664a82640 1 -- start start 2024-05-17T04:09:22.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7ff5809eb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff57c06fb60 0x7ff57c1fd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7fbf23fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf1c178060 0x7fbf1c178470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7fef3d0df640 1 -- 172.21.15.131:0/1400125880 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef3004e3f0 msgr2=0x7fef3004fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7fef3d0df640 1 --2- 172.21.15.131:0/1400125880 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef3004e3f0 0x7fef3004fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7fef3d0df640 1 -- 172.21.15.131:0/1400125880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef30008100 msgr2=0x7fef30008510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7fef3d0df640 1 --2- 172.21.15.131:0/1400125880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef30008100 0x7fef30008510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff5809eb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff57c073e10 0x7ff57c158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7fef3d0df640 1 -- 172.21.15.131:0/1400125880 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef30008a50 con 0x7fef240039b0 2024-05-17T04:09:22.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff5809eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff57c163920 0x7ff57c1ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f1561345640 1 -- 172.21.15.131:0/896883189 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15540dbe70 msgr2=0x7f15540dc280 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-17T04:09:22.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7ff7ee4ce640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e80744d0 0x7ff7e8148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f1561345640 1 --2- 172.21.15.131:0/896883189 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15540dbe70 0x7f15540dc280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f1561345640 1 -- 172.21.15.131:0/896883189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f155404fe90 msgr2=0x7f15540502a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-17T04:09:22.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f1561345640 1 --2- 172.21.15.131:0/896883189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f155404fe90 0x7f15540502a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f1561345640 1 -- 172.21.15.131:0/896883189 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15540d41e0 con 0x7f15540507e0 2024-05-17T04:09:22.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7fbf23fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf1c178060 0x7fbf1c178470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:60356/0 (socket says 172.21.15.131:60356) 2024-05-17T04:09:22.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff579d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff57c073e10 0x7ff57c158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff579d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff57c073e10 0x7ff57c158de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:60374/0 (socket says 172.21.15.131:60374) 2024-05-17T04:09:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f2595101640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25900d1690 0x7f259015e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff579d9b640 1 -- 172.21.15.131:0/2572322511 learned_addr learned my addr 172.21.15.131:0/2572322511 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff5809eb640 1 -- 172.21.15.131:0/2572322511 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c074220 con 0x7ff57c163920 2024-05-17T04:09:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff7ee4ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7e815c4a0 0x7ff7e814f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff7e7fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e80744d0 0x7ff7e8148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff5809eb640 1 -- 172.21.15.131:0/2572322511 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c072ca0 con 0x7ff57c073e10 2024-05-17T04:09:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff5809eb640 1 -- 172.21.15.131:0/2572322511 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff57c0731c0 con 0x7ff57c06fb60 2024-05-17T04:09:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff57a59c640 1 --2- 172.21.15.131:0/2572322511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff57c06fb60 0x7ff57c1fd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f2595101640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900d45a0 0x7f259015e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f2595101640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2590163be0 0x7f2590154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f2595101640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2590163ff0 con 0x7f25900d1690 2024-05-17T04:09:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f2595101640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f25900d0cc0 con 0x7f25900d45a0 2024-05-17T04:09:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f2595101640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f25900d1360 con 0x7f2590163be0 2024-05-17T04:09:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff7e7fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e80744d0 0x7ff7e8148a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43560/0 (socket says 172.21.15.131:43560) 2024-05-17T04:09:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.138+0000 7fbf23fff640 1 -- 172.21.15.131:0/1309461605 learned_addr learned my addr 172.21.15.131:0/1309461605 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7fbf237fe640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c033d10 0x7fbf1c1743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7fbf28b8e640 1 -- 172.21.15.131:0/1309461605 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c052720 con 0x7fbf1c178060 2024-05-17T04:09:22.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7fbf28b8e640 1 -- 172.21.15.131:0/1309461605 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbf1c033940 con 0x7fbf1c033d10 2024-05-17T04:09:22.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7fef3d0df640 1 --2- 172.21.15.131:0/1400125880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef240039b0 0x7fef30164bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fef38052290 tx=0x7fef3806a6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7fbf22ffd640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf1c039d10 0x7fbf1c04c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f2594900640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2590163be0 0x7f2590154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f258ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25900d1690 0x7f259015e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f2594900640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2590163be0 0x7f2590154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:48484/0 (socket says 172.21.15.131:48484) 2024-05-17T04:09:22.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f2594900640 1 -- 172.21.15.131:0/4254308287 learned_addr learned my addr 172.21.15.131:0/4254308287 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f258ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25900d1690 0x7f259015e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43568/0 (socket says 172.21.15.131:43568) 2024-05-17T04:09:22.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff57ad9d640 1 --2- 172.21.15.131:0/2572322511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff57c163920 0x7ff57c1ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f9c9cf05640 1 -- 172.21.15.131:0/3881700871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c98154480 msgr2=0x7f9c98158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f9c9cf05640 1 --2- 172.21.15.131:0/3881700871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c98154480 0x7f9c98158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f9c9cf05640 1 -- 172.21.15.131:0/3881700871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c98161540 msgr2=0x7f9c981431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f9c9cf05640 1 --2- 172.21.15.131:0/3881700871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c98161540 0x7f9c981431e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f9c9cf05640 1 -- 172.21.15.131:0/3881700871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c981f9ad0 con 0x7f9c981f9180 2024-05-17T04:09:22.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f9c977fe640 1 --2- 172.21.15.131:0/3881700871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c98161540 0x7f9c981431e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:22.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff7e7fff640 1 -- 172.21.15.131:0/3285475841 learned_addr learned my addr 172.21.15.131:0/3285475841 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7f258f7fe640 1 --2- 172.21.15.131:0/4254308287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900d45a0 0x7f259015e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff7ee4ce640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7e814e310 0x7ff7e814fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.139+0000 7ff7e77fe640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7e815c4a0 0x7ff7e814f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f9c9cf05640 1 --2- 172.21.15.131:0/3881700871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c981f9180 0x7f9c981f9590 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000c390 tx=0x7f9c8000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7fbf23fff640 1 -- 172.21.15.131:0/1309461605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c033d10 msgr2=0x7fbf1c1743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7fbf23fff640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c033d10 0x7fbf1c1743a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7fbf23fff640 1 -- 172.21.15.131:0/1309461605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf1c039d10 msgr2=0x7fbf1c04c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7ff7eca6b640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7e814e310 0x7ff7e814fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7ff579d9b640 1 -- 172.21.15.131:0/2572322511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff57c06fb60 msgr2=0x7ff57c1fd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7ff579d9b640 1 --2- 172.21.15.131:0/2572322511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff57c06fb60 0x7ff57c1fd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7ff579d9b640 1 -- 172.21.15.131:0/2572322511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff57c163920 msgr2=0x7ff57c1ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7ff579d9b640 1 --2- 172.21.15.131:0/2572322511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff57c163920 0x7ff57c1ed2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7ff579d9b640 1 -- 172.21.15.131:0/2572322511 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57c165e80 con 0x7ff57c073e10 2024-05-17T04:09:22.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/3285475841 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e806fc30 con 0x7ff7e80744d0 2024-05-17T04:09:22.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/3285475841 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e806f430 con 0x7ff7e815c4a0 2024-05-17T04:09:22.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f1561345640 1 --2- 172.21.15.131:0/896883189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15540507e0 0x7f1554037fd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f155c02e230 tx=0x7f155c069d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/3285475841 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff7e806fdb0 con 0x7ff7e814e310 2024-05-17T04:09:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7fbf23fff640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf1c039d10 0x7fbf1c04c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7fbf23fff640 1 -- 172.21.15.131:0/1309461605 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1c178ec0 con 0x7fbf1c178060 2024-05-17T04:09:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7fbf22ffd640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf1c039d10 0x7fbf1c04c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f2594900640 1 -- 172.21.15.131:0/4254308287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900d45a0 msgr2=0x7f259015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f2594900640 1 --2- 172.21.15.131:0/4254308287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25900d45a0 0x7f259015e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f2594900640 1 -- 172.21.15.131:0/4254308287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25900d1690 msgr2=0x7f259015e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f2594900640 1 --2- 172.21.15.131:0/4254308287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25900d1690 0x7f259015e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f2594900640 1 -- 172.21.15.131:0/4254308287 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2590164420 con 0x7f2590163be0 2024-05-17T04:09:22.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f9c94ff9640 1 -- 172.21.15.131:0/3881700871 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c80017070 con 0x7f9c981f9180 2024-05-17T04:09:22.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f9c94ff9640 1 -- 172.21.15.131:0/3881700871 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c800052d0 con 0x7f9c981f9180 2024-05-17T04:09:22.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f9c94ff9640 1 -- 172.21.15.131:0/3881700871 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c80003830 con 0x7f9c981f9180 2024-05-17T04:09:22.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7fbf237fe640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c033d10 0x7fbf1c1743a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:22.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7fbf23fff640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf1c178060 0x7fbf1c178470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbf2402e230 tx=0x7fbf24076a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7fbf0ffff640 1 -- 172.21.15.131:0/1309461605 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf240b4050 con 0x7fbf1c178060 2024-05-17T04:09:22.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7fbf0ffff640 1 -- 172.21.15.131:0/1309461605 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf240b5040 con 0x7fbf1c178060 2024-05-17T04:09:22.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7fbf28b8e640 1 -- 172.21.15.131:0/1309461605 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1c1789b0 con 0x7fbf1c178060 2024-05-17T04:09:22.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7fef2dffb640 1 -- 172.21.15.131:0/1400125880 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef380be070 con 0x7fef240039b0 2024-05-17T04:09:22.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7fef2dffb640 1 -- 172.21.15.131:0/1400125880 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef3806aa80 con 0x7fef240039b0 2024-05-17T04:09:22.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7fef2dffb640 1 -- 172.21.15.131:0/1400125880 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3806caa0 con 0x7fef240039b0 2024-05-17T04:09:22.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7fef3e0e1640 1 -- 172.21.15.131:0/1400125880 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef301654e0 con 0x7fef240039b0 2024-05-17T04:09:22.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7ff579d9b640 1 --2- 172.21.15.131:0/2572322511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff57c073e10 0x7ff57c158de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff564034040 tx=0x7ff564004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7ff572ffd640 1 -- 172.21.15.131:0/2572322511 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56403f020 con 0x7ff57c073e10 2024-05-17T04:09:22.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7ff572ffd640 1 -- 172.21.15.131:0/2572322511 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff564037040 con 0x7ff57c073e10 2024-05-17T04:09:22.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f15597fa640 1 -- 172.21.15.131:0/896883189 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155c075290 con 0x7f15540507e0 2024-05-17T04:09:22.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f15597fa640 1 -- 172.21.15.131:0/896883189 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f155c064050 con 0x7f15540507e0 2024-05-17T04:09:22.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f15597fa640 1 -- 172.21.15.131:0/896883189 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155c0756f0 con 0x7f15540507e0 2024-05-17T04:09:22.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f1664a82640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f166006d0d0 0x7f166014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f1664a82640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16600d0340 0x7f166014d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7f1664a82640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f166015d500 0x7f1660147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7f1664a82640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f166006e310 con 0x7f16600d0340 2024-05-17T04:09:22.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7f1664a82640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f166006e030 con 0x7f166015d500 2024-05-17T04:09:22.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7f1664a82640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f166006e830 con 0x7f166006d0d0 2024-05-17T04:09:22.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7f165f7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f166006d0d0 0x7f166014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7f165f7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f166006d0d0 0x7f166014e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:48504/0 (socket says 172.21.15.131:48504) 2024-05-17T04:09:22.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7f165f7fe640 1 -- 172.21.15.131:0/2987180930 learned_addr learned my addr 172.21.15.131:0/2987180930 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f2594900640 1 --2- 172.21.15.131:0/4254308287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2590163be0 0x7f2590154f10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2588009e50 tx=0x7f2588004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f258cff9640 1 -- 172.21.15.131:0/4254308287 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258803f070 con 0x7f2590163be0 2024-05-17T04:09:22.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f258ffff640 1 --2- 172.21.15.131:0/4254308287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25900d1690 0x7f259015e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:22.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f258cff9640 1 -- 172.21.15.131:0/4254308287 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2588031b70 con 0x7f2590163be0 2024-05-17T04:09:22.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f258cff9640 1 -- 172.21.15.131:0/4254308287 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2588044460 con 0x7f2590163be0 2024-05-17T04:09:22.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f9c9d706640 1 -- 172.21.15.131:0/3881700871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c981589b0 con 0x7f9c981f9180 2024-05-17T04:09:22.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.140+0000 7f9c9d706640 1 -- 172.21.15.131:0/3881700871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c98158f70 con 0x7f9c981f9180 2024-05-17T04:09:22.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7ff7e77fe640 1 -- 172.21.15.131:0/3285475841 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7e814e310 msgr2=0x7ff7e814fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7ff7e77fe640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7e814e310 0x7ff7e814fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7ff7e77fe640 1 -- 172.21.15.131:0/3285475841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e80744d0 msgr2=0x7ff7e8148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7ff7e77fe640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e80744d0 0x7ff7e8148a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7ff7e77fe640 1 -- 172.21.15.131:0/3285475841 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e814eb30 con 0x7ff7e815c4a0 2024-05-17T04:09:22.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7ff7e7fff640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e80744d0 0x7ff7e8148a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:22.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7ff7e77fe640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7e815c4a0 0x7ff7e814f8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c310 tx=0x7ff7d400c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7fef3e0e1640 1 -- 172.21.15.131:0/1400125880 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef30165aa0 con 0x7fef240039b0 2024-05-17T04:09:22.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.141+0000 7f165effd640 1 --2- 172.21.15.131:0/2987180930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16600d0340 0x7f166014d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7f9c8e7fc640 1 -- 172.21.15.131:0/3881700871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9c98161df0 con 0x7f9c981f9180 2024-05-17T04:09:22.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7f165effd640 1 -- 172.21.15.131:0/2987180930 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f166006d0d0 msgr2=0x7f166014e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7f165effd640 1 --2- 172.21.15.131:0/2987180930 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f166006d0d0 0x7f166014e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7f165effd640 1 -- 172.21.15.131:0/2987180930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f166015d500 msgr2=0x7f1660147f60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-17T04:09:22.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7f165effd640 1 --2- 172.21.15.131:0/2987180930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f166015d500 0x7f1660147f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7f165effd640 1 -- 172.21.15.131:0/2987180930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16601557b0 con 0x7f16600d0340 2024-05-17T04:09:22.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7f1562da8640 1 -- 172.21.15.131:0/896883189 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15540dc960 con 0x7f15540507e0 2024-05-17T04:09:22.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7f1562da8640 1 -- 172.21.15.131:0/896883189 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15540377d0 con 0x7f15540507e0 2024-05-17T04:09:22.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7fbf0ffff640 1 -- 172.21.15.131:0/1309461605 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24068a90 con 0x7fbf1c178060 2024-05-17T04:09:22.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7f165effd640 1 --2- 172.21.15.131:0/2987180930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16600d0340 0x7f166014d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1650009e70 tx=0x7f165000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7ff572ffd640 1 -- 172.21.15.131:0/2572322511 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff564036070 con 0x7ff57c073e10 2024-05-17T04:09:22.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7ff5809eb640 1 -- 172.21.15.131:0/2572322511 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff57c159320 con 0x7ff57c073e10 2024-05-17T04:09:22.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7ff5809eb640 1 -- 172.21.15.131:0/2572322511 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff57c1fdd70 con 0x7ff57c073e10 2024-05-17T04:09:22.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7f2595101640 1 -- 172.21.15.131:0/4254308287 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2590164700 con 0x7f2590163be0 2024-05-17T04:09:22.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7fbf28b8e640 1 -- 172.21.15.131:0/1309461605 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf1c04d720 con 0x7fbf1c178060 2024-05-17T04:09:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7f2595101640 1 -- 172.21.15.131:0/4254308287 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2590164cc0 con 0x7f2590163be0 2024-05-17T04:09:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7ff7e4ff9640 1 -- 172.21.15.131:0/3285475841 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40074e0 con 0x7ff7e815c4a0 2024-05-17T04:09:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7ff7e4ff9640 1 -- 172.21.15.131:0/3285475841 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d4007680 con 0x7ff7e815c4a0 2024-05-17T04:09:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.142+0000 7ff7e4ff9640 1 -- 172.21.15.131:0/3285475841 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4004a00 con 0x7ff7e815c4a0 2024-05-17T04:09:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.143+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/3285475841 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e814ee10 con 0x7ff7e815c4a0 2024-05-17T04:09:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.143+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/3285475841 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e814f3d0 con 0x7ff7e815c4a0 2024-05-17T04:09:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.143+0000 7fef3e0e1640 1 -- 172.21.15.131:0/1400125880 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef30165290 con 0x7fef240039b0 2024-05-17T04:09:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.143+0000 7ff5809eb640 1 -- 172.21.15.131:0/2572322511 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff57c1661f0 con 0x7ff57c073e10 2024-05-17T04:09:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.143+0000 7fbf28b8e640 1 -- 172.21.15.131:0/1309461605 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbf1c051830 con 0x7fbf1c178060 2024-05-17T04:09:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.144+0000 7fef2dffb640 1 -- 172.21.15.131:0/1400125880 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef380c1070 con 0x7fef240039b0 2024-05-17T04:09:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7f1562da8640 1 -- 172.21.15.131:0/896883189 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f15540dce80 con 0x7f15540507e0 2024-05-17T04:09:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.146+0000 7fbf0ffff640 1 -- 172.21.15.131:0/1309461605 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbf240c2020 con 0x7fbf1c178060 2024-05-17T04:09:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7fef2dffb640 1 --2- 172.21.15.131:0/1400125880 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fef1c0763a0 0x7fef1c0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7fef2dffb640 1 -- 172.21.15.131:0/1400125880 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fef38133ac0 con 0x7fef240039b0 2024-05-17T04:09:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7fef2dffb640 1 --2- 172.21.15.131:0/1400125880 >> [v2:172.21.15.131:6816/730333560,v1:172.21.15.131:6818/730333560] conn(0x7fef1c07fb60 0x7fef1c081ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7fef2dffb640 1 -- 172.21.15.131:0/1400125880 --> [v2:172.21.15.131:6816/730333560,v1:172.21.15.131:6818/730333560] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef380694e0 con 0x7fef1c07fb60 2024-05-17T04:09:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7fef2dffb640 1 -- 172.21.15.131:0/1400125880 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fef381382a0 con 0x7fef240039b0 2024-05-17T04:09:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7fef3c8de640 1 --2- 172.21.15.131:0/1400125880 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fef1c0763a0 0x7fef1c0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7fef3d8e0640 1 --2- 172.21.15.131:0/1400125880 >> [v2:172.21.15.131:6816/730333560,v1:172.21.15.131:6818/730333560] conn(0x7fef1c07fb60 0x7fef1c081ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.146+0000 7fef3c8de640 1 --2- 172.21.15.131:0/1400125880 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fef1c0763a0 0x7fef1c0788b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fef30000ca0 tx=0x7fef34008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.146+0000 7fef3d8e0640 1 --2- 172.21.15.131:0/1400125880 >> [v2:172.21.15.131:6816/730333560,v1:172.21.15.131:6818/730333560] conn(0x7fef1c07fb60 0x7fef1c081ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7ff572ffd640 1 -- 172.21.15.131:0/2572322511 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff564042020 con 0x7ff57c073e10 2024-05-17T04:09:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.146+0000 7ff572ffd640 1 --2- 172.21.15.131:0/2572322511 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff55c0763a0 0x7ff55c0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.146+0000 7ff572ffd640 1 -- 172.21.15.131:0/2572322511 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff5640b8460 con 0x7ff57c073e10 2024-05-17T04:09:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.146+0000 7ff572ffd640 1 --2- 172.21.15.131:0/2572322511 >> [v2:172.21.15.131:6800/797420574,v1:172.21.15.131:6801/797420574] conn(0x7ff55c07fb60 0x7ff55c081ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.146+0000 7ff572ffd640 1 -- 172.21.15.131:0/2572322511 --> [v2:172.21.15.131:6800/797420574,v1:172.21.15.131:6801/797420574] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff56400ae60 con 0x7ff55c07fb60 2024-05-17T04:09:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.146+0000 7ff572ffd640 1 -- 172.21.15.131:0/2572322511 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff5640b8850 con 0x7ff57c073e10 2024-05-17T04:09:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7f1647fff640 1 -- 172.21.15.131:0/2987180930 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1650024070 con 0x7f16600d0340 2024-05-17T04:09:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7f1647fff640 1 -- 172.21.15.131:0/2987180930 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1650017a50 con 0x7f16600d0340 2024-05-17T04:09:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7f1647fff640 1 -- 172.21.15.131:0/2987180930 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1650017e40 con 0x7f16600d0340 2024-05-17T04:09:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7f1664a82640 1 -- 172.21.15.131:0/2987180930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1660155a90 con 0x7f16600d0340 2024-05-17T04:09:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7f1664a82640 1 -- 172.21.15.131:0/2987180930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1660157720 con 0x7f16600d0340 2024-05-17T04:09:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.146+0000 7f1645ffb640 1 -- 172.21.15.131:0/2987180930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1638001030 con 0x7f16600d0340 2024-05-17T04:09:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7ff7d27fc640 1 -- 172.21.15.131:0/3285475841 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7e80b4d90 con 0x7ff7e815c4a0 2024-05-17T04:09:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.146+0000 7ff7e4ff9640 1 -- 172.21.15.131:0/3285475841 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff7d4004ba0 con 0x7ff7e815c4a0 2024-05-17T04:09:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.146+0000 7f9c94ff9640 1 -- 172.21.15.131:0/3881700871 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9c8001a070 con 0x7f9c981f9180 2024-05-17T04:09:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.144+0000 7f25867fc640 1 -- 172.21.15.131:0/4254308287 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25900d00d0 con 0x7f2590163be0 2024-05-17T04:09:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.145+0000 7f258cff9640 1 -- 172.21.15.131:0/4254308287 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f258803b410 con 0x7f2590163be0 2024-05-17T04:09:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7fbf0ffff640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbf080763a0 0x7fbf080788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7ff57a59c640 1 --2- 172.21.15.131:0/2572322511 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff55c0763a0 0x7ff55c0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.146+0000 7ff7e4ff9640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff7cc0763a0 0x7ff7cc0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7fbf0ffff640 1 -- 172.21.15.131:0/1309461605 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbf24134de0 con 0x7fbf1c178060 2024-05-17T04:09:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7ff57ad9d640 1 --2- 172.21.15.131:0/2572322511 >> [v2:172.21.15.131:6800/797420574,v1:172.21.15.131:6801/797420574] conn(0x7ff55c07fb60 0x7ff55c081ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7f258cff9640 1 --2- 172.21.15.131:0/4254308287 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f25700763d0 0x7f25700788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7f258cff9640 1 -- 172.21.15.131:0/4254308287 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f25880b8ff0 con 0x7f2590163be0 2024-05-17T04:09:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7f258cff9640 1 --2- 172.21.15.131:0/4254308287 >> [v2:172.21.15.150:6808/491308104,v1:172.21.15.150:6810/491308104] conn(0x7f257007fb90 0x7f2570082020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7f258cff9640 1 -- 172.21.15.131:0/4254308287 --> [v2:172.21.15.150:6808/491308104,v1:172.21.15.150:6810/491308104] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25700826f0 con 0x7f257007fb90 2024-05-17T04:09:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7f258cff9640 1 -- 172.21.15.131:0/4254308287 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f25880bb5f0 con 0x7f2590163be0 2024-05-17T04:09:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7ff7e4ff9640 1 -- 172.21.15.131:0/3285475841 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff7d40972d0 con 0x7ff7e815c4a0 2024-05-17T04:09:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7ff7e4ff9640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.150:6824/2147509392,v1:172.21.15.150:6825/2147509392] conn(0x7ff7cc07fae0 0x7ff7cc081f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7ff7e4ff9640 1 -- 172.21.15.131:0/3285475841 --> [v2:172.21.15.150:6824/2147509392,v1:172.21.15.150:6825/2147509392] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7cc082640 con 0x7ff7cc07fae0 2024-05-17T04:09:22.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7ff7e4ff9640 1 -- 172.21.15.131:0/3285475841 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff7d409e050 con 0x7ff7e815c4a0 2024-05-17T04:09:22.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7fef2dffb640 1 -- 172.21.15.131:0/1400125880 <== osd.1 v2:172.21.15.131:6816/730333560 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fef380694e0 con 0x7fef1c07fb60 2024-05-17T04:09:22.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7f15597fa640 1 -- 172.21.15.131:0/896883189 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f155c075db0 con 0x7f15540507e0 2024-05-17T04:09:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7f258ffff640 1 --2- 172.21.15.131:0/4254308287 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f25700763d0 0x7f25700788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7f258f7fe640 1 --2- 172.21.15.131:0/4254308287 >> [v2:172.21.15.150:6808/491308104,v1:172.21.15.150:6810/491308104] conn(0x7f257007fb90 0x7f2570082020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7ff57ad9d640 1 --2- 172.21.15.131:0/2572322511 >> [v2:172.21.15.131:6800/797420574,v1:172.21.15.131:6801/797420574] conn(0x7ff55c07fb60 0x7ff55c081ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7fbf0ffff640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.131:6817/2798377402,v1:172.21.15.131:6819/2798377402] conn(0x7fbf0807fb60 0x7fbf08081ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7fbf0ffff640 1 -- 172.21.15.131:0/1309461605 --> [v2:172.21.15.131:6817/2798377402,v1:172.21.15.131:6819/2798377402] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf240a8840 con 0x7fbf0807fb60 2024-05-17T04:09:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7fbf0ffff640 1 -- 172.21.15.131:0/1309461605 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbf241351d0 con 0x7fbf1c178060 2024-05-17T04:09:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7fbf237fe640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbf080763a0 0x7fbf080788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7f15597fa640 1 --2- 172.21.15.131:0/896883189 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f15400763d0 0x7f15400788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7f15597fa640 1 -- 172.21.15.131:0/896883189 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f155c1136b0 con 0x7f15540507e0 2024-05-17T04:09:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7f15597fa640 1 --2- 172.21.15.131:0/896883189 >> [v2:172.21.15.131:6808/4197534495,v1:172.21.15.131:6809/4197534495] conn(0x7f154007fb90 0x7f1540082020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7ff7e7fff640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff7cc0763a0 0x7ff7cc0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.147+0000 7ff7eca6b640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.150:6824/2147509392,v1:172.21.15.150:6825/2147509392] conn(0x7ff7cc07fae0 0x7ff7cc081f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7ff7eca6b640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.150:6824/2147509392,v1:172.21.15.150:6825/2147509392] conn(0x7ff7cc07fae0 0x7ff7cc081f70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7f9c94ff9640 1 --2- 172.21.15.131:0/3881700871 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9c780763a0 0x7f9c780788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7f9c94ff9640 1 -- 172.21.15.131:0/3881700871 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9c80097320 con 0x7f9c981f9180 2024-05-17T04:09:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7f9c94ff9640 1 --2- 172.21.15.131:0/3881700871 >> [v2:172.21.15.150:6809/1730671783,v1:172.21.15.150:6811/1730671783] conn(0x7f9c7807fb60 0x7f9c78081ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7f9c94ff9640 1 -- 172.21.15.131:0/3881700871 --> [v2:172.21.15.150:6809/1730671783,v1:172.21.15.150:6811/1730671783] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c780826c0 con 0x7f9c7807fb60 2024-05-17T04:09:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7f9c94ff9640 1 -- 172.21.15.131:0/3881700871 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9c80097710 con 0x7f9c981f9180 2024-05-17T04:09:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7f15597fa640 1 -- 172.21.15.131:0/896883189 --> [v2:172.21.15.131:6808/4197534495,v1:172.21.15.131:6809/4197534495] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f155c072e90 con 0x7f154007fb90 2024-05-17T04:09:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7f15597fa640 1 -- 172.21.15.131:0/896883189 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f155c11a050 con 0x7f15540507e0 2024-05-17T04:09:22.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7f258f7fe640 1 --2- 172.21.15.131:0/4254308287 >> [v2:172.21.15.150:6808/491308104,v1:172.21.15.150:6810/491308104] conn(0x7f257007fb90 0x7f2570082020 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.148+0000 7f9c977fe640 1 --2- 172.21.15.131:0/3881700871 >> [v2:172.21.15.150:6809/1730671783,v1:172.21.15.150:6811/1730671783] conn(0x7f9c7807fb60 0x7f9c78081ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.149+0000 7f155bfff640 1 --2- 172.21.15.131:0/896883189 >> [v2:172.21.15.131:6808/4197534495,v1:172.21.15.131:6809/4197534495] conn(0x7f154007fb90 0x7f1540082020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.149+0000 7f9c97fff640 1 --2- 172.21.15.131:0/3881700871 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9c780763a0 0x7f9c780788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.149+0000 7ff7e4ff9640 1 -- 172.21.15.131:0/3285475841 <== osd.7 v2:172.21.15.150:6824/2147509392 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff7cc082640 con 0x7ff7cc07fae0 2024-05-17T04:09:22.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.149+0000 7f9c977fe640 1 --2- 172.21.15.131:0/3881700871 >> [v2:172.21.15.150:6809/1730671783,v1:172.21.15.150:6811/1730671783] conn(0x7f9c7807fb60 0x7f9c78081ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.149+0000 7ff7e7fff640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff7cc0763a0 0x7ff7cc0788b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0001310 tx=0x7ff7e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.149+0000 7fbf22ffd640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.131:6817/2798377402,v1:172.21.15.131:6819/2798377402] conn(0x7fbf0807fb60 0x7fbf08081ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.150+0000 7fbf237fe640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbf080763a0 0x7fbf080788b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbf10005fd0 tx=0x7fbf10008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.150+0000 7fbf22ffd640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.131:6817/2798377402,v1:172.21.15.131:6819/2798377402] conn(0x7fbf0807fb60 0x7fbf08081ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.149+0000 7ff572ffd640 1 -- 172.21.15.131:0/2572322511 <== osd.2 v2:172.21.15.131:6800/797420574 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff56400ae60 con 0x7ff55c07fb60 2024-05-17T04:09:22.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.149+0000 7ff57a59c640 1 --2- 172.21.15.131:0/2572322511 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff55c0763a0 0x7ff55c0788b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff56c006fd0 tx=0x7ff56c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.150+0000 7f155bfff640 1 --2- 172.21.15.131:0/896883189 >> [v2:172.21.15.131:6808/4197534495,v1:172.21.15.131:6809/4197534495] conn(0x7f154007fb90 0x7f1540082020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.150+0000 7f1560b44640 1 --2- 172.21.15.131:0/896883189 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f15400763d0 0x7f15400788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.150+0000 7f1560b44640 1 --2- 172.21.15.131:0/896883189 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f15400763d0 0x7f15400788e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f155403a630 tx=0x7f1550008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.149+0000 7f258cff9640 1 -- 172.21.15.131:0/4254308287 <== osd.5 v2:172.21.15.150:6808/491308104 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25700826f0 con 0x7f257007fb90 2024-05-17T04:09:22.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.150+0000 7f258ffff640 1 --2- 172.21.15.131:0/4254308287 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f25700763d0 0x7f25700788e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f25800096d0 tx=0x7f2580009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.150+0000 7f9c94ff9640 1 -- 172.21.15.131:0/3881700871 <== osd.6 v2:172.21.15.150:6809/1730671783 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9c780826c0 con 0x7f9c7807fb60 2024-05-17T04:09:22.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.150+0000 7f9c97fff640 1 --2- 172.21.15.131:0/3881700871 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9c780763a0 0x7f9c780788b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c88007fd0 tx=0x7f9c88007d80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.151+0000 7f15597fa640 1 -- 172.21.15.131:0/896883189 <== osd.3 v2:172.21.15.131:6808/4197534495 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f155c072e90 con 0x7f154007fb90 2024-05-17T04:09:22.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.151+0000 7f1647fff640 1 -- 172.21.15.131:0/2987180930 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1650027070 con 0x7f16600d0340 2024-05-17T04:09:22.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.152+0000 7fbf0ffff640 1 -- 172.21.15.131:0/1309461605 <== osd.0 v2:172.21.15.131:6817/2798377402 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbf240a8840 con 0x7fbf0807fb60 2024-05-17T04:09:22.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.152+0000 7f1647fff640 1 --2- 172.21.15.131:0/2987180930 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f164c0763a0 0x7f164c0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.153+0000 7f1647fff640 1 -- 172.21.15.131:0/2987180930 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f16500a01a0 con 0x7f16600d0340 2024-05-17T04:09:22.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.153+0000 7f1647fff640 1 --2- 172.21.15.131:0/2987180930 >> [v2:172.21.15.150:6800/2205449991,v1:172.21.15.150:6801/2205449991] conn(0x7f164c07fb60 0x7f164c081ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.153+0000 7f1647fff640 1 -- 172.21.15.131:0/2987180930 --> [v2:172.21.15.150:6800/2205449991,v1:172.21.15.150:6801/2205449991] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1650023ec0 con 0x7f164c07fb60 2024-05-17T04:09:22.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.153+0000 7f1647fff640 1 -- 172.21.15.131:0/2987180930 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f16500a0590 con 0x7f16600d0340 2024-05-17T04:09:22.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.153+0000 7f165f7fe640 1 --2- 172.21.15.131:0/2987180930 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f164c0763a0 0x7f164c0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.154+0000 7f165f7fe640 1 --2- 172.21.15.131:0/2987180930 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f164c0763a0 0x7f164c0788b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1658001ed0 tx=0x7f1658009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.154+0000 7f165ffff640 1 --2- 172.21.15.131:0/2987180930 >> [v2:172.21.15.150:6800/2205449991,v1:172.21.15.150:6801/2205449991] conn(0x7f164c07fb60 0x7f164c081ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.155+0000 7f165ffff640 1 --2- 172.21.15.131:0/2987180930 >> [v2:172.21.15.150:6800/2205449991,v1:172.21.15.150:6801/2205449991] conn(0x7f164c07fb60 0x7f164c081ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.155+0000 7f1647fff640 1 -- 172.21.15.131:0/2987180930 <== osd.4 v2:172.21.15.150:6800/2205449991 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1650023ec0 con 0x7f164c07fb60 2024-05-17T04:09:22.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.178+0000 7ff7d27fc640 1 -- 172.21.15.131:0/3285475841 --> [v2:172.21.15.150:6824/2147509392,v1:172.21.15.150:6825/2147509392] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff7e814c900 con 0x7ff7cc07fae0 2024-05-17T04:09:22.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.178+0000 7fef3e0e1640 1 -- 172.21.15.131:0/1400125880 --> [v2:172.21.15.131:6816/730333560,v1:172.21.15.131:6818/730333560] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fef3000acd0 con 0x7fef1c07fb60 2024-05-17T04:09:22.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.179+0000 7ff7e4ff9640 1 -- 172.21.15.131:0/3285475841 <== osd.7 v2:172.21.15.150:6824/2147509392 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff7e814c900 con 0x7ff7cc07fae0 2024-05-17T04:09:22.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.179+0000 7fef2dffb640 1 -- 172.21.15.131:0/1400125880 <== osd.1 v2:172.21.15.131:6816/730333560 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fef3000acd0 con 0x7fef1c07fb60 2024-05-17T04:09:22.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.179+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/3285475841 >> [v2:172.21.15.150:6824/2147509392,v1:172.21.15.150:6825/2147509392] conn(0x7ff7cc07fae0 msgr2=0x7ff7cc081f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.179+0000 7ff7ee4ce640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.150:6824/2147509392,v1:172.21.15.150:6825/2147509392] conn(0x7ff7cc07fae0 0x7ff7cc081f70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.180+0000 7fef3e0e1640 1 -- 172.21.15.131:0/1400125880 >> [v2:172.21.15.131:6816/730333560,v1:172.21.15.131:6818/730333560] conn(0x7fef1c07fb60 msgr2=0x7fef1c081ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.180+0000 7fef3e0e1640 1 --2- 172.21.15.131:0/1400125880 >> [v2:172.21.15.131:6816/730333560,v1:172.21.15.131:6818/730333560] conn(0x7fef1c07fb60 0x7fef1c081ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.180+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/3285475841 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff7cc0763a0 msgr2=0x7ff7cc0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.180+0000 7ff7ee4ce640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff7cc0763a0 0x7ff7cc0788b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0001310 tx=0x7ff7e0009040 comp rx=0 tx=0).stop 2024-05-17T04:09:22.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.180+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/3285475841 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7e815c4a0 msgr2=0x7ff7e814f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.180+0000 7ff7ee4ce640 1 --2- 172.21.15.131:0/3285475841 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7e815c4a0 0x7ff7e814f8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c310 tx=0x7ff7d400c7d0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.180+0000 7ff7eca6b640 1 -- 172.21.15.131:0/3285475841 reap_dead start 2024-05-17T04:09:22.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.180+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/3285475841 shutdown_connections 2024-05-17T04:09:22.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.180+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/3285475841 >> 172.21.15.131:0/3285475841 conn(0x7ff7e80d1e80 msgr2=0x7ff7e80733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.181+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/3285475841 shutdown_connections 2024-05-17T04:09:22.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.181+0000 7fef3e0e1640 1 -- 172.21.15.131:0/1400125880 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fef1c0763a0 msgr2=0x7fef1c0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.181+0000 7fef3e0e1640 1 --2- 172.21.15.131:0/1400125880 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fef1c0763a0 0x7fef1c0788b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fef30000ca0 tx=0x7fef34008040 comp rx=0 tx=0).stop 2024-05-17T04:09:22.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.181+0000 7fef3e0e1640 1 -- 172.21.15.131:0/1400125880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef240039b0 msgr2=0x7fef30164bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.181+0000 7fef3e0e1640 1 --2- 172.21.15.131:0/1400125880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef240039b0 0x7fef30164bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fef38052290 tx=0x7fef3806a6e0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.181+0000 7ff7ee4ce640 1 -- 172.21.15.131:0/3285475841 wait complete. 2024-05-17T04:09:22.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.181+0000 7fef3d8e0640 1 -- 172.21.15.131:0/1400125880 reap_dead start 2024-05-17T04:09:22.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.181+0000 7fef3e0e1640 1 -- 172.21.15.131:0/1400125880 shutdown_connections 2024-05-17T04:09:22.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.181+0000 7fef3e0e1640 1 -- 172.21.15.131:0/1400125880 >> 172.21.15.131:0/1400125880 conn(0x7fef300569f0 msgr2=0x7fef30007990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.181+0000 7f25867fc640 1 -- 172.21.15.131:0/4254308287 --> [v2:172.21.15.150:6808/491308104,v1:172.21.15.150:6810/491308104] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2590165740 con 0x7f257007fb90 2024-05-17T04:09:22.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.181+0000 7f258cff9640 1 -- 172.21.15.131:0/4254308287 <== osd.5 v2:172.21.15.150:6808/491308104 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2590165740 con 0x7f257007fb90 2024-05-17T04:09:22.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.182+0000 7fef3e0e1640 1 -- 172.21.15.131:0/1400125880 shutdown_connections 2024-05-17T04:09:22.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.182+0000 7fef3e0e1640 1 -- 172.21.15.131:0/1400125880 wait complete. 2024-05-17T04:09:22.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.182+0000 7ff5809eb640 1 -- 172.21.15.131:0/2572322511 --> [v2:172.21.15.131:6800/797420574,v1:172.21.15.131:6801/797420574] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff57c0738d0 con 0x7ff55c07fb60 2024-05-17T04:09:22.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.182+0000 7f25867fc640 1 -- 172.21.15.131:0/4254308287 >> [v2:172.21.15.150:6808/491308104,v1:172.21.15.150:6810/491308104] conn(0x7f257007fb90 msgr2=0x7f2570082020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.182+0000 7f25867fc640 1 --2- 172.21.15.131:0/4254308287 >> [v2:172.21.15.150:6808/491308104,v1:172.21.15.150:6810/491308104] conn(0x7f257007fb90 0x7f2570082020 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.182+0000 7ff572ffd640 1 -- 172.21.15.131:0/2572322511 <== osd.2 v2:172.21.15.131:6800/797420574 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff57c0738d0 con 0x7ff55c07fb60 2024-05-17T04:09:22.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.182+0000 7f25867fc640 1 -- 172.21.15.131:0/4254308287 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f25700763d0 msgr2=0x7f25700788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.182+0000 7f25867fc640 1 --2- 172.21.15.131:0/4254308287 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f25700763d0 0x7f25700788e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f25800096d0 tx=0x7f2580009240 comp rx=0 tx=0).stop 2024-05-17T04:09:22.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.182+0000 7f25867fc640 1 -- 172.21.15.131:0/4254308287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2590163be0 msgr2=0x7f2590154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.182+0000 7f25867fc640 1 --2- 172.21.15.131:0/4254308287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2590163be0 0x7f2590154f10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2588009e50 tx=0x7f2588004a40 comp rx=0 tx=0).stop 2024-05-17T04:09:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.182+0000 7f2594900640 1 -- 172.21.15.131:0/4254308287 reap_dead start 2024-05-17T04:09:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.183+0000 7f25867fc640 1 -- 172.21.15.131:0/4254308287 shutdown_connections 2024-05-17T04:09:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.183+0000 7f25867fc640 1 -- 172.21.15.131:0/4254308287 >> 172.21.15.131:0/4254308287 conn(0x7f25900b6c40 msgr2=0x7f25900b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.183+0000 7ff570ff9640 1 -- 172.21.15.131:0/2572322511 >> [v2:172.21.15.131:6800/797420574,v1:172.21.15.131:6801/797420574] conn(0x7ff55c07fb60 msgr2=0x7ff55c081ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.183+0000 7ff570ff9640 1 --2- 172.21.15.131:0/2572322511 >> [v2:172.21.15.131:6800/797420574,v1:172.21.15.131:6801/797420574] conn(0x7ff55c07fb60 0x7ff55c081ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.183+0000 7f1562da8640 1 -- 172.21.15.131:0/896883189 --> [v2:172.21.15.131:6808/4197534495,v1:172.21.15.131:6809/4197534495] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1554037d90 con 0x7f154007fb90 2024-05-17T04:09:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.183+0000 7ff570ff9640 1 -- 172.21.15.131:0/2572322511 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff55c0763a0 msgr2=0x7ff55c0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.183+0000 7ff570ff9640 1 --2- 172.21.15.131:0/2572322511 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff55c0763a0 0x7ff55c0788b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff56c006fd0 tx=0x7ff56c008040 comp rx=0 tx=0).stop 2024-05-17T04:09:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.183+0000 7ff570ff9640 1 -- 172.21.15.131:0/2572322511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff57c073e10 msgr2=0x7ff57c158de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.183+0000 7ff570ff9640 1 --2- 172.21.15.131:0/2572322511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff57c073e10 0x7ff57c158de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff564034040 tx=0x7ff564004a40 comp rx=0 tx=0).stop 2024-05-17T04:09:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.183+0000 7ff57ad9d640 1 -- 172.21.15.131:0/2572322511 reap_dead start 2024-05-17T04:09:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.184+0000 7ff570ff9640 1 -- 172.21.15.131:0/2572322511 shutdown_connections 2024-05-17T04:09:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.184+0000 7ff570ff9640 1 -- 172.21.15.131:0/2572322511 >> 172.21.15.131:0/2572322511 conn(0x7ff57c06d710 msgr2=0x7ff57c0b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.184+0000 7f25867fc640 1 -- 172.21.15.131:0/4254308287 shutdown_connections 2024-05-17T04:09:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.184+0000 7f25867fc640 1 -- 172.21.15.131:0/4254308287 wait complete. 2024-05-17T04:09:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.184+0000 7f15597fa640 1 -- 172.21.15.131:0/896883189 <== osd.3 v2:172.21.15.131:6808/4197534495 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1554037d90 con 0x7f154007fb90 2024-05-17T04:09:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.184+0000 7ff570ff9640 1 -- 172.21.15.131:0/2572322511 shutdown_connections 2024-05-17T04:09:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.184+0000 7ff570ff9640 1 -- 172.21.15.131:0/2572322511 wait complete. 2024-05-17T04:09:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.184+0000 7f9c8e7fc640 1 -- 172.21.15.131:0/3881700871 --> [v2:172.21.15.150:6809/1730671783,v1:172.21.15.150:6811/1730671783] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9c98158760 con 0x7f9c7807fb60 2024-05-17T04:09:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.185+0000 7f1562da8640 1 -- 172.21.15.131:0/896883189 >> [v2:172.21.15.131:6808/4197534495,v1:172.21.15.131:6809/4197534495] conn(0x7f154007fb90 msgr2=0x7f1540082020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.185+0000 7f1562da8640 1 --2- 172.21.15.131:0/896883189 >> [v2:172.21.15.131:6808/4197534495,v1:172.21.15.131:6809/4197534495] conn(0x7f154007fb90 0x7f1540082020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.185+0000 7f1562da8640 1 -- 172.21.15.131:0/896883189 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f15400763d0 msgr2=0x7f15400788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.185+0000 7f1562da8640 1 --2- 172.21.15.131:0/896883189 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f15400763d0 0x7f15400788e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f155403a630 tx=0x7f1550008040 comp rx=0 tx=0).stop 2024-05-17T04:09:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.186+0000 7f1645ffb640 1 -- 172.21.15.131:0/2987180930 --> [v2:172.21.15.150:6800/2205449991,v1:172.21.15.150:6801/2205449991] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1638002dd0 con 0x7f164c07fb60 2024-05-17T04:09:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.185+0000 7f9c94ff9640 1 -- 172.21.15.131:0/3881700871 <== osd.6 v2:172.21.15.150:6809/1730671783 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9c98158760 con 0x7f9c7807fb60 2024-05-17T04:09:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.186+0000 7fbf28b8e640 1 -- 172.21.15.131:0/1309461605 --> [v2:172.21.15.131:6817/2798377402,v1:172.21.15.131:6819/2798377402] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbf1c04d1f0 con 0x7fbf0807fb60 2024-05-17T04:09:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.185+0000 7f1562da8640 1 -- 172.21.15.131:0/896883189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15540507e0 msgr2=0x7f1554037fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.185+0000 7f1562da8640 1 --2- 172.21.15.131:0/896883189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15540507e0 0x7f1554037fd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f155c02e230 tx=0x7f155c069d10 comp rx=0 tx=0).stop 2024-05-17T04:09:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.185+0000 7f1561345640 1 -- 172.21.15.131:0/896883189 reap_dead start 2024-05-17T04:09:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.186+0000 7f9c8e7fc640 1 -- 172.21.15.131:0/3881700871 >> [v2:172.21.15.150:6809/1730671783,v1:172.21.15.150:6811/1730671783] conn(0x7f9c7807fb60 msgr2=0x7f9c78081ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.186+0000 7f9c8e7fc640 1 --2- 172.21.15.131:0/3881700871 >> [v2:172.21.15.150:6809/1730671783,v1:172.21.15.150:6811/1730671783] conn(0x7f9c7807fb60 0x7f9c78081ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.185+0000 7f1562da8640 1 -- 172.21.15.131:0/896883189 shutdown_connections 2024-05-17T04:09:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.185+0000 7f1562da8640 1 -- 172.21.15.131:0/896883189 >> 172.21.15.131:0/896883189 conn(0x7f15540362f0 msgr2=0x7f155400a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.185+0000 7f1562da8640 1 -- 172.21.15.131:0/896883189 shutdown_connections 2024-05-17T04:09:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.185+0000 7f1562da8640 1 -- 172.21.15.131:0/896883189 wait complete. 2024-05-17T04:09:22.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.187+0000 7fbf0ffff640 1 -- 172.21.15.131:0/1309461605 <== osd.0 v2:172.21.15.131:6817/2798377402 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbf1c04d1f0 con 0x7fbf0807fb60 2024-05-17T04:09:22.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.186+0000 7f1647fff640 1 -- 172.21.15.131:0/2987180930 <== osd.4 v2:172.21.15.150:6800/2205449991 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1638002dd0 con 0x7f164c07fb60 2024-05-17T04:09:22.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.186+0000 7f9c8e7fc640 1 -- 172.21.15.131:0/3881700871 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9c780763a0 msgr2=0x7f9c780788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.186+0000 7f9c8e7fc640 1 --2- 172.21.15.131:0/3881700871 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9c780763a0 0x7f9c780788b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c88007fd0 tx=0x7f9c88007d80 comp rx=0 tx=0).stop 2024-05-17T04:09:22.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.186+0000 7f9c8e7fc640 1 -- 172.21.15.131:0/3881700871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c981f9180 msgr2=0x7f9c981f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.187+0000 7f9c8e7fc640 1 --2- 172.21.15.131:0/3881700871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c981f9180 0x7f9c981f9590 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000c390 tx=0x7f9c8000c850 comp rx=0 tx=0).stop 2024-05-17T04:09:22.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.187+0000 7f9c9cf05640 1 -- 172.21.15.131:0/3881700871 reap_dead start 2024-05-17T04:09:22.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.187+0000 7f9c8e7fc640 1 -- 172.21.15.131:0/3881700871 shutdown_connections 2024-05-17T04:09:22.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.187+0000 7f9c8e7fc640 1 -- 172.21.15.131:0/3881700871 >> 172.21.15.131:0/3881700871 conn(0x7f9c9806cd20 msgr2=0x7f9c980b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.187+0000 7f9c8e7fc640 1 -- 172.21.15.131:0/3881700871 shutdown_connections 2024-05-17T04:09:22.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.187+0000 7f9c8e7fc640 1 -- 172.21.15.131:0/3881700871 wait complete. 2024-05-17T04:09:22.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.187+0000 7f1645ffb640 1 -- 172.21.15.131:0/2987180930 >> [v2:172.21.15.150:6800/2205449991,v1:172.21.15.150:6801/2205449991] conn(0x7f164c07fb60 msgr2=0x7f164c081ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.187+0000 7f1645ffb640 1 --2- 172.21.15.131:0/2987180930 >> [v2:172.21.15.150:6800/2205449991,v1:172.21.15.150:6801/2205449991] conn(0x7f164c07fb60 0x7f164c081ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.188+0000 7f1645ffb640 1 -- 172.21.15.131:0/2987180930 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f164c0763a0 msgr2=0x7f164c0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.188+0000 7f1645ffb640 1 --2- 172.21.15.131:0/2987180930 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f164c0763a0 0x7f164c0788b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1658001ed0 tx=0x7f1658009040 comp rx=0 tx=0).stop 2024-05-17T04:09:22.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.188+0000 7f1645ffb640 1 -- 172.21.15.131:0/2987180930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16600d0340 msgr2=0x7f166014d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.188+0000 7f1645ffb640 1 --2- 172.21.15.131:0/2987180930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16600d0340 0x7f166014d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1650009e70 tx=0x7f165000ec10 comp rx=0 tx=0).stop 2024-05-17T04:09:22.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.188+0000 7f165ffff640 1 -- 172.21.15.131:0/2987180930 reap_dead start 2024-05-17T04:09:22.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.188+0000 7f1645ffb640 1 -- 172.21.15.131:0/2987180930 shutdown_connections 2024-05-17T04:09:22.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.188+0000 7f1645ffb640 1 -- 172.21.15.131:0/2987180930 >> 172.21.15.131:0/2987180930 conn(0x7f166006f6d0 msgr2=0x7f16600688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.189+0000 7f1645ffb640 1 -- 172.21.15.131:0/2987180930 shutdown_connections 2024-05-17T04:09:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.189+0000 7f1645ffb640 1 -- 172.21.15.131:0/2987180930 wait complete. 2024-05-17T04:09:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.189+0000 7fbf28b8e640 1 -- 172.21.15.131:0/1309461605 >> [v2:172.21.15.131:6817/2798377402,v1:172.21.15.131:6819/2798377402] conn(0x7fbf0807fb60 msgr2=0x7fbf08081ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.189+0000 7fbf28b8e640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.131:6817/2798377402,v1:172.21.15.131:6819/2798377402] conn(0x7fbf0807fb60 0x7fbf08081ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.190+0000 7fbf28b8e640 1 -- 172.21.15.131:0/1309461605 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbf080763a0 msgr2=0x7fbf080788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.190+0000 7fbf28b8e640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbf080763a0 0x7fbf080788b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbf10005fd0 tx=0x7fbf10008040 comp rx=0 tx=0).stop 2024-05-17T04:09:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.190+0000 7fbf28b8e640 1 -- 172.21.15.131:0/1309461605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf1c178060 msgr2=0x7fbf1c178470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.190+0000 7fbf28b8e640 1 --2- 172.21.15.131:0/1309461605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf1c178060 0x7fbf1c178470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbf2402e230 tx=0x7fbf24076a50 comp rx=0 tx=0).stop 2024-05-17T04:09:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.190+0000 7fbf23fff640 1 -- 172.21.15.131:0/1309461605 reap_dead start 2024-05-17T04:09:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.190+0000 7fbf28b8e640 1 -- 172.21.15.131:0/1309461605 shutdown_connections 2024-05-17T04:09:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.190+0000 7fbf28b8e640 1 -- 172.21.15.131:0/1309461605 >> 172.21.15.131:0/1309461605 conn(0x7fbf1c01db60 msgr2=0x7fbf1c053430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.191+0000 7fbf28b8e640 1 -- 172.21.15.131:0/1309461605 shutdown_connections 2024-05-17T04:09:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.191+0000 7fbf28b8e640 1 -- 172.21.15.131:0/1309461605 wait complete. 2024-05-17T04:09:22.240 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-05-17T04:09:22.240 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-17T04:09:22.241 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-05-17T04:09:22.241 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-17T04:09:22.242 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-05-17T04:09:22.242 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-17T04:09:22.243 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-05-17T04:09:22.243 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-17T04:09:22.244 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-05-17T04:09:22.244 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-17T04:09:22.245 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-05-17T04:09:22.245 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-17T04:09:22.246 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-05-17T04:09:22.246 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-17T04:09:22.247 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-05-17T04:09:22.247 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-17T04:09:22.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.504+0000 7f0e134f9640 1 Processor -- start 2024-05-17T04:09:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.505+0000 7f94eedb2640 1 Processor -- start 2024-05-17T04:09:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.505+0000 7f94eedb2640 1 -- start start 2024-05-17T04:09:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.504+0000 7f0e134f9640 1 -- start start 2024-05-17T04:09:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.506+0000 7f359f19e640 1 Processor -- start 2024-05-17T04:09:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.506+0000 7f359f19e640 1 -- start start 2024-05-17T04:09:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.507+0000 7f94eedb2640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f94e000a830 0x7f94e0051860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.507+0000 7f94eedb2640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f94e0039d40 0x7f94e00537e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.507+0000 7f94eedb2640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94e0006890 con 0x7f94e0033d40 2024-05-17T04:09:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.507+0000 7f94eedb2640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f94e0006640 con 0x7f94e0039d40 2024-05-17T04:09:22.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.507+0000 7f94eedb2640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f94e0052ac0 con 0x7f94e000a830 2024-05-17T04:09:22.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.507+0000 7f0e134f9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0e0400a800 0x7f0e04051830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.507+0000 7f0e134f9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e040337c0 0x7f0e04052f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.507+0000 7f0e134f9640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e04006860 con 0x7f0e04033d10 2024-05-17T04:09:22.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.507+0000 7f0e134f9640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f0e04006610 con 0x7f0e0400a800 2024-05-17T04:09:22.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.507+0000 7f0e134f9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0e04052a90 con 0x7f0e040337c0 2024-05-17T04:09:22.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.507+0000 7f94ecb4e640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f94e0033d40 0x7f94e000a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:40974/0 (socket says 172.21.15.131:40974) 2024-05-17T04:09:22.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.507+0000 7f94ecb4e640 1 -- 172.21.15.131:0/4196698754 learned_addr learned my addr 172.21.15.131:0/4196698754 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:22.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.507+0000 7f94e7fff640 1 --2- 172.21.15.131:0/4196698754 >> v2:172.21.15.150:3300/0 conn(0x7f94e000a830 0x7f94e0051860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f94ed34f640 1 --2- 172.21.15.131:0/4196698754 >> v2:172.21.15.131:3300/0 conn(0x7f94e0039d40 0x7f94e00537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.507+0000 7f0e12cf8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e040337c0 0x7f0e04052f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f0e11cf6640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0e0400a800 0x7f0e04051830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f0e11cf6640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0e0400a800 0x7f0e04051830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:60424/0 (socket says 172.21.15.131:60424) 2024-05-17T04:09:22.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f0e11cf6640 1 -- 172.21.15.131:0/3152618911 learned_addr learned my addr 172.21.15.131:0/3152618911 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f0e12cf8640 1 --2- 172.21.15.131:0/3152618911 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e040337c0 0x7f0e04052f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:48506/0 (socket says 172.21.15.131:48506) 2024-05-17T04:09:22.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f0e11cf6640 1 -- 172.21.15.131:0/3152618911 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e040337c0 msgr2=0x7f0e04052f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f0e11cf6640 1 --2- 172.21.15.131:0/3152618911 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e040337c0 0x7f0e04052f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f94e77fe640 1 -- 172.21.15.131:0/4196698754 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2076816083 0 0) 0x7f94e0006890 con 0x7f94e0033d40 2024-05-17T04:09:22.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f94e77fe640 1 -- 172.21.15.131:0/4196698754 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94d8003520 con 0x7f94e0033d40 2024-05-17T04:09:22.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f94e77fe640 1 -- 172.21.15.131:0/4196698754 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1010634915 0 0) 0x7f94d8003520 con 0x7f94e0033d40 2024-05-17T04:09:22.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f94e77fe640 1 -- 172.21.15.131:0/4196698754 >> v2:172.21.15.150:3300/0 conn(0x7f94e000a830 msgr2=0x7f94e0051860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f94e77fe640 1 --2- 172.21.15.131:0/4196698754 >> v2:172.21.15.150:3300/0 conn(0x7f94e000a830 0x7f94e0051860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f94e77fe640 1 -- 172.21.15.131:0/4196698754 >> v2:172.21.15.131:3300/0 conn(0x7f94e0039d40 msgr2=0x7f94e00537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f359f19e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3590054f30 0x7f359000c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f359f19e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35900524b0 con 0x7f3590057610 2024-05-17T04:09:22.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f359f19e640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3590052790 con 0x7f3590055340 2024-05-17T04:09:22.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f359f19e640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f359000c290 con 0x7f3590054f30 2024-05-17T04:09:22.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f359cf3a640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f3590057610 0x7f3590054820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34650/0 (socket says 172.21.15.131:34650) 2024-05-17T04:09:22.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f359cf3a640 1 -- 172.21.15.131:0/1898307849 learned_addr learned my addr 172.21.15.131:0/1898307849 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:22.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f94e77fe640 1 --2- 172.21.15.131:0/4196698754 >> v2:172.21.15.131:3300/0 conn(0x7f94e0039d40 0x7f94e00537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f94e77fe640 1 -- 172.21.15.131:0/4196698754 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e0006b70 con 0x7f94e0033d40 2024-05-17T04:09:22.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f94e77fe640 1 -- 172.21.15.131:0/4196698754 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7f94dc001740 con 0x7f94e0033d40 2024-05-17T04:09:22.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f94e7fff640 1 --2- 172.21.15.131:0/4196698754 >> v2:172.21.15.150:3300/0 conn(0x7f94e000a830 0x7f94e0051860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:22.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.508+0000 7f0e11cf6640 1 -- 172.21.15.131:0/3152618911 >> v1:172.21.15.131:6789/0 conn(0x7f0e04033d10 legacy=0x7f0e0400a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f94e77fe640 1 -- 172.21.15.131:0/4196698754 >> v1:172.21.15.150:6789/0 conn(0x7f94e0033d40 legacy=0x7f94e000a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f3597fff640 1 --2- 172.21.15.131:0/1898307849 >> v2:172.21.15.150:3300/0 conn(0x7f3590054f30 0x7f359000c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f52a16b3640 1 Processor -- start 2024-05-17T04:09:22.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f94e77fe640 1 --2- 172.21.15.131:0/4196698754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94d8003aa0 0x7f94d8003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f52a16b3640 1 -- start start 2024-05-17T04:09:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f0e11cf6640 1 -- 172.21.15.131:0/3152618911 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e04006b40 con 0x7f0e0400a800 2024-05-17T04:09:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3089023548 0 0) 0x7f35900524b0 con 0x7f3590057610 2024-05-17T04:09:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3588003520 con 0x7f3590057610 2024-05-17T04:09:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3520403063 0 0) 0x7f3590052790 con 0x7f3590055340 2024-05-17T04:09:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35900524b0 con 0x7f3590055340 2024-05-17T04:09:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f94e77fe640 1 --2- 172.21.15.131:0/4196698754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d8004800 0x7f94d8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f94e77fe640 1 --2- 172.21.15.131:0/4196698754 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94d80052a0 0x7f94d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f94ecb4e640 1 --2- 172.21.15.131:0/4196698754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94d8003aa0 0x7f94d8003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f94e77fe640 1 -- 172.21.15.131:0/4196698754 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f94e0006640 con 0x7f94d8003aa0 2024-05-17T04:09:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1275751637 0 0) 0x7f3588003520 con 0x7f3590057610 2024-05-17T04:09:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 >> v2:172.21.15.150:3300/0 conn(0x7f3590054f30 msgr2=0x7f359000c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f94e77fe640 1 -- 172.21.15.131:0/4196698754 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f94e0052ac0 con 0x7f94d8004800 2024-05-17T04:09:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 --2- 172.21.15.131:0/1898307849 >> v2:172.21.15.150:3300/0 conn(0x7f3590054f30 0x7f359000c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 >> v1:172.21.15.150:6789/0 conn(0x7f3590055340 legacy=0x7f359000cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f94e7fff640 1 --2- 172.21.15.131:0/4196698754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d8004800 0x7f94d8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3590052a70 con 0x7f3590057610 2024-05-17T04:09:22.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f94e77fe640 1 -- 172.21.15.131:0/4196698754 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f94d800c2b0 con 0x7f94d80052a0 2024-05-17T04:09:22.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f94ed34f640 1 --2- 172.21.15.131:0/4196698754 >> v2:172.21.15.131:3300/0 conn(0x7f94e0039d40 0x7f94e00537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:22.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7f358c001620 con 0x7f3590057610 2024-05-17T04:09:22.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 >> v1:172.21.15.131:6789/0 conn(0x7f3590057610 legacy=0x7f3590054820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 --2- 172.21.15.131:0/1898307849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3588004bd0 0x7f3588005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 --2- 172.21.15.131:0/1898307849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35880037a0 0x7f3588003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 --2- 172.21.15.131:0/1898307849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35880042f0 0x7f358800fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f359000c290 con 0x7f35880042f0 2024-05-17T04:09:22.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3588005a40 con 0x7f3588004bd0 2024-05-17T04:09:22.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3588005c40 con 0x7f35880037a0 2024-05-17T04:09:22.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f359cf3a640 1 --2- 172.21.15.131:0/1898307849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3588004bd0 0x7f3588005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f359d73b640 1 --2- 172.21.15.131:0/1898307849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35880042f0 0x7f358800fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f3597fff640 1 --2- 172.21.15.131:0/1898307849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35880037a0 0x7f3588003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7ff0d6626640 1 Processor -- start 2024-05-17T04:09:22.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f94ed34f640 1 --2- 172.21.15.131:0/4196698754 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94d80052a0 0x7f94d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.509+0000 7f0e12cf8640 1 --2- 172.21.15.131:0/3152618911 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e040337c0 0x7f0e04052f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:22.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7fd401563640 1 Processor -- start 2024-05-17T04:09:22.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7fd401563640 1 -- start start 2024-05-17T04:09:22.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f94e7fff640 1 -- 172.21.15.131:0/4196698754 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94d80052a0 msgr2=0x7f94d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f94e7fff640 1 --2- 172.21.15.131:0/4196698754 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94d80052a0 0x7f94d800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f94e7fff640 1 -- 172.21.15.131:0/4196698754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94d8003aa0 msgr2=0x7f94d8003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f94e7fff640 1 --2- 172.21.15.131:0/4196698754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94d8003aa0 0x7f94d8003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f94e7fff640 1 -- 172.21.15.131:0/4196698754 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d8003520 con 0x7f94d8004800 2024-05-17T04:09:22.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f27c9170640 1 Processor -- start 2024-05-17T04:09:22.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f27c9170640 1 -- start start 2024-05-17T04:09:22.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.511+0000 7f0e11cf6640 1 --2- 172.21.15.131:0/3152618911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e0400a800 0x7f0e04051830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0083f0 tx=0x7f0dfc00abe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea8a08abee5a486f server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.511+0000 7f94ed34f640 1 -- 172.21.15.131:0/4196698754 reap_dead start 2024-05-17T04:09:22.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.511+0000 7f0e114f5640 1 -- 172.21.15.131:0/3152618911 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0089e0 con 0x7f0e0400a800 2024-05-17T04:09:22.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.511+0000 7f52a16b3640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f529c06d100 0x7f529c0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f359d73b640 1 -- 172.21.15.131:0/1898307849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35880037a0 msgr2=0x7f3588003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.511+0000 7f52a16b3640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f529c06d830 con 0x7f529c073300 2024-05-17T04:09:22.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.511+0000 7f52a16b3640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f529c06db10 con 0x7f529c073e20 2024-05-17T04:09:22.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.511+0000 7f52a16b3640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f529c0b4090 con 0x7f529c06d100 2024-05-17T04:09:22.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f359d73b640 1 --2- 172.21.15.131:0/1898307849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35880037a0 0x7f3588003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f359d73b640 1 -- 172.21.15.131:0/1898307849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3588004bd0 msgr2=0x7f3588005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f359d73b640 1 --2- 172.21.15.131:0/1898307849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3588004bd0 0x7f3588005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7f359d73b640 1 -- 172.21.15.131:0/1898307849 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3588003520 con 0x7f35880042f0 2024-05-17T04:09:22.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.511+0000 7f529affd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f529c06d100 0x7f529c0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.511+0000 7f529affd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f529c06d100 0x7f529c0cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:60450/0 (socket says 172.21.15.131:60450) 2024-05-17T04:09:22.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.511+0000 7f529affd640 1 -- 172.21.15.131:0/3730780706 learned_addr learned my addr 172.21.15.131:0/3730780706 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.511+0000 7f0e114f5640 1 -- 172.21.15.131:0/3152618911 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dfc008b80 con 0x7f0e0400a800 2024-05-17T04:09:22.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7f0e114f5640 1 -- 172.21.15.131:0/3152618911 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0089e0 con 0x7f0e0400a800 2024-05-17T04:09:22.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7f529a7fc640 1 -- 172.21.15.131:0/3730780706 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2701778653 0 0) 0x7f529c06db10 con 0x7f529c073e20 2024-05-17T04:09:22.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7f529a7fc640 1 -- 172.21.15.131:0/3730780706 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5288003520 con 0x7f529c073e20 2024-05-17T04:09:22.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7f359d73b640 1 --2- 172.21.15.131:0/1898307849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35880042f0 0x7f358800fe50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3598069ff0 tx=0x7f3588005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f1438ab55179b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7f359d73b640 1 -- 172.21.15.131:0/1898307849 reap_dead start 2024-05-17T04:09:22.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7fd401563640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd3f4007480 0x7fd3f4036690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7fd401563640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f40543a0 0x7fd3f4006750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7f529affd640 1 -- 172.21.15.131:0/3730780706 >> v1:172.21.15.150:6789/0 conn(0x7f529c073e20 legacy=0x7f529c0b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7f529affd640 1 -- 172.21.15.131:0/3730780706 >> v1:172.21.15.131:6789/0 conn(0x7f529c073300 legacy=0x7f529c073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.510+0000 7ff0d6626640 1 -- start start 2024-05-17T04:09:22.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7ff0d6626640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff0d0167500 0x7ff0d0167910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7ff0d6626640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d00b4dd0 con 0x7ff0d006e9e0 2024-05-17T04:09:22.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7ff0d6626640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d0167e50 con 0x7ff0d015dfd0 2024-05-17T04:09:22.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7ff0d6626640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7ff0d00b6040 con 0x7ff0d0167500 2024-05-17T04:09:22.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7f529affd640 1 -- 172.21.15.131:0/3730780706 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529c06ddf0 con 0x7f529c06d100 2024-05-17T04:09:22.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7f0e134f9640 1 -- 172.21.15.131:0/3152618911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e0400a800 msgr2=0x7f0e04051830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7f0e134f9640 1 --2- 172.21.15.131:0/3152618911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e0400a800 0x7f0e04051830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0083f0 tx=0x7f0dfc00abe0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7fd401563640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f4036fe0 con 0x7fd3f4036bd0 2024-05-17T04:09:22.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7fd401563640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd3f403a7a0 con 0x7fd3f4007480 2024-05-17T04:09:22.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35980b4070 con 0x7f35880042f0 2024-05-17T04:09:22.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7fd3fb7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f40543a0 0x7fd3f4006750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7fd3fb7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f40543a0 0x7fd3f4006750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:48538/0 (socket says 172.21.15.131:48538) 2024-05-17T04:09:22.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7fd3fb7fe640 1 -- 172.21.15.131:0/3738197489 learned_addr learned my addr 172.21.15.131:0/3738197489 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35980a7c50 con 0x7f35880042f0 2024-05-17T04:09:22.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7f27c9170640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f27c415d140 0x7f27c40d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.512+0000 7f27c9170640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27c40d3d00 0x7f27c40d4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f27c9170640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27c40d4650 con 0x7f27c406d910 2024-05-17T04:09:22.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f27c9170640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f27c40d0d70 con 0x7f27c415d140 2024-05-17T04:09:22.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f27c9170640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f27c406deb0 con 0x7f27c40d3d00 2024-05-17T04:09:22.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7fd401563640 1 -- 172.21.15.131:0/3738197489 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f40528f0 con 0x7fd3f40543a0 2024-05-17T04:09:22.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7ff0d4e23640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff0d0167500 0x7ff0d0167910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7ff0d4e23640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff0d0167500 0x7ff0d0167910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:60468/0 (socket says 172.21.15.131:60468) 2024-05-17T04:09:22.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7ff0d4e23640 1 -- 172.21.15.131:0/1455402752 learned_addr learned my addr 172.21.15.131:0/1455402752 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f27c2d9d640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f27c406d910 0x7f27c4160d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:41018/0 (socket says 172.21.15.131:41018) 2024-05-17T04:09:22.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f27c2d9d640 1 -- 172.21.15.131:0/3624849387 learned_addr learned my addr 172.21.15.131:0/3624849387 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:22.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f27c359e640 1 --2- 172.21.15.131:0/3624849387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27c40d3d00 0x7f27c40d4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f0e134f9640 1 -- 172.21.15.131:0/3152618911 shutdown_connections 2024-05-17T04:09:22.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f0e134f9640 1 --2- 172.21.15.131:0/3152618911 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e040337c0 0x7f0e04052f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f0e134f9640 1 --2- 172.21.15.131:0/3152618911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e0400a800 0x7f0e04051830 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f0e134f9640 1 -- 172.21.15.131:0/3152618911 >> 172.21.15.131:0/3152618911 conn(0x7f0e0401db60 msgr2=0x7f0e04039600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f0e134f9640 1 -- 172.21.15.131:0/3152618911 shutdown_connections 2024-05-17T04:09:22.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7fd3faffd640 1 --2- 172.21.15.131:0/3738197489 >> v2:172.21.15.150:3300/0 conn(0x7fd3f4007480 0x7fd3f4036690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f27c1d9b640 1 -- 172.21.15.131:0/3624849387 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 350847704 0 0) 0x7f27b8001110 con 0x7f27c406d910 2024-05-17T04:09:22.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f27c1d9b640 1 -- 172.21.15.131:0/3624849387 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27ac003520 con 0x7f27c406d910 2024-05-17T04:09:22.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f27c259c640 1 --2- 172.21.15.131:0/3624849387 >> v2:172.21.15.131:3300/0 conn(0x7f27c415d140 0x7f27c40d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f27c359e640 1 -- 172.21.15.131:0/3624849387 >> v2:172.21.15.131:3300/0 conn(0x7f27c415d140 msgr2=0x7f27c40d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f27c359e640 1 --2- 172.21.15.131:0/3624849387 >> v2:172.21.15.131:3300/0 conn(0x7f27c415d140 0x7f27c40d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f27c359e640 1 -- 172.21.15.131:0/3624849387 >> v1:172.21.15.150:6789/0 conn(0x7f27c406d910 legacy=0x7f27c4160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f27c359e640 1 -- 172.21.15.131:0/3624849387 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c406e190 con 0x7f27c40d3d00 2024-05-17T04:09:22.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f27c259c640 1 --2- 172.21.15.131:0/3624849387 >> v2:172.21.15.131:3300/0 conn(0x7f27c415d140 0x7f27c40d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:22.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7fd3fb7fe640 1 -- 172.21.15.131:0/3738197489 >> v2:172.21.15.150:3300/0 conn(0x7fd3f4007480 msgr2=0x7fd3f4036690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7fd3fb7fe640 1 --2- 172.21.15.131:0/3738197489 >> v2:172.21.15.150:3300/0 conn(0x7fd3f4007480 0x7fd3f4036690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7fd3fb7fe640 1 -- 172.21.15.131:0/3738197489 >> v1:172.21.15.131:6789/0 conn(0x7fd3f4036bd0 legacy=0x7fd3f4006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7fd3fb7fe640 1 -- 172.21.15.131:0/3738197489 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f403a4c0 con 0x7fd3f40543a0 2024-05-17T04:09:22.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f35977fe640 1 -- 172.21.15.131:0/1898307849 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3598064190 con 0x7f35880042f0 2024-05-17T04:09:22.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7ff0d4e23640 1 -- 172.21.15.131:0/1455402752 >> v1:172.21.15.150:6789/0 conn(0x7ff0d015dfd0 legacy=0x7ff0d00b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7ff0d4e23640 1 -- 172.21.15.131:0/1455402752 >> v1:172.21.15.131:6789/0 conn(0x7ff0d006e9e0 legacy=0x7ff0d006edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7ff0d4e23640 1 -- 172.21.15.131:0/1455402752 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d015e3e0 con 0x7ff0d0167500 2024-05-17T04:09:22.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.513+0000 7f0e134f9640 1 -- 172.21.15.131:0/3152618911 wait complete. 2024-05-17T04:09:22.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f359f19e640 1 -- 172.21.15.131:0/1898307849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35880042f0 msgr2=0x7f358800fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f94e7fff640 1 --2- 172.21.15.131:0/4196698754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d8004800 0x7f94d8004c10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f94d40098a0 tx=0x7f94d8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ca6564ec6407369 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f359f19e640 1 --2- 172.21.15.131:0/1898307849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35880042f0 0x7f358800fe50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3598069ff0 tx=0x7f3588005830 comp rx=0 tx=0).stop 2024-05-17T04:09:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f359f19e640 1 -- 172.21.15.131:0/1898307849 shutdown_connections 2024-05-17T04:09:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f359f19e640 1 --2- 172.21.15.131:0/1898307849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35880042f0 0x7f358800fe50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f359f19e640 1 -- 172.21.15.131:0/1898307849 >> 172.21.15.131:0/1898307849 conn(0x7f35900569d0 msgr2=0x7f3590056de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f94e77fe640 1 -- 172.21.15.131:0/4196698754 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d400f040 con 0x7f94d8004800 2024-05-17T04:09:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f94e77fe640 1 -- 172.21.15.131:0/4196698754 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d4004230 con 0x7f94d8004800 2024-05-17T04:09:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f529affd640 1 --2- 172.21.15.131:0/3730780706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c06d100 0x7f529c0cd500 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f528c009870 tx=0x7f528c02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6676188a0cdd33f server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f27c359e640 1 --2- 172.21.15.131:0/3624849387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27c40d3d00 0x7f27c40d4110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f27b40097a0 tx=0x7f27b402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c692f1329800bf0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7fd3fb7fe640 1 --2- 172.21.15.131:0/3738197489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f40543a0 0x7fd3f4006750 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc07ba50 tx=0x7fd3fc0a7e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c16a638659b1ad9e server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f94e77fe640 1 -- 172.21.15.131:0/4196698754 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d402a9b0 con 0x7f94d8004800 2024-05-17T04:09:22.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f359f19e640 1 -- 172.21.15.131:0/1898307849 shutdown_connections 2024-05-17T04:09:22.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f529a7fc640 1 -- 172.21.15.131:0/3730780706 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c037070 con 0x7f529c06d100 2024-05-17T04:09:22.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f529a7fc640 1 -- 172.21.15.131:0/3730780706 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528c032440 con 0x7f529c06d100 2024-05-17T04:09:22.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f529a7fc640 1 -- 172.21.15.131:0/3730780706 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c037070 con 0x7f529c06d100 2024-05-17T04:09:22.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f27c1d9b640 1 -- 172.21.15.131:0/3624849387 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4037070 con 0x7f27c40d3d00 2024-05-17T04:09:22.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f27c1d9b640 1 -- 172.21.15.131:0/3624849387 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b4032440 con 0x7f27c40d3d00 2024-05-17T04:09:22.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.514+0000 7f27c1d9b640 1 -- 172.21.15.131:0/3624849387 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4037070 con 0x7f27c40d3d00 2024-05-17T04:09:22.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.515+0000 7f359f19e640 1 -- 172.21.15.131:0/1898307849 wait complete. 2024-05-17T04:09:22.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.515+0000 7ff0d4e23640 1 --2- 172.21.15.131:0/1455402752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d0167500 0x7ff0d0167910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009870 tx=0x7ff0cc02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b8d347b18ae773e server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.515+0000 7fd3f9ffb640 1 -- 172.21.15.131:0/3738197489 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc070ca0 con 0x7fd3f40543a0 2024-05-17T04:09:22.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.515+0000 7fd3f9ffb640 1 -- 172.21.15.131:0/3738197489 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3fc070e40 con 0x7fd3f40543a0 2024-05-17T04:09:22.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.515+0000 7fd3f9ffb640 1 -- 172.21.15.131:0/3738197489 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc0a8940 con 0x7fd3f40543a0 2024-05-17T04:09:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.515+0000 7f94eedb2640 1 -- 172.21.15.131:0/4196698754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d8004800 msgr2=0x7f94d8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.515+0000 7f94eedb2640 1 --2- 172.21.15.131:0/4196698754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d8004800 0x7f94d8004c10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f94d40098a0 tx=0x7f94d8005830 comp rx=0 tx=0).stop 2024-05-17T04:09:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.515+0000 7f94eedb2640 1 -- 172.21.15.131:0/4196698754 shutdown_connections 2024-05-17T04:09:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.515+0000 7f94eedb2640 1 --2- 172.21.15.131:0/4196698754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94d8004800 0x7f94d8004c10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.515+0000 7ff0c7fff640 1 -- 172.21.15.131:0/1455402752 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc037070 con 0x7ff0d0167500 2024-05-17T04:09:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.515+0000 7ff0c7fff640 1 -- 172.21.15.131:0/1455402752 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0cc02ae50 con 0x7ff0d0167500 2024-05-17T04:09:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.515+0000 7ff0c7fff640 1 -- 172.21.15.131:0/1455402752 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc032860 con 0x7ff0d0167500 2024-05-17T04:09:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.515+0000 7f94eedb2640 1 -- 172.21.15.131:0/4196698754 >> 172.21.15.131:0/4196698754 conn(0x7f94e001db90 msgr2=0x7f94e0039630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.515+0000 7f2b46e6c640 1 Processor -- start 2024-05-17T04:09:22.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f52a16b3640 1 -- 172.21.15.131:0/3730780706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c06d100 msgr2=0x7f529c0cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f2b46e6c640 1 -- start start 2024-05-17T04:09:22.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f52a16b3640 1 --2- 172.21.15.131:0/3730780706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c06d100 0x7f529c0cd500 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f528c009870 tx=0x7f528c02a250 comp rx=0 tx=0).stop 2024-05-17T04:09:22.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f27c9170640 1 -- 172.21.15.131:0/3624849387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27c40d3d00 msgr2=0x7f27c40d4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f27c9170640 1 --2- 172.21.15.131:0/3624849387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27c40d3d00 0x7f27c40d4110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f27b40097a0 tx=0x7f27b402a180 comp rx=0 tx=0).stop 2024-05-17T04:09:22.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f52a16b3640 1 -- 172.21.15.131:0/3730780706 shutdown_connections 2024-05-17T04:09:22.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f52a16b3640 1 --2- 172.21.15.131:0/3730780706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c06d100 0x7f529c0cd500 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f52a16b3640 1 -- 172.21.15.131:0/3730780706 >> 172.21.15.131:0/3730780706 conn(0x7f529c0b36d0 msgr2=0x7f529c0d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f27c9170640 1 -- 172.21.15.131:0/3624849387 shutdown_connections 2024-05-17T04:09:22.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f27c9170640 1 --2- 172.21.15.131:0/3624849387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27c40d3d00 0x7f27c40d4110 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f27c9170640 1 --2- 172.21.15.131:0/3624849387 >> v2:172.21.15.131:3300/0 conn(0x7f27c415d140 0x7f27c40d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f27c9170640 1 -- 172.21.15.131:0/3624849387 >> 172.21.15.131:0/3624849387 conn(0x7f27c40b6c10 msgr2=0x7f27c40b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f52a16b3640 1 -- 172.21.15.131:0/3730780706 shutdown_connections 2024-05-17T04:09:22.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f52a16b3640 1 -- 172.21.15.131:0/3730780706 wait complete. 2024-05-17T04:09:22.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.517+0000 7ff0d6626640 1 -- 172.21.15.131:0/1455402752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d0167500 msgr2=0x7ff0d0167910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.517+0000 7ff0d6626640 1 --2- 172.21.15.131:0/1455402752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d0167500 0x7ff0d0167910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009870 tx=0x7ff0cc02a300 comp rx=0 tx=0).stop 2024-05-17T04:09:22.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f27c9170640 1 -- 172.21.15.131:0/3624849387 shutdown_connections 2024-05-17T04:09:22.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f27c9170640 1 -- 172.21.15.131:0/3624849387 wait complete. 2024-05-17T04:09:22.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f0e134f9640 1 Processor -- start 2024-05-17T04:09:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f0e134f9640 1 -- start start 2024-05-17T04:09:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7fd401563640 1 -- 172.21.15.131:0/3738197489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f40543a0 msgr2=0x7fd3f4006750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7fd401563640 1 --2- 172.21.15.131:0/3738197489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f40543a0 0x7fd3f4006750 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc07ba50 tx=0x7fd3fc0a7e40 comp rx=0 tx=0).stop 2024-05-17T04:09:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7fd401563640 1 -- 172.21.15.131:0/3738197489 shutdown_connections 2024-05-17T04:09:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7fd401563640 1 --2- 172.21.15.131:0/3738197489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f40543a0 0x7fd3f4006750 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7fd401563640 1 --2- 172.21.15.131:0/3738197489 >> v2:172.21.15.150:3300/0 conn(0x7fd3f4007480 0x7fd3f4036690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7fd401563640 1 -- 172.21.15.131:0/3738197489 >> 172.21.15.131:0/3738197489 conn(0x7fd3f401dfa0 msgr2=0x7fd3f4039a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.516+0000 7f94eedb2640 1 -- 172.21.15.131:0/4196698754 shutdown_connections 2024-05-17T04:09:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.517+0000 7fd401563640 1 -- 172.21.15.131:0/3738197489 shutdown_connections 2024-05-17T04:09:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.517+0000 7f94eedb2640 1 -- 172.21.15.131:0/4196698754 wait complete. 2024-05-17T04:09:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.517+0000 7ff0d6626640 1 -- 172.21.15.131:0/1455402752 shutdown_connections 2024-05-17T04:09:22.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.517+0000 7ff0d6626640 1 --2- 172.21.15.131:0/1455402752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d0167500 0x7ff0d0167910 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.517+0000 7ff0d6626640 1 -- 172.21.15.131:0/1455402752 >> 172.21.15.131:0/1455402752 conn(0x7ff0d00b3190 msgr2=0x7ff0d006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.517+0000 7fd401563640 1 -- 172.21.15.131:0/3738197489 wait complete. 2024-05-17T04:09:22.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.517+0000 7ff0d6626640 1 -- 172.21.15.131:0/1455402752 shutdown_connections 2024-05-17T04:09:22.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.517+0000 7ff0d6626640 1 -- 172.21.15.131:0/1455402752 wait complete. 2024-05-17T04:09:22.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.518+0000 7f359f19e640 1 Processor -- start 2024-05-17T04:09:22.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.518+0000 7f359f19e640 1 -- start start 2024-05-17T04:09:22.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.518+0000 7f2b46e6c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2b38034e70 0x7f2b3803ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.518+0000 7f2b46e6c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b380529e0 0x7f2b38006d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.518+0000 7f2b46e6c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b380068c0 con 0x7f2b380e76d0 2024-05-17T04:09:22.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.518+0000 7f2b46e6c640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f2b38054e40 con 0x7f2b38034e70 2024-05-17T04:09:22.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.518+0000 7f2b46e6c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2b3803b400 con 0x7f2b380529e0 2024-05-17T04:09:22.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.518+0000 7f2b45669640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f2b380e76d0 0x7f2b380522d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34690/0 (socket says 172.21.15.131:34690) 2024-05-17T04:09:22.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.518+0000 7f2b45669640 1 -- 172.21.15.131:0/3480492242 learned_addr learned my addr 172.21.15.131:0/3480492242 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:22.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.518+0000 7f2b45e6a640 1 --2- 172.21.15.131:0/3480492242 >> v2:172.21.15.131:3300/0 conn(0x7f2b38034e70 0x7f2b3803ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.519+0000 7f0e134f9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e040337c0 0x7f0e0417c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.519+0000 7f2b4666b640 1 --2- 172.21.15.131:0/3480492242 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b380529e0 0x7f2b38006d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.519+0000 7f0e134f9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e04033d10 0x7f0e040e1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.519+0000 7f0e11cf6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e04033d10 0x7f0e040e1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.519+0000 7f0e11cf6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e04033d10 0x7f0e040e1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43624/0 (socket says 172.21.15.131:43624) 2024-05-17T04:09:22.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.519+0000 7f0e134f9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e040df6c0 0x7f0e040e1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.519+0000 7f0e11cf6640 1 -- 172.21.15.131:0/2638247397 learned_addr learned my addr 172.21.15.131:0/2638247397 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.519+0000 7f0e134f9640 1 -- 172.21.15.131:0/2638247397 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0e04039d10 con 0x7f0e04033d10 2024-05-17T04:09:22.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.519+0000 7f2b44e68640 1 -- 172.21.15.131:0/3480492242 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2613713611 0 0) 0x7f2b380068c0 con 0x7f2b380e76d0 2024-05-17T04:09:22.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.519+0000 7f2b44e68640 1 -- 172.21.15.131:0/3480492242 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b2c003520 con 0x7f2b380e76d0 2024-05-17T04:09:22.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.519+0000 7f0e12cf8640 1 --2- 172.21.15.131:0/2638247397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e040df6c0 0x7f0e040e1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f52a16b3640 1 Processor -- start 2024-05-17T04:09:22.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f0e134f9640 1 -- 172.21.15.131:0/2638247397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0e04052720 con 0x7f0e040df6c0 2024-05-17T04:09:22.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f0e134f9640 1 -- 172.21.15.131:0/2638247397 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0e04039e90 con 0x7f0e040337c0 2024-05-17T04:09:22.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f27c9170640 1 Processor -- start 2024-05-17T04:09:22.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f2b45e6a640 1 -- 172.21.15.131:0/3480492242 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b380529e0 msgr2=0x7f2b38006d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:22.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f2b45e6a640 1 --2- 172.21.15.131:0/3480492242 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b380529e0 0x7f2b38006d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f2b45e6a640 1 -- 172.21.15.131:0/3480492242 >> v1:172.21.15.131:6789/0 conn(0x7f2b380e76d0 legacy=0x7f2b380522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f2b45e6a640 1 -- 172.21.15.131:0/3480492242 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b38055070 con 0x7f2b38034e70 2024-05-17T04:09:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f27c9170640 1 -- start start 2024-05-17T04:09:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f94eedb2640 1 Processor -- start 2024-05-17T04:09:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7ff0d6626640 1 Processor -- start 2024-05-17T04:09:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f0e12cf8640 1 -- 172.21.15.131:0/2638247397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e040337c0 msgr2=0x7f0e0417c580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-17T04:09:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f0e12cf8640 1 --2- 172.21.15.131:0/2638247397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e040337c0 0x7f0e0417c580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7fd401563640 1 Processor -- start 2024-05-17T04:09:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f52a16b3640 1 -- start start 2024-05-17T04:09:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f0e12cf8640 1 -- 172.21.15.131:0/2638247397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e04033d10 msgr2=0x7f0e040e1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7f359f19e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35880042f0 0x7f3590038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7fd401563640 1 -- start start 2024-05-17T04:09:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f0e12cf8640 1 --2- 172.21.15.131:0/2638247397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e04033d10 0x7f0e040e1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7f0e12cf8640 1 -- 172.21.15.131:0/2638247397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0417cac0 con 0x7f0e040df6c0 2024-05-17T04:09:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7f359f19e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f359004da10 0x7f35900d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7f0e11cf6640 1 --2- 172.21.15.131:0/2638247397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e04033d10 0x7f0e040e1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7f359f19e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f359003a960 0x7f359003ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7f359cf3a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35880042f0 0x7f3590038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7f359cf3a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35880042f0 0x7f3590038fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:60490/0 (socket says 172.21.15.131:60490) 2024-05-17T04:09:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7f0e12cf8640 1 --2- 172.21.15.131:0/2638247397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e040df6c0 0x7f0e040e1790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c06b5b0 tx=0x7f0e0c06dc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7f359d73b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f359003a960 0x7f359003ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7f359d73b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f359003a960 0x7f359003ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43636/0 (socket says 172.21.15.131:43636) 2024-05-17T04:09:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7f2b45e6a640 1 --2- 172.21.15.131:0/3480492242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b38034e70 0x7f2b3803ae20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009a00 tx=0x7f2b3c02a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8053055c93c03169 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7f359cf3a640 1 -- 172.21.15.131:0/3344377101 learned_addr learned my addr 172.21.15.131:0/3344377101 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7f359f19e640 1 -- 172.21.15.131:0/3344377101 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3590036230 con 0x7f359003a960 2024-05-17T04:09:22.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f359f19e640 1 -- 172.21.15.131:0/3344377101 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f35900360b0 con 0x7f35880042f0 2024-05-17T04:09:22.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f359f19e640 1 -- 172.21.15.131:0/3344377101 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3590054820 con 0x7f359004da10 2024-05-17T04:09:22.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f359d73b640 1 -- 172.21.15.131:0/3344377101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f359004da10 msgr2=0x7f35900d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f359d73b640 1 --2- 172.21.15.131:0/3344377101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f359004da10 0x7f35900d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f359d73b640 1 -- 172.21.15.131:0/3344377101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35880042f0 msgr2=0x7f3590038fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f359d73b640 1 --2- 172.21.15.131:0/3344377101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35880042f0 0x7f3590038fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f359d73b640 1 -- 172.21.15.131:0/3344377101 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359003a090 con 0x7f359003a960 2024-05-17T04:09:22.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7f94eedb2640 1 -- start start 2024-05-17T04:09:22.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f27c9170640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27c406d910 0x7f27c40ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f52a16b3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c06d100 0x7f529c1418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.520+0000 7ff0d6626640 1 -- start start 2024-05-17T04:09:22.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7ff0d6626640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0d006e9e0 0x7ff0d0156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f52a16b3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f529c073300 0x7f529c13e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f52a16b3640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f529c073e20 0x7f529c155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7ff0d6626640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d015dfd0 0x7ff0d01ee440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f27c9170640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27c40d3d00 0x7f27c40cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f27c9170640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27c415d140 0x7f27c40cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f27c9170640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f27c415d550 con 0x7f27c415d140 2024-05-17T04:09:22.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f27c9170640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f27c415fc90 con 0x7f27c406d910 2024-05-17T04:09:22.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f27c9170640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f27c4161450 con 0x7f27c40d3d00 2024-05-17T04:09:22.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f359d73b640 1 --2- 172.21.15.131:0/3344377101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f359003a960 0x7f359003ad70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3598000b60 tx=0x7f359806a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.521+0000 7f0e02ffd640 1 -- 172.21.15.131:0/2638247397 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c09a070 con 0x7f0e040df6c0 2024-05-17T04:09:22.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f0e02ffd640 1 -- 172.21.15.131:0/2638247397 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e0c075760 con 0x7f0e040df6c0 2024-05-17T04:09:22.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7ff0d6626640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d0167500 0x7ff0d01ee980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f0e02ffd640 1 -- 172.21.15.131:0/2638247397 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c075fb0 con 0x7f0e040df6c0 2024-05-17T04:09:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f0e134f9640 1 -- 172.21.15.131:0/2638247397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e04036150 con 0x7f0e040df6c0 2024-05-17T04:09:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.522+0000 7f0e134f9640 1 -- 172.21.15.131:0/2638247397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e0404c0d0 con 0x7f0e040df6c0 2024-05-17T04:09:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7ff0d6626640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d00b59f0 con 0x7ff0d0167500 2024-05-17T04:09:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7ff0d6626640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d00b5710 con 0x7ff0d015dfd0 2024-05-17T04:09:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f52a16b3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f529c0d1640 con 0x7f529c073300 2024-05-17T04:09:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f52a16b3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f529c0d14c0 con 0x7f529c06d100 2024-05-17T04:09:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7ff0d6626640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d00b5cd0 con 0x7ff0d006e9e0 2024-05-17T04:09:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f52a16b3640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f529c0d17c0 con 0x7f529c073e20 2024-05-17T04:09:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f529b7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f529c073e20 0x7f529c155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f529b7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f529c073e20 0x7f529c155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:48582/0 (socket says 172.21.15.131:48582) 2024-05-17T04:09:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f529b7fe640 1 -- 172.21.15.131:0/706263708 learned_addr learned my addr 172.21.15.131:0/706263708 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7ff0d5e25640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d0167500 0x7ff0d01ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f35957fa640 1 -- 172.21.15.131:0/3344377101 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35980b4070 con 0x7f359003a960 2024-05-17T04:09:22.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7ff0d5624640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0d006e9e0 0x7ff0d0156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f359f19e640 1 -- 172.21.15.131:0/3344377101 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359003b770 con 0x7f359003a960 2024-05-17T04:09:22.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f529affd640 1 --2- 172.21.15.131:0/706263708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c06d100 0x7f529c1418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7ff0d5624640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0d006e9e0 0x7ff0d0156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:48580/0 (socket says 172.21.15.131:48580) 2024-05-17T04:09:22.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f359f19e640 1 -- 172.21.15.131:0/3344377101 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f359003ba50 con 0x7f359003a960 2024-05-17T04:09:22.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7fd401563640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f4007480 0x7fd3f40d72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f2b44e68640 1 -- 172.21.15.131:0/3480492242 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c036070 con 0x7f2b38034e70 2024-05-17T04:09:22.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f2b44e68640 1 -- 172.21.15.131:0/3480492242 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3c031600 con 0x7f2b38034e70 2024-05-17T04:09:22.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f2b44e68640 1 -- 172.21.15.131:0/3480492242 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c0319d0 con 0x7f2b38034e70 2024-05-17T04:09:22.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f529b7fe640 1 -- 172.21.15.131:0/706263708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c06d100 msgr2=0x7f529c1418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f529b7fe640 1 --2- 172.21.15.131:0/706263708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c06d100 0x7f529c1418d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f529b7fe640 1 -- 172.21.15.131:0/706263708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f529c073300 msgr2=0x7f529c13e8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-17T04:09:22.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f529b7fe640 1 --2- 172.21.15.131:0/706263708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f529c073300 0x7f529c13e8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f529b7fe640 1 -- 172.21.15.131:0/706263708 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529c152e80 con 0x7f529c073e20 2024-05-17T04:09:22.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7fd401563640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3f4036bd0 0x7fd3f404b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f94eedb2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94d8004800 0x7f94e0020c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f94eedb2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e00211b0 0x7f94e00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f94eedb2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e00cea50 0x7f94e00cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f94eedb2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f94e00337f0 con 0x7f94e00211b0 2024-05-17T04:09:22.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f94eedb2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f94e0052750 con 0x7f94e00cea50 2024-05-17T04:09:22.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f94eedb2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f94e0033970 con 0x7f94d8004800 2024-05-17T04:09:22.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7fd401563640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3f40543a0 0x7fd3f404f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7fd3faffd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f4007480 0x7fd3f40d72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f94ecb4e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94d8004800 0x7f94e0020c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7fd3faffd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f4007480 0x7fd3f40d72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:48596/0 (socket says 172.21.15.131:48596) 2024-05-17T04:09:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7fd3faffd640 1 -- 172.21.15.131:0/31834349 learned_addr learned my addr 172.21.15.131:0/31834349 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7ff0d5624640 1 -- 172.21.15.131:0/175410930 learned_addr learned my addr 172.21.15.131:0/175410930 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7fd401563640 1 -- 172.21.15.131:0/31834349 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f403a150 con 0x7fd3f4036bd0 2024-05-17T04:09:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f529b7fe640 1 --2- 172.21.15.131:0/706263708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f529c073e20 0x7f529c155890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f529400c760 tx=0x7f529400cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f94ecb4e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94d8004800 0x7f94e0020c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:48598/0 (socket says 172.21.15.131:48598) 2024-05-17T04:09:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f94ecb4e640 1 -- 172.21.15.131:0/4090631064 learned_addr learned my addr 172.21.15.131:0/4090631064 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7fd401563640 1 -- 172.21.15.131:0/31834349 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f4052e70 con 0x7fd3f40543a0 2024-05-17T04:09:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7fd3fa7fc640 1 --2- 172.21.15.131:0/31834349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3f4036bd0 0x7fd3f404b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7fd401563640 1 -- 172.21.15.131:0/31834349 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f4007890 con 0x7fd3f4007480 2024-05-17T04:09:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f94ed34f640 1 --2- 172.21.15.131:0/4090631064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e00cea50 0x7f94e00cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7ff0d4e23640 1 --2- 172.21.15.131:0/175410930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d015dfd0 0x7ff0d01ee440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f0e134f9640 1 -- 172.21.15.131:0/2638247397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e0404bbe0 con 0x7f0e040df6c0 2024-05-17T04:09:22.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f27c259c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27c40d3d00 0x7f27c40cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f27c259c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27c40d3d00 0x7f27c40cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:48584/0 (socket says 172.21.15.131:48584) 2024-05-17T04:09:22.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f27c2d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27c406d910 0x7f27c40ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.523+0000 7f27c259c640 1 -- 172.21.15.131:0/4187984827 learned_addr learned my addr 172.21.15.131:0/4187984827 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f94e7fff640 1 --2- 172.21.15.131:0/4090631064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e00211b0 0x7f94e00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f27c359e640 1 --2- 172.21.15.131:0/4187984827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27c415d140 0x7f27c40cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f27c2d9d640 1 -- 172.21.15.131:0/4187984827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27c40d3d00 msgr2=0x7f27c40cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f27c2d9d640 1 --2- 172.21.15.131:0/4187984827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27c40d3d00 0x7f27c40cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f27c2d9d640 1 -- 172.21.15.131:0/4187984827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27c415d140 msgr2=0x7f27c40cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f52937fe640 1 -- 172.21.15.131:0/706263708 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5294003b70 con 0x7f529c073e20 2024-05-17T04:09:22.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f35957fa640 1 -- 172.21.15.131:0/3344377101 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35980bf070 con 0x7f359003a960 2024-05-17T04:09:22.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f94ecb4e640 1 -- 172.21.15.131:0/4090631064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e00cea50 msgr2=0x7f94e00cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f94ecb4e640 1 --2- 172.21.15.131:0/4090631064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e00cea50 0x7f94e00cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f94ecb4e640 1 -- 172.21.15.131:0/4090631064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e00211b0 msgr2=0x7f94e00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f94ecb4e640 1 --2- 172.21.15.131:0/4090631064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e00211b0 0x7f94e00ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f94ecb4e640 1 -- 172.21.15.131:0/4090631064 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e00201c0 con 0x7f94d8004800 2024-05-17T04:09:22.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f52a16b3640 1 -- 172.21.15.131:0/706263708 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f529c140830 con 0x7f529c073e20 2024-05-17T04:09:22.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f52a16b3640 1 -- 172.21.15.131:0/706263708 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f529c140df0 con 0x7f529c073e20 2024-05-17T04:09:22.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f27c2d9d640 1 --2- 172.21.15.131:0/4187984827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27c415d140 0x7f27c40cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7f27c2d9d640 1 -- 172.21.15.131:0/4187984827 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c41f6a90 con 0x7f27c406d910 2024-05-17T04:09:22.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7f27c359e640 1 --2- 172.21.15.131:0/4187984827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27c415d140 0x7f27c40cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:22.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7f35957fa640 1 -- 172.21.15.131:0/3344377101 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359806aa00 con 0x7f359003a960 2024-05-17T04:09:22.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7ff0d5e25640 1 -- 172.21.15.131:0/175410930 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0d006e9e0 msgr2=0x7ff0d0156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7ff0d5e25640 1 --2- 172.21.15.131:0/175410930 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0d006e9e0 0x7ff0d0156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7f94ecb4e640 1 --2- 172.21.15.131:0/4090631064 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94d8004800 0x7f94e0020c70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f94dc007370 tx=0x7f94dc007830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7ff0d5e25640 1 -- 172.21.15.131:0/175410930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d015dfd0 msgr2=0x7ff0d01ee440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7ff0d5e25640 1 --2- 172.21.15.131:0/175410930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d015dfd0 0x7ff0d01ee440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7f2b46e6c640 1 -- 172.21.15.131:0/3480492242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b38034e70 msgr2=0x7f2b3803ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7f2b46e6c640 1 --2- 172.21.15.131:0/3480492242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b38034e70 0x7f2b3803ae20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009a00 tx=0x7f2b3c02a400 comp rx=0 tx=0).stop 2024-05-17T04:09:22.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7f52937fe640 1 -- 172.21.15.131:0/706263708 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5294003d30 con 0x7f529c073e20 2024-05-17T04:09:22.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7f52937fe640 1 -- 172.21.15.131:0/706263708 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529400aa30 con 0x7f529c073e20 2024-05-17T04:09:22.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7f94e57fa640 1 -- 172.21.15.131:0/4090631064 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc00f990 con 0x7f94d8004800 2024-05-17T04:09:22.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7f94e57fa640 1 -- 172.21.15.131:0/4090631064 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94dc018070 con 0x7f94d8004800 2024-05-17T04:09:22.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7f94e57fa640 1 -- 172.21.15.131:0/4090631064 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc00fdb0 con 0x7f94d8004800 2024-05-17T04:09:22.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7f3582ffd640 1 -- 172.21.15.131:0/3344377101 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3590055aa0 con 0x7f359003a960 2024-05-17T04:09:22.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.526+0000 7f94eedb2640 1 -- 172.21.15.131:0/4090631064 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e001f120 con 0x7f94d8004800 2024-05-17T04:09:22.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.526+0000 7f94eedb2640 1 -- 172.21.15.131:0/4090631064 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e001f6e0 con 0x7f94d8004800 2024-05-17T04:09:22.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.524+0000 7fd3fb7fe640 1 --2- 172.21.15.131:0/31834349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3f40543a0 0x7fd3f404f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7fd3faffd640 1 -- 172.21.15.131:0/31834349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3f40543a0 msgr2=0x7fd3f404f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7fd3faffd640 1 --2- 172.21.15.131:0/31834349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3f40543a0 0x7fd3f404f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7fd3faffd640 1 -- 172.21.15.131:0/31834349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3f4036bd0 msgr2=0x7fd3f404b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7fd3faffd640 1 --2- 172.21.15.131:0/31834349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3f4036bd0 0x7fd3f404b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7fd3faffd640 1 -- 172.21.15.131:0/31834349 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f4050320 con 0x7fd3f4007480 2024-05-17T04:09:22.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7fd3fa7fc640 1 --2- 172.21.15.131:0/31834349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3f4036bd0 0x7fd3f404b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:22.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7fd3faffd640 1 --2- 172.21.15.131:0/31834349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f4007480 0x7fd3f40d72d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00bf50 tx=0x7fd3ec00dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7fd3e37fe640 1 -- 172.21.15.131:0/31834349 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec018070 con 0x7fd3f4007480 2024-05-17T04:09:22.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7fd3e37fe640 1 -- 172.21.15.131:0/31834349 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ec0127e0 con 0x7fd3f4007480 2024-05-17T04:09:22.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.525+0000 7fd3e37fe640 1 -- 172.21.15.131:0/31834349 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec012bd0 con 0x7fd3f4007480 2024-05-17T04:09:22.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.526+0000 7f2b46e6c640 1 -- 172.21.15.131:0/3480492242 shutdown_connections 2024-05-17T04:09:22.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.526+0000 7f2b46e6c640 1 --2- 172.21.15.131:0/3480492242 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b380529e0 0x7f2b38006d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.526+0000 7f2b46e6c640 1 --2- 172.21.15.131:0/3480492242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b38034e70 0x7f2b3803ae20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.526+0000 7f2b46e6c640 1 -- 172.21.15.131:0/3480492242 >> 172.21.15.131:0/3480492242 conn(0x7f2b3801ec70 msgr2=0x7f2b3803a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.526+0000 7f0e02ffd640 1 -- 172.21.15.131:0/2638247397 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0e0c09d070 con 0x7f0e040df6c0 2024-05-17T04:09:22.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.526+0000 7f0e02ffd640 1 --2- 172.21.15.131:0/2638247397 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0df00763d0 0x7f0df00788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.526+0000 7f0e02ffd640 1 -- 172.21.15.131:0/2638247397 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0e0c114290 con 0x7f0e040df6c0 2024-05-17T04:09:22.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.527+0000 7f52a16b3640 1 -- 172.21.15.131:0/706263708 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f529c0cd500 con 0x7f529c073e20 2024-05-17T04:09:22.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.527+0000 7ff0d5e25640 1 -- 172.21.15.131:0/175410930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d00ce490 con 0x7ff0d0167500 2024-05-17T04:09:22.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.527+0000 7f35957fa640 1 -- 172.21.15.131:0/3344377101 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f35980c4460 con 0x7f359003a960 2024-05-17T04:09:22.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.527+0000 7f0e124f7640 1 --2- 172.21.15.131:0/2638247397 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0df00763d0 0x7f0df00788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.526+0000 7fd401563640 1 -- 172.21.15.131:0/31834349 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f4050600 con 0x7fd3f4007480 2024-05-17T04:09:22.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.526+0000 7fd401563640 1 -- 172.21.15.131:0/31834349 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f4050bc0 con 0x7fd3f4007480 2024-05-17T04:09:22.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.527+0000 7ff0d5e25640 1 --2- 172.21.15.131:0/175410930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d0167500 0x7ff0d01ee980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000c390 tx=0x7ff0c000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.527+0000 7f94eedb2640 1 -- 172.21.15.131:0/4090631064 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e0051860 con 0x7f94d8004800 2024-05-17T04:09:22.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.527+0000 7f27c2d9d640 1 --2- 172.21.15.131:0/4187984827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27c406d910 0x7f27c40ce360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f27b800c3f0 tx=0x7f27b8001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.528+0000 7f35957fa640 1 --2- 172.21.15.131:0/3344377101 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f357c0763d0 0x7f357c0788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.528+0000 7f52937fe640 1 -- 172.21.15.131:0/706263708 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f529400abd0 con 0x7f529c073e20 2024-05-17T04:09:22.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.528+0000 7f35957fa640 1 -- 172.21.15.131:0/3344377101 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3598134380 con 0x7f359003a960 2024-05-17T04:09:22.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.528+0000 7f2b46e6c640 1 -- 172.21.15.131:0/3480492242 shutdown_connections 2024-05-17T04:09:22.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.528+0000 7f0e124f7640 1 --2- 172.21.15.131:0/2638247397 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0df00763d0 0x7f0df00788e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0e08001470 tx=0x7f0e080079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.528+0000 7fd401563640 1 -- 172.21.15.131:0/31834349 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3f40371c0 con 0x7fd3f4007480 2024-05-17T04:09:22.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.528+0000 7f359cf3a640 1 --2- 172.21.15.131:0/3344377101 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f357c0763d0 0x7f357c0788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.528+0000 7f52937fe640 1 --2- 172.21.15.131:0/706263708 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f527c0763a0 0x7f527c0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.528+0000 7f2b46e6c640 1 -- 172.21.15.131:0/3480492242 wait complete. 2024-05-17T04:09:22.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.529+0000 7f52937fe640 1 -- 172.21.15.131:0/706263708 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f52940977d0 con 0x7f529c073e20 2024-05-17T04:09:22.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.528+0000 7fd3e37fe640 1 -- 172.21.15.131:0/31834349 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd3ec0095e0 con 0x7fd3f4007480 2024-05-17T04:09:22.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.529+0000 7f529affd640 1 --2- 172.21.15.131:0/706263708 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f527c0763a0 0x7f527c0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.529+0000 7f94e57fa640 1 -- 172.21.15.131:0/4090631064 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f94dc01d460 con 0x7f94d8004800 2024-05-17T04:09:22.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.529+0000 7fd3e37fe640 1 --2- 172.21.15.131:0/31834349 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd3e807ebe0 0x7fd3e80810f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.529+0000 7f529affd640 1 --2- 172.21.15.131:0/706263708 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f527c0763a0 0x7f527c0788b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f528c034000 tx=0x7f528c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.529+0000 7fd3e37fe640 1 -- 172.21.15.131:0/31834349 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd3ec00f020 con 0x7fd3f4007480 2024-05-17T04:09:22.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.529+0000 7fd3fa7fc640 1 --2- 172.21.15.131:0/31834349 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd3e807ebe0 0x7fd3e80810f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.529+0000 7f359cf3a640 1 --2- 172.21.15.131:0/3344377101 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f357c0763d0 0x7f357c0788e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f358c001eb0 tx=0x7f358c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.530+0000 7f27ab7fe640 1 -- 172.21.15.131:0/4187984827 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8017070 con 0x7f27c406d910 2024-05-17T04:09:22.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.530+0000 7f94e57fa640 1 --2- 172.21.15.131:0/4090631064 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f94cc0763a0 0x7f94cc0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.530+0000 7f27c9170640 1 -- 172.21.15.131:0/4187984827 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c41f66c0 con 0x7f27c406d910 2024-05-17T04:09:22.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.530+0000 7f27c9170640 1 -- 172.21.15.131:0/4187984827 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c40c9140 con 0x7f27c406d910 2024-05-17T04:09:22.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.530+0000 7f0e02ffd640 1 -- 172.21.15.131:0/2638247397 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0e0c0dd240 con 0x7f0e040df6c0 2024-05-17T04:09:22.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.530+0000 7fd3fa7fc640 1 --2- 172.21.15.131:0/31834349 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd3e807ebe0 0x7fd3e80810f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd3f404e7b0 tx=0x7fd3f0009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.530+0000 7f94e57fa640 1 -- 172.21.15.131:0/4090631064 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f94dc097a10 con 0x7f94d8004800 2024-05-17T04:09:22.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.531+0000 7f27ab7fe640 1 -- 172.21.15.131:0/4187984827 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b8005ce0 con 0x7f27c406d910 2024-05-17T04:09:22.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.531+0000 7f27ab7fe640 1 -- 172.21.15.131:0/4187984827 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b80072d0 con 0x7f27c406d910 2024-05-17T04:09:22.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.530+0000 7f94e7fff640 1 --2- 172.21.15.131:0/4090631064 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f94cc0763a0 0x7f94cc0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.531+0000 7f94e7fff640 1 --2- 172.21.15.131:0/4090631064 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f94cc0763a0 0x7f94cc0788b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f94d4033000 tx=0x7f94d402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.531+0000 7f2b46e6c640 1 Processor -- start 2024-05-17T04:09:22.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.531+0000 7f2b46e6c640 1 -- start start 2024-05-17T04:09:22.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.532+0000 7f27c9170640 1 -- 172.21.15.131:0/4187984827 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27c40cbfa0 con 0x7f27c406d910 2024-05-17T04:09:22.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.532+0000 7f27ab7fe640 1 -- 172.21.15.131:0/4187984827 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f27b801a070 con 0x7f27c406d910 2024-05-17T04:09:22.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.532+0000 7f2b46e6c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b38034e70 0x7f2b38037120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b46e6c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b380e76d0 0x7f2b38178fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b46e6c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b38179510 0x7f2b3800bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b46e6c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2b380e7ae0 con 0x7f2b38179510 2024-05-17T04:09:22.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b46e6c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2b38055630 con 0x7f2b380e76d0 2024-05-17T04:09:22.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b46e6c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2b380072b0 con 0x7f2b38034e70 2024-05-17T04:09:22.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b4666b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b38179510 0x7f2b3800bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b4666b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b38179510 0x7f2b3800bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43696/0 (socket says 172.21.15.131:43696) 2024-05-17T04:09:22.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b4666b640 1 -- 172.21.15.131:0/1769609005 learned_addr learned my addr 172.21.15.131:0/1769609005 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:22.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b45669640 1 --2- 172.21.15.131:0/1769609005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b380e76d0 0x7f2b38178fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b45e6a640 1 --2- 172.21.15.131:0/1769609005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b38034e70 0x7f2b38037120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f27ab7fe640 1 --2- 172.21.15.131:0/4187984827 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f27b0076320 0x7f27b0078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f27ab7fe640 1 -- 172.21.15.131:0/4187984827 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f27b8096c20 con 0x7f27c406d910 2024-05-17T04:09:22.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f27c259c640 1 --2- 172.21.15.131:0/4187984827 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f27b0076320 0x7f27b0078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f52937fe640 1 -- 172.21.15.131:0/706263708 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5294060dd0 con 0x7f529c073e20 2024-05-17T04:09:22.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b4666b640 1 -- 172.21.15.131:0/1769609005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b38034e70 msgr2=0x7f2b38037120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b4666b640 1 --2- 172.21.15.131:0/1769609005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b38034e70 0x7f2b38037120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b4666b640 1 -- 172.21.15.131:0/1769609005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b380e76d0 msgr2=0x7f2b38178fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b4666b640 1 --2- 172.21.15.131:0/1769609005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b380e76d0 0x7f2b38178fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b4666b640 1 -- 172.21.15.131:0/1769609005 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b3817a620 con 0x7f2b38179510 2024-05-17T04:09:22.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.533+0000 7f2b4666b640 1 --2- 172.21.15.131:0/1769609005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b38179510 0x7f2b3800bf20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b4007ba50 tx=0x7f2b40069d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.534+0000 7f27c259c640 1 --2- 172.21.15.131:0/4187984827 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f27b0076320 0x7f27b0078830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0075a0 tx=0x7f27bc007530 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.535+0000 7f2b367fc640 1 -- 172.21.15.131:0/1769609005 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4009a070 con 0x7f2b38179510 2024-05-17T04:09:22.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.535+0000 7f2b46e6c640 1 -- 172.21.15.131:0/1769609005 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b380354e0 con 0x7f2b38179510 2024-05-17T04:09:22.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.535+0000 7ff0c5ffb640 1 -- 172.21.15.131:0/175410930 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0017070 con 0x7ff0d0167500 2024-05-17T04:09:22.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.535+0000 7ff0c5ffb640 1 -- 172.21.15.131:0/175410930 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c00052d0 con 0x7ff0d0167500 2024-05-17T04:09:22.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.535+0000 7ff0c5ffb640 1 -- 172.21.15.131:0/175410930 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0003830 con 0x7ff0d0167500 2024-05-17T04:09:22.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.535+0000 7f35957fa640 1 -- 172.21.15.131:0/3344377101 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f35980fd8f0 con 0x7f359003a960 2024-05-17T04:09:22.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.535+0000 7ff0d6626640 1 -- 172.21.15.131:0/175410930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d00ce770 con 0x7ff0d0167500 2024-05-17T04:09:22.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.535+0000 7f2b367fc640 1 -- 172.21.15.131:0/1769609005 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b40075490 con 0x7f2b38179510 2024-05-17T04:09:22.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.535+0000 7f2b367fc640 1 -- 172.21.15.131:0/1769609005 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40075840 con 0x7f2b38179510 2024-05-17T04:09:22.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.535+0000 7f2b46e6c640 1 -- 172.21.15.131:0/1769609005 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b38035aa0 con 0x7f2b38179510 2024-05-17T04:09:22.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.535+0000 7ff0d6626640 1 -- 172.21.15.131:0/175410930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d00ced30 con 0x7ff0d0167500 2024-05-17T04:09:22.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.537+0000 7ff0d6626640 1 -- 172.21.15.131:0/175410930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d0164bb0 con 0x7ff0d0167500 2024-05-17T04:09:22.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.537+0000 7f2b46e6c640 1 -- 172.21.15.131:0/1769609005 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b3803ae20 con 0x7f2b38179510 2024-05-17T04:09:22.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.538+0000 7f27ab7fe640 1 -- 172.21.15.131:0/4187984827 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f27c40cbfa0 con 0x7f27c406d910 2024-05-17T04:09:22.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.538+0000 7f2b367fc640 1 -- 172.21.15.131:0/1769609005 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2b4009d070 con 0x7f2b38179510 2024-05-17T04:09:22.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.538+0000 7ff0c5ffb640 1 -- 172.21.15.131:0/175410930 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff0c001a070 con 0x7ff0d0167500 2024-05-17T04:09:22.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.539+0000 7ff0c5ffb640 1 --2- 172.21.15.131:0/175410930 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff0b40762d0 0x7ff0b40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.539+0000 7ff0c5ffb640 1 -- 172.21.15.131:0/175410930 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff0c0096d90 con 0x7ff0d0167500 2024-05-17T04:09:22.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.538+0000 7fd3e37fe640 1 -- 172.21.15.131:0/31834349 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd3ec061140 con 0x7fd3f4007480 2024-05-17T04:09:22.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.540+0000 7ff0d5624640 1 --2- 172.21.15.131:0/175410930 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff0b40762d0 0x7ff0b40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.538+0000 7f2b367fc640 1 --2- 172.21.15.131:0/1769609005 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b240762d0 0x7f2b240787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:22.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.539+0000 7f2b45e6a640 1 --2- 172.21.15.131:0/1769609005 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b240762d0 0x7f2b240787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:22.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.540+0000 7ff0d5624640 1 --2- 172.21.15.131:0/175410930 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff0b40762d0 0x7ff0b40787e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff0c80012e0 tx=0x7ff0c8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.541+0000 7f2b367fc640 1 -- 172.21.15.131:0/1769609005 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2b40113710 con 0x7f2b38179510 2024-05-17T04:09:22.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.541+0000 7f2b45e6a640 1 --2- 172.21.15.131:0/1769609005 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b240762d0 0x7f2b240787e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c033000 tx=0x7f2b3c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:22.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.545+0000 7f94e57fa640 1 -- 172.21.15.131:0/4090631064 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f94dc060f80 con 0x7f94d8004800 2024-05-17T04:09:22.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.547+0000 7ff0c5ffb640 1 -- 172.21.15.131:0/175410930 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff0d0164bb0 con 0x7ff0d0167500 2024-05-17T04:09:22.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.556+0000 7f2b367fc640 1 -- 172.21.15.131:0/1769609005 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2b40092070 con 0x7f2b38179510 2024-05-17T04:09:22.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.966+0000 7f0e134f9640 1 -- 172.21.15.131:0/2638247397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0e04051830 con 0x7f0e040df6c0 2024-05-17T04:09:22.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.966+0000 7f52a16b3640 1 -- 172.21.15.131:0/706263708 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f529c151d50 con 0x7f529c073e20 2024-05-17T04:09:22.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.967+0000 7f0e02ffd640 1 -- 172.21.15.131:0/2638247397 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0e0c0e1540 con 0x7f0e040df6c0 2024-05-17T04:09:22.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.967+0000 7f52937fe640 1 -- 172.21.15.131:0/706263708 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f52940606d0 con 0x7f529c073e20 2024-05-17T04:09:22.968 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-05-17T04:09:22.969 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-05-17T04:09:22.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.970+0000 7f27c9170640 1 -- 172.21.15.131:0/4187984827 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f27c40c8c50 con 0x7f27c406d910 2024-05-17T04:09:22.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.970+0000 7f0e00ff9640 1 -- 172.21.15.131:0/2638247397 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0df00763d0 msgr2=0x7f0df00788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.970+0000 7f0e00ff9640 1 --2- 172.21.15.131:0/2638247397 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0df00763d0 0x7f0df00788e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0e08001470 tx=0x7f0e080079b0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.970+0000 7fd401563640 1 -- 172.21.15.131:0/31834349 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd3f4004d80 con 0x7fd3f4007480 2024-05-17T04:09:22.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.970+0000 7f52917fa640 1 -- 172.21.15.131:0/706263708 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f527c0763a0 msgr2=0x7f527c0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.970+0000 7f52917fa640 1 --2- 172.21.15.131:0/706263708 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f527c0763a0 0x7f527c0788b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f528c034000 tx=0x7f528c02e000 comp rx=0 tx=0).stop 2024-05-17T04:09:22.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.970+0000 7f52917fa640 1 -- 172.21.15.131:0/706263708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f529c073e20 msgr2=0x7f529c155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.970+0000 7f52917fa640 1 --2- 172.21.15.131:0/706263708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f529c073e20 0x7f529c155890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f529400c760 tx=0x7f529400cc20 comp rx=0 tx=0).stop 2024-05-17T04:09:22.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.970+0000 7f0e00ff9640 1 -- 172.21.15.131:0/2638247397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e040df6c0 msgr2=0x7f0e040e1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f0e00ff9640 1 --2- 172.21.15.131:0/2638247397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e040df6c0 0x7f0e040e1790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c06b5b0 tx=0x7f0e0c06dc40 comp rx=0 tx=0).stop 2024-05-17T04:09:22.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f52917fa640 1 -- 172.21.15.131:0/706263708 shutdown_connections 2024-05-17T04:09:22.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f52917fa640 1 --2- 172.21.15.131:0/706263708 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f527c0763a0 0x7f527c0788b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f52917fa640 1 --2- 172.21.15.131:0/706263708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f529c073300 0x7f529c13e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f52917fa640 1 --2- 172.21.15.131:0/706263708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f529c073e20 0x7f529c155890 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f52917fa640 1 --2- 172.21.15.131:0/706263708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c06d100 0x7f529c1418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f52917fa640 1 -- 172.21.15.131:0/706263708 >> 172.21.15.131:0/706263708 conn(0x7f529c0b36d0 msgr2=0x7f529c0af850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f0e00ff9640 1 -- 172.21.15.131:0/2638247397 shutdown_connections 2024-05-17T04:09:22.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f0e00ff9640 1 --2- 172.21.15.131:0/2638247397 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0df00763d0 0x7f0df00788e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f0e00ff9640 1 --2- 172.21.15.131:0/2638247397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e04033d10 0x7f0e040e1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f0e00ff9640 1 --2- 172.21.15.131:0/2638247397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e040df6c0 0x7f0e040e1790 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f0e00ff9640 1 --2- 172.21.15.131:0/2638247397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e040337c0 0x7f0e0417c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f0e00ff9640 1 -- 172.21.15.131:0/2638247397 >> 172.21.15.131:0/2638247397 conn(0x7f0e0401db60 msgr2=0x7f0e040d9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f52917fa640 1 -- 172.21.15.131:0/706263708 shutdown_connections 2024-05-17T04:09:22.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f52917fa640 1 -- 172.21.15.131:0/706263708 wait complete. 2024-05-17T04:09:22.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f0e00ff9640 1 -- 172.21.15.131:0/2638247397 shutdown_connections 2024-05-17T04:09:22.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7f0e00ff9640 1 -- 172.21.15.131:0/2638247397 wait complete. 2024-05-17T04:09:22.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.971+0000 7fd3e37fe640 1 -- 172.21.15.131:0/31834349 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd3ec0691c0 con 0x7fd3f4007480 2024-05-17T04:09:22.978 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-05-17T04:09:22.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.972+0000 7f27ab7fe640 1 -- 172.21.15.131:0/4187984827 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f27c40d4650 con 0x7f27c406d910 2024-05-17T04:09:22.980 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-05-17T04:09:22.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.975+0000 7fd401563640 1 -- 172.21.15.131:0/31834349 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd3e807ebe0 msgr2=0x7fd3e80810f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.975+0000 7fd401563640 1 --2- 172.21.15.131:0/31834349 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd3e807ebe0 0x7fd3e80810f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd3f404e7b0 tx=0x7fd3f0009060 comp rx=0 tx=0).stop 2024-05-17T04:09:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.975+0000 7fd401563640 1 -- 172.21.15.131:0/31834349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f4007480 msgr2=0x7fd3f40d72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.975+0000 7fd401563640 1 --2- 172.21.15.131:0/31834349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f4007480 0x7fd3f40d72d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00bf50 tx=0x7fd3ec00dbe0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7f3582ffd640 1 -- 172.21.15.131:0/3344377101 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f35900082f0 con 0x7f359003a960 2024-05-17T04:09:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7fd401563640 1 -- 172.21.15.131:0/31834349 shutdown_connections 2024-05-17T04:09:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7fd401563640 1 --2- 172.21.15.131:0/31834349 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd3e807ebe0 0x7fd3e80810f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7fd401563640 1 --2- 172.21.15.131:0/31834349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3f4036bd0 0x7fd3f404b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7fd401563640 1 --2- 172.21.15.131:0/31834349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3f40543a0 0x7fd3f404f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7fd401563640 1 --2- 172.21.15.131:0/31834349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3f4007480 0x7fd3f40d72d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7fd401563640 1 -- 172.21.15.131:0/31834349 >> 172.21.15.131:0/31834349 conn(0x7fd3f401dfa0 msgr2=0x7fd3f4031b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7f27c9170640 1 -- 172.21.15.131:0/4187984827 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f27b0076320 msgr2=0x7f27b0078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7fd401563640 1 -- 172.21.15.131:0/31834349 shutdown_connections 2024-05-17T04:09:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7fd401563640 1 -- 172.21.15.131:0/31834349 wait complete. 2024-05-17T04:09:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7f27c9170640 1 --2- 172.21.15.131:0/4187984827 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f27b0076320 0x7f27b0078830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0075a0 tx=0x7f27bc007530 comp rx=0 tx=0).stop 2024-05-17T04:09:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7f27c9170640 1 -- 172.21.15.131:0/4187984827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27c406d910 msgr2=0x7f27c40ce360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7f27c9170640 1 --2- 172.21.15.131:0/4187984827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27c406d910 0x7f27c40ce360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f27b800c3f0 tx=0x7f27b8001e70 comp rx=0 tx=0).stop 2024-05-17T04:09:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7f27c9170640 1 -- 172.21.15.131:0/4187984827 shutdown_connections 2024-05-17T04:09:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7f27c9170640 1 --2- 172.21.15.131:0/4187984827 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f27b0076320 0x7f27b0078830 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7f27c9170640 1 --2- 172.21.15.131:0/4187984827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27c415d140 0x7f27c40cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7f27c9170640 1 --2- 172.21.15.131:0/4187984827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27c40d3d00 0x7f27c40cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7f27c9170640 1 --2- 172.21.15.131:0/4187984827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27c406d910 0x7f27c40ce360 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.976+0000 7f27c9170640 1 -- 172.21.15.131:0/4187984827 >> 172.21.15.131:0/4187984827 conn(0x7f27c40b6c10 msgr2=0x7f27c40cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.977+0000 7f35957fa640 1 -- 172.21.15.131:0/3344377101 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f35980fd1f0 con 0x7f359003a960 2024-05-17T04:09:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.977+0000 7f27c9170640 1 -- 172.21.15.131:0/4187984827 shutdown_connections 2024-05-17T04:09:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.977+0000 7f27c9170640 1 -- 172.21.15.131:0/4187984827 wait complete. 2024-05-17T04:09:22.984 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-05-17T04:09:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.980+0000 7f3582ffd640 1 -- 172.21.15.131:0/3344377101 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f357c0763d0 msgr2=0x7f357c0788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.981+0000 7f3582ffd640 1 --2- 172.21.15.131:0/3344377101 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f357c0763d0 0x7f357c0788e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f358c001eb0 tx=0x7f358c009040 comp rx=0 tx=0).stop 2024-05-17T04:09:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.981+0000 7f3582ffd640 1 -- 172.21.15.131:0/3344377101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f359003a960 msgr2=0x7f359003ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.981+0000 7f3582ffd640 1 --2- 172.21.15.131:0/3344377101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f359003a960 0x7f359003ad70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3598000b60 tx=0x7f359806a6e0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.981+0000 7f3582ffd640 1 -- 172.21.15.131:0/3344377101 shutdown_connections 2024-05-17T04:09:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.981+0000 7f3582ffd640 1 --2- 172.21.15.131:0/3344377101 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f357c0763d0 0x7f357c0788e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.981+0000 7f3582ffd640 1 --2- 172.21.15.131:0/3344377101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f359003a960 0x7f359003ad70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.981+0000 7f3582ffd640 1 --2- 172.21.15.131:0/3344377101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f359004da10 0x7f35900d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.981+0000 7f3582ffd640 1 --2- 172.21.15.131:0/3344377101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35880042f0 0x7f3590038fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.981+0000 7f94eedb2640 1 -- 172.21.15.131:0/4090631064 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f94e0031800 con 0x7f94d8004800 2024-05-17T04:09:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.981+0000 7f3582ffd640 1 -- 172.21.15.131:0/3344377101 >> 172.21.15.131:0/3344377101 conn(0x7f35900569d0 msgr2=0x7f35900e4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.982+0000 7ff0d6626640 1 -- 172.21.15.131:0/175410930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff0d0168260 con 0x7ff0d0167500 2024-05-17T04:09:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.982+0000 7f3582ffd640 1 -- 172.21.15.131:0/3344377101 shutdown_connections 2024-05-17T04:09:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.982+0000 7f3582ffd640 1 -- 172.21.15.131:0/3344377101 wait complete. 2024-05-17T04:09:22.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.982+0000 7ff0c5ffb640 1 -- 172.21.15.131:0/175410930 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff0c0021080 con 0x7ff0d0167500 2024-05-17T04:09:22.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.982+0000 7f94e57fa640 1 -- 172.21.15.131:0/4090631064 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f94dc060880 con 0x7f94d8004800 2024-05-17T04:09:22.988 INFO:teuthology.orchestra.run.smithi131.stdout:55834574855 2024-05-17T04:09:22.989 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-05-17T04:09:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7ff0d6626640 1 -- 172.21.15.131:0/175410930 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff0b40762d0 msgr2=0x7ff0b40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7f94eedb2640 1 -- 172.21.15.131:0/4090631064 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f94cc0763a0 msgr2=0x7f94cc0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7f94eedb2640 1 --2- 172.21.15.131:0/4090631064 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f94cc0763a0 0x7f94cc0788b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f94d4033000 tx=0x7f94d402e000 comp rx=0 tx=0).stop 2024-05-17T04:09:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7ff0d6626640 1 --2- 172.21.15.131:0/175410930 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff0b40762d0 0x7ff0b40787e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff0c80012e0 tx=0x7ff0c8009040 comp rx=0 tx=0).stop 2024-05-17T04:09:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7ff0d6626640 1 -- 172.21.15.131:0/175410930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d0167500 msgr2=0x7ff0d01ee980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7ff0d6626640 1 --2- 172.21.15.131:0/175410930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d0167500 0x7ff0d01ee980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000c390 tx=0x7ff0c000c850 comp rx=0 tx=0).stop 2024-05-17T04:09:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7f94eedb2640 1 -- 172.21.15.131:0/4090631064 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94d8004800 msgr2=0x7f94e0020c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7f94eedb2640 1 --2- 172.21.15.131:0/4090631064 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94d8004800 0x7f94e0020c70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f94dc007370 tx=0x7f94dc007830 comp rx=0 tx=0).stop 2024-05-17T04:09:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7ff0d6626640 1 -- 172.21.15.131:0/175410930 shutdown_connections 2024-05-17T04:09:22.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7ff0d6626640 1 --2- 172.21.15.131:0/175410930 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff0b40762d0 0x7ff0b40787e0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff0c80012e0 tx=0x7ff0c8009040 comp rx=0 tx=0).stop 2024-05-17T04:09:22.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7ff0d6626640 1 --2- 172.21.15.131:0/175410930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d0167500 0x7ff0d01ee980 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7ff0d6626640 1 --2- 172.21.15.131:0/175410930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0d015dfd0 0x7ff0d01ee440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7ff0d6626640 1 --2- 172.21.15.131:0/175410930 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0d006e9e0 0x7ff0d0156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7ff0d6626640 1 -- 172.21.15.131:0/175410930 >> 172.21.15.131:0/175410930 conn(0x7ff0d00b3190 msgr2=0x7ff0d015c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7f94eedb2640 1 -- 172.21.15.131:0/4090631064 shutdown_connections 2024-05-17T04:09:22.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7f94eedb2640 1 --2- 172.21.15.131:0/4090631064 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f94cc0763a0 0x7f94cc0788b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7f94eedb2640 1 --2- 172.21.15.131:0/4090631064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e00211b0 0x7f94e00ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7f94eedb2640 1 --2- 172.21.15.131:0/4090631064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e00cea50 0x7f94e00cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7f94eedb2640 1 --2- 172.21.15.131:0/4090631064 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94d8004800 0x7f94e0020c70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:22.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.987+0000 7f94eedb2640 1 -- 172.21.15.131:0/4090631064 >> 172.21.15.131:0/4090631064 conn(0x7f94e001db90 msgr2=0x7f94e0032000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:22.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.988+0000 7ff0d6626640 1 -- 172.21.15.131:0/175410930 shutdown_connections 2024-05-17T04:09:22.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.988+0000 7ff0d6626640 1 -- 172.21.15.131:0/175410930 wait complete. 2024-05-17T04:09:22.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.988+0000 7f94eedb2640 1 -- 172.21.15.131:0/4090631064 shutdown_connections 2024-05-17T04:09:22.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.988+0000 7f94eedb2640 1 -- 172.21.15.131:0/4090631064 wait complete. 2024-05-17T04:09:22.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-05-17T04:09:22.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-05-17T04:09:22.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.997+0000 7f2b46e6c640 1 -- 172.21.15.131:0/1769609005 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2b3817a3b0 con 0x7f2b38179510 2024-05-17T04:09:22.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:22.998+0000 7f2b367fc640 1 -- 172.21.15.131:0/1769609005 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2b400dc5b0 con 0x7f2b38179510 2024-05-17T04:09:22.999 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-05-17T04:09:23.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-05-17T04:09:23.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-05-17T04:09:23.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:23.002+0000 7f2b46e6c640 1 -- 172.21.15.131:0/1769609005 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b240762d0 msgr2=0x7f2b240787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:23.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:23.002+0000 7f2b46e6c640 1 --2- 172.21.15.131:0/1769609005 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b240762d0 0x7f2b240787e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c033000 tx=0x7f2b3c008030 comp rx=0 tx=0).stop 2024-05-17T04:09:23.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:23.002+0000 7f2b46e6c640 1 -- 172.21.15.131:0/1769609005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b38179510 msgr2=0x7f2b3800bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:23.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:23.002+0000 7f2b46e6c640 1 --2- 172.21.15.131:0/1769609005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b38179510 0x7f2b3800bf20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b4007ba50 tx=0x7f2b40069d10 comp rx=0 tx=0).stop 2024-05-17T04:09:23.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:23.003+0000 7f2b46e6c640 1 -- 172.21.15.131:0/1769609005 shutdown_connections 2024-05-17T04:09:23.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:23.003+0000 7f2b46e6c640 1 --2- 172.21.15.131:0/1769609005 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b240762d0 0x7f2b240787e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:23.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:23.003+0000 7f2b46e6c640 1 --2- 172.21.15.131:0/1769609005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b38179510 0x7f2b3800bf20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:23.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:23.003+0000 7f2b46e6c640 1 --2- 172.21.15.131:0/1769609005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b380e76d0 0x7f2b38178fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:23.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:23.003+0000 7f2b46e6c640 1 --2- 172.21.15.131:0/1769609005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b38034e70 0x7f2b38037120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:23.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:23.003+0000 7f2b46e6c640 1 -- 172.21.15.131:0/1769609005 >> 172.21.15.131:0/1769609005 conn(0x7f2b3801ec70 msgr2=0x7f2b38033b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:23.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:23.003+0000 7f2b46e6c640 1 -- 172.21.15.131:0/1769609005 shutdown_connections 2024-05-17T04:09:23.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:23.003+0000 7f2b46e6c640 1 -- 172.21.15.131:0/1769609005 wait complete. 2024-05-17T04:09:23.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-05-17T04:09:23.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-05-17T04:09:23.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-05-17T04:09:23.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-05-17T04:09:23.998 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-17T04:09:23.999 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-17T04:09:24.005 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-17T04:09:24.005 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-17T04:09:24.007 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-17T04:09:24.009 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-17T04:09:24.012 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-17T04:09:24.018 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-17T04:09:24.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.176+0000 7f9e4305f640 1 Processor -- start 2024-05-17T04:09:24.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.177+0000 7f9e4305f640 1 -- start start 2024-05-17T04:09:24.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.182+0000 7f9e4305f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9e34033d10 0x7f9e34051830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.184+0000 7f9e4185c640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9e340337c0 0x7f9e3400a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:41028/0 (socket says 172.21.15.131:41028) 2024-05-17T04:09:24.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.184+0000 7fcd87562640 1 Processor -- start 2024-05-17T04:09:24.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.184+0000 7f9e4185c640 1 -- 172.21.15.131:0/1592653214 learned_addr learned my addr 172.21.15.131:0/1592653214 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:24.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.184+0000 7f9e4205d640 1 --2- 172.21.15.131:0/1592653214 >> v2:172.21.15.150:3300/0 conn(0x7f9e34033d10 0x7f9e34051830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.184+0000 7f9e4305f640 1 -- 172.21.15.131:0/1592653214 --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e34006860 con 0x7f9e3400a800 2024-05-17T04:09:24.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.184+0000 7f9e4305f640 1 -- 172.21.15.131:0/1592653214 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e34006b40 con 0x7f9e340337c0 2024-05-17T04:09:24.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.184+0000 7f9e4305f640 1 -- 172.21.15.131:0/1592653214 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f9e34006610 con 0x7f9e34033d10 2024-05-17T04:09:24.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.185+0000 7f9e4105b640 1 -- 172.21.15.131:0/1592653214 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2565100435 0 0) 0x7f9e34006b40 con 0x7f9e340337c0 2024-05-17T04:09:24.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.185+0000 7f9e4105b640 1 -- 172.21.15.131:0/1592653214 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e28003520 con 0x7f9e340337c0 2024-05-17T04:09:24.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.185+0000 7fcd87562640 1 -- start start 2024-05-17T04:09:24.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.186+0000 7f9e4205d640 1 -- 172.21.15.131:0/1592653214 >> v1:172.21.15.150:6789/0 conn(0x7f9e340337c0 legacy=0x7f9e3400a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.186+0000 7f9e4205d640 1 -- 172.21.15.131:0/1592653214 >> v1:172.21.15.131:6789/0 conn(0x7f9e3400a800 legacy=0x7f9e34052f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.186+0000 7f9e4205d640 1 -- 172.21.15.131:0/1592653214 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e34006e20 con 0x7f9e34033d10 2024-05-17T04:09:24.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.188+0000 7f9e4205d640 1 --2- 172.21.15.131:0/1592653214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e34033d10 0x7f9e34051830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009790 tx=0x7f9e3802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=875fe31bb2f10eda server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.189+0000 7f9e4105b640 1 -- 172.21.15.131:0/1592653214 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38037070 con 0x7f9e34033d10 2024-05-17T04:09:24.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.189+0000 7f9e4105b640 1 -- 172.21.15.131:0/1592653214 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e38032440 con 0x7f9e34033d10 2024-05-17T04:09:24.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.189+0000 7f9e4105b640 1 -- 172.21.15.131:0/1592653214 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38032810 con 0x7f9e34033d10 2024-05-17T04:09:24.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.192+0000 7f9e4305f640 1 -- 172.21.15.131:0/1592653214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e34033d10 msgr2=0x7f9e34051830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.192+0000 7f9e4305f640 1 --2- 172.21.15.131:0/1592653214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e34033d10 0x7f9e34051830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009790 tx=0x7f9e3802a270 comp rx=0 tx=0).stop 2024-05-17T04:09:24.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.189+0000 7fcd87562640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd8006d8c0 0x7fcd8006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.189+0000 7fcd87562640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcd80074050 0x7fcd80074460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.190+0000 7fcd87562640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8006c820 con 0x7fcd80070970 2024-05-17T04:09:24.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.190+0000 7fcd87562640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fcd80073200 con 0x7fcd80074050 2024-05-17T04:09:24.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.190+0000 7fcd87562640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcd8006cb00 con 0x7fcd8006d8c0 2024-05-17T04:09:24.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.190+0000 7fcd85aff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcd80074050 0x7fcd80074460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.194+0000 7f9e4305f640 1 -- 172.21.15.131:0/1592653214 shutdown_connections 2024-05-17T04:09:24.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.190+0000 7fcd85aff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcd80074050 0x7fcd80074460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43712/0 (socket says 172.21.15.131:43712) 2024-05-17T04:09:24.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.194+0000 7f9e4305f640 1 --2- 172.21.15.131:0/1592653214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e34033d10 0x7f9e34051830 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.190+0000 7fcd85aff640 1 -- 172.21.15.131:0/3776272783 learned_addr learned my addr 172.21.15.131:0/3776272783 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:24.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.194+0000 7f9e4305f640 1 -- 172.21.15.131:0/1592653214 >> 172.21.15.131:0/1592653214 conn(0x7f9e3401db60 msgr2=0x7f9e34039600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.191+0000 7fcd85aff640 1 -- 172.21.15.131:0/3776272783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd8006d8c0 msgr2=0x7fcd8006dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:24.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.191+0000 7fcd85aff640 1 --2- 172.21.15.131:0/3776272783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd8006d8c0 0x7fcd8006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.191+0000 7fcd85aff640 1 -- 172.21.15.131:0/3776272783 >> v1:172.21.15.150:6789/0 conn(0x7fcd80070970 legacy=0x7fcd8015b480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-17T04:09:24.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.191+0000 7fcd85aff640 1 -- 172.21.15.131:0/3776272783 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8006cde0 con 0x7fcd80074050 2024-05-17T04:09:24.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.194+0000 7f9e4305f640 1 -- 172.21.15.131:0/1592653214 shutdown_connections 2024-05-17T04:09:24.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.194+0000 7f9e4305f640 1 -- 172.21.15.131:0/1592653214 wait complete. 2024-05-17T04:09:24.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.195+0000 7fcd85aff640 1 --2- 172.21.15.131:0/3776272783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd80074050 0x7fcd80074460 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800ffd0 tx=0x7fcd7803b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a58c33f699341b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.197+0000 7fcd77fff640 1 -- 172.21.15.131:0/3776272783 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78047070 con 0x7fcd80074050 2024-05-17T04:09:24.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.197+0000 7fcd77fff640 1 -- 172.21.15.131:0/3776272783 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd78003b90 con 0x7fcd80074050 2024-05-17T04:09:24.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.198+0000 7fcd87562640 1 -- 172.21.15.131:0/3776272783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd80074050 msgr2=0x7fcd80074460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.198+0000 7fcd87562640 1 --2- 172.21.15.131:0/3776272783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd80074050 0x7fcd80074460 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800ffd0 tx=0x7fcd7803b440 comp rx=0 tx=0).stop 2024-05-17T04:09:24.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.199+0000 7f9e4305f640 1 Processor -- start 2024-05-17T04:09:24.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.199+0000 7f9e4305f640 1 -- start start 2024-05-17T04:09:24.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.199+0000 7fcd87562640 1 -- 172.21.15.131:0/3776272783 shutdown_connections 2024-05-17T04:09:24.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.199+0000 7fcd87562640 1 --2- 172.21.15.131:0/3776272783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd80074050 0x7fcd80074460 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.199+0000 7fcd87562640 1 --2- 172.21.15.131:0/3776272783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd8006d8c0 0x7fcd8006dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.199+0000 7fcd87562640 1 -- 172.21.15.131:0/3776272783 >> 172.21.15.131:0/3776272783 conn(0x7fcd8006e330 msgr2=0x7fcd8006e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.199+0000 7fcd87562640 1 -- 172.21.15.131:0/3776272783 shutdown_connections 2024-05-17T04:09:24.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.199+0000 7fcd87562640 1 -- 172.21.15.131:0/3776272783 wait complete. 2024-05-17T04:09:24.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.201+0000 7f9e4305f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e340337c0 0x7f9e340d1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.202+0000 7f9e4305f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e34033d10 0x7f9e3404fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.202+0000 7f9e4185c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e34033d10 0x7f9e3404fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.202+0000 7f9e4205d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e340337c0 0x7f9e340d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.202+0000 7f9e4205d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e340337c0 0x7f9e340d1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:60550/0 (socket says 172.21.15.131:60550) 2024-05-17T04:09:24.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.202+0000 7f9e4185c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e34033d10 0x7f9e3404fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43722/0 (socket says 172.21.15.131:43722) 2024-05-17T04:09:24.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.202+0000 7f9e4205d640 1 -- 172.21.15.131:0/3479327128 learned_addr learned my addr 172.21.15.131:0/3479327128 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:24.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.203+0000 7f9e4305f640 1 --2- 172.21.15.131:0/3479327128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e340d3660 0x7f9e34050320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.203+0000 7fcd87562640 1 Processor -- start 2024-05-17T04:09:24.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.203+0000 7fcd87562640 1 -- start start 2024-05-17T04:09:24.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.203+0000 7f9e4305f640 1 -- 172.21.15.131:0/3479327128 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9e34039d10 con 0x7f9e34033d10 2024-05-17T04:09:24.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.203+0000 7f9e4285e640 1 --2- 172.21.15.131:0/3479327128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e340d3660 0x7f9e34050320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.203+0000 7f9e4305f640 1 -- 172.21.15.131:0/3479327128 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9e34052a90 con 0x7f9e340337c0 2024-05-17T04:09:24.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.203+0000 7f9e4305f640 1 -- 172.21.15.131:0/3479327128 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9e34039e90 con 0x7f9e340d3660 2024-05-17T04:09:24.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.204+0000 7f9e4185c640 1 -- 172.21.15.131:0/3479327128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e340d3660 msgr2=0x7f9e34050320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.204+0000 7f9e4185c640 1 --2- 172.21.15.131:0/3479327128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e340d3660 0x7f9e34050320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.204+0000 7f9e4185c640 1 -- 172.21.15.131:0/3479327128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e340337c0 msgr2=0x7f9e340d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.204+0000 7f9e4185c640 1 --2- 172.21.15.131:0/3479327128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e340337c0 0x7f9e340d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.204+0000 7f9e4185c640 1 -- 172.21.15.131:0/3479327128 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e34034690 con 0x7f9e34033d10 2024-05-17T04:09:24.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.205+0000 7fcd87562640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd8006d8c0 0x7fcd800c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.205+0000 7f9e4185c640 1 --2- 172.21.15.131:0/3479327128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e34033d10 0x7f9e3404fde0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c064300 tx=0x7f9e3c075660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.206+0000 7fcd852fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd8006d8c0 0x7fcd800c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.206+0000 7fcd852fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd8006d8c0 0x7fcd800c9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43728/0 (socket says 172.21.15.131:43728) 2024-05-17T04:09:24.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.206+0000 7f9e32ffd640 1 -- 172.21.15.131:0/3479327128 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c076300 con 0x7f9e34033d10 2024-05-17T04:09:24.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.206+0000 7f9e32ffd640 1 -- 172.21.15.131:0/3479327128 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e3c075790 con 0x7f9e34033d10 2024-05-17T04:09:24.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.206+0000 7f9e32ffd640 1 -- 172.21.15.131:0/3479327128 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c06c930 con 0x7f9e34033d10 2024-05-17T04:09:24.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.206+0000 7f9e4305f640 1 -- 172.21.15.131:0/3479327128 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e34034970 con 0x7f9e34033d10 2024-05-17T04:09:24.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.206+0000 7fcd852fe640 1 -- 172.21.15.131:0/1349121871 learned_addr learned my addr 172.21.15.131:0/1349121871 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:24.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.206+0000 7fcd87562640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd80070970 0x7fcd800cc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.206+0000 7fcd87562640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd80074050 0x7fcd800cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.206+0000 7fcd87562640 1 -- 172.21.15.131:0/1349121871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcd800b4c10 con 0x7fcd8006d8c0 2024-05-17T04:09:24.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.206+0000 7fcd87562640 1 -- 172.21.15.131:0/1349121871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8006d3a0 con 0x7fcd80070970 2024-05-17T04:09:24.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.206+0000 7fcd84afd640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd80070970 0x7fcd800cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.206+0000 7fcd85aff640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd80074050 0x7fcd800cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.206+0000 7fcd87562640 1 -- 172.21.15.131:0/1349121871 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcd800b4d90 con 0x7fcd80074050 2024-05-17T04:09:24.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.207+0000 7fcd852fe640 1 -- 172.21.15.131:0/1349121871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd80074050 msgr2=0x7fcd800cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.207+0000 7fcd852fe640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd80074050 0x7fcd800cce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.207+0000 7fcd852fe640 1 -- 172.21.15.131:0/1349121871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd80070970 msgr2=0x7fcd800cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.207+0000 7fcd852fe640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd80070970 0x7fcd800cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.207+0000 7fcd852fe640 1 -- 172.21.15.131:0/1349121871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd800c9aa0 con 0x7fcd8006d8c0 2024-05-17T04:09:24.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.208+0000 7fcd852fe640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd8006d8c0 0x7fcd800c9560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00b780 tx=0x7fcd7c00bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.208+0000 7fcd84afd640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd80070970 0x7fcd800cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:24.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.209+0000 7fcd75ffb640 1 -- 172.21.15.131:0/1349121871 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c019070 con 0x7fcd8006d8c0 2024-05-17T04:09:24.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.210+0000 7f9e32ffd640 1 -- 172.21.15.131:0/3479327128 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9e3c06cad0 con 0x7f9e34033d10 2024-05-17T04:09:24.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.209+0000 7fcd75ffb640 1 -- 172.21.15.131:0/1349121871 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd7c00c740 con 0x7fcd8006d8c0 2024-05-17T04:09:24.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.209+0000 7fcd87562640 1 -- 172.21.15.131:0/1349121871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd80148290 con 0x7fcd8006d8c0 2024-05-17T04:09:24.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.209+0000 7fcd75ffb640 1 -- 172.21.15.131:0/1349121871 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c00cb30 con 0x7fcd8006d8c0 2024-05-17T04:09:24.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.209+0000 7fcd87562640 1 -- 172.21.15.131:0/1349121871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd80148850 con 0x7fcd8006d8c0 2024-05-17T04:09:24.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.210+0000 7f9e32ffd640 1 --2- 172.21.15.131:0/3479327128 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e20076320 0x7f9e20078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.211+0000 7f9e4205d640 1 --2- 172.21.15.131:0/3479327128 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e20076320 0x7f9e20078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.211+0000 7f9e4305f640 1 -- 172.21.15.131:0/3479327128 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e34034f30 con 0x7f9e34033d10 2024-05-17T04:09:24.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.212+0000 7f9e32ffd640 1 -- 172.21.15.131:0/3479327128 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9e3c06cdc0 con 0x7f9e34033d10 2024-05-17T04:09:24.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.213+0000 7fcd87562640 1 -- 172.21.15.131:0/1349121871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd60005290 con 0x7fcd8006d8c0 2024-05-17T04:09:24.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.213+0000 7fcd75ffb640 1 -- 172.21.15.131:0/1349121871 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcd7c01c070 con 0x7fcd8006d8c0 2024-05-17T04:09:24.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.214+0000 7f9e4305f640 1 -- 172.21.15.131:0/3479327128 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e34008a90 con 0x7f9e34033d10 2024-05-17T04:09:24.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.219+0000 7fcd75ffb640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fcd6c076520 0x7fcd6c078a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.219+0000 7fcd75ffb640 1 -- 172.21.15.131:0/1349121871 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcd7c096df0 con 0x7fcd8006d8c0 2024-05-17T04:09:24.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.220+0000 7f9e4205d640 1 --2- 172.21.15.131:0/3479327128 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e20076320 0x7f9e20078830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009500 tx=0x7f9e3802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.220+0000 7fcd84afd640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fcd6c076520 0x7fcd6c078a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.221+0000 7fcd84afd640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fcd6c076520 0x7fcd6c078a30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcd8015a2a0 tx=0x7fcd70008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.228+0000 7fcd75ffb640 1 -- 172.21.15.131:0/1349121871 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcd7c05fd60 con 0x7fcd8006d8c0 2024-05-17T04:09:24.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.237+0000 7f9e32ffd640 1 -- 172.21.15.131:0/3479327128 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9e3c0dbbe0 con 0x7f9e34033d10 2024-05-17T04:09:24.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.253+0000 7fa837fac640 1 Processor -- start 2024-05-17T04:09:24.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.255+0000 7fb7eb2c1640 1 Processor -- start 2024-05-17T04:09:24.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.256+0000 7fb7eb2c1640 1 -- start start 2024-05-17T04:09:24.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.254+0000 7fa837fac640 1 -- start start 2024-05-17T04:09:24.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.256+0000 7fe5f803c640 1 Processor -- start 2024-05-17T04:09:24.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.256+0000 7fa837fac640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa83015b480 0x7fa83006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.256+0000 7fa837fac640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8300b4c10 0x7fa8300b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.256+0000 7fa837fac640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8300b5560 con 0x7fa83006de00 2024-05-17T04:09:24.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.256+0000 7fa837fac640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa830073200 con 0x7fa8300b4c10 2024-05-17T04:09:24.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.256+0000 7fa837fac640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa83006c820 con 0x7fa83015b480 2024-05-17T04:09:24.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.257+0000 7fa835547640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa83006de00 0x7fa830074050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:41044/0 (socket says 172.21.15.131:41044) 2024-05-17T04:09:24.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.257+0000 7fa835547640 1 -- 172.21.15.131:0/691827217 learned_addr learned my addr 172.21.15.131:0/691827217 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:24.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.257+0000 7fa836549640 1 --2- 172.21.15.131:0/691827217 >> v2:172.21.15.150:3300/0 conn(0x7fa8300b4c10 0x7fa8300b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.257+0000 7fa834d46640 1 -- 172.21.15.131:0/691827217 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 338852169 0 0) 0x7fa82c004900 con 0x7fa83006de00 2024-05-17T04:09:24.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.257+0000 7fa834d46640 1 -- 172.21.15.131:0/691827217 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa81c005730 con 0x7fa83006de00 2024-05-17T04:09:24.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.257+0000 7fa836549640 1 -- 172.21.15.131:0/691827217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa83015b480 msgr2=0x7fa83006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:24.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.257+0000 7fa835d48640 1 --2- 172.21.15.131:0/691827217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa83015b480 0x7fa83006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.257+0000 7fa836549640 1 --2- 172.21.15.131:0/691827217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa83015b480 0x7fa83006d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.257+0000 7fa836549640 1 -- 172.21.15.131:0/691827217 >> v1:172.21.15.150:6789/0 conn(0x7fa83006de00 legacy=0x7fa830074050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.257+0000 7fa836549640 1 -- 172.21.15.131:0/691827217 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83006cb00 con 0x7fa8300b4c10 2024-05-17T04:09:24.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.258+0000 7fa835d48640 1 --2- 172.21.15.131:0/691827217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa83015b480 0x7fa83006d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:24.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.256+0000 7fe5f803c640 1 -- start start 2024-05-17T04:09:24.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.258+0000 7fb7eb2c1640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e406d8c0 0x7fb7e406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.258+0000 7fb7eb2c1640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb7e4074050 0x7fb7e4074460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.258+0000 7fb7eb2c1640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e406cb00 con 0x7fb7e4070970 2024-05-17T04:09:24.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.258+0000 7fb7eb2c1640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fb7e415b9b0 con 0x7fb7e4074050 2024-05-17T04:09:24.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.258+0000 7fb7eb2c1640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e4073200 con 0x7fb7e406d8c0 2024-05-17T04:09:24.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.258+0000 7fb7e905d640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb7e4070970 0x7fb7e415b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:41056/0 (socket says 172.21.15.131:41056) 2024-05-17T04:09:24.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.258+0000 7fb7e905d640 1 -- 172.21.15.131:0/300815137 learned_addr learned my addr 172.21.15.131:0/300815137 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:24.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.258+0000 7fb7e885c640 1 --2- 172.21.15.131:0/300815137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e406d8c0 0x7fb7e406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.258+0000 7fa836549640 1 --2- 172.21.15.131:0/691827217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8300b4c10 0x7fa8300b5020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa82800aea0 tx=0x7fa82802a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69dcdc4a9eadab server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fccc7fff640 1 Processor -- start 2024-05-17T04:09:24.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fb7dbfff640 1 -- 172.21.15.131:0/300815137 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1221465830 0 0) 0x7fb7e406cb00 con 0x7fb7e4070970 2024-05-17T04:09:24.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fb7dbfff640 1 -- 172.21.15.131:0/300815137 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7d0003520 con 0x7fb7e4070970 2024-05-17T04:09:24.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fb7e885c640 1 -- 172.21.15.131:0/300815137 >> v2:172.21.15.150:3300/0 conn(0x7fb7e4074050 msgr2=0x7fb7e4074460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:24.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fccc7fff640 1 -- start start 2024-05-17T04:09:24.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fa834d46640 1 -- 172.21.15.131:0/691827217 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828036070 con 0x7fa8300b4c10 2024-05-17T04:09:24.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fa834d46640 1 -- 172.21.15.131:0/691827217 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa828008440 con 0x7fa8300b4c10 2024-05-17T04:09:24.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fa834d46640 1 -- 172.21.15.131:0/691827217 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828008810 con 0x7fa8300b4c10 2024-05-17T04:09:24.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fe5f803c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5f00b5320 0x7fe5f0074460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fe5f803c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f006c820 con 0x7fe5f0074050 2024-05-17T04:09:24.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fe5f803c640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f006cb00 con 0x7fe5f015b480 2024-05-17T04:09:24.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fe5f803c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f0073200 con 0x7fe5f00b5320 2024-05-17T04:09:24.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fe5f65d9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5f00b5320 0x7fe5f0074460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fe5f65d9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5f00b5320 0x7fe5f0074460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:48654/0 (socket says 172.21.15.131:48654) 2024-05-17T04:09:24.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fe5f65d9640 1 -- 172.21.15.131:0/584273670 learned_addr learned my addr 172.21.15.131:0/584273670 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:24.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fb7e985e640 1 --2- 172.21.15.131:0/300815137 >> v2:172.21.15.150:3300/0 conn(0x7fb7e4074050 0x7fb7e4074460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fb7e885c640 1 --2- 172.21.15.131:0/300815137 >> v2:172.21.15.150:3300/0 conn(0x7fb7e4074050 0x7fb7e4074460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fb7e885c640 1 -- 172.21.15.131:0/300815137 >> v1:172.21.15.150:6789/0 conn(0x7fb7e4070970 legacy=0x7fb7e415b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fb7e885c640 1 -- 172.21.15.131:0/300815137 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e406cde0 con 0x7fb7e406d8c0 2024-05-17T04:09:24.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.259+0000 7fb7e985e640 1 --2- 172.21.15.131:0/300815137 >> v2:172.21.15.150:3300/0 conn(0x7fb7e4074050 0x7fb7e4074460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:24.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.260+0000 7fb7e885c640 1 --2- 172.21.15.131:0/300815137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e406d8c0 0x7fb7e406dcd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009d90 tx=0x7fb7dc02a550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bca1fcdb6b45c2d server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.260+0000 7fe5f65d9640 1 -- 172.21.15.131:0/584273670 >> v1:172.21.15.150:6789/0 conn(0x7fe5f015b480 legacy=0x7fe5f006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.260+0000 7fe5f4dd6640 1 -- 172.21.15.131:0/584273670 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1516256213 0 0) 0x7fe5f006c820 con 0x7fe5f0074050 2024-05-17T04:09:24.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.260+0000 7fe5f65d9640 1 -- 172.21.15.131:0/584273670 >> v1:172.21.15.131:6789/0 conn(0x7fe5f0074050 legacy=0x7fe5f00b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fccc7fff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fccc00e6ba0 0x7fccc00e6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fccc7fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc0057ba0 0x7fccc0057fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fe5f65d9640 1 -- 172.21.15.131:0/584273670 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f006cde0 con 0x7fe5f00b5320 2024-05-17T04:09:24.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fccc7fff640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccc00e74f0 con 0x7fccc00e3200 2024-05-17T04:09:24.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fccc7fff640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fccc00069b0 con 0x7fccc00e6ba0 2024-05-17T04:09:24.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fccc7fff640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fccc0007550 con 0x7fccc0057ba0 2024-05-17T04:09:24.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fa837fac640 1 -- 172.21.15.131:0/691827217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8300b4c10 msgr2=0x7fa8300b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fa837fac640 1 --2- 172.21.15.131:0/691827217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8300b4c10 0x7fa8300b5020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa82800aea0 tx=0x7fa82802a620 comp rx=0 tx=0).stop 2024-05-17T04:09:24.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fccc77fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc0057ba0 0x7fccc0057fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fccc77fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc0057ba0 0x7fccc0057fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:48658/0 (socket says 172.21.15.131:48658) 2024-05-17T04:09:24.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fccc77fe640 1 -- 172.21.15.131:0/1602775571 learned_addr learned my addr 172.21.15.131:0/1602775571 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:24.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fa837fac640 1 -- 172.21.15.131:0/691827217 shutdown_connections 2024-05-17T04:09:24.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fa837fac640 1 --2- 172.21.15.131:0/691827217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8300b4c10 0x7fa8300b5020 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fa837fac640 1 --2- 172.21.15.131:0/691827217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa83015b480 0x7fa83006d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fa837fac640 1 -- 172.21.15.131:0/691827217 >> 172.21.15.131:0/691827217 conn(0x7fa83006e330 msgr2=0x7fa83006e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fccc67fc640 1 --2- 172.21.15.131:0/1602775571 >> v2:172.21.15.150:3300/0 conn(0x7fccc00e6ba0 0x7fccc00e6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7f3d411dd640 1 Processor -- start 2024-05-17T04:09:24.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.260+0000 7fb7dbfff640 1 -- 172.21.15.131:0/300815137 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc007740 con 0x7fb7e406d8c0 2024-05-17T04:09:24.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.260+0000 7fb7dbfff640 1 -- 172.21.15.131:0/300815137 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7dc0078e0 con 0x7fb7e406d8c0 2024-05-17T04:09:24.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fccc77fe640 1 -- 172.21.15.131:0/1602775571 >> v2:172.21.15.150:3300/0 conn(0x7fccc00e6ba0 msgr2=0x7fccc00e6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:24.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fccc77fe640 1 --2- 172.21.15.131:0/1602775571 >> v2:172.21.15.150:3300/0 conn(0x7fccc00e6ba0 0x7fccc00e6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fccc77fe640 1 -- 172.21.15.131:0/1602775571 >> v1:172.21.15.150:6789/0 conn(0x7fccc00e3200 legacy=0x7fccc0006e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fa837fac640 1 -- 172.21.15.131:0/691827217 shutdown_connections 2024-05-17T04:09:24.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fccc77fe640 1 -- 172.21.15.131:0/1602775571 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc0005da0 con 0x7fccc0057ba0 2024-05-17T04:09:24.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/300815137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e406d8c0 msgr2=0x7fb7e406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fb7eb2c1640 1 --2- 172.21.15.131:0/300815137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e406d8c0 0x7fb7e406dcd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009d90 tx=0x7fb7dc02a550 comp rx=0 tx=0).stop 2024-05-17T04:09:24.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.262+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/300815137 shutdown_connections 2024-05-17T04:09:24.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.262+0000 7fb7eb2c1640 1 --2- 172.21.15.131:0/300815137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e406d8c0 0x7fb7e406dcd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.262+0000 7fb7eb2c1640 1 --2- 172.21.15.131:0/300815137 >> v2:172.21.15.150:3300/0 conn(0x7fb7e4074050 0x7fb7e4074460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.262+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/300815137 >> 172.21.15.131:0/300815137 conn(0x7fb7e406e330 msgr2=0x7fb7e406e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.262+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/300815137 shutdown_connections 2024-05-17T04:09:24.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.262+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/300815137 wait complete. 2024-05-17T04:09:24.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.262+0000 7fe5f65d9640 1 --2- 172.21.15.131:0/584273670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5f00b5320 0x7fe5f0074460 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009b80 tx=0x7fe5e802bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=280176534ff95953 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.261+0000 7fa837fac640 1 -- 172.21.15.131:0/691827217 wait complete. 2024-05-17T04:09:24.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.262+0000 7fe5f4dd6640 1 -- 172.21.15.131:0/584273670 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8033070 con 0x7fe5f00b5320 2024-05-17T04:09:24.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.262+0000 7fe5f4dd6640 1 -- 172.21.15.131:0/584273670 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e802f620 con 0x7fe5f00b5320 2024-05-17T04:09:24.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.262+0000 7fe5f4dd6640 1 -- 172.21.15.131:0/584273670 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e802f9f0 con 0x7fe5f00b5320 2024-05-17T04:09:24.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.262+0000 7fccc77fe640 1 --2- 172.21.15.131:0/1602775571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc0057ba0 0x7fccc0057fb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009870 tx=0x7fccbc02a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e8636bfa0d084e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.263+0000 7fccc5ffb640 1 -- 172.21.15.131:0/1602775571 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc037070 con 0x7fccc0057ba0 2024-05-17T04:09:24.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.263+0000 7fccc5ffb640 1 -- 172.21.15.131:0/1602775571 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccbc032440 con 0x7fccc0057ba0 2024-05-17T04:09:24.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.263+0000 7fccc5ffb640 1 -- 172.21.15.131:0/1602775571 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc032810 con 0x7fccc0057ba0 2024-05-17T04:09:24.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.263+0000 7ff4450ba640 1 Processor -- start 2024-05-17T04:09:24.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.263+0000 7ff4450ba640 1 -- start start 2024-05-17T04:09:24.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.263+0000 7fe5f803c640 1 -- 172.21.15.131:0/584273670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5f00b5320 msgr2=0x7fe5f0074460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.263+0000 7fe5f803c640 1 --2- 172.21.15.131:0/584273670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5f00b5320 0x7fe5f0074460 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009b80 tx=0x7fe5e802bab0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.263+0000 7f3d411dd640 1 -- start start 2024-05-17T04:09:24.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.264+0000 7fe5f803c640 1 -- 172.21.15.131:0/584273670 shutdown_connections 2024-05-17T04:09:24.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.264+0000 7fe5f803c640 1 --2- 172.21.15.131:0/584273670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5f00b5320 0x7fe5f0074460 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.264+0000 7fe5f803c640 1 -- 172.21.15.131:0/584273670 >> 172.21.15.131:0/584273670 conn(0x7fe5f006e330 msgr2=0x7fe5f006e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.264+0000 7fccc7fff640 1 -- 172.21.15.131:0/1602775571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc0057ba0 msgr2=0x7fccc0057fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.264+0000 7fccc7fff640 1 --2- 172.21.15.131:0/1602775571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc0057ba0 0x7fccc0057fb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009870 tx=0x7fccbc02a140 comp rx=0 tx=0).stop 2024-05-17T04:09:24.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.264+0000 7fccc7fff640 1 -- 172.21.15.131:0/1602775571 shutdown_connections 2024-05-17T04:09:24.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.264+0000 7fccc7fff640 1 --2- 172.21.15.131:0/1602775571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc0057ba0 0x7fccc0057fb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.264+0000 7fccc7fff640 1 --2- 172.21.15.131:0/1602775571 >> v2:172.21.15.150:3300/0 conn(0x7fccc00e6ba0 0x7fccc00e6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.264+0000 7fccc7fff640 1 -- 172.21.15.131:0/1602775571 >> 172.21.15.131:0/1602775571 conn(0x7fccc003a740 msgr2=0x7fccc003ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.264+0000 7fccc7fff640 1 -- 172.21.15.131:0/1602775571 shutdown_connections 2024-05-17T04:09:24.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.264+0000 7fccc7fff640 1 -- 172.21.15.131:0/1602775571 wait complete. 2024-05-17T04:09:24.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.265+0000 7fe5f803c640 1 -- 172.21.15.131:0/584273670 shutdown_connections 2024-05-17T04:09:24.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.265+0000 7fe5f803c640 1 -- 172.21.15.131:0/584273670 wait complete. 2024-05-17T04:09:24.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.265+0000 7fa837fac640 1 Processor -- start 2024-05-17T04:09:24.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.265+0000 7fb7eb2c1640 1 Processor -- start 2024-05-17T04:09:24.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.265+0000 7fa837fac640 1 -- start start 2024-05-17T04:09:24.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.265+0000 7ff4450ba640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff4400aff40 0x7ff4400b5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.266+0000 7ff43ed9d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff4400aff40 0x7ff4400b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.266+0000 7ff43ed9d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff4400aff40 0x7ff4400b5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43744/0 (socket says 172.21.15.131:43744) 2024-05-17T04:09:24.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.266+0000 7ff4450ba640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4400b4200 0x7ff4400b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.266+0000 7ff43ed9d640 1 -- 172.21.15.131:0/3016232131 learned_addr learned my addr 172.21.15.131:0/3016232131 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:24.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.265+0000 7fb7eb2c1640 1 -- start start 2024-05-17T04:09:24.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.266+0000 7ff43f59e640 1 --2- 172.21.15.131:0/3016232131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4400b4200 0x7ff4400b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.266+0000 7ff4450ba640 1 -- 172.21.15.131:0/3016232131 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4400b4b50 con 0x7ff44015e410 2024-05-17T04:09:24.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.266+0000 7ff4450ba640 1 -- 172.21.15.131:0/3016232131 --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff4400cdb50 con 0x7ff4400aff40 2024-05-17T04:09:24.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.266+0000 7ff4450ba640 1 -- 172.21.15.131:0/3016232131 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff4400b0350 con 0x7ff4400b4200 2024-05-17T04:09:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.265+0000 7f3d411dd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d340e7670 0x7f3d34006f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.266+0000 7f3d411dd640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d340524b0 con 0x7f3d340329a0 2024-05-17T04:09:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.266+0000 7f3d411dd640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d34052790 con 0x7f3d3401d760 2024-05-17T04:09:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.266+0000 7f3d411dd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3d34006780 con 0x7f3d340e7670 2024-05-17T04:09:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.266+0000 7f3d3bfff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f3d340329a0 0x7f3d34053f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34716/0 (socket says 172.21.15.131:34716) 2024-05-17T04:09:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.266+0000 7f3d3bfff640 1 -- 172.21.15.131:0/2771315483 learned_addr learned my addr 172.21.15.131:0/2771315483 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.266+0000 7f3d3b7fe640 1 --2- 172.21.15.131:0/2771315483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d340e7670 0x7f3d34006f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426063016 0 0) 0x7f3d340524b0 con 0x7f3d340329a0 2024-05-17T04:09:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d2c003520 con 0x7f3d340329a0 2024-05-17T04:09:24.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785567261 0 0) 0x7f3d34052790 con 0x7f3d3401d760 2024-05-17T04:09:24.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d340524b0 con 0x7f3d3401d760 2024-05-17T04:09:24.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 -- 172.21.15.131:0/3016232131 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 989644478 0 0) 0x7ff4400b4b50 con 0x7ff44015e410 2024-05-17T04:09:24.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 -- 172.21.15.131:0/3016232131 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff42c003520 con 0x7ff44015e410 2024-05-17T04:09:24.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 -- 172.21.15.131:0/3016232131 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4127514993 0 0) 0x7ff42c003520 con 0x7ff44015e410 2024-05-17T04:09:24.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 -- 172.21.15.131:0/3016232131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4400b4200 msgr2=0x7ff4400b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:24.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 --2- 172.21.15.131:0/3016232131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4400b4200 0x7ff4400b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 -- 172.21.15.131:0/3016232131 >> v2:172.21.15.131:3300/0 conn(0x7ff4400aff40 msgr2=0x7ff4400b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:24.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 --2- 172.21.15.131:0/3016232131 >> v2:172.21.15.131:3300/0 conn(0x7ff4400aff40 0x7ff4400b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7fccc7fff640 1 Processor -- start 2024-05-17T04:09:24.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7fccc7fff640 1 -- start start 2024-05-17T04:09:24.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7fa837fac640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa83006de00 0x7fa83015e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7fa837fac640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8300b4c10 0x7fa83014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7fa837fac640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa83015b480 0x7fa83014d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7fe5f803c640 1 Processor -- start 2024-05-17T04:09:24.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7fe5f803c640 1 -- start start 2024-05-17T04:09:24.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4108293360 0 0) 0x7f3d340524b0 con 0x7f3d3401d760 2024-05-17T04:09:24.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d340e7670 msgr2=0x7f3d34006f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:24.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7f3d3affd640 1 --2- 172.21.15.131:0/2771315483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d340e7670 0x7f3d34006f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 >> v1:172.21.15.131:6789/0 conn(0x7f3d340329a0 legacy=0x7f3d34053f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d34006a60 con 0x7f3d3401d760 2024-05-17T04:09:24.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7f3d3c0508e0 con 0x7f3d3401d760 2024-05-17T04:09:24.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 >> v1:172.21.15.150:6789/0 conn(0x7f3d3401d760 legacy=0x7f3d3401db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7f3d3affd640 1 --2- 172.21.15.131:0/2771315483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d2c004ba0 0x7f3d2c004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7f3d3affd640 1 --2- 172.21.15.131:0/2771315483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d2c0037a0 0x7f3d2c003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7f3d3affd640 1 --2- 172.21.15.131:0/2771315483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d2c0040f0 0x7f3d2c00ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3d34006780 con 0x7f3d2c0040f0 2024-05-17T04:09:24.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2c00bf80 con 0x7f3d2c0037a0 2024-05-17T04:09:24.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2c00c180 con 0x7f3d2c004ba0 2024-05-17T04:09:24.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7fa835547640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8300b4c10 0x7fa83014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7fa835547640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8300b4c10 0x7fa83014fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:48684/0 (socket says 172.21.15.131:48684) 2024-05-17T04:09:24.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7fa835547640 1 -- 172.21.15.131:0/3063496152 learned_addr learned my addr 172.21.15.131:0/3063496152 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:24.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7fa836549640 1 --2- 172.21.15.131:0/3063496152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa83015b480 0x7fa83014d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 -- 172.21.15.131:0/3016232131 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4400b0620 con 0x7ff44015e410 2024-05-17T04:09:24.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 -- 172.21.15.131:0/3016232131 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7ff4280016f0 con 0x7ff44015e410 2024-05-17T04:09:24.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 -- 172.21.15.131:0/3016232131 >> v1:172.21.15.150:6789/0 conn(0x7ff44015e410 legacy=0x7ff4400cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 --2- 172.21.15.131:0/3016232131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff42c003a00 0x7ff42c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 --2- 172.21.15.131:0/3016232131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff42c004800 0x7ff42c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 --2- 172.21.15.131:0/3016232131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff42c0053f0 0x7ff42c00ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 -- 172.21.15.131:0/3016232131 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff4400cdb50 con 0x7ff42c003a00 2024-05-17T04:09:24.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 -- 172.21.15.131:0/3016232131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff4400b0350 con 0x7ff42c004800 2024-05-17T04:09:24.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43e59c640 1 -- 172.21.15.131:0/3016232131 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff42c00c390 con 0x7ff42c0053f0 2024-05-17T04:09:24.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43ed9d640 1 --2- 172.21.15.131:0/3016232131 >> v2:172.21.15.131:3300/0 conn(0x7ff4400aff40 0x7ff4400b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:24.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43659c640 1 --2- 172.21.15.131:0/3016232131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff42c004800 0x7ff42c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43f59e640 1 --2- 172.21.15.131:0/3016232131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4400b4200 0x7ff4400b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:24.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7ff43ed9d640 1 --2- 172.21.15.131:0/3016232131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff42c003a00 0x7ff42c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7ff43f59e640 1 --2- 172.21.15.131:0/3016232131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff42c0053f0 0x7ff42c00ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7ff43659c640 1 -- 172.21.15.131:0/3016232131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff42c0053f0 msgr2=0x7ff42c00ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:24.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7ff43659c640 1 --2- 172.21.15.131:0/3016232131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff42c0053f0 0x7ff42c00ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7ff43659c640 1 -- 172.21.15.131:0/3016232131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff42c003a00 msgr2=0x7ff42c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:24.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7ff43659c640 1 --2- 172.21.15.131:0/3016232131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff42c003a00 0x7ff42c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7f3d409dc640 1 --2- 172.21.15.131:0/2771315483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d2c0040f0 0x7f3d2c00ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7ff43659c640 1 -- 172.21.15.131:0/3016232131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4400b0620 con 0x7ff42c004800 2024-05-17T04:09:24.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7f3d3bfff640 1 --2- 172.21.15.131:0/2771315483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d2c004ba0 0x7f3d2c004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.267+0000 7fb7eb2c1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7e406d8c0 0x7fb7e4154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7f3d3b7fe640 1 --2- 172.21.15.131:0/2771315483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d340e7670 0x7f3d34006f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:24.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.268+0000 7fa835d48640 1 --2- 172.21.15.131:0/3063496152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa83006de00 0x7fa83015e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7fa837fac640 1 -- 172.21.15.131:0/3063496152 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa83006d3a0 con 0x7fa83015b480 2024-05-17T04:09:24.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7fb7eb2c1640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e4070970 0x7fb7e415e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7fb7eb2c1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7e4074050 0x7fb7e40c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7fb7eb2c1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e40b4c10 con 0x7fb7e406d8c0 2024-05-17T04:09:24.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7fa837fac640 1 -- 172.21.15.131:0/3063496152 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa83006cea0 con 0x7fa83006de00 2024-05-17T04:09:24.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7fb7e905d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7e406d8c0 0x7fb7e4154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7fb7e905d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7e406d8c0 0x7fb7e4154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43746/0 (socket says 172.21.15.131:43746) 2024-05-17T04:09:24.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7fb7e905d640 1 -- 172.21.15.131:0/434585237 learned_addr learned my addr 172.21.15.131:0/434585237 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:24.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/434585237 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e406d3a0 con 0x7fb7e4074050 2024-05-17T04:09:24.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/434585237 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e40b4d90 con 0x7fb7e4070970 2024-05-17T04:09:24.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7fb7e985e640 1 --2- 172.21.15.131:0/434585237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7e4074050 0x7fb7e40c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7fb7e885c640 1 --2- 172.21.15.131:0/434585237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e4070970 0x7fb7e415e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7fa837fac640 1 -- 172.21.15.131:0/3063496152 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa830074760 con 0x7fa8300b4c10 2024-05-17T04:09:24.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7f3d409dc640 1 -- 172.21.15.131:0/2771315483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d2c004ba0 msgr2=0x7f3d2c004fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:24.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7f3d409dc640 1 --2- 172.21.15.131:0/2771315483 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d2c004ba0 0x7f3d2c004fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7f3d409dc640 1 -- 172.21.15.131:0/2771315483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d2c0037a0 msgr2=0x7f3d2c003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:24.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7f3d409dc640 1 --2- 172.21.15.131:0/2771315483 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d2c0037a0 0x7f3d2c003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7f3d409dc640 1 -- 172.21.15.131:0/2771315483 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d340524b0 con 0x7f3d2c0040f0 2024-05-17T04:09:24.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fb7e905d640 1 -- 172.21.15.131:0/434585237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e4070970 msgr2=0x7fb7e415e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fb7e905d640 1 --2- 172.21.15.131:0/434585237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e4070970 0x7fb7e415e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fb7e905d640 1 -- 172.21.15.131:0/434585237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7e4074050 msgr2=0x7fb7e40c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fb7e905d640 1 --2- 172.21.15.131:0/434585237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7e4074050 0x7fb7e40c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fb7e905d640 1 -- 172.21.15.131:0/434585237 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e415cc40 con 0x7fb7e406d8c0 2024-05-17T04:09:24.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fccc7fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc0057ba0 0x7fccc0051300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fccc7fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc00e3200 0x7fccc00cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fccc7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccc00e6ba0 0x7fccc00ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fb7e905d640 1 --2- 172.21.15.131:0/434585237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7e406d8c0 0x7fb7e4154020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c410 tx=0x7fb7e000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.269+0000 7ff43659c640 1 --2- 172.21.15.131:0/3016232131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff42c004800 0x7ff42c004c10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff428007970 tx=0x7ff42c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7513d3d97d2549b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fccc7fff640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fccc0006640 con 0x7fccc0057ba0 2024-05-17T04:09:24.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fccc7fff640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fccc0006360 con 0x7fccc00e6ba0 2024-05-17T04:09:24.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fccc7fff640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fccc00584f0 con 0x7fccc00e3200 2024-05-17T04:09:24.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fa835547640 1 -- 172.21.15.131:0/3063496152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa83006de00 msgr2=0x7fa83015e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fa835547640 1 --2- 172.21.15.131:0/3063496152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa83006de00 0x7fa83015e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fa835547640 1 -- 172.21.15.131:0/3063496152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa83015b480 msgr2=0x7fa83014d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fa835547640 1 --2- 172.21.15.131:0/3063496152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa83015b480 0x7fa83014d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fa835547640 1 -- 172.21.15.131:0/3063496152 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83015ca60 con 0x7fa8300b4c10 2024-05-17T04:09:24.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7ff43e59c640 1 -- 172.21.15.131:0/3016232131 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff428036070 con 0x7ff42c004800 2024-05-17T04:09:24.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fccc6ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc0057ba0 0x7fccc0051300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fccc6ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc0057ba0 0x7fccc0051300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43766/0 (socket says 172.21.15.131:43766) 2024-05-17T04:09:24.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fccc6ffd640 1 -- 172.21.15.131:0/2336134965 learned_addr learned my addr 172.21.15.131:0/2336134965 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:24.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7fe5f803c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5f0074050 0x7fe5f0156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7ff43e59c640 1 -- 172.21.15.131:0/3016232131 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff42802ae50 con 0x7ff42c004800 2024-05-17T04:09:24.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.270+0000 7ff43e59c640 1 -- 172.21.15.131:0/3016232131 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff428012dd0 con 0x7ff42c004800 2024-05-17T04:09:24.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7f3d409dc640 1 --2- 172.21.15.131:0/2771315483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d2c0040f0 0x7f3d2c00ba40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c051b50 tx=0x7f3d2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e833201b4843e00 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fb7d9ffb640 1 -- 172.21.15.131:0/434585237 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0017070 con 0x7fb7e406d8c0 2024-05-17T04:09:24.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fb7d9ffb640 1 -- 172.21.15.131:0/434585237 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e0005ce0 con 0x7fb7e406d8c0 2024-05-17T04:09:24.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fa835547640 1 --2- 172.21.15.131:0/3063496152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8300b4c10 0x7fa83014fe80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa82c006110 tx=0x7fa82c00da40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fb7d9ffb640 1 -- 172.21.15.131:0/434585237 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00072d0 con 0x7fb7e406d8c0 2024-05-17T04:09:24.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/434585237 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e415d140 con 0x7fb7e406d8c0 2024-05-17T04:09:24.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fccc67fc640 1 --2- 172.21.15.131:0/2336134965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc00e3200 0x7fccc00cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fe5f5dd8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5f0074050 0x7fe5f0156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fe5f5dd8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5f0074050 0x7fe5f0156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43774/0 (socket says 172.21.15.131:43774) 2024-05-17T04:09:24.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fe5f5dd8640 1 -- 172.21.15.131:0/245610492 learned_addr learned my addr 172.21.15.131:0/245610492 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:24.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c0b4070 con 0x7f3d2c0040f0 2024-05-17T04:09:24.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fe5f803c640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5f015b480 0x7fe5f0150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fccc6ffd640 1 -- 172.21.15.131:0/2336134965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc00e3200 msgr2=0x7fccc00cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fccc6ffd640 1 --2- 172.21.15.131:0/2336134965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc00e3200 0x7fccc00cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fccc6ffd640 1 -- 172.21.15.131:0/2336134965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccc00e6ba0 msgr2=0x7fccc00ce060 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-17T04:09:24.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fccc6ffd640 1 --2- 172.21.15.131:0/2336134965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccc00e6ba0 0x7fccc00ce060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fccc6ffd640 1 -- 172.21.15.131:0/2336134965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc004fc50 con 0x7fccc0057ba0 2024-05-17T04:09:24.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d3c0af610 con 0x7f3d2c0040f0 2024-05-17T04:09:24.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7f3d3affd640 1 -- 172.21.15.131:0/2771315483 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c064190 con 0x7f3d2c0040f0 2024-05-17T04:09:24.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fe5f803c640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5f00ce550 0x7fe5f015f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/434585237 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e415d700 con 0x7fb7e406d8c0 2024-05-17T04:09:24.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fe5f803c640 1 -- 172.21.15.131:0/245610492 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f006dfd0 con 0x7fe5f0074050 2024-05-17T04:09:24.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fccc6ffd640 1 --2- 172.21.15.131:0/2336134965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc0057ba0 0x7fccc0051300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fccc806b750 tx=0x7fccc8069d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fe5f55d7640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5f015b480 0x7fe5f0150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fe5f65d9640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5f00ce550 0x7fe5f015f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7fe5f803c640 1 -- 172.21.15.131:0/245610492 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f006d3a0 con 0x7fe5f015b480 2024-05-17T04:09:24.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.272+0000 7fe5f803c640 1 -- 172.21.15.131:0/245610492 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f015b890 con 0x7fe5f00ce550 2024-05-17T04:09:24.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.272+0000 7fe5f5dd8640 1 -- 172.21.15.131:0/245610492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5f00ce550 msgr2=0x7fe5f015f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.272+0000 7fe5f5dd8640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5f00ce550 0x7fe5f015f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.272+0000 7fe5f5dd8640 1 -- 172.21.15.131:0/245610492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5f015b480 msgr2=0x7fe5f0150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.272+0000 7fe5f5dd8640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5f015b480 0x7fe5f0150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.272+0000 7fe5f5dd8640 1 -- 172.21.15.131:0/245610492 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f0156f40 con 0x7fe5f0074050 2024-05-17T04:09:24.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.273+0000 7f3d411dd640 1 -- 172.21.15.131:0/2771315483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d2c0040f0 msgr2=0x7f3d2c00ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.273+0000 7f3d411dd640 1 --2- 172.21.15.131:0/2771315483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d2c0040f0 0x7f3d2c00ba40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c051b50 tx=0x7f3d2c005830 comp rx=0 tx=0).stop 2024-05-17T04:09:24.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.273+0000 7f3d409dc640 1 -- 172.21.15.131:0/2771315483 reap_dead start 2024-05-17T04:09:24.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.273+0000 7fccaf7fe640 1 -- 172.21.15.131:0/2336134965 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8075490 con 0x7fccc0057ba0 2024-05-17T04:09:24.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.273+0000 7fe5f5dd8640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5f0074050 0x7fe5f0156a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4001e80 tx=0x7fe5e400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.273+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/434585237 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e406dcd0 con 0x7fb7e406d8c0 2024-05-17T04:09:24.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.274+0000 7fe5e27fc640 1 -- 172.21.15.131:0/245610492 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4017070 con 0x7fe5f0074050 2024-05-17T04:09:24.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.274+0000 7fe5f803c640 1 -- 172.21.15.131:0/245610492 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f0155960 con 0x7fe5f0074050 2024-05-17T04:09:24.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.273+0000 7fccc7fff640 1 -- 172.21.15.131:0/2336134965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc004ff30 con 0x7fccc0057ba0 2024-05-17T04:09:24.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.273+0000 7fccc7fff640 1 -- 172.21.15.131:0/2336134965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc00504f0 con 0x7fccc0057ba0 2024-05-17T04:09:24.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.274+0000 7fccaf7fe640 1 -- 172.21.15.131:0/2336134965 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc8090070 con 0x7fccc0057ba0 2024-05-17T04:09:24.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.275+0000 7fa8267fc640 1 -- 172.21.15.131:0/3063496152 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c012c40 con 0x7fa8300b4c10 2024-05-17T04:09:24.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.275+0000 7fa8267fc640 1 -- 172.21.15.131:0/3063496152 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa82c016070 con 0x7fa8300b4c10 2024-05-17T04:09:24.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.275+0000 7fa837fac640 1 -- 172.21.15.131:0/3063496152 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83015cd40 con 0x7fa8300b4c10 2024-05-17T04:09:24.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.275+0000 7fa837fac640 1 -- 172.21.15.131:0/3063496152 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83015d300 con 0x7fa8300b4c10 2024-05-17T04:09:24.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.274+0000 7fe5f803c640 1 -- 172.21.15.131:0/245610492 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f0155f20 con 0x7fe5f0074050 2024-05-17T04:09:24.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.274+0000 7fe5e27fc640 1 -- 172.21.15.131:0/245610492 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e4005270 con 0x7fe5f0074050 2024-05-17T04:09:24.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.274+0000 7fe5e27fc640 1 -- 172.21.15.131:0/245610492 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e400ce10 con 0x7fe5f0074050 2024-05-17T04:09:24.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.273+0000 7f3d411dd640 1 -- 172.21.15.131:0/2771315483 shutdown_connections 2024-05-17T04:09:24.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.273+0000 7f3d411dd640 1 -- 172.21.15.131:0/2771315483 >> 172.21.15.131:0/2771315483 conn(0x7f3d340362c0 msgr2=0x7f3d340366d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.273+0000 7f3d411dd640 1 -- 172.21.15.131:0/2771315483 shutdown_connections 2024-05-17T04:09:24.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.273+0000 7f3d411dd640 1 -- 172.21.15.131:0/2771315483 wait complete. 2024-05-17T04:09:24.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.275+0000 7fb7d9ffb640 1 -- 172.21.15.131:0/434585237 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb7e001a070 con 0x7fb7e406d8c0 2024-05-17T04:09:24.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.275+0000 7fb7d9ffb640 1 --2- 172.21.15.131:0/434585237 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb7c8076320 0x7fb7c8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.276+0000 7fb7d9ffb640 1 -- 172.21.15.131:0/434585237 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb7e0096ca0 con 0x7fb7e406d8c0 2024-05-17T04:09:24.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.276+0000 7fccaf7fe640 1 -- 172.21.15.131:0/2336134965 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8075890 con 0x7fccc0057ba0 2024-05-17T04:09:24.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.276+0000 7fcca7fff640 1 -- 172.21.15.131:0/2336134965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc003d830 con 0x7fccc0057ba0 2024-05-17T04:09:24.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.276+0000 7f3d411dd640 1 Processor -- start 2024-05-17T04:09:24.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7ff4450ba640 1 -- 172.21.15.131:0/3016232131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff42c004800 msgr2=0x7ff42c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7ff4450ba640 1 --2- 172.21.15.131:0/3016232131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff42c004800 0x7ff42c004c10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff428007970 tx=0x7ff42c005830 comp rx=0 tx=0).stop 2024-05-17T04:09:24.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.271+0000 7ff43f59e640 1 -- 172.21.15.131:0/3016232131 reap_dead start 2024-05-17T04:09:24.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.272+0000 7ff4450ba640 1 -- 172.21.15.131:0/3016232131 shutdown_connections 2024-05-17T04:09:24.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.272+0000 7ff4450ba640 1 -- 172.21.15.131:0/3016232131 >> 172.21.15.131:0/3016232131 conn(0x7ff4400b36d0 msgr2=0x7ff4400d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.272+0000 7ff4450ba640 1 -- 172.21.15.131:0/3016232131 shutdown_connections 2024-05-17T04:09:24.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.272+0000 7ff4450ba640 1 -- 172.21.15.131:0/3016232131 wait complete. 2024-05-17T04:09:24.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.275+0000 7ff4450ba640 1 Processor -- start 2024-05-17T04:09:24.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.275+0000 7ff4450ba640 1 -- start start 2024-05-17T04:09:24.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.276+0000 7fa8267fc640 1 -- 172.21.15.131:0/3063496152 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c01a410 con 0x7fa8300b4c10 2024-05-17T04:09:24.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.276+0000 7f3d411dd640 1 -- start start 2024-05-17T04:09:24.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.277+0000 7fb7e885c640 1 --2- 172.21.15.131:0/434585237 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb7c8076320 0x7fb7c8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.277+0000 7ff4450ba640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff42c004800 0x7ff4401581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.278+0000 7fb7e885c640 1 --2- 172.21.15.131:0/434585237 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb7c8076320 0x7fb7c8078830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc034000 tx=0x7fb7dc02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.278+0000 7ff43ed9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff42c004800 0x7ff4401581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.278+0000 7ff43ed9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff42c004800 0x7ff4401581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43788/0 (socket says 172.21.15.131:43788) 2024-05-17T04:09:24.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.278+0000 7ff4450ba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff440160460 0x7ff4400b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.278+0000 7ff43ed9d640 1 -- 172.21.15.131:0/1820224596 learned_addr learned my addr 172.21.15.131:0/1820224596 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:24.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.278+0000 7ff4450ba640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4400b14e0 0x7ff44015f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.278+0000 7ff4450ba640 1 -- 172.21.15.131:0/1820224596 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff4400cd7e0 con 0x7ff42c004800 2024-05-17T04:09:24.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.278+0000 7ff4450ba640 1 -- 172.21.15.131:0/1820224596 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff4400cd500 con 0x7ff440160460 2024-05-17T04:09:24.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.278+0000 7ff43659c640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff440160460 0x7ff4400b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.278+0000 7fa837fac640 1 -- 172.21.15.131:0/3063496152 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa818005290 con 0x7fa8300b4c10 2024-05-17T04:09:24.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.278+0000 7fe5d3fff640 1 -- 172.21.15.131:0/245610492 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f00cf120 con 0x7fe5f0074050 2024-05-17T04:09:24.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.278+0000 7fa8267fc640 1 -- 172.21.15.131:0/3063496152 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa82c018030 con 0x7fa8300b4c10 2024-05-17T04:09:24.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.278+0000 7ff43f59e640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4400b14e0 0x7ff44015f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.279+0000 7ff4450ba640 1 -- 172.21.15.131:0/1820224596 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff44015e820 con 0x7ff4400b14e0 2024-05-17T04:09:24.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.279+0000 7fa8267fc640 1 --2- 172.21.15.131:0/3063496152 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa8140763d0 0x7fa8140788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.279+0000 7f3d411dd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d2c0040f0 0x7f3d340dbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.279+0000 7fa835d48640 1 --2- 172.21.15.131:0/3063496152 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa8140763d0 0x7fa8140788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.279+0000 7f3d411dd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d3404b310 0x7f3d34039bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.279+0000 7ff43659c640 1 -- 172.21.15.131:0/1820224596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4400b14e0 msgr2=0x7ff44015f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.279+0000 7f3d411dd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d3403a0f0 0x7f3d34037620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.279+0000 7f3d3bfff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d2c0040f0 0x7f3d340dbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.279+0000 7fa8267fc640 1 -- 172.21.15.131:0/3063496152 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa82c09b7f0 con 0x7fa8300b4c10 2024-05-17T04:09:24.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.279+0000 7f3d3bfff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d2c0040f0 0x7f3d340dbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:48742/0 (socket says 172.21.15.131:48742) 2024-05-17T04:09:24.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.279+0000 7f3d3b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d3404b310 0x7f3d34039bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.279+0000 7f3d3b7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d3404b310 0x7f3d34039bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:60666/0 (socket says 172.21.15.131:60666) 2024-05-17T04:09:24.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.279+0000 7ff43659c640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4400b14e0 0x7ff44015f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.279+0000 7ff43659c640 1 -- 172.21.15.131:0/1820224596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff42c004800 msgr2=0x7ff4401581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7f3d3b7fe640 1 -- 172.21.15.131:0/4134096054 learned_addr learned my addr 172.21.15.131:0/4134096054 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:24.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7f3d409dc640 1 --2- 172.21.15.131:0/4134096054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d3403a0f0 0x7f3d34037620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7f3d411dd640 1 -- 172.21.15.131:0/4134096054 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3d34007100 con 0x7f3d3403a0f0 2024-05-17T04:09:24.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7f3d411dd640 1 -- 172.21.15.131:0/4134096054 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3d34006f80 con 0x7f3d3404b310 2024-05-17T04:09:24.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7f3d411dd640 1 -- 172.21.15.131:0/4134096054 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3d34007280 con 0x7f3d2c0040f0 2024-05-17T04:09:24.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7fa835d48640 1 --2- 172.21.15.131:0/3063496152 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa8140763d0 0x7fa8140788e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa82000a950 tx=0x7fa820008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7ff43659c640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff42c004800 0x7ff4401581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7ff43659c640 1 -- 172.21.15.131:0/1820224596 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4400b18f0 con 0x7ff440160460 2024-05-17T04:09:24.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7ff43ed9d640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff42c004800 0x7ff4401581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:24.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7ff43659c640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff440160460 0x7ff4400b0fa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00c360 tx=0x7ff428001890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7f3d409dc640 1 -- 172.21.15.131:0/4134096054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d2c0040f0 msgr2=0x7f3d340dbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7f3d409dc640 1 --2- 172.21.15.131:0/4134096054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d2c0040f0 0x7f3d340dbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7f3d409dc640 1 -- 172.21.15.131:0/4134096054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d3404b310 msgr2=0x7f3d34039bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7f3d409dc640 1 --2- 172.21.15.131:0/4134096054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d3404b310 0x7f3d34039bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7f3d409dc640 1 -- 172.21.15.131:0/4134096054 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d340dc320 con 0x7f3d3403a0f0 2024-05-17T04:09:24.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7ff437fff640 1 -- 172.21.15.131:0/1820224596 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff428042070 con 0x7ff440160460 2024-05-17T04:09:24.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7ff437fff640 1 -- 172.21.15.131:0/1820224596 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff428037040 con 0x7ff440160460 2024-05-17T04:09:24.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.280+0000 7f3d409dc640 1 --2- 172.21.15.131:0/4134096054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d3403a0f0 0x7f3d34037620 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c07ba50 tx=0x7f3d3c076a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.281+0000 7ff4450ba640 1 -- 172.21.15.131:0/1820224596 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff44015ea90 con 0x7ff440160460 2024-05-17T04:09:24.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.281+0000 7ff437fff640 1 -- 172.21.15.131:0/1820224596 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff428036070 con 0x7ff440160460 2024-05-17T04:09:24.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.281+0000 7ff4450ba640 1 -- 172.21.15.131:0/1820224596 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff440160ce0 con 0x7ff440160460 2024-05-17T04:09:24.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.282+0000 7ff4450ba640 1 -- 172.21.15.131:0/1820224596 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4400b5630 con 0x7ff440160460 2024-05-17T04:09:24.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.282+0000 7fb7d9ffb640 1 -- 172.21.15.131:0/434585237 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb7e005fbd0 con 0x7fb7e406d8c0 2024-05-17T04:09:24.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.283+0000 7ff437fff640 1 -- 172.21.15.131:0/1820224596 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff428045070 con 0x7ff440160460 2024-05-17T04:09:24.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.284+0000 7fccaf7fe640 1 -- 172.21.15.131:0/2336134965 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fccc8075db0 con 0x7fccc0057ba0 2024-05-17T04:09:24.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.284+0000 7ff437fff640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff4200762d0 0x7ff4200787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.284+0000 7fa8267fc640 1 -- 172.21.15.131:0/3063496152 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa8300b5560 con 0x7fa8300b4c10 2024-05-17T04:09:24.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.285+0000 7fccaf7fe640 1 --2- 172.21.15.131:0/2336134965 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fccb40762d0 0x7fccb40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.285+0000 7fccaf7fe640 1 -- 172.21.15.131:0/2336134965 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fccc8113dd0 con 0x7fccc0057ba0 2024-05-17T04:09:24.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.285+0000 7fccc67fc640 1 --2- 172.21.15.131:0/2336134965 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fccb40762d0 0x7fccb40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.285+0000 7fe5e27fc640 1 -- 172.21.15.131:0/245610492 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe5e401a070 con 0x7fe5f0074050 2024-05-17T04:09:24.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.285+0000 7ff43ed9d640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff4200762d0 0x7ff4200787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.285+0000 7ff437fff640 1 -- 172.21.15.131:0/1820224596 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff4280b72a0 con 0x7ff440160460 2024-05-17T04:09:24.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.286+0000 7f3d38ff9640 1 -- 172.21.15.131:0/4134096054 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c0b4070 con 0x7f3d3403a0f0 2024-05-17T04:09:24.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.286+0000 7fe5e27fc640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe5d4076300 0x7fe5d4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.286+0000 7fe5e27fc640 1 -- 172.21.15.131:0/245610492 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe5e4060900 con 0x7fe5f0074050 2024-05-17T04:09:24.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.286+0000 7f3d38ff9640 1 -- 172.21.15.131:0/4134096054 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d3c0b5040 con 0x7f3d3403a0f0 2024-05-17T04:09:24.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.286+0000 7f3d38ff9640 1 -- 172.21.15.131:0/4134096054 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c0afbd0 con 0x7f3d3403a0f0 2024-05-17T04:09:24.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.286+0000 7fccc67fc640 1 --2- 172.21.15.131:0/2336134965 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fccb40762d0 0x7fccb40787e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fccb8006fd0 tx=0x7fccb8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.286+0000 7ff43ed9d640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff4200762d0 0x7ff4200787e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff430012440 tx=0x7ff430008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.287+0000 7fe5f55d7640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe5d4076300 0x7fe5d4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.287+0000 7f3d411dd640 1 -- 172.21.15.131:0/4134096054 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d3403a500 con 0x7f3d3403a0f0 2024-05-17T04:09:24.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.287+0000 7f3d411dd640 1 -- 172.21.15.131:0/4134096054 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d3400aab0 con 0x7f3d3403a0f0 2024-05-17T04:09:24.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.287+0000 7fe5f55d7640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe5d4076300 0x7fe5d4078810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec007fd0 tx=0x7fe5ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.288+0000 7ff437fff640 1 -- 172.21.15.131:0/1820224596 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff4400b18f0 con 0x7ff440160460 2024-05-17T04:09:24.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.289+0000 7f3d411dd640 1 -- 172.21.15.131:0/4134096054 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d3404e460 con 0x7f3d3403a0f0 2024-05-17T04:09:24.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.294+0000 7fccaf7fe640 1 -- 172.21.15.131:0/2336134965 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fccc80a4080 con 0x7fccc0057ba0 2024-05-17T04:09:24.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.304+0000 7fe5e27fc640 1 -- 172.21.15.131:0/245610492 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe5e4064d70 con 0x7fe5f0074050 2024-05-17T04:09:24.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.307+0000 7f3d38ff9640 1 -- 172.21.15.131:0/4134096054 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3d3c0c1060 con 0x7f3d3403a0f0 2024-05-17T04:09:24.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.307+0000 7f3d38ff9640 1 --2- 172.21.15.131:0/4134096054 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3d200762d0 0x7f3d200787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.307+0000 7f3d38ff9640 1 -- 172.21.15.131:0/4134096054 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3d3c1336b0 con 0x7f3d3403a0f0 2024-05-17T04:09:24.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.308+0000 7f3d3bfff640 1 --2- 172.21.15.131:0/4134096054 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3d200762d0 0x7f3d200787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.309+0000 7f3d3bfff640 1 --2- 172.21.15.131:0/4134096054 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3d200762d0 0x7f3d200787e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3d280048c0 tx=0x7f3d28007d70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.315+0000 7f3d38ff9640 1 -- 172.21.15.131:0/4134096054 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3d3403a500 con 0x7f3d3403a0f0 2024-05-17T04:09:24.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.626+0000 7fcd87562640 1 -- 172.21.15.131:0/1349121871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fcd60005580 con 0x7fcd8006d8c0 2024-05-17T04:09:24.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.627+0000 7fcd75ffb640 1 -- 172.21.15.131:0/1349121871 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcd7c064060 con 0x7fcd8006d8c0 2024-05-17T04:09:24.628 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-05-17T04:09:24.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.630+0000 7fcd6b7fe640 1 -- 172.21.15.131:0/1349121871 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fcd6c076520 msgr2=0x7fcd6c078a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.630+0000 7fcd6b7fe640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fcd6c076520 0x7fcd6c078a30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcd8015a2a0 tx=0x7fcd70008040 comp rx=0 tx=0).stop 2024-05-17T04:09:24.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.631+0000 7fcd6b7fe640 1 -- 172.21.15.131:0/1349121871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd8006d8c0 msgr2=0x7fcd800c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.631+0000 7fcd6b7fe640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd8006d8c0 0x7fcd800c9560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00b780 tx=0x7fcd7c00bc40 comp rx=0 tx=0).stop 2024-05-17T04:09:24.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.631+0000 7fcd6b7fe640 1 -- 172.21.15.131:0/1349121871 shutdown_connections 2024-05-17T04:09:24.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.631+0000 7fcd6b7fe640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fcd6c076520 0x7fcd6c078a30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.631+0000 7fcd6b7fe640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd80074050 0x7fcd800cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.631+0000 7fcd6b7fe640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd80070970 0x7fcd800cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.631+0000 7fcd6b7fe640 1 --2- 172.21.15.131:0/1349121871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd8006d8c0 0x7fcd800c9560 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.631+0000 7fcd6b7fe640 1 -- 172.21.15.131:0/1349121871 >> 172.21.15.131:0/1349121871 conn(0x7fcd8006e330 msgr2=0x7fcd80159390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.631+0000 7fcd6b7fe640 1 -- 172.21.15.131:0/1349121871 shutdown_connections 2024-05-17T04:09:24.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.632+0000 7fcd6b7fe640 1 -- 172.21.15.131:0/1349121871 wait complete. 2024-05-17T04:09:24.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-05-17T04:09:24.650 DEBUG:teuthology.parallel:result is None 2024-05-17T04:09:24.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.666+0000 7f9e4305f640 1 -- 172.21.15.131:0/3479327128 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9e340d8300 con 0x7f9e34033d10 2024-05-17T04:09:24.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.667+0000 7f9e32ffd640 1 -- 172.21.15.131:0/3479327128 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9e3c0e4220 con 0x7f9e34033d10 2024-05-17T04:09:24.669 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-05-17T04:09:24.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.670+0000 7f9e4305f640 1 -- 172.21.15.131:0/3479327128 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e20076320 msgr2=0x7f9e20078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.671+0000 7f9e4305f640 1 --2- 172.21.15.131:0/3479327128 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e20076320 0x7f9e20078830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009500 tx=0x7f9e3802e000 comp rx=0 tx=0).stop 2024-05-17T04:09:24.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.671+0000 7f9e4305f640 1 -- 172.21.15.131:0/3479327128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e34033d10 msgr2=0x7f9e3404fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.671+0000 7f9e4305f640 1 --2- 172.21.15.131:0/3479327128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e34033d10 0x7f9e3404fde0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c064300 tx=0x7f9e3c075660 comp rx=0 tx=0).stop 2024-05-17T04:09:24.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.671+0000 7f9e4305f640 1 -- 172.21.15.131:0/3479327128 shutdown_connections 2024-05-17T04:09:24.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.671+0000 7f9e4305f640 1 --2- 172.21.15.131:0/3479327128 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e20076320 0x7f9e20078830 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.671+0000 7f9e4305f640 1 --2- 172.21.15.131:0/3479327128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e34033d10 0x7f9e3404fde0 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c064300 tx=0x7f9e3c075660 comp rx=0 tx=0).stop 2024-05-17T04:09:24.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.671+0000 7f9e4305f640 1 --2- 172.21.15.131:0/3479327128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e340d3660 0x7f9e34050320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.671+0000 7f9e4305f640 1 --2- 172.21.15.131:0/3479327128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e340337c0 0x7f9e340d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.671+0000 7f9e4305f640 1 -- 172.21.15.131:0/3479327128 >> 172.21.15.131:0/3479327128 conn(0x7f9e3401db60 msgr2=0x7f9e34052e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.671+0000 7f9e4305f640 1 -- 172.21.15.131:0/3479327128 shutdown_connections 2024-05-17T04:09:24.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.671+0000 7f9e4305f640 1 -- 172.21.15.131:0/3479327128 wait complete. 2024-05-17T04:09:24.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.687+0000 7fe5d3fff640 1 -- 172.21.15.131:0/245610492 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe5f0070970 con 0x7fe5f0074050 2024-05-17T04:09:24.688 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-05-17T04:09:24.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.687+0000 7fe5e27fc640 1 -- 172.21.15.131:0/245610492 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe5e4064670 con 0x7fe5f0074050 2024-05-17T04:09:24.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-05-17T04:09:24.689 DEBUG:teuthology.parallel:result is None 2024-05-17T04:09:24.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.690+0000 7fe5d3fff640 1 -- 172.21.15.131:0/245610492 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe5d4076300 msgr2=0x7fe5d4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.690+0000 7fe5d3fff640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe5d4076300 0x7fe5d4078810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec007fd0 tx=0x7fe5ec009040 comp rx=0 tx=0).stop 2024-05-17T04:09:24.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.690+0000 7fe5d3fff640 1 -- 172.21.15.131:0/245610492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5f0074050 msgr2=0x7fe5f0156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.690+0000 7fe5d3fff640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5f0074050 0x7fe5f0156a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4001e80 tx=0x7fe5e400cc80 comp rx=0 tx=0).stop 2024-05-17T04:09:24.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.690+0000 7fe5d3fff640 1 -- 172.21.15.131:0/245610492 shutdown_connections 2024-05-17T04:09:24.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.690+0000 7fe5d3fff640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe5d4076300 0x7fe5d4078810 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.690+0000 7fe5d3fff640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5f00ce550 0x7fe5f015f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.690+0000 7fe5d3fff640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5f015b480 0x7fe5f0150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.690+0000 7fe5d3fff640 1 --2- 172.21.15.131:0/245610492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5f0074050 0x7fe5f0156a00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.690+0000 7fe5d3fff640 1 -- 172.21.15.131:0/245610492 >> 172.21.15.131:0/245610492 conn(0x7fe5f006e330 msgr2=0x7fe5f01536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.690+0000 7fe5d3fff640 1 -- 172.21.15.131:0/245610492 shutdown_connections 2024-05-17T04:09:24.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.690+0000 7fe5d3fff640 1 -- 172.21.15.131:0/245610492 wait complete. 2024-05-17T04:09:24.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-05-17T04:09:24.708 DEBUG:teuthology.parallel:result is None 2024-05-17T04:09:24.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.710+0000 7fcca7fff640 1 -- 172.21.15.131:0/2336134965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fccc003d550 con 0x7fccc0057ba0 2024-05-17T04:09:24.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.710+0000 7fccaf7fe640 1 -- 172.21.15.131:0/2336134965 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fccc8113020 con 0x7fccc0057ba0 2024-05-17T04:09:24.711 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-05-17T04:09:24.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.712+0000 7fcca7fff640 1 -- 172.21.15.131:0/2336134965 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fccb40762d0 msgr2=0x7fccb40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.712+0000 7fcca7fff640 1 --2- 172.21.15.131:0/2336134965 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fccb40762d0 0x7fccb40787e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fccb8006fd0 tx=0x7fccb8008040 comp rx=0 tx=0).stop 2024-05-17T04:09:24.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.712+0000 7fcca7fff640 1 -- 172.21.15.131:0/2336134965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc0057ba0 msgr2=0x7fccc0051300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.712+0000 7fcca7fff640 1 --2- 172.21.15.131:0/2336134965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc0057ba0 0x7fccc0051300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fccc806b750 tx=0x7fccc8069d10 comp rx=0 tx=0).stop 2024-05-17T04:09:24.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.712+0000 7fcca7fff640 1 -- 172.21.15.131:0/2336134965 shutdown_connections 2024-05-17T04:09:24.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.712+0000 7fcca7fff640 1 --2- 172.21.15.131:0/2336134965 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fccb40762d0 0x7fccb40787e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.712+0000 7fcca7fff640 1 --2- 172.21.15.131:0/2336134965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccc00e6ba0 0x7fccc00ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.712+0000 7fcca7fff640 1 --2- 172.21.15.131:0/2336134965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc00e3200 0x7fccc00cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.712+0000 7fcca7fff640 1 --2- 172.21.15.131:0/2336134965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc0057ba0 0x7fccc0051300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.712+0000 7fcca7fff640 1 -- 172.21.15.131:0/2336134965 >> 172.21.15.131:0/2336134965 conn(0x7fccc003a740 msgr2=0x7fccc0004f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.713+0000 7fcca7fff640 1 -- 172.21.15.131:0/2336134965 shutdown_connections 2024-05-17T04:09:24.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.713+0000 7fcca7fff640 1 -- 172.21.15.131:0/2336134965 wait complete. 2024-05-17T04:09:24.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.720+0000 7ff4450ba640 1 -- 172.21.15.131:0/1820224596 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff44006ab20 con 0x7ff440160460 2024-05-17T04:09:24.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.721+0000 7ff437fff640 1 -- 172.21.15.131:0/1820224596 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff4280801e0 con 0x7ff440160460 2024-05-17T04:09:24.722 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-05-17T04:09:24.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.722+0000 7fa837fac640 1 -- 172.21.15.131:0/3063496152 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa818005580 con 0x7fa8300b4c10 2024-05-17T04:09:24.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.722+0000 7fa8267fc640 1 -- 172.21.15.131:0/3063496152 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa82c0647a0 con 0x7fa8300b4c10 2024-05-17T04:09:24.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.723+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/434585237 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb7e4160040 con 0x7fb7e406d8c0 2024-05-17T04:09:24.724 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-05-17T04:09:24.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.723+0000 7fb7d9ffb640 1 -- 172.21.15.131:0/434585237 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb7e0063ed0 con 0x7fb7e406d8c0 2024-05-17T04:09:24.724 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-05-17T04:09:24.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.723+0000 7ff4450ba640 1 -- 172.21.15.131:0/1820224596 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff4200762d0 msgr2=0x7ff4200787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.723+0000 7ff4450ba640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff4200762d0 0x7ff4200787e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff430012440 tx=0x7ff430008040 comp rx=0 tx=0).stop 2024-05-17T04:09:24.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.723+0000 7ff4450ba640 1 -- 172.21.15.131:0/1820224596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff440160460 msgr2=0x7ff4400b0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.723+0000 7ff4450ba640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff440160460 0x7ff4400b0fa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00c360 tx=0x7ff428001890 comp rx=0 tx=0).stop 2024-05-17T04:09:24.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.723+0000 7ff4450ba640 1 -- 172.21.15.131:0/1820224596 shutdown_connections 2024-05-17T04:09:24.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.723+0000 7ff4450ba640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff4200762d0 0x7ff4200787e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.723+0000 7ff4450ba640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4400b14e0 0x7ff44015f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.723+0000 7ff4450ba640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff440160460 0x7ff4400b0fa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.723+0000 7ff4450ba640 1 --2- 172.21.15.131:0/1820224596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff42c004800 0x7ff4401581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.723+0000 7ff4450ba640 1 -- 172.21.15.131:0/1820224596 >> 172.21.15.131:0/1820224596 conn(0x7ff4400b36d0 msgr2=0x7ff44006d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.724+0000 7ff4450ba640 1 -- 172.21.15.131:0/1820224596 shutdown_connections 2024-05-17T04:09:24.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.724+0000 7ff4450ba640 1 -- 172.21.15.131:0/1820224596 wait complete. 2024-05-17T04:09:24.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-05-17T04:09:24.728 DEBUG:teuthology.parallel:result is None 2024-05-17T04:09:24.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.726+0000 7fa837fac640 1 -- 172.21.15.131:0/3063496152 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa8140763d0 msgr2=0x7fa8140788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.726+0000 7fa837fac640 1 --2- 172.21.15.131:0/3063496152 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa8140763d0 0x7fa8140788e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa82000a950 tx=0x7fa820008040 comp rx=0 tx=0).stop 2024-05-17T04:09:24.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.726+0000 7fa837fac640 1 -- 172.21.15.131:0/3063496152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8300b4c10 msgr2=0x7fa83014fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.726+0000 7fa837fac640 1 --2- 172.21.15.131:0/3063496152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8300b4c10 0x7fa83014fe80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa82c006110 tx=0x7fa82c00da40 comp rx=0 tx=0).stop 2024-05-17T04:09:24.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.726+0000 7fa837fac640 1 -- 172.21.15.131:0/3063496152 shutdown_connections 2024-05-17T04:09:24.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.726+0000 7fa837fac640 1 --2- 172.21.15.131:0/3063496152 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa8140763d0 0x7fa8140788e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.726+0000 7fa837fac640 1 --2- 172.21.15.131:0/3063496152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa83015b480 0x7fa83014d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.726+0000 7fa837fac640 1 --2- 172.21.15.131:0/3063496152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8300b4c10 0x7fa83014fe80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.726+0000 7fa837fac640 1 --2- 172.21.15.131:0/3063496152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa83006de00 0x7fa83015e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.726+0000 7fa837fac640 1 -- 172.21.15.131:0/3063496152 >> 172.21.15.131:0/3063496152 conn(0x7fa83006e330 msgr2=0x7fa8300b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.726+0000 7fa837fac640 1 -- 172.21.15.131:0/3063496152 shutdown_connections 2024-05-17T04:09:24.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.726+0000 7fa837fac640 1 -- 172.21.15.131:0/3063496152 wait complete. 2024-05-17T04:09:24.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.727+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/434585237 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb7c8076320 msgr2=0x7fb7c8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.727+0000 7fb7eb2c1640 1 --2- 172.21.15.131:0/434585237 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb7c8076320 0x7fb7c8078830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc034000 tx=0x7fb7dc02f000 comp rx=0 tx=0).stop 2024-05-17T04:09:24.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.727+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/434585237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7e406d8c0 msgr2=0x7fb7e4154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.727+0000 7fb7eb2c1640 1 --2- 172.21.15.131:0/434585237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7e406d8c0 0x7fb7e4154020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c410 tx=0x7fb7e000c8d0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.727+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/434585237 shutdown_connections 2024-05-17T04:09:24.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.727+0000 7fb7eb2c1640 1 --2- 172.21.15.131:0/434585237 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb7c8076320 0x7fb7c8078830 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.727+0000 7fb7eb2c1640 1 --2- 172.21.15.131:0/434585237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7e4074050 0x7fb7e40c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.727+0000 7fb7eb2c1640 1 --2- 172.21.15.131:0/434585237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7e4070970 0x7fb7e415e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.727+0000 7fb7eb2c1640 1 --2- 172.21.15.131:0/434585237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7e406d8c0 0x7fb7e4154020 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.727+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/434585237 >> 172.21.15.131:0/434585237 conn(0x7fb7e406e330 msgr2=0x7fb7e40cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.727+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/434585237 shutdown_connections 2024-05-17T04:09:24.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.727+0000 7fb7eb2c1640 1 -- 172.21.15.131:0/434585237 wait complete. 2024-05-17T04:09:24.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.737+0000 7f3d411dd640 1 -- 172.21.15.131:0/4134096054 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3d340500e0 con 0x7f3d3403a0f0 2024-05-17T04:09:24.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.738+0000 7f3d38ff9640 1 -- 172.21.15.131:0/4134096054 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3d340dc320 con 0x7f3d3403a0f0 2024-05-17T04:09:24.739 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-05-17T04:09:24.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2024-05-17T04:09:24.740 DEBUG:teuthology.parallel:result is None 2024-05-17T04:09:24.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.740+0000 7f3d411dd640 1 -- 172.21.15.131:0/4134096054 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3d200762d0 msgr2=0x7f3d200787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.740+0000 7f3d411dd640 1 --2- 172.21.15.131:0/4134096054 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3d200762d0 0x7f3d200787e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3d280048c0 tx=0x7f3d28007d70 comp rx=0 tx=0).stop 2024-05-17T04:09:24.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.740+0000 7f3d411dd640 1 -- 172.21.15.131:0/4134096054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d3403a0f0 msgr2=0x7f3d34037620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.740+0000 7f3d411dd640 1 --2- 172.21.15.131:0/4134096054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d3403a0f0 0x7f3d34037620 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c07ba50 tx=0x7f3d3c076a50 comp rx=0 tx=0).stop 2024-05-17T04:09:24.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.740+0000 7f3d411dd640 1 -- 172.21.15.131:0/4134096054 shutdown_connections 2024-05-17T04:09:24.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.740+0000 7f3d411dd640 1 --2- 172.21.15.131:0/4134096054 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3d200762d0 0x7f3d200787e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.740+0000 7f3d411dd640 1 --2- 172.21.15.131:0/4134096054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d3403a0f0 0x7f3d34037620 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.740+0000 7f3d411dd640 1 --2- 172.21.15.131:0/4134096054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d3404b310 0x7f3d34039bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.740+0000 7f3d411dd640 1 --2- 172.21.15.131:0/4134096054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d2c0040f0 0x7f3d340dbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.741+0000 7f3d411dd640 1 -- 172.21.15.131:0/4134096054 >> 172.21.15.131:0/4134096054 conn(0x7f3d340362c0 msgr2=0x7f3d340313c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.741+0000 7f3d411dd640 1 -- 172.21.15.131:0/4134096054 shutdown_connections 2024-05-17T04:09:24.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.741+0000 7f3d411dd640 1 -- 172.21.15.131:0/4134096054 wait complete. 2024-05-17T04:09:24.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-05-17T04:09:24.744 DEBUG:teuthology.parallel:result is None 2024-05-17T04:09:24.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-05-17T04:09:24.744 DEBUG:teuthology.parallel:result is None 2024-05-17T04:09:24.753 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-05-17T04:09:24.753 DEBUG:teuthology.parallel:result is None 2024-05-17T04:09:24.753 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-17T04:09:24.753 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-17T04:09:24.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.903+0000 7f8cffce4640 1 Processor -- start 2024-05-17T04:09:24.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.903+0000 7f8cffce4640 1 -- start start 2024-05-17T04:09:24.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.904+0000 7f8cffce4640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8cf815f770 0x7f8cf80d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.904+0000 7f8cffce4640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cf80d05b0 con 0x7f8cf80d3da0 2024-05-17T04:09:24.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.904+0000 7f8cffce4640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cf80d0890 con 0x7f8cf80cf880 2024-05-17T04:09:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.904+0000 7f8cffce4640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f8cf80d0b70 con 0x7f8cf815f770 2024-05-17T04:09:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.904+0000 7f8cfd27f640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f8cf80d3da0 0x7f8cf80d41b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:54748/0 (socket says 172.21.15.131:54748) 2024-05-17T04:09:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.904+0000 7f8cfd27f640 1 -- 172.21.15.131:0/3518184107 learned_addr learned my addr 172.21.15.131:0/3518184107 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfca7e640 1 -- 172.21.15.131:0/3518184107 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 603154419 0 0) 0x7f8cf80d05b0 con 0x7f8cf80d3da0 2024-05-17T04:09:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfca7e640 1 -- 172.21.15.131:0/3518184107 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ce4003520 con 0x7f8cf80d3da0 2024-05-17T04:09:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfda80640 1 --2- 172.21.15.131:0/3518184107 >> v2:172.21.15.150:3300/0 conn(0x7f8cf815f770 0x7f8cf80d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfca7e640 1 -- 172.21.15.131:0/3518184107 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 343594145 0 0) 0x7f8ce4003520 con 0x7f8cf80d3da0 2024-05-17T04:09:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfca7e640 1 -- 172.21.15.131:0/3518184107 >> v2:172.21.15.150:3300/0 conn(0x7f8cf815f770 msgr2=0x7f8cf80d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfca7e640 1 --2- 172.21.15.131:0/3518184107 >> v2:172.21.15.150:3300/0 conn(0x7f8cf815f770 0x7f8cf80d1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfca7e640 1 -- 172.21.15.131:0/3518184107 >> v1:172.21.15.150:6789/0 conn(0x7f8cf80cf880 legacy=0x7f8cf80cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfca7e640 1 -- 172.21.15.131:0/3518184107 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf80d0e50 con 0x7f8cf80d3da0 2024-05-17T04:09:24.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfca7e640 1 -- 172.21.15.131:0/3518184107 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7f8ce80016f0 con 0x7f8cf80d3da0 2024-05-17T04:09:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfca7e640 1 -- 172.21.15.131:0/3518184107 >> v1:172.21.15.131:6789/0 conn(0x7f8cf80d3da0 legacy=0x7f8cf80d41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfca7e640 1 --2- 172.21.15.131:0/3518184107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce4003a50 0x7f8ce4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfca7e640 1 --2- 172.21.15.131:0/3518184107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce4004800 0x7f8ce4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfca7e640 1 --2- 172.21.15.131:0/3518184107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce4005250 0x7f8ce400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfca7e640 1 -- 172.21.15.131:0/3518184107 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf80d0b70 con 0x7f8ce4003a50 2024-05-17T04:09:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfca7e640 1 -- 172.21.15.131:0/3518184107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce400c1e0 con 0x7f8ce4004800 2024-05-17T04:09:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfca7e640 1 -- 172.21.15.131:0/3518184107 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce400c3e0 con 0x7f8ce4005250 2024-05-17T04:09:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfda80640 1 --2- 172.21.15.131:0/3518184107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce4003a50 0x7f8ce4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfd27f640 1 --2- 172.21.15.131:0/3518184107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce4004800 0x7f8ce4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfe281640 1 --2- 172.21.15.131:0/3518184107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce4005250 0x7f8ce400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfda80640 1 -- 172.21.15.131:0/3518184107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce4005250 msgr2=0x7f8ce400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:24.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfda80640 1 --2- 172.21.15.131:0/3518184107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce4005250 0x7f8ce400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfda80640 1 -- 172.21.15.131:0/3518184107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce4004800 msgr2=0x7f8ce4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.905+0000 7f8cfda80640 1 --2- 172.21.15.131:0/3518184107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce4004800 0x7f8ce4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.906+0000 7f8cfda80640 1 -- 172.21.15.131:0/3518184107 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce4003520 con 0x7f8ce4003a50 2024-05-17T04:09:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.906+0000 7f8cfd27f640 1 --2- 172.21.15.131:0/3518184107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce4004800 0x7f8ce4004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.906+0000 7f8cfe281640 1 -- 172.21.15.131:0/3518184107 reap_dead start 2024-05-17T04:09:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.906+0000 7f8cfda80640 1 --2- 172.21.15.131:0/3518184107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce4003a50 0x7f8ce4003ec0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009ac0 tx=0x7f8ce4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9aa1dec58877c server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.906+0000 7f8cfca7e640 1 -- 172.21.15.131:0/3518184107 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4036070 con 0x7f8ce4003a50 2024-05-17T04:09:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.906+0000 7f8cfca7e640 1 -- 172.21.15.131:0/3518184107 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf4031400 con 0x7f8ce4003a50 2024-05-17T04:09:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.906+0000 7f8cfca7e640 1 -- 172.21.15.131:0/3518184107 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4009690 con 0x7f8ce4003a50 2024-05-17T04:09:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.907+0000 7f8cffce4640 1 -- 172.21.15.131:0/3518184107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce4003a50 msgr2=0x7f8ce4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.907+0000 7f8cffce4640 1 --2- 172.21.15.131:0/3518184107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce4003a50 0x7f8ce4003ec0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009ac0 tx=0x7f8ce4005830 comp rx=0 tx=0).stop 2024-05-17T04:09:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.907+0000 7f8cffce4640 1 -- 172.21.15.131:0/3518184107 shutdown_connections 2024-05-17T04:09:24.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.907+0000 7f8cffce4640 1 --2- 172.21.15.131:0/3518184107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce4003a50 0x7f8ce4003ec0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.907+0000 7f8cffce4640 1 -- 172.21.15.131:0/3518184107 >> 172.21.15.131:0/3518184107 conn(0x7f8cf80d2300 msgr2=0x7f8cf80b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:24.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.907+0000 7f8cffce4640 1 -- 172.21.15.131:0/3518184107 shutdown_connections 2024-05-17T04:09:24.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.907+0000 7f8cffce4640 1 -- 172.21.15.131:0/3518184107 wait complete. 2024-05-17T04:09:24.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.909+0000 7f8cffce4640 1 Processor -- start 2024-05-17T04:09:24.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.909+0000 7f8cffce4640 1 -- start start 2024-05-17T04:09:24.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.910+0000 7f8cffce4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce4003a50 0x7f8cf8155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.910+0000 7f8cffce4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cf80ca850 0x7f8cf80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.910+0000 7f8cffce4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cf80b64b0 0x7f8cf815a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.910+0000 7f8cffce4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf80d17d0 con 0x7f8cf80b64b0 2024-05-17T04:09:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.910+0000 7f8cffce4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf80d1650 con 0x7f8cf80ca850 2024-05-17T04:09:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.910+0000 7f8cffce4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf80d1950 con 0x7f8ce4003a50 2024-05-17T04:09:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.910+0000 7f8cfe281640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cf80b64b0 0x7f8cf815a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.910+0000 7f8cfe281640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cf80b64b0 0x7f8cf815a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57150/0 (socket says 172.21.15.131:57150) 2024-05-17T04:09:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.910+0000 7f8cfe281640 1 -- 172.21.15.131:0/1479098630 learned_addr learned my addr 172.21.15.131:0/1479098630 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.911+0000 7f8cfda80640 1 --2- 172.21.15.131:0/1479098630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce4003a50 0x7f8cf8155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.911+0000 7f8cfd27f640 1 --2- 172.21.15.131:0/1479098630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cf80ca850 0x7f8cf80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.911+0000 7f8cfe281640 1 -- 172.21.15.131:0/1479098630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce4003a50 msgr2=0x7f8cf8155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.911+0000 7f8cfe281640 1 --2- 172.21.15.131:0/1479098630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce4003a50 0x7f8cf8155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.911+0000 7f8cfe281640 1 -- 172.21.15.131:0/1479098630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cf80ca850 msgr2=0x7f8cf80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:24.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.911+0000 7f8cfe281640 1 --2- 172.21.15.131:0/1479098630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cf80ca850 0x7f8cf80b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:24.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.911+0000 7f8cfe281640 1 -- 172.21.15.131:0/1479098630 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf80b68c0 con 0x7f8cf80b64b0 2024-05-17T04:09:24.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.911+0000 7f8cfe281640 1 --2- 172.21.15.131:0/1479098630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cf80b64b0 0x7f8cf815a730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8cf80b6d70 tx=0x7f8cf000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.911+0000 7f8cee7fc640 1 -- 172.21.15.131:0/1479098630 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0006b50 con 0x7f8cf80b64b0 2024-05-17T04:09:24.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.911+0000 7f8cee7fc640 1 -- 172.21.15.131:0/1479098630 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf0006d30 con 0x7f8cf80b64b0 2024-05-17T04:09:24.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.911+0000 7f8cffce4640 1 -- 172.21.15.131:0/1479098630 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf80c9190 con 0x7f8cf80b64b0 2024-05-17T04:09:24.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.911+0000 7f8cee7fc640 1 -- 172.21.15.131:0/1479098630 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0003bb0 con 0x7f8cf80b64b0 2024-05-17T04:09:24.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.911+0000 7f8cffce4640 1 -- 172.21.15.131:0/1479098630 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf80c9750 con 0x7f8cf80b64b0 2024-05-17T04:09:24.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.912+0000 7f8cffce4640 1 -- 172.21.15.131:0/1479098630 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf8162dc0 con 0x7f8cf80b64b0 2024-05-17T04:09:24.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.913+0000 7f8cee7fc640 1 -- 172.21.15.131:0/1479098630 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8cf0005070 con 0x7f8cf80b64b0 2024-05-17T04:09:24.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.913+0000 7f8cee7fc640 1 --2- 172.21.15.131:0/1479098630 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cdc0762d0 0x7f8cdc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:24.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.913+0000 7f8cee7fc640 1 -- 172.21.15.131:0/1479098630 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8cf0097140 con 0x7f8cf80b64b0 2024-05-17T04:09:24.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.913+0000 7f8cfda80640 1 --2- 172.21.15.131:0/1479098630 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cdc0762d0 0x7f8cdc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:24.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.914+0000 7f8cfda80640 1 --2- 172.21.15.131:0/1479098630 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cdc0762d0 0x7f8cdc0787e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4033000 tx=0x7f8cf4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:24.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:24.918+0000 7f8cee7fc640 1 -- 172.21.15.131:0/1479098630 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8cf8162dc0 con 0x7f8cf80b64b0 2024-05-17T04:09:25.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.093+0000 7f8cffce4640 1 -- 172.21.15.131:0/1479098630 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8cf80b5a50 con 0x7f8cdc0762d0 2024-05-17T04:09:25.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.099+0000 7f8cee7fc640 1 -- 172.21.15.131:0/1479098630 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f8cf80b5a50 con 0x7f8cdc0762d0 2024-05-17T04:09:25.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:25.105 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-05-17T04:09:25.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.102+0000 7f8cffce4640 1 -- 172.21.15.131:0/1479098630 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cdc0762d0 msgr2=0x7f8cdc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.102+0000 7f8cffce4640 1 --2- 172.21.15.131:0/1479098630 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cdc0762d0 0x7f8cdc0787e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4033000 tx=0x7f8cf4008030 comp rx=0 tx=0).stop 2024-05-17T04:09:25.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.102+0000 7f8cffce4640 1 -- 172.21.15.131:0/1479098630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cf80b64b0 msgr2=0x7f8cf815a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.102+0000 7f8cffce4640 1 --2- 172.21.15.131:0/1479098630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cf80b64b0 0x7f8cf815a730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8cf80b6d70 tx=0x7f8cf000ec10 comp rx=0 tx=0).stop 2024-05-17T04:09:25.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.103+0000 7f8cffce4640 1 -- 172.21.15.131:0/1479098630 shutdown_connections 2024-05-17T04:09:25.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.103+0000 7f8cffce4640 1 --2- 172.21.15.131:0/1479098630 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cdc0762d0 0x7f8cdc0787e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.103+0000 7f8cffce4640 1 --2- 172.21.15.131:0/1479098630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cf80b64b0 0x7f8cf815a730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.103+0000 7f8cffce4640 1 --2- 172.21.15.131:0/1479098630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cf80ca850 0x7f8cf80b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.103+0000 7f8cffce4640 1 --2- 172.21.15.131:0/1479098630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce4003a50 0x7f8cf8155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.103+0000 7f8cffce4640 1 -- 172.21.15.131:0/1479098630 >> 172.21.15.131:0/1479098630 conn(0x7f8cf80d2300 msgr2=0x7f8cf80b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:25.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.103+0000 7f8cffce4640 1 -- 172.21.15.131:0/1479098630 shutdown_connections 2024-05-17T04:09:25.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.103+0000 7f8cffce4640 1 -- 172.21.15.131:0/1479098630 wait complete. 2024-05-17T04:09:25.115 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-05-17T04:09:24.712011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003016"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608267+0000","last_change":"2024-05-17T04:09:05.395971+0000","last_active":"2024-05-17T04:09:11.608267+0000","last_peered":"2024-05-17T04:09:11.608267+0000","last_clean":"2024-05-17T04:09:11.608267+0000","last_became_active":"2024-05-17T04:09:05.395651+0000","last_became_peered":"2024-05-17T04:09:05.395651+0000","last_unstale":"2024-05-17T04:09:11.608267+0000","last_undegraded":"2024-05-17T04:09:11.608267+0000","last_fullsized":"2024-05-17T04:09:11.608267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:57:11.208612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608153+0000","last_change":"2024-05-17T04:09:06.397289+0000","last_active":"2024-05-17T04:09:11.608153+0000","last_peered":"2024-05-17T04:09:11.608153+0000","last_clean":"2024-05-17T04:09:11.608153+0000","last_became_active":"2024-05-17T04:09:06.396997+0000","last_became_peered":"2024-05-17T04:09:06.396997+0000","last_unstale":"2024-05-17T04:09:11.608153+0000","last_undegraded":"2024-05-17T04:09:11.608153+0000","last_fullsized":"2024-05-17T04:09:11.608153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607109+0000","last_change":"2024-05-17T04:09:10.610399+0000","last_active":"2024-05-17T04:09:11.607109+0000","last_peered":"2024-05-17T04:09:11.607109+0000","last_clean":"2024-05-17T04:09:11.607109+0000","last_became_active":"2024-05-17T04:09:10.609922+0000","last_became_peered":"2024-05-17T04:09:10.609922+0000","last_unstale":"2024-05-17T04:09:11.607109+0000","last_undegraded":"2024-05-17T04:09:11.607109+0000","last_fullsized":"2024-05-17T04:09:11.607109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:31:14.568941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608463+0000","last_change":"2024-05-17T04:09:05.395919+0000","last_active":"2024-05-17T04:09:11.608463+0000","last_peered":"2024-05-17T04:09:11.608463+0000","last_clean":"2024-05-17T04:09:11.608463+0000","last_became_active":"2024-05-17T04:09:05.395589+0000","last_became_peered":"2024-05-17T04:09:05.395589+0000","last_unstale":"2024-05-17T04:09:11.608463+0000","last_undegraded":"2024-05-17T04:09:11.608463+0000","last_fullsized":"2024-05-17T04:09:11.608463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:41:33.830645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607815+0000","last_change":"2024-05-17T04:09:06.414579+0000","last_active":"2024-05-17T04:09:11.607815+0000","last_peered":"2024-05-17T04:09:11.607815+0000","last_clean":"2024-05-17T04:09:11.607815+0000","last_became_active":"2024-05-17T04:09:06.414199+0000","last_became_peered":"2024-05-17T04:09:06.414199+0000","last_unstale":"2024-05-17T04:09:11.607815+0000","last_undegraded":"2024-05-17T04:09:11.607815+0000","last_fullsized":"2024-05-17T04:09:11.607815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424690+0000","last_change":"2024-05-17T04:09:10.422768+0000","last_active":"2024-05-17T04:09:11.424690+0000","last_peered":"2024-05-17T04:09:11.424690+0000","last_clean":"2024-05-17T04:09:11.424690+0000","last_became_active":"2024-05-17T04:09:10.422303+0000","last_became_peered":"2024-05-17T04:09:10.422303+0000","last_unstale":"2024-05-17T04:09:11.424690+0000","last_undegraded":"2024-05-17T04:09:11.424690+0000","last_fullsized":"2024-05-17T04:09:11.424690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:12.808010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608697+0000","last_change":"2024-05-17T04:09:05.398049+0000","last_active":"2024-05-17T04:09:11.608697+0000","last_peered":"2024-05-17T04:09:11.608697+0000","last_clean":"2024-05-17T04:09:11.608697+0000","last_became_active":"2024-05-17T04:09:05.397723+0000","last_became_peered":"2024-05-17T04:09:05.397723+0000","last_unstale":"2024-05-17T04:09:11.608697+0000","last_undegraded":"2024-05-17T04:09:11.608697+0000","last_fullsized":"2024-05-17T04:09:11.608697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:13:02.014037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426420+0000","last_change":"2024-05-17T04:09:06.410885+0000","last_active":"2024-05-17T04:09:11.426420+0000","last_peered":"2024-05-17T04:09:11.426420+0000","last_clean":"2024-05-17T04:09:11.426420+0000","last_became_active":"2024-05-17T04:09:06.410301+0000","last_became_peered":"2024-05-17T04:09:06.410301+0000","last_unstale":"2024-05-17T04:09:11.426420+0000","last_undegraded":"2024-05-17T04:09:11.426420+0000","last_fullsized":"2024-05-17T04:09:11.426420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:31.927628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425517+0000","last_change":"2024-05-17T04:09:10.424849+0000","last_active":"2024-05-17T04:09:11.425517+0000","last_peered":"2024-05-17T04:09:11.425517+0000","last_clean":"2024-05-17T04:09:11.425517+0000","last_became_active":"2024-05-17T04:09:10.423933+0000","last_became_peered":"2024-05-17T04:09:10.423933+0000","last_unstale":"2024-05-17T04:09:11.425517+0000","last_undegraded":"2024-05-17T04:09:11.425517+0000","last_fullsized":"2024-05-17T04:09:11.425517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:35.952081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608158+0000","last_change":"2024-05-17T04:09:05.398656+0000","last_active":"2024-05-17T04:09:11.608158+0000","last_peered":"2024-05-17T04:09:11.608158+0000","last_clean":"2024-05-17T04:09:11.608158+0000","last_became_active":"2024-05-17T04:09:05.398331+0000","last_became_peered":"2024-05-17T04:09:05.398331+0000","last_unstale":"2024-05-17T04:09:11.608158+0000","last_undegraded":"2024-05-17T04:09:11.608158+0000","last_fullsized":"2024-05-17T04:09:11.608158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426238+0000","last_change":"2024-05-17T04:09:06.406845+0000","last_active":"2024-05-17T04:09:11.426238+0000","last_peered":"2024-05-17T04:09:11.426238+0000","last_clean":"2024-05-17T04:09:11.426238+0000","last_became_active":"2024-05-17T04:09:06.406340+0000","last_became_peered":"2024-05-17T04:09:06.406340+0000","last_unstale":"2024-05-17T04:09:11.426238+0000","last_undegraded":"2024-05-17T04:09:11.426238+0000","last_fullsized":"2024-05-17T04:09:11.426238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:34.167127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425448+0000","last_change":"2024-05-17T04:09:10.422002+0000","last_active":"2024-05-17T04:09:11.425448+0000","last_peered":"2024-05-17T04:09:11.425448+0000","last_clean":"2024-05-17T04:09:11.425448+0000","last_became_active":"2024-05-17T04:09:10.421382+0000","last_became_peered":"2024-05-17T04:09:10.421382+0000","last_unstale":"2024-05-17T04:09:11.425448+0000","last_undegraded":"2024-05-17T04:09:11.425448+0000","last_fullsized":"2024-05-17T04:09:11.425448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:03:00.539137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607249+0000","last_change":"2024-05-17T04:09:06.405110+0000","last_active":"2024-05-17T04:09:11.607249+0000","last_peered":"2024-05-17T04:09:11.607249+0000","last_clean":"2024-05-17T04:09:11.607249+0000","last_became_active":"2024-05-17T04:09:06.404776+0000","last_became_peered":"2024-05-17T04:09:06.404776+0000","last_unstale":"2024-05-17T04:09:11.607249+0000","last_undegraded":"2024-05-17T04:09:11.607249+0000","last_fullsized":"2024-05-17T04:09:11.607249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608023+0000","last_change":"2024-05-17T04:09:05.399818+0000","last_active":"2024-05-17T04:09:11.608023+0000","last_peered":"2024-05-17T04:09:11.608023+0000","last_clean":"2024-05-17T04:09:11.608023+0000","last_became_active":"2024-05-17T04:09:05.399507+0000","last_became_peered":"2024-05-17T04:09:05.399507+0000","last_unstale":"2024-05-17T04:09:11.608023+0000","last_undegraded":"2024-05-17T04:09:11.608023+0000","last_fullsized":"2024-05-17T04:09:11.608023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:34.821170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426755+0000","last_change":"2024-05-17T04:09:10.420268+0000","last_active":"2024-05-17T04:09:11.426755+0000","last_peered":"2024-05-17T04:09:11.426755+0000","last_clean":"2024-05-17T04:09:11.426755+0000","last_became_active":"2024-05-17T04:09:10.419850+0000","last_became_peered":"2024-05-17T04:09:10.419850+0000","last_unstale":"2024-05-17T04:09:11.426755+0000","last_undegraded":"2024-05-17T04:09:11.426755+0000","last_fullsized":"2024-05-17T04:09:11.426755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:43.859624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608320+0000","last_change":"2024-05-17T04:09:06.395791+0000","last_active":"2024-05-17T04:09:11.608320+0000","last_peered":"2024-05-17T04:09:11.608320+0000","last_clean":"2024-05-17T04:09:11.608320+0000","last_became_active":"2024-05-17T04:09:06.395479+0000","last_became_peered":"2024-05-17T04:09:06.395479+0000","last_unstale":"2024-05-17T04:09:11.608320+0000","last_undegraded":"2024-05-17T04:09:11.608320+0000","last_fullsized":"2024-05-17T04:09:11.608320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515550+0000","last_change":"2024-05-17T04:09:05.396843+0000","last_active":"2024-05-17T04:09:11.515550+0000","last_peered":"2024-05-17T04:09:11.515550+0000","last_clean":"2024-05-17T04:09:11.515550+0000","last_became_active":"2024-05-17T04:09:05.396540+0000","last_became_peered":"2024-05-17T04:09:05.396540+0000","last_unstale":"2024-05-17T04:09:11.515550+0000","last_undegraded":"2024-05-17T04:09:11.515550+0000","last_fullsized":"2024-05-17T04:09:11.515550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:00.457470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425672+0000","last_change":"2024-05-17T04:09:10.423569+0000","last_active":"2024-05-17T04:09:11.425672+0000","last_peered":"2024-05-17T04:09:11.425672+0000","last_clean":"2024-05-17T04:09:11.425672+0000","last_became_active":"2024-05-17T04:09:10.423055+0000","last_became_peered":"2024-05-17T04:09:10.423055+0000","last_unstale":"2024-05-17T04:09:11.425672+0000","last_undegraded":"2024-05-17T04:09:11.425672+0000","last_fullsized":"2024-05-17T04:09:11.425672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:38.191579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607983+0000","last_change":"2024-05-17T04:09:06.402857+0000","last_active":"2024-05-17T04:09:11.607983+0000","last_peered":"2024-05-17T04:09:11.607983+0000","last_clean":"2024-05-17T04:09:11.607983+0000","last_became_active":"2024-05-17T04:09:06.402555+0000","last_became_peered":"2024-05-17T04:09:06.402555+0000","last_unstale":"2024-05-17T04:09:11.607983+0000","last_undegraded":"2024-05-17T04:09:11.607983+0000","last_fullsized":"2024-05-17T04:09:11.607983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514978+0000","last_change":"2024-05-17T04:09:05.395456+0000","last_active":"2024-05-17T04:09:11.514978+0000","last_peered":"2024-05-17T04:09:11.514978+0000","last_clean":"2024-05-17T04:09:11.514978+0000","last_became_active":"2024-05-17T04:09:05.394962+0000","last_became_peered":"2024-05-17T04:09:05.394962+0000","last_unstale":"2024-05-17T04:09:11.514978+0000","last_undegraded":"2024-05-17T04:09:11.514978+0000","last_fullsized":"2024-05-17T04:09:11.514978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515619+0000","last_change":"2024-05-17T04:09:10.611575+0000","last_active":"2024-05-17T04:09:11.515619+0000","last_peered":"2024-05-17T04:09:11.515619+0000","last_clean":"2024-05-17T04:09:11.515619+0000","last_became_active":"2024-05-17T04:09:10.610851+0000","last_became_peered":"2024-05-17T04:09:10.610851+0000","last_unstale":"2024-05-17T04:09:11.515619+0000","last_undegraded":"2024-05-17T04:09:11.515619+0000","last_fullsized":"2024-05-17T04:09:11.515619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:53:08.507830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425259+0000","last_change":"2024-05-17T04:09:06.394990+0000","last_active":"2024-05-17T04:09:11.425259+0000","last_peered":"2024-05-17T04:09:11.425259+0000","last_clean":"2024-05-17T04:09:11.425259+0000","last_became_active":"2024-05-17T04:09:06.394578+0000","last_became_peered":"2024-05-17T04:09:06.394578+0000","last_unstale":"2024-05-17T04:09:11.425259+0000","last_undegraded":"2024-05-17T04:09:11.425259+0000","last_fullsized":"2024-05-17T04:09:11.425259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:05.815923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607236+0000","last_change":"2024-05-17T04:09:05.403173+0000","last_active":"2024-05-17T04:09:11.607236+0000","last_peered":"2024-05-17T04:09:11.607236+0000","last_clean":"2024-05-17T04:09:11.607236+0000","last_became_active":"2024-05-17T04:09:05.402862+0000","last_became_peered":"2024-05-17T04:09:05.402862+0000","last_unstale":"2024-05-17T04:09:11.607236+0000","last_undegraded":"2024-05-17T04:09:11.607236+0000","last_fullsized":"2024-05-17T04:09:11.607236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:00.457470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425484+0000","last_change":"2024-05-17T04:09:10.424841+0000","last_active":"2024-05-17T04:09:11.425484+0000","last_peered":"2024-05-17T04:09:11.425484+0000","last_clean":"2024-05-17T04:09:11.425484+0000","last_became_active":"2024-05-17T04:09:10.423871+0000","last_became_peered":"2024-05-17T04:09:10.423871+0000","last_unstale":"2024-05-17T04:09:11.425484+0000","last_undegraded":"2024-05-17T04:09:11.425484+0000","last_fullsized":"2024-05-17T04:09:11.425484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:46.008630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608200+0000","last_change":"2024-05-17T04:09:06.397726+0000","last_active":"2024-05-17T04:09:11.608200+0000","last_peered":"2024-05-17T04:09:11.608200+0000","last_clean":"2024-05-17T04:09:11.608200+0000","last_became_active":"2024-05-17T04:09:06.396138+0000","last_became_peered":"2024-05-17T04:09:06.396138+0000","last_unstale":"2024-05-17T04:09:11.608200+0000","last_undegraded":"2024-05-17T04:09:11.608200+0000","last_fullsized":"2024-05-17T04:09:11.608200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608451+0000","last_change":"2024-05-17T04:09:05.395429+0000","last_active":"2024-05-17T04:09:11.608451+0000","last_peered":"2024-05-17T04:09:11.608451+0000","last_clean":"2024-05-17T04:09:11.608451+0000","last_became_active":"2024-05-17T04:09:05.394265+0000","last_became_peered":"2024-05-17T04:09:05.394265+0000","last_unstale":"2024-05-17T04:09:11.608451+0000","last_undegraded":"2024-05-17T04:09:11.608451+0000","last_fullsized":"2024-05-17T04:09:11.608451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425112+0000","last_change":"2024-05-17T04:09:10.608056+0000","last_active":"2024-05-17T04:09:11.425112+0000","last_peered":"2024-05-17T04:09:11.425112+0000","last_clean":"2024-05-17T04:09:11.425112+0000","last_became_active":"2024-05-17T04:09:10.607528+0000","last_became_peered":"2024-05-17T04:09:10.607528+0000","last_unstale":"2024-05-17T04:09:11.425112+0000","last_undegraded":"2024-05-17T04:09:11.425112+0000","last_fullsized":"2024-05-17T04:09:11.425112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:13.074744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607552+0000","last_change":"2024-05-17T04:09:06.403004+0000","last_active":"2024-05-17T04:09:11.607552+0000","last_peered":"2024-05-17T04:09:11.607552+0000","last_clean":"2024-05-17T04:09:11.607552+0000","last_became_active":"2024-05-17T04:09:06.402507+0000","last_became_peered":"2024-05-17T04:09:06.402507+0000","last_unstale":"2024-05-17T04:09:11.607552+0000","last_undegraded":"2024-05-17T04:09:11.607552+0000","last_fullsized":"2024-05-17T04:09:11.607552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:41.984177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515570+0000","last_change":"2024-05-17T04:09:05.399350+0000","last_active":"2024-05-17T04:09:11.515570+0000","last_peered":"2024-05-17T04:09:11.515570+0000","last_clean":"2024-05-17T04:09:11.515570+0000","last_became_active":"2024-05-17T04:09:05.399049+0000","last_became_peered":"2024-05-17T04:09:05.399049+0000","last_unstale":"2024-05-17T04:09:11.515570+0000","last_undegraded":"2024-05-17T04:09:11.515570+0000","last_fullsized":"2024-05-17T04:09:11.515570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607786+0000","last_change":"2024-05-17T04:09:10.611499+0000","last_active":"2024-05-17T04:09:11.607786+0000","last_peered":"2024-05-17T04:09:11.607786+0000","last_clean":"2024-05-17T04:09:11.607786+0000","last_became_active":"2024-05-17T04:09:10.611068+0000","last_became_peered":"2024-05-17T04:09:10.611068+0000","last_unstale":"2024-05-17T04:09:11.607786+0000","last_undegraded":"2024-05-17T04:09:11.607786+0000","last_fullsized":"2024-05-17T04:09:11.607786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:32:16.388318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515650+0000","last_change":"2024-05-17T04:09:06.399281+0000","last_active":"2024-05-17T04:09:11.515650+0000","last_peered":"2024-05-17T04:09:11.515650+0000","last_clean":"2024-05-17T04:09:11.515650+0000","last_became_active":"2024-05-17T04:09:06.398973+0000","last_became_peered":"2024-05-17T04:09:06.398973+0000","last_unstale":"2024-05-17T04:09:11.515650+0000","last_undegraded":"2024-05-17T04:09:11.515650+0000","last_fullsized":"2024-05-17T04:09:11.515650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608834+0000","last_change":"2024-05-17T04:09:05.402787+0000","last_active":"2024-05-17T04:09:11.608834+0000","last_peered":"2024-05-17T04:09:11.608834+0000","last_clean":"2024-05-17T04:09:11.608834+0000","last_became_active":"2024-05-17T04:09:05.402451+0000","last_became_peered":"2024-05-17T04:09:05.402451+0000","last_unstale":"2024-05-17T04:09:11.608834+0000","last_undegraded":"2024-05-17T04:09:11.608834+0000","last_fullsized":"2024-05-17T04:09:11.608834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607456+0000","last_change":"2024-05-17T04:09:10.608220+0000","last_active":"2024-05-17T04:09:11.607456+0000","last_peered":"2024-05-17T04:09:11.607456+0000","last_clean":"2024-05-17T04:09:11.607456+0000","last_became_active":"2024-05-17T04:09:10.607719+0000","last_became_peered":"2024-05-17T04:09:10.607719+0000","last_unstale":"2024-05-17T04:09:11.607456+0000","last_undegraded":"2024-05-17T04:09:11.607456+0000","last_fullsized":"2024-05-17T04:09:11.607456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:53:08.507830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426361+0000","last_change":"2024-05-17T04:09:06.406634+0000","last_active":"2024-05-17T04:09:11.426361+0000","last_peered":"2024-05-17T04:09:11.426361+0000","last_clean":"2024-05-17T04:09:11.426361+0000","last_became_active":"2024-05-17T04:09:06.406011+0000","last_became_peered":"2024-05-17T04:09:06.406011+0000","last_unstale":"2024-05-17T04:09:11.426361+0000","last_undegraded":"2024-05-17T04:09:11.426361+0000","last_fullsized":"2024-05-17T04:09:11.426361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:49.079670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515733+0000","last_change":"2024-05-17T04:09:05.395393+0000","last_active":"2024-05-17T04:09:11.515733+0000","last_peered":"2024-05-17T04:09:11.515733+0000","last_clean":"2024-05-17T04:09:11.515733+0000","last_became_active":"2024-05-17T04:09:05.395026+0000","last_became_peered":"2024-05-17T04:09:05.395026+0000","last_unstale":"2024-05-17T04:09:11.515733+0000","last_undegraded":"2024-05-17T04:09:11.515733+0000","last_fullsized":"2024-05-17T04:09:11.515733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514970+0000","last_change":"2024-05-17T04:09:10.426127+0000","last_active":"2024-05-17T04:09:11.514970+0000","last_peered":"2024-05-17T04:09:11.514970+0000","last_clean":"2024-05-17T04:09:11.514970+0000","last_became_active":"2024-05-17T04:09:10.425310+0000","last_became_peered":"2024-05-17T04:09:10.425310+0000","last_unstale":"2024-05-17T04:09:11.514970+0000","last_undegraded":"2024-05-17T04:09:11.514970+0000","last_fullsized":"2024-05-17T04:09:11.514970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:05:01.660626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426527+0000","last_change":"2024-05-17T04:09:06.396617+0000","last_active":"2024-05-17T04:09:11.426527+0000","last_peered":"2024-05-17T04:09:11.426527+0000","last_clean":"2024-05-17T04:09:11.426527+0000","last_became_active":"2024-05-17T04:09:06.396314+0000","last_became_peered":"2024-05-17T04:09:06.396314+0000","last_unstale":"2024-05-17T04:09:11.426527+0000","last_undegraded":"2024-05-17T04:09:11.426527+0000","last_fullsized":"2024-05-17T04:09:11.426527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:07.188086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425216+0000","last_change":"2024-05-17T04:09:05.394393+0000","last_active":"2024-05-17T04:09:11.425216+0000","last_peered":"2024-05-17T04:09:11.425216+0000","last_clean":"2024-05-17T04:09:11.425216+0000","last_became_active":"2024-05-17T04:09:05.393756+0000","last_became_peered":"2024-05-17T04:09:05.393756+0000","last_unstale":"2024-05-17T04:09:11.425216+0000","last_undegraded":"2024-05-17T04:09:11.425216+0000","last_fullsized":"2024-05-17T04:09:11.425216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515309+0000","last_change":"2024-05-17T04:09:10.419986+0000","last_active":"2024-05-17T04:09:11.515309+0000","last_peered":"2024-05-17T04:09:11.515309+0000","last_clean":"2024-05-17T04:09:11.515309+0000","last_became_active":"2024-05-17T04:09:10.419116+0000","last_became_peered":"2024-05-17T04:09:10.419116+0000","last_unstale":"2024-05-17T04:09:11.515309+0000","last_undegraded":"2024-05-17T04:09:11.515309+0000","last_fullsized":"2024-05-17T04:09:11.515309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:28.367001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514954+0000","last_change":"2024-05-17T04:09:06.407059+0000","last_active":"2024-05-17T04:09:11.514954+0000","last_peered":"2024-05-17T04:09:11.514954+0000","last_clean":"2024-05-17T04:09:11.514954+0000","last_became_active":"2024-05-17T04:09:06.406752+0000","last_became_peered":"2024-05-17T04:09:06.406752+0000","last_unstale":"2024-05-17T04:09:11.514954+0000","last_undegraded":"2024-05-17T04:09:11.514954+0000","last_fullsized":"2024-05-17T04:09:11.514954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.423948+0000","last_change":"2024-05-17T04:09:05.390296+0000","last_active":"2024-05-17T04:09:11.423948+0000","last_peered":"2024-05-17T04:09:11.423948+0000","last_clean":"2024-05-17T04:09:11.423948+0000","last_became_active":"2024-05-17T04:09:05.389917+0000","last_became_peered":"2024-05-17T04:09:05.389917+0000","last_unstale":"2024-05-17T04:09:11.423948+0000","last_undegraded":"2024-05-17T04:09:11.423948+0000","last_fullsized":"2024-05-17T04:09:11.423948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515762+0000","last_change":"2024-05-17T04:09:10.429919+0000","last_active":"2024-05-17T04:09:11.515762+0000","last_peered":"2024-05-17T04:09:11.515762+0000","last_clean":"2024-05-17T04:09:11.515762+0000","last_became_active":"2024-05-17T04:09:10.429394+0000","last_became_peered":"2024-05-17T04:09:10.429394+0000","last_unstale":"2024-05-17T04:09:11.515762+0000","last_undegraded":"2024-05-17T04:09:11.515762+0000","last_fullsized":"2024-05-17T04:09:11.515762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:44.081339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.606952+0000","last_change":"2024-05-17T04:09:06.403836+0000","last_active":"2024-05-17T04:09:11.606952+0000","last_peered":"2024-05-17T04:09:11.606952+0000","last_clean":"2024-05-17T04:09:11.606952+0000","last_became_active":"2024-05-17T04:09:06.403514+0000","last_became_peered":"2024-05-17T04:09:06.403514+0000","last_unstale":"2024-05-17T04:09:11.606952+0000","last_undegraded":"2024-05-17T04:09:11.606952+0000","last_fullsized":"2024-05-17T04:09:11.606952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:01:05.018624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607372+0000","last_change":"2024-05-17T04:09:05.401167+0000","last_active":"2024-05-17T04:09:11.607372+0000","last_peered":"2024-05-17T04:09:11.607372+0000","last_clean":"2024-05-17T04:09:11.607372+0000","last_became_active":"2024-05-17T04:09:05.400797+0000","last_became_peered":"2024-05-17T04:09:05.400797+0000","last_unstale":"2024-05-17T04:09:11.607372+0000","last_undegraded":"2024-05-17T04:09:11.607372+0000","last_fullsized":"2024-05-17T04:09:11.607372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:23:01.826205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607778+0000","last_change":"2024-05-17T04:09:10.607420+0000","last_active":"2024-05-17T04:09:11.607778+0000","last_peered":"2024-05-17T04:09:11.607778+0000","last_clean":"2024-05-17T04:09:11.607778+0000","last_became_active":"2024-05-17T04:09:10.606963+0000","last_became_peered":"2024-05-17T04:09:10.606963+0000","last_unstale":"2024-05-17T04:09:11.607778+0000","last_undegraded":"2024-05-17T04:09:11.607778+0000","last_fullsized":"2024-05-17T04:09:11.607778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:28.367001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607186+0000","last_change":"2024-05-17T04:09:06.414099+0000","last_active":"2024-05-17T04:09:11.607186+0000","last_peered":"2024-05-17T04:09:11.607186+0000","last_clean":"2024-05-17T04:09:11.607186+0000","last_became_active":"2024-05-17T04:09:06.413727+0000","last_became_peered":"2024-05-17T04:09:06.413727+0000","last_unstale":"2024-05-17T04:09:11.607186+0000","last_undegraded":"2024-05-17T04:09:11.607186+0000","last_fullsized":"2024-05-17T04:09:11.607186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424782+0000","last_change":"2024-05-17T04:09:05.395595+0000","last_active":"2024-05-17T04:09:11.424782+0000","last_peered":"2024-05-17T04:09:11.424782+0000","last_clean":"2024-05-17T04:09:11.424782+0000","last_became_active":"2024-05-17T04:09:05.395288+0000","last_became_peered":"2024-05-17T04:09:05.395288+0000","last_unstale":"2024-05-17T04:09:11.424782+0000","last_undegraded":"2024-05-17T04:09:11.424782+0000","last_fullsized":"2024-05-17T04:09:11.424782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607476+0000","last_change":"2024-05-17T04:08:56.447797+0000","last_active":"2024-05-17T04:09:11.607476+0000","last_peered":"2024-05-17T04:09:11.607476+0000","last_clean":"2024-05-17T04:09:11.607476+0000","last_became_active":"2024-05-17T04:08:56.446705+0000","last_became_peered":"2024-05-17T04:08:56.446705+0000","last_unstale":"2024-05-17T04:09:11.607476+0000","last_undegraded":"2024-05-17T04:09:11.607476+0000","last_fullsized":"2024-05-17T04:09:11.607476+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_clean_scrub_stamp":"2024-05-17T04:08:54.847367+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:40:00.515431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608157+0000","last_change":"2024-05-17T04:09:10.608442+0000","last_active":"2024-05-17T04:09:11.608157+0000","last_peered":"2024-05-17T04:09:11.608157+0000","last_clean":"2024-05-17T04:09:11.608157+0000","last_became_active":"2024-05-17T04:09:10.607993+0000","last_became_peered":"2024-05-17T04:09:10.607993+0000","last_unstale":"2024-05-17T04:09:11.608157+0000","last_undegraded":"2024-05-17T04:09:11.608157+0000","last_fullsized":"2024-05-17T04:09:11.608157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:53.104122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608435+0000","last_change":"2024-05-17T04:09:06.414021+0000","last_active":"2024-05-17T04:09:11.608435+0000","last_peered":"2024-05-17T04:09:11.608435+0000","last_clean":"2024-05-17T04:09:11.608435+0000","last_became_active":"2024-05-17T04:09:06.413481+0000","last_became_peered":"2024-05-17T04:09:06.413481+0000","last_unstale":"2024-05-17T04:09:11.608435+0000","last_undegraded":"2024-05-17T04:09:11.608435+0000","last_fullsized":"2024-05-17T04:09:11.608435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:31.927628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424257+0000","last_change":"2024-05-17T04:09:05.394878+0000","last_active":"2024-05-17T04:09:11.424257+0000","last_peered":"2024-05-17T04:09:11.424257+0000","last_clean":"2024-05-17T04:09:11.424257+0000","last_became_active":"2024-05-17T04:09:05.394529+0000","last_became_peered":"2024-05-17T04:09:05.394529+0000","last_unstale":"2024-05-17T04:09:11.424257+0000","last_undegraded":"2024-05-17T04:09:11.424257+0000","last_fullsized":"2024-05-17T04:09:11.424257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:41:33.830645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607795+0000","last_change":"2024-05-17T04:09:10.607640+0000","last_active":"2024-05-17T04:09:11.607795+0000","last_peered":"2024-05-17T04:09:11.607795+0000","last_clean":"2024-05-17T04:09:11.607795+0000","last_became_active":"2024-05-17T04:09:10.607137+0000","last_became_peered":"2024-05-17T04:09:10.607137+0000","last_unstale":"2024-05-17T04:09:11.607795+0000","last_undegraded":"2024-05-17T04:09:11.607795+0000","last_fullsized":"2024-05-17T04:09:11.607795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:35.952081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426630+0000","last_change":"2024-05-17T04:09:06.399777+0000","last_active":"2024-05-17T04:09:11.426630+0000","last_peered":"2024-05-17T04:09:11.426630+0000","last_clean":"2024-05-17T04:09:11.426630+0000","last_became_active":"2024-05-17T04:09:06.399443+0000","last_became_peered":"2024-05-17T04:09:06.399443+0000","last_unstale":"2024-05-17T04:09:11.426630+0000","last_undegraded":"2024-05-17T04:09:11.426630+0000","last_fullsized":"2024-05-17T04:09:11.426630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:39.835171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515423+0000","last_change":"2024-05-17T04:09:05.397664+0000","last_active":"2024-05-17T04:09:11.515423+0000","last_peered":"2024-05-17T04:09:11.515423+0000","last_clean":"2024-05-17T04:09:11.515423+0000","last_became_active":"2024-05-17T04:09:05.397386+0000","last_became_peered":"2024-05-17T04:09:05.397386+0000","last_unstale":"2024-05-17T04:09:11.515423+0000","last_undegraded":"2024-05-17T04:09:11.515423+0000","last_fullsized":"2024-05-17T04:09:11.515423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607683+0000","last_change":"2024-05-17T04:09:10.424457+0000","last_active":"2024-05-17T04:09:11.607683+0000","last_peered":"2024-05-17T04:09:11.607683+0000","last_clean":"2024-05-17T04:09:11.607683+0000","last_became_active":"2024-05-17T04:09:10.423487+0000","last_became_peered":"2024-05-17T04:09:10.423487+0000","last_unstale":"2024-05-17T04:09:11.607683+0000","last_undegraded":"2024-05-17T04:09:11.607683+0000","last_fullsized":"2024-05-17T04:09:11.607683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:14.612103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.609012+0000","last_change":"2024-05-17T04:09:06.411544+0000","last_active":"2024-05-17T04:09:11.609012+0000","last_peered":"2024-05-17T04:09:11.609012+0000","last_clean":"2024-05-17T04:09:11.609012+0000","last_became_active":"2024-05-17T04:09:06.411193+0000","last_became_peered":"2024-05-17T04:09:06.411193+0000","last_unstale":"2024-05-17T04:09:11.609012+0000","last_undegraded":"2024-05-17T04:09:11.609012+0000","last_fullsized":"2024-05-17T04:09:11.609012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:40.056886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424170+0000","last_change":"2024-05-17T04:09:05.390395+0000","last_active":"2024-05-17T04:09:11.424170+0000","last_peered":"2024-05-17T04:09:11.424170+0000","last_clean":"2024-05-17T04:09:11.424170+0000","last_became_active":"2024-05-17T04:09:05.389769+0000","last_became_peered":"2024-05-17T04:09:05.389769+0000","last_unstale":"2024-05-17T04:09:11.424170+0000","last_undegraded":"2024-05-17T04:09:11.424170+0000","last_fullsized":"2024-05-17T04:09:11.424170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424395+0000","last_change":"2024-05-17T04:09:10.610765+0000","last_active":"2024-05-17T04:09:11.424395+0000","last_peered":"2024-05-17T04:09:11.424395+0000","last_clean":"2024-05-17T04:09:11.424395+0000","last_became_active":"2024-05-17T04:09:10.610286+0000","last_became_peered":"2024-05-17T04:09:10.610286+0000","last_unstale":"2024-05-17T04:09:11.424395+0000","last_undegraded":"2024-05-17T04:09:11.424395+0000","last_fullsized":"2024-05-17T04:09:11.424395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:31:14.568941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608756+0000","last_change":"2024-05-17T04:09:06.408406+0000","last_active":"2024-05-17T04:09:11.608756+0000","last_peered":"2024-05-17T04:09:11.608756+0000","last_clean":"2024-05-17T04:09:11.608756+0000","last_became_active":"2024-05-17T04:09:06.405343+0000","last_became_peered":"2024-05-17T04:09:06.405343+0000","last_unstale":"2024-05-17T04:09:11.608756+0000","last_undegraded":"2024-05-17T04:09:11.608756+0000","last_fullsized":"2024-05-17T04:09:11.608756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:49.079670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426903+0000","last_change":"2024-05-17T04:09:05.396149+0000","last_active":"2024-05-17T04:09:11.426903+0000","last_peered":"2024-05-17T04:09:11.426903+0000","last_clean":"2024-05-17T04:09:11.426903+0000","last_became_active":"2024-05-17T04:09:05.395640+0000","last_became_peered":"2024-05-17T04:09:05.395640+0000","last_unstale":"2024-05-17T04:09:11.426903+0000","last_undegraded":"2024-05-17T04:09:11.426903+0000","last_fullsized":"2024-05-17T04:09:11.426903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:36:25.869388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424730+0000","last_change":"2024-05-17T04:09:10.420386+0000","last_active":"2024-05-17T04:09:11.424730+0000","last_peered":"2024-05-17T04:09:11.424730+0000","last_clean":"2024-05-17T04:09:11.424730+0000","last_became_active":"2024-05-17T04:09:10.419914+0000","last_became_peered":"2024-05-17T04:09:10.419914+0000","last_unstale":"2024-05-17T04:09:11.424730+0000","last_undegraded":"2024-05-17T04:09:11.424730+0000","last_fullsized":"2024-05-17T04:09:11.424730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:06.408047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607581+0000","last_change":"2024-05-17T04:09:06.408118+0000","last_active":"2024-05-17T04:09:11.607581+0000","last_peered":"2024-05-17T04:09:11.607581+0000","last_clean":"2024-05-17T04:09:11.607581+0000","last_became_active":"2024-05-17T04:09:06.406680+0000","last_became_peered":"2024-05-17T04:09:06.406680+0000","last_unstale":"2024-05-17T04:09:11.607581+0000","last_undegraded":"2024-05-17T04:09:11.607581+0000","last_fullsized":"2024-05-17T04:09:11.607581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:34.167127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.423794+0000","last_change":"2024-05-17T04:09:05.397048+0000","last_active":"2024-05-17T04:09:11.423794+0000","last_peered":"2024-05-17T04:09:11.423794+0000","last_clean":"2024-05-17T04:09:11.423794+0000","last_became_active":"2024-05-17T04:09:05.396745+0000","last_became_peered":"2024-05-17T04:09:05.396745+0000","last_unstale":"2024-05-17T04:09:11.423794+0000","last_undegraded":"2024-05-17T04:09:11.423794+0000","last_fullsized":"2024-05-17T04:09:11.423794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607578+0000","last_change":"2024-05-17T04:09:10.427098+0000","last_active":"2024-05-17T04:09:11.607578+0000","last_peered":"2024-05-17T04:09:11.607578+0000","last_clean":"2024-05-17T04:09:11.607578+0000","last_became_active":"2024-05-17T04:09:10.426559+0000","last_became_peered":"2024-05-17T04:09:10.426559+0000","last_unstale":"2024-05-17T04:09:11.607578+0000","last_undegraded":"2024-05-17T04:09:11.607578+0000","last_fullsized":"2024-05-17T04:09:11.607578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:44.081339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607896+0000","last_change":"2024-05-17T04:09:06.394018+0000","last_active":"2024-05-17T04:09:11.607896+0000","last_peered":"2024-05-17T04:09:11.607896+0000","last_clean":"2024-05-17T04:09:11.607896+0000","last_became_active":"2024-05-17T04:09:06.393664+0000","last_became_peered":"2024-05-17T04:09:06.393664+0000","last_unstale":"2024-05-17T04:09:11.607896+0000","last_undegraded":"2024-05-17T04:09:11.607896+0000","last_fullsized":"2024-05-17T04:09:11.607896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:07:56.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607640+0000","last_change":"2024-05-17T04:09:05.395140+0000","last_active":"2024-05-17T04:09:11.607640+0000","last_peered":"2024-05-17T04:09:11.607640+0000","last_clean":"2024-05-17T04:09:11.607640+0000","last_became_active":"2024-05-17T04:09:05.394556+0000","last_became_peered":"2024-05-17T04:09:05.394556+0000","last_unstale":"2024-05-17T04:09:11.607640+0000","last_undegraded":"2024-05-17T04:09:11.607640+0000","last_fullsized":"2024-05-17T04:09:11.607640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607361+0000","last_change":"2024-05-17T04:09:10.608635+0000","last_active":"2024-05-17T04:09:11.607361+0000","last_peered":"2024-05-17T04:09:11.607361+0000","last_clean":"2024-05-17T04:09:11.607361+0000","last_became_active":"2024-05-17T04:09:10.608151+0000","last_became_peered":"2024-05-17T04:09:10.608151+0000","last_unstale":"2024-05-17T04:09:11.607361+0000","last_undegraded":"2024-05-17T04:09:11.607361+0000","last_fullsized":"2024-05-17T04:09:11.607361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:32:44.289047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607892+0000","last_change":"2024-05-17T04:09:06.407790+0000","last_active":"2024-05-17T04:09:11.607892+0000","last_peered":"2024-05-17T04:09:11.607892+0000","last_clean":"2024-05-17T04:09:11.607892+0000","last_became_active":"2024-05-17T04:09:06.407484+0000","last_became_peered":"2024-05-17T04:09:06.407484+0000","last_unstale":"2024-05-17T04:09:11.607892+0000","last_undegraded":"2024-05-17T04:09:11.607892+0000","last_fullsized":"2024-05-17T04:09:11.607892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:39.835171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425090+0000","last_change":"2024-05-17T04:09:05.393381+0000","last_active":"2024-05-17T04:09:11.425090+0000","last_peered":"2024-05-17T04:09:11.425090+0000","last_clean":"2024-05-17T04:09:11.425090+0000","last_became_active":"2024-05-17T04:09:05.392480+0000","last_became_peered":"2024-05-17T04:09:05.392480+0000","last_unstale":"2024-05-17T04:09:11.425090+0000","last_undegraded":"2024-05-17T04:09:11.425090+0000","last_fullsized":"2024-05-17T04:09:11.425090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608339+0000","last_change":"2024-05-17T04:09:10.607929+0000","last_active":"2024-05-17T04:09:11.608339+0000","last_peered":"2024-05-17T04:09:11.608339+0000","last_clean":"2024-05-17T04:09:11.608339+0000","last_became_active":"2024-05-17T04:09:10.606975+0000","last_became_peered":"2024-05-17T04:09:10.606975+0000","last_unstale":"2024-05-17T04:09:11.608339+0000","last_undegraded":"2024-05-17T04:09:11.608339+0000","last_fullsized":"2024-05-17T04:09:11.608339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:36:14.040927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607173+0000","last_change":"2024-05-17T04:09:06.399704+0000","last_active":"2024-05-17T04:09:11.607173+0000","last_peered":"2024-05-17T04:09:11.607173+0000","last_clean":"2024-05-17T04:09:11.607173+0000","last_became_active":"2024-05-17T04:09:06.399395+0000","last_became_peered":"2024-05-17T04:09:06.399395+0000","last_unstale":"2024-05-17T04:09:11.607173+0000","last_undegraded":"2024-05-17T04:09:11.607173+0000","last_fullsized":"2024-05-17T04:09:11.607173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:33:02.204060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608048+0000","last_change":"2024-05-17T04:09:05.394133+0000","last_active":"2024-05-17T04:09:11.608048+0000","last_peered":"2024-05-17T04:09:11.608048+0000","last_clean":"2024-05-17T04:09:11.608048+0000","last_became_active":"2024-05-17T04:09:05.393854+0000","last_became_peered":"2024-05-17T04:09:05.393854+0000","last_unstale":"2024-05-17T04:09:11.608048+0000","last_undegraded":"2024-05-17T04:09:11.608048+0000","last_fullsized":"2024-05-17T04:09:11.608048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:41:33.830645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426113+0000","last_change":"2024-05-17T04:09:10.607826+0000","last_active":"2024-05-17T04:09:11.426113+0000","last_peered":"2024-05-17T04:09:11.426113+0000","last_clean":"2024-05-17T04:09:11.426113+0000","last_became_active":"2024-05-17T04:09:10.607382+0000","last_became_peered":"2024-05-17T04:09:10.607382+0000","last_unstale":"2024-05-17T04:09:11.426113+0000","last_undegraded":"2024-05-17T04:09:11.426113+0000","last_fullsized":"2024-05-17T04:09:11.426113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:55:48.002918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608335+0000","last_change":"2024-05-17T04:09:06.403425+0000","last_active":"2024-05-17T04:09:11.608335+0000","last_peered":"2024-05-17T04:09:11.608335+0000","last_clean":"2024-05-17T04:09:11.608335+0000","last_became_active":"2024-05-17T04:09:06.403093+0000","last_became_peered":"2024-05-17T04:09:06.403093+0000","last_unstale":"2024-05-17T04:09:11.608335+0000","last_undegraded":"2024-05-17T04:09:11.608335+0000","last_fullsized":"2024-05-17T04:09:11.608335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:41.984177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:15.993336+0000","last_change":"2024-05-17T04:09:05.393968+0000","last_active":"2024-05-17T04:09:15.993336+0000","last_peered":"2024-05-17T04:09:15.993336+0000","last_clean":"2024-05-17T04:09:15.993336+0000","last_became_active":"2024-05-17T04:09:05.393641+0000","last_became_peered":"2024-05-17T04:09:05.393641+0000","last_unstale":"2024-05-17T04:09:15.993336+0000","last_undegraded":"2024-05-17T04:09:15.993336+0000","last_fullsized":"2024-05-17T04:09:15.993336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515095+0000","last_change":"2024-05-17T04:09:10.424091+0000","last_active":"2024-05-17T04:09:11.515095+0000","last_peered":"2024-05-17T04:09:11.515095+0000","last_clean":"2024-05-17T04:09:11.515095+0000","last_became_active":"2024-05-17T04:09:10.423669+0000","last_became_peered":"2024-05-17T04:09:10.423669+0000","last_unstale":"2024-05-17T04:09:11.515095+0000","last_undegraded":"2024-05-17T04:09:11.515095+0000","last_fullsized":"2024-05-17T04:09:11.515095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:14.612103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425973+0000","last_change":"2024-05-17T04:09:06.395242+0000","last_active":"2024-05-17T04:09:11.425973+0000","last_peered":"2024-05-17T04:09:11.425973+0000","last_clean":"2024-05-17T04:09:11.425973+0000","last_became_active":"2024-05-17T04:09:06.394956+0000","last_became_peered":"2024-05-17T04:09:06.394956+0000","last_unstale":"2024-05-17T04:09:11.425973+0000","last_undegraded":"2024-05-17T04:09:11.425973+0000","last_fullsized":"2024-05-17T04:09:11.425973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:35.828470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515417+0000","last_change":"2024-05-17T04:09:05.395871+0000","last_active":"2024-05-17T04:09:11.515417+0000","last_peered":"2024-05-17T04:09:11.515417+0000","last_clean":"2024-05-17T04:09:11.515417+0000","last_became_active":"2024-05-17T04:09:05.395565+0000","last_became_peered":"2024-05-17T04:09:05.395565+0000","last_unstale":"2024-05-17T04:09:11.515417+0000","last_undegraded":"2024-05-17T04:09:11.515417+0000","last_fullsized":"2024-05-17T04:09:11.515417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:34.821170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425594+0000","last_change":"2024-05-17T04:09:10.422395+0000","last_active":"2024-05-17T04:09:11.425594+0000","last_peered":"2024-05-17T04:09:11.425594+0000","last_clean":"2024-05-17T04:09:11.425594+0000","last_became_active":"2024-05-17T04:09:10.421563+0000","last_became_peered":"2024-05-17T04:09:10.421563+0000","last_unstale":"2024-05-17T04:09:11.425594+0000","last_undegraded":"2024-05-17T04:09:11.425594+0000","last_fullsized":"2024-05-17T04:09:11.425594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:53.104122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608163+0000","last_change":"2024-05-17T04:09:06.407304+0000","last_active":"2024-05-17T04:09:11.608163+0000","last_peered":"2024-05-17T04:09:11.608163+0000","last_clean":"2024-05-17T04:09:11.608163+0000","last_became_active":"2024-05-17T04:09:06.406969+0000","last_became_peered":"2024-05-17T04:09:06.406969+0000","last_unstale":"2024-05-17T04:09:11.608163+0000","last_undegraded":"2024-05-17T04:09:11.608163+0000","last_fullsized":"2024-05-17T04:09:11.608163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426091+0000","last_change":"2024-05-17T04:09:05.396508+0000","last_active":"2024-05-17T04:09:11.426091+0000","last_peered":"2024-05-17T04:09:11.426091+0000","last_clean":"2024-05-17T04:09:11.426091+0000","last_became_active":"2024-05-17T04:09:05.396175+0000","last_became_peered":"2024-05-17T04:09:05.396175+0000","last_unstale":"2024-05-17T04:09:11.426091+0000","last_undegraded":"2024-05-17T04:09:11.426091+0000","last_fullsized":"2024-05-17T04:09:11.426091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607951+0000","last_change":"2024-05-17T04:09:10.426973+0000","last_active":"2024-05-17T04:09:11.607951+0000","last_peered":"2024-05-17T04:09:11.607951+0000","last_clean":"2024-05-17T04:09:11.607951+0000","last_became_active":"2024-05-17T04:09:10.426412+0000","last_became_peered":"2024-05-17T04:09:10.426412+0000","last_unstale":"2024-05-17T04:09:11.607951+0000","last_undegraded":"2024-05-17T04:09:11.607951+0000","last_fullsized":"2024-05-17T04:09:11.607951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:12:14.748809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425895+0000","last_change":"2024-05-17T04:09:06.403005+0000","last_active":"2024-05-17T04:09:11.425895+0000","last_peered":"2024-05-17T04:09:11.425895+0000","last_clean":"2024-05-17T04:09:11.425895+0000","last_became_active":"2024-05-17T04:09:06.402234+0000","last_became_peered":"2024-05-17T04:09:06.402234+0000","last_unstale":"2024-05-17T04:09:11.425895+0000","last_undegraded":"2024-05-17T04:09:11.425895+0000","last_fullsized":"2024-05-17T04:09:11.425895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:02:56.514685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608325+0000","last_change":"2024-05-17T04:09:05.398997+0000","last_active":"2024-05-17T04:09:11.608325+0000","last_peered":"2024-05-17T04:09:11.608325+0000","last_clean":"2024-05-17T04:09:11.608325+0000","last_became_active":"2024-05-17T04:09:05.398311+0000","last_became_peered":"2024-05-17T04:09:05.398311+0000","last_unstale":"2024-05-17T04:09:11.608325+0000","last_undegraded":"2024-05-17T04:09:11.608325+0000","last_fullsized":"2024-05-17T04:09:11.608325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607285+0000","last_change":"2024-05-17T04:09:10.611442+0000","last_active":"2024-05-17T04:09:11.607285+0000","last_peered":"2024-05-17T04:09:11.607285+0000","last_clean":"2024-05-17T04:09:11.607285+0000","last_became_active":"2024-05-17T04:09:10.610948+0000","last_became_peered":"2024-05-17T04:09:10.610948+0000","last_unstale":"2024-05-17T04:09:11.607285+0000","last_undegraded":"2024-05-17T04:09:11.607285+0000","last_fullsized":"2024-05-17T04:09:11.607285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:55:48.002918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607426+0000","last_change":"2024-05-17T04:09:10.610609+0000","last_active":"2024-05-17T04:09:11.607426+0000","last_peered":"2024-05-17T04:09:11.607426+0000","last_clean":"2024-05-17T04:09:11.607426+0000","last_became_active":"2024-05-17T04:09:10.610158+0000","last_became_peered":"2024-05-17T04:09:10.610158+0000","last_unstale":"2024-05-17T04:09:11.607426+0000","last_undegraded":"2024-05-17T04:09:11.607426+0000","last_fullsized":"2024-05-17T04:09:11.607426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:05:01.660626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514846+0000","last_change":"2024-05-17T04:09:06.405815+0000","last_active":"2024-05-17T04:09:11.514846+0000","last_peered":"2024-05-17T04:09:11.514846+0000","last_clean":"2024-05-17T04:09:11.514846+0000","last_became_active":"2024-05-17T04:09:06.405516+0000","last_became_peered":"2024-05-17T04:09:06.405516+0000","last_unstale":"2024-05-17T04:09:11.514846+0000","last_undegraded":"2024-05-17T04:09:11.514846+0000","last_fullsized":"2024-05-17T04:09:11.514846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426561+0000","last_change":"2024-05-17T04:09:05.392753+0000","last_active":"2024-05-17T04:09:11.426561+0000","last_peered":"2024-05-17T04:09:11.426561+0000","last_clean":"2024-05-17T04:09:11.426561+0000","last_became_active":"2024-05-17T04:09:05.392392+0000","last_became_peered":"2024-05-17T04:09:05.392392+0000","last_unstale":"2024-05-17T04:09:11.426561+0000","last_undegraded":"2024-05-17T04:09:11.426561+0000","last_fullsized":"2024-05-17T04:09:11.426561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608054+0000","last_change":"2024-05-17T04:09:10.425375+0000","last_active":"2024-05-17T04:09:11.608054+0000","last_peered":"2024-05-17T04:09:11.608054+0000","last_clean":"2024-05-17T04:09:11.608054+0000","last_became_active":"2024-05-17T04:09:10.424219+0000","last_became_peered":"2024-05-17T04:09:10.424219+0000","last_unstale":"2024-05-17T04:09:11.608054+0000","last_undegraded":"2024-05-17T04:09:11.608054+0000","last_fullsized":"2024-05-17T04:09:11.608054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:43.859624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607887+0000","last_change":"2024-05-17T04:09:06.398505+0000","last_active":"2024-05-17T04:09:11.607887+0000","last_peered":"2024-05-17T04:09:11.607887+0000","last_clean":"2024-05-17T04:09:11.607887+0000","last_became_active":"2024-05-17T04:09:06.398135+0000","last_became_peered":"2024-05-17T04:09:06.398135+0000","last_unstale":"2024-05-17T04:09:11.607887+0000","last_undegraded":"2024-05-17T04:09:11.607887+0000","last_fullsized":"2024-05-17T04:09:11.607887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:07:56.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607594+0000","last_change":"2024-05-17T04:09:05.396795+0000","last_active":"2024-05-17T04:09:11.607594+0000","last_peered":"2024-05-17T04:09:11.607594+0000","last_clean":"2024-05-17T04:09:11.607594+0000","last_became_active":"2024-05-17T04:09:05.396335+0000","last_became_peered":"2024-05-17T04:09:05.396335+0000","last_unstale":"2024-05-17T04:09:11.607594+0000","last_undegraded":"2024-05-17T04:09:11.607594+0000","last_fullsized":"2024-05-17T04:09:11.607594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:57:11.208612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607531+0000","last_change":"2024-05-17T04:09:05.393287+0000","last_active":"2024-05-17T04:09:11.607531+0000","last_peered":"2024-05-17T04:09:11.607531+0000","last_clean":"2024-05-17T04:09:11.607531+0000","last_became_active":"2024-05-17T04:09:05.392948+0000","last_became_peered":"2024-05-17T04:09:05.392948+0000","last_unstale":"2024-05-17T04:09:11.607531+0000","last_undegraded":"2024-05-17T04:09:11.607531+0000","last_fullsized":"2024-05-17T04:09:11.607531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607875+0000","last_change":"2024-05-17T04:09:06.403950+0000","last_active":"2024-05-17T04:09:11.607875+0000","last_peered":"2024-05-17T04:09:11.607875+0000","last_clean":"2024-05-17T04:09:11.607875+0000","last_became_active":"2024-05-17T04:09:06.403257+0000","last_became_peered":"2024-05-17T04:09:06.403257+0000","last_unstale":"2024-05-17T04:09:11.607875+0000","last_undegraded":"2024-05-17T04:09:11.607875+0000","last_fullsized":"2024-05-17T04:09:11.607875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424114+0000","last_change":"2024-05-17T04:09:10.424315+0000","last_active":"2024-05-17T04:09:11.424114+0000","last_peered":"2024-05-17T04:09:11.424114+0000","last_clean":"2024-05-17T04:09:11.424114+0000","last_became_active":"2024-05-17T04:09:10.423838+0000","last_became_peered":"2024-05-17T04:09:10.423838+0000","last_unstale":"2024-05-17T04:09:11.424114+0000","last_undegraded":"2024-05-17T04:09:11.424114+0000","last_fullsized":"2024-05-17T04:09:11.424114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:39:27.123196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608419+0000","last_change":"2024-05-17T04:09:05.398565+0000","last_active":"2024-05-17T04:09:11.608419+0000","last_peered":"2024-05-17T04:09:11.608419+0000","last_clean":"2024-05-17T04:09:11.608419+0000","last_became_active":"2024-05-17T04:09:05.398229+0000","last_became_peered":"2024-05-17T04:09:05.398229+0000","last_unstale":"2024-05-17T04:09:11.608419+0000","last_undegraded":"2024-05-17T04:09:11.608419+0000","last_fullsized":"2024-05-17T04:09:11.608419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425580+0000","last_change":"2024-05-17T04:09:06.400725+0000","last_active":"2024-05-17T04:09:11.425580+0000","last_peered":"2024-05-17T04:09:11.425580+0000","last_clean":"2024-05-17T04:09:11.425580+0000","last_became_active":"2024-05-17T04:09:06.400391+0000","last_became_peered":"2024-05-17T04:09:06.400391+0000","last_unstale":"2024-05-17T04:09:11.425580+0000","last_undegraded":"2024-05-17T04:09:11.425580+0000","last_fullsized":"2024-05-17T04:09:11.425580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:09.290308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607875+0000","last_change":"2024-05-17T04:09:10.420250+0000","last_active":"2024-05-17T04:09:11.607875+0000","last_peered":"2024-05-17T04:09:11.607875+0000","last_clean":"2024-05-17T04:09:11.607875+0000","last_became_active":"2024-05-17T04:09:10.419846+0000","last_became_peered":"2024-05-17T04:09:10.419846+0000","last_unstale":"2024-05-17T04:09:11.607875+0000","last_undegraded":"2024-05-17T04:09:11.607875+0000","last_fullsized":"2024-05-17T04:09:11.607875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:21:44.098959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607925+0000","last_change":"2024-05-17T04:09:06.395888+0000","last_active":"2024-05-17T04:09:11.607925+0000","last_peered":"2024-05-17T04:09:11.607925+0000","last_clean":"2024-05-17T04:09:11.607925+0000","last_became_active":"2024-05-17T04:09:06.395422+0000","last_became_peered":"2024-05-17T04:09:06.395422+0000","last_unstale":"2024-05-17T04:09:11.607925+0000","last_undegraded":"2024-05-17T04:09:11.607925+0000","last_fullsized":"2024-05-17T04:09:11.607925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:33:02.204060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.423823+0000","last_change":"2024-05-17T04:09:06.413727+0000","last_active":"2024-05-17T04:09:11.423823+0000","last_peered":"2024-05-17T04:09:11.423823+0000","last_clean":"2024-05-17T04:09:11.423823+0000","last_became_active":"2024-05-17T04:09:06.413402+0000","last_became_peered":"2024-05-17T04:09:06.413402+0000","last_unstale":"2024-05-17T04:09:11.423823+0000","last_undegraded":"2024-05-17T04:09:11.423823+0000","last_fullsized":"2024-05-17T04:09:11.423823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:01.464770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424975+0000","last_change":"2024-05-17T04:09:06.408357+0000","last_active":"2024-05-17T04:09:11.424975+0000","last_peered":"2024-05-17T04:09:11.424975+0000","last_clean":"2024-05-17T04:09:11.424975+0000","last_became_active":"2024-05-17T04:09:06.407758+0000","last_became_peered":"2024-05-17T04:09:06.407758+0000","last_unstale":"2024-05-17T04:09:11.424975+0000","last_undegraded":"2024-05-17T04:09:11.424975+0000","last_fullsized":"2024-05-17T04:09:11.424975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:24.342548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607783+0000","last_change":"2024-05-17T04:09:06.392141+0000","last_active":"2024-05-17T04:09:11.607783+0000","last_peered":"2024-05-17T04:09:11.607783+0000","last_clean":"2024-05-17T04:09:11.607783+0000","last_became_active":"2024-05-17T04:09:06.391676+0000","last_became_peered":"2024-05-17T04:09:06.391676+0000","last_unstale":"2024-05-17T04:09:11.607783+0000","last_undegraded":"2024-05-17T04:09:11.607783+0000","last_fullsized":"2024-05-17T04:09:11.607783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608443+0000","last_change":"2024-05-17T04:09:06.395595+0000","last_active":"2024-05-17T04:09:11.608443+0000","last_peered":"2024-05-17T04:09:11.608443+0000","last_clean":"2024-05-17T04:09:11.608443+0000","last_became_active":"2024-05-17T04:09:06.394124+0000","last_became_peered":"2024-05-17T04:09:06.394124+0000","last_unstale":"2024-05-17T04:09:11.608443+0000","last_undegraded":"2024-05-17T04:09:11.608443+0000","last_fullsized":"2024-05-17T04:09:11.608443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:34.167127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515269+0000","last_change":"2024-05-17T04:09:06.404994+0000","last_active":"2024-05-17T04:09:11.515269+0000","last_peered":"2024-05-17T04:09:11.515269+0000","last_clean":"2024-05-17T04:09:11.515269+0000","last_became_active":"2024-05-17T04:09:06.404667+0000","last_became_peered":"2024-05-17T04:09:06.404667+0000","last_unstale":"2024-05-17T04:09:11.515269+0000","last_undegraded":"2024-05-17T04:09:11.515269+0000","last_fullsized":"2024-05-17T04:09:11.515269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607898+0000","last_change":"2024-05-17T04:09:06.402279+0000","last_active":"2024-05-17T04:09:11.607898+0000","last_peered":"2024-05-17T04:09:11.607898+0000","last_clean":"2024-05-17T04:09:11.607898+0000","last_became_active":"2024-05-17T04:09:06.401947+0000","last_became_peered":"2024-05-17T04:09:06.401947+0000","last_unstale":"2024-05-17T04:09:11.607898+0000","last_undegraded":"2024-05-17T04:09:11.607898+0000","last_fullsized":"2024-05-17T04:09:11.607898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607463+0000","last_change":"2024-05-17T04:09:06.407232+0000","last_active":"2024-05-17T04:09:11.607463+0000","last_peered":"2024-05-17T04:09:11.607463+0000","last_clean":"2024-05-17T04:09:11.607463+0000","last_became_active":"2024-05-17T04:09:06.406929+0000","last_became_peered":"2024-05-17T04:09:06.406929+0000","last_unstale":"2024-05-17T04:09:11.607463+0000","last_undegraded":"2024-05-17T04:09:11.607463+0000","last_fullsized":"2024-05-17T04:09:11.607463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:02:56.514685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426472+0000","last_change":"2024-05-17T04:09:06.402162+0000","last_active":"2024-05-17T04:09:11.426472+0000","last_peered":"2024-05-17T04:09:11.426472+0000","last_clean":"2024-05-17T04:09:11.426472+0000","last_became_active":"2024-05-17T04:09:06.401853+0000","last_became_peered":"2024-05-17T04:09:06.401853+0000","last_unstale":"2024-05-17T04:09:11.426472+0000","last_undegraded":"2024-05-17T04:09:11.426472+0000","last_fullsized":"2024-05-17T04:09:11.426472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607445+0000","last_change":"2024-05-17T04:09:06.405967+0000","last_active":"2024-05-17T04:09:11.607445+0000","last_peered":"2024-05-17T04:09:11.607445+0000","last_clean":"2024-05-17T04:09:11.607445+0000","last_became_active":"2024-05-17T04:09:06.405658+0000","last_became_peered":"2024-05-17T04:09:06.405658+0000","last_unstale":"2024-05-17T04:09:11.607445+0000","last_undegraded":"2024-05-17T04:09:11.607445+0000","last_fullsized":"2024-05-17T04:09:11.607445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424870+0000","last_change":"2024-05-17T04:09:06.402392+0000","last_active":"2024-05-17T04:09:11.424870+0000","last_peered":"2024-05-17T04:09:11.424870+0000","last_clean":"2024-05-17T04:09:11.424870+0000","last_became_active":"2024-05-17T04:09:06.401547+0000","last_became_peered":"2024-05-17T04:09:06.401547+0000","last_unstale":"2024-05-17T04:09:11.424870+0000","last_undegraded":"2024-05-17T04:09:11.424870+0000","last_fullsized":"2024-05-17T04:09:11.424870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:04:57.636173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607524+0000","last_change":"2024-05-17T04:09:06.403901+0000","last_active":"2024-05-17T04:09:11.607524+0000","last_peered":"2024-05-17T04:09:11.607524+0000","last_clean":"2024-05-17T04:09:11.607524+0000","last_became_active":"2024-05-17T04:09:06.402890+0000","last_became_peered":"2024-05-17T04:09:06.402890+0000","last_unstale":"2024-05-17T04:09:11.607524+0000","last_undegraded":"2024-05-17T04:09:11.607524+0000","last_fullsized":"2024-05-17T04:09:11.607524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:07:56.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608474+0000","last_change":"2024-05-17T04:09:06.405422+0000","last_active":"2024-05-17T04:09:11.608474+0000","last_peered":"2024-05-17T04:09:11.608474+0000","last_clean":"2024-05-17T04:09:11.608474+0000","last_became_active":"2024-05-17T04:09:06.405094+0000","last_became_peered":"2024-05-17T04:09:06.405094+0000","last_unstale":"2024-05-17T04:09:11.608474+0000","last_undegraded":"2024-05-17T04:09:11.608474+0000","last_fullsized":"2024-05-17T04:09:11.608474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608609+0000","last_change":"2024-05-17T04:09:06.409849+0000","last_active":"2024-05-17T04:09:11.608609+0000","last_peered":"2024-05-17T04:09:11.608609+0000","last_clean":"2024-05-17T04:09:11.608609+0000","last_became_active":"2024-05-17T04:09:06.409168+0000","last_became_peered":"2024-05-17T04:09:06.409168+0000","last_unstale":"2024-05-17T04:09:11.608609+0000","last_undegraded":"2024-05-17T04:09:11.608609+0000","last_fullsized":"2024-05-17T04:09:11.608609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:04:57.636173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424161+0000","last_change":"2024-05-17T04:09:06.396066+0000","last_active":"2024-05-17T04:09:11.424161+0000","last_peered":"2024-05-17T04:09:11.424161+0000","last_clean":"2024-05-17T04:09:11.424161+0000","last_became_active":"2024-05-17T04:09:06.394962+0000","last_became_peered":"2024-05-17T04:09:06.394962+0000","last_unstale":"2024-05-17T04:09:11.424161+0000","last_undegraded":"2024-05-17T04:09:11.424161+0000","last_fullsized":"2024-05-17T04:09:11.424161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:35.828470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426434+0000","last_change":"2024-05-17T04:09:06.405156+0000","last_active":"2024-05-17T04:09:11.426434+0000","last_peered":"2024-05-17T04:09:11.426434+0000","last_clean":"2024-05-17T04:09:11.426434+0000","last_became_active":"2024-05-17T04:09:06.404857+0000","last_became_peered":"2024-05-17T04:09:06.404857+0000","last_unstale":"2024-05-17T04:09:11.426434+0000","last_undegraded":"2024-05-17T04:09:11.426434+0000","last_fullsized":"2024-05-17T04:09:11.426434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:10.587650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425653+0000","last_change":"2024-05-17T04:09:06.404527+0000","last_active":"2024-05-17T04:09:11.425653+0000","last_peered":"2024-05-17T04:09:11.425653+0000","last_clean":"2024-05-17T04:09:11.425653+0000","last_became_active":"2024-05-17T04:09:06.404215+0000","last_became_peered":"2024-05-17T04:09:06.404215+0000","last_unstale":"2024-05-17T04:09:11.425653+0000","last_undegraded":"2024-05-17T04:09:11.425653+0000","last_fullsized":"2024-05-17T04:09:11.425653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514907+0000","last_change":"2024-05-17T04:09:06.404828+0000","last_active":"2024-05-17T04:09:11.514907+0000","last_peered":"2024-05-17T04:09:11.514907+0000","last_clean":"2024-05-17T04:09:11.514907+0000","last_became_active":"2024-05-17T04:09:06.404512+0000","last_became_peered":"2024-05-17T04:09:06.404512+0000","last_unstale":"2024-05-17T04:09:11.514907+0000","last_undegraded":"2024-05-17T04:09:11.514907+0000","last_fullsized":"2024-05-17T04:09:11.514907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607167+0000","last_change":"2024-05-17T04:09:06.395825+0000","last_active":"2024-05-17T04:09:11.607167+0000","last_peered":"2024-05-17T04:09:11.607167+0000","last_clean":"2024-05-17T04:09:11.607167+0000","last_became_active":"2024-05-17T04:09:06.395519+0000","last_became_peered":"2024-05-17T04:09:06.395519+0000","last_unstale":"2024-05-17T04:09:11.607167+0000","last_undegraded":"2024-05-17T04:09:11.607167+0000","last_fullsized":"2024-05-17T04:09:11.607167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:24:33.148839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608216+0000","last_change":"2024-05-17T04:09:06.397289+0000","last_active":"2024-05-17T04:09:11.608216+0000","last_peered":"2024-05-17T04:09:11.608216+0000","last_clean":"2024-05-17T04:09:11.608216+0000","last_became_active":"2024-05-17T04:09:06.396970+0000","last_became_peered":"2024-05-17T04:09:06.396970+0000","last_unstale":"2024-05-17T04:09:11.608216+0000","last_undegraded":"2024-05-17T04:09:11.608216+0000","last_fullsized":"2024-05-17T04:09:11.608216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425858+0000","last_change":"2024-05-17T04:09:06.395813+0000","last_active":"2024-05-17T04:09:11.425858+0000","last_peered":"2024-05-17T04:09:11.425858+0000","last_clean":"2024-05-17T04:09:11.425858+0000","last_became_active":"2024-05-17T04:09:06.395523+0000","last_became_peered":"2024-05-17T04:09:06.395523+0000","last_unstale":"2024-05-17T04:09:11.425858+0000","last_undegraded":"2024-05-17T04:09:11.425858+0000","last_fullsized":"2024-05-17T04:09:11.425858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:01.464770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608123+0000","last_change":"2024-05-17T04:09:06.415051+0000","last_active":"2024-05-17T04:09:11.608123+0000","last_peered":"2024-05-17T04:09:11.608123+0000","last_clean":"2024-05-17T04:09:11.608123+0000","last_became_active":"2024-05-17T04:09:06.414567+0000","last_became_peered":"2024-05-17T04:09:06.414567+0000","last_unstale":"2024-05-17T04:09:11.608123+0000","last_undegraded":"2024-05-17T04:09:11.608123+0000","last_fullsized":"2024-05-17T04:09:11.608123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607819+0000","last_change":"2024-05-17T04:09:06.414418+0000","last_active":"2024-05-17T04:09:11.607819+0000","last_peered":"2024-05-17T04:09:11.607819+0000","last_clean":"2024-05-17T04:09:11.607819+0000","last_became_active":"2024-05-17T04:09:06.414073+0000","last_became_peered":"2024-05-17T04:09:06.414073+0000","last_unstale":"2024-05-17T04:09:11.607819+0000","last_undegraded":"2024-05-17T04:09:11.607819+0000","last_fullsized":"2024-05-17T04:09:11.607819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608958+0000","last_change":"2024-05-17T04:09:06.415334+0000","last_active":"2024-05-17T04:09:11.608958+0000","last_peered":"2024-05-17T04:09:11.608958+0000","last_clean":"2024-05-17T04:09:11.608958+0000","last_became_active":"2024-05-17T04:09:06.414983+0000","last_became_peered":"2024-05-17T04:09:06.414983+0000","last_unstale":"2024-05-17T04:09:11.608958+0000","last_undegraded":"2024-05-17T04:09:11.608958+0000","last_fullsized":"2024-05-17T04:09:11.608958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:24.342548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607791+0000","last_change":"2024-05-17T04:09:06.411128+0000","last_active":"2024-05-17T04:09:11.607791+0000","last_peered":"2024-05-17T04:09:11.607791+0000","last_clean":"2024-05-17T04:09:11.607791+0000","last_became_active":"2024-05-17T04:09:06.410770+0000","last_became_peered":"2024-05-17T04:09:06.410770+0000","last_unstale":"2024-05-17T04:09:11.607791+0000","last_undegraded":"2024-05-17T04:09:11.607791+0000","last_fullsized":"2024-05-17T04:09:11.607791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:33:02.204060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607458+0000","last_change":"2024-05-17T04:09:06.408726+0000","last_active":"2024-05-17T04:09:11.607458+0000","last_peered":"2024-05-17T04:09:11.607458+0000","last_clean":"2024-05-17T04:09:11.607458+0000","last_became_active":"2024-05-17T04:09:06.404912+0000","last_became_peered":"2024-05-17T04:09:06.404912+0000","last_unstale":"2024-05-17T04:09:11.607458+0000","last_undegraded":"2024-05-17T04:09:11.607458+0000","last_fullsized":"2024-05-17T04:09:11.607458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:02:56.514685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424735+0000","last_change":"2024-05-17T04:09:06.408616+0000","last_active":"2024-05-17T04:09:11.424735+0000","last_peered":"2024-05-17T04:09:11.424735+0000","last_clean":"2024-05-17T04:09:11.424735+0000","last_became_active":"2024-05-17T04:09:06.408066+0000","last_became_peered":"2024-05-17T04:09:06.408066+0000","last_unstale":"2024-05-17T04:09:11.424735+0000","last_undegraded":"2024-05-17T04:09:11.424735+0000","last_fullsized":"2024-05-17T04:09:11.424735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607652+0000","last_change":"2024-05-17T04:09:06.402593+0000","last_active":"2024-05-17T04:09:11.607652+0000","last_peered":"2024-05-17T04:09:11.607652+0000","last_clean":"2024-05-17T04:09:11.607652+0000","last_became_active":"2024-05-17T04:09:06.402279+0000","last_became_peered":"2024-05-17T04:09:06.402279+0000","last_unstale":"2024-05-17T04:09:11.607652+0000","last_undegraded":"2024-05-17T04:09:11.607652+0000","last_fullsized":"2024-05-17T04:09:11.607652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:10.587650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425778+0000","last_change":"2024-05-17T04:09:06.410616+0000","last_active":"2024-05-17T04:09:11.425778+0000","last_peered":"2024-05-17T04:09:11.425778+0000","last_clean":"2024-05-17T04:09:11.425778+0000","last_became_active":"2024-05-17T04:09:06.409954+0000","last_became_peered":"2024-05-17T04:09:06.409954+0000","last_unstale":"2024-05-17T04:09:11.425778+0000","last_undegraded":"2024-05-17T04:09:11.425778+0000","last_fullsized":"2024-05-17T04:09:11.425778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:41.984177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607553+0000","last_change":"2024-05-17T04:09:06.386066+0000","last_active":"2024-05-17T04:09:11.607553+0000","last_peered":"2024-05-17T04:09:11.607553+0000","last_clean":"2024-05-17T04:09:11.607553+0000","last_became_active":"2024-05-17T04:09:06.385689+0000","last_became_peered":"2024-05-17T04:09:06.385689+0000","last_unstale":"2024-05-17T04:09:11.607553+0000","last_undegraded":"2024-05-17T04:09:11.607553+0000","last_fullsized":"2024-05-17T04:09:11.607553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515522+0000","last_change":"2024-05-17T04:09:06.395571+0000","last_active":"2024-05-17T04:09:11.515522+0000","last_peered":"2024-05-17T04:09:11.515522+0000","last_clean":"2024-05-17T04:09:11.515522+0000","last_became_active":"2024-05-17T04:09:06.394746+0000","last_became_peered":"2024-05-17T04:09:06.394746+0000","last_unstale":"2024-05-17T04:09:11.515522+0000","last_undegraded":"2024-05-17T04:09:11.515522+0000","last_fullsized":"2024-05-17T04:09:11.515522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608880+0000","last_change":"2024-05-17T04:09:06.409444+0000","last_active":"2024-05-17T04:09:11.608880+0000","last_peered":"2024-05-17T04:09:11.608880+0000","last_clean":"2024-05-17T04:09:11.608880+0000","last_became_active":"2024-05-17T04:09:06.409107+0000","last_became_peered":"2024-05-17T04:09:06.409107+0000","last_unstale":"2024-05-17T04:09:11.608880+0000","last_undegraded":"2024-05-17T04:09:11.608880+0000","last_fullsized":"2024-05-17T04:09:11.608880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:53:04.483377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-17T04:09:25.120 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-17T04:09:25.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.267+0000 7f789da9c640 1 Processor -- start 2024-05-17T04:09:25.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.267+0000 7f789da9c640 1 -- start start 2024-05-17T04:09:25.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.269+0000 7f789da9c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f789815f7e0 0x7f78980b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.269+0000 7f789da9c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f789806c6f0 0x7f789806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.269+0000 7f789da9c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f789806d040 con 0x7f78980d3e10 2024-05-17T04:09:25.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.269+0000 7f789da9c640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f78980d1830 con 0x7f789806c6f0 2024-05-17T04:09:25.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.269+0000 7f789da9c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f78980cfe90 con 0x7f789815f7e0 2024-05-17T04:09:25.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.269+0000 7f7897fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f789806c6f0 0x7f789806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.269+0000 7f788ffff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f78980d3e10 0x7f78980d4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:54750/0 (socket says 172.21.15.131:54750) 2024-05-17T04:09:25.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.269+0000 7f788ffff640 1 -- 172.21.15.131:0/3095257135 learned_addr learned my addr 172.21.15.131:0/3095257135 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:25.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.269+0000 7f78977fe640 1 --2- 172.21.15.131:0/3095257135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f789815f7e0 0x7f78980b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.269+0000 7f7897fff640 1 -- 172.21.15.131:0/3095257135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f789815f7e0 msgr2=0x7f78980b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:25.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.269+0000 7f7897fff640 1 --2- 172.21.15.131:0/3095257135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f789815f7e0 0x7f78980b87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.269+0000 7f7897fff640 1 -- 172.21.15.131:0/3095257135 >> v1:172.21.15.131:6789/0 conn(0x7f78980d3e10 legacy=0x7f78980d4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.269+0000 7f7897fff640 1 -- 172.21.15.131:0/3095257135 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78980cf880 con 0x7f789806c6f0 2024-05-17T04:09:25.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.269+0000 7f7896ffd640 1 -- 172.21.15.131:0/3095257135 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4097259594 0 0) 0x7f789806d040 con 0x7f78980d3e10 2024-05-17T04:09:25.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.270+0000 7f7897fff640 1 --2- 172.21.15.131:0/3095257135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789806c6f0 0x7f789806cb00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7890009d90 tx=0x7f789002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c919558a19c2d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:25.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.270+0000 7f7896ffd640 1 -- 172.21.15.131:0/3095257135 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789002ae60 con 0x7f789806c6f0 2024-05-17T04:09:25.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.270+0000 7f7896ffd640 1 -- 172.21.15.131:0/3095257135 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7890007740 con 0x7f789806c6f0 2024-05-17T04:09:25.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.270+0000 7f7896ffd640 1 -- 172.21.15.131:0/3095257135 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7890007b10 con 0x7f789806c6f0 2024-05-17T04:09:25.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.271+0000 7f789da9c640 1 -- 172.21.15.131:0/3095257135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789806c6f0 msgr2=0x7f789806cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.271+0000 7f789da9c640 1 --2- 172.21.15.131:0/3095257135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789806c6f0 0x7f789806cb00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7890009d90 tx=0x7f789002a640 comp rx=0 tx=0).stop 2024-05-17T04:09:25.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.271+0000 7f789da9c640 1 -- 172.21.15.131:0/3095257135 shutdown_connections 2024-05-17T04:09:25.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.271+0000 7f789da9c640 1 --2- 172.21.15.131:0/3095257135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789806c6f0 0x7f789806cb00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.271+0000 7f789da9c640 1 --2- 172.21.15.131:0/3095257135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f789815f7e0 0x7f78980b87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.271+0000 7f789da9c640 1 -- 172.21.15.131:0/3095257135 >> 172.21.15.131:0/3095257135 conn(0x7f78980d5860 msgr2=0x7f78980d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:25.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.271+0000 7f789da9c640 1 -- 172.21.15.131:0/3095257135 shutdown_connections 2024-05-17T04:09:25.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.271+0000 7f789da9c640 1 -- 172.21.15.131:0/3095257135 wait complete. 2024-05-17T04:09:25.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.273+0000 7f789da9c640 1 Processor -- start 2024-05-17T04:09:25.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.273+0000 7f789da9c640 1 -- start start 2024-05-17T04:09:25.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f789da9c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f789806c6f0 0x7f78981561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f789da9c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78980d3e10 0x7f78980ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f789da9c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789815f7e0 0x7f78980ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f789da9c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f78980cfb20 con 0x7f789815f7e0 2024-05-17T04:09:25.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f789da9c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f789806d5b0 con 0x7f789806c6f0 2024-05-17T04:09:25.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f789da9c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f78980b8d30 con 0x7f78980d3e10 2024-05-17T04:09:25.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f7897fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789815f7e0 0x7f78980ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f7897fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789815f7e0 0x7f78980ce100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57164/0 (socket says 172.21.15.131:57164) 2024-05-17T04:09:25.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f7897fff640 1 -- 172.21.15.131:0/980308923 learned_addr learned my addr 172.21.15.131:0/980308923 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:25.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f78977fe640 1 --2- 172.21.15.131:0/980308923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f789806c6f0 0x7f78981561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f788ffff640 1 --2- 172.21.15.131:0/980308923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78980d3e10 0x7f78980ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f7897fff640 1 -- 172.21.15.131:0/980308923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78980d3e10 msgr2=0x7f78980ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f7897fff640 1 --2- 172.21.15.131:0/980308923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78980d3e10 0x7f78980ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f7897fff640 1 -- 172.21.15.131:0/980308923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f789806c6f0 msgr2=0x7f78981561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f7897fff640 1 --2- 172.21.15.131:0/980308923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f789806c6f0 0x7f78981561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.274+0000 7f7897fff640 1 -- 172.21.15.131:0/980308923 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78981e72c0 con 0x7f789815f7e0 2024-05-17T04:09:25.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.275+0000 7f7897fff640 1 --2- 172.21.15.131:0/980308923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789815f7e0 0x7f78980ce100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7890009eb0 tx=0x7f7890004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:25.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.275+0000 7f7894ff9640 1 -- 172.21.15.131:0/980308923 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789003f070 con 0x7f789815f7e0 2024-05-17T04:09:25.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.275+0000 7f7894ff9640 1 -- 172.21.15.131:0/980308923 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7890031d40 con 0x7f789815f7e0 2024-05-17T04:09:25.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.275+0000 7f789da9c640 1 -- 172.21.15.131:0/980308923 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7898156720 con 0x7f789815f7e0 2024-05-17T04:09:25.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.275+0000 7f7894ff9640 1 -- 172.21.15.131:0/980308923 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7890009450 con 0x7f789815f7e0 2024-05-17T04:09:25.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.275+0000 7f789da9c640 1 -- 172.21.15.131:0/980308923 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78981e6fe0 con 0x7f789815f7e0 2024-05-17T04:09:25.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.276+0000 7f789da9c640 1 -- 172.21.15.131:0/980308923 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78981e6a60 con 0x7f789815f7e0 2024-05-17T04:09:25.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.276+0000 7f7894ff9640 1 -- 172.21.15.131:0/980308923 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7890043410 con 0x7f789815f7e0 2024-05-17T04:09:25.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.277+0000 7f7894ff9640 1 --2- 172.21.15.131:0/980308923 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7878076300 0x7f7878078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.277+0000 7f7894ff9640 1 -- 172.21.15.131:0/980308923 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f78900b8b60 con 0x7f789815f7e0 2024-05-17T04:09:25.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.277+0000 7f78977fe640 1 --2- 172.21.15.131:0/980308923 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7878076300 0x7f7878078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.277+0000 7f78977fe640 1 --2- 172.21.15.131:0/980308923 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7878076300 0x7f7878078810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f78880079a0 tx=0x7f7888008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:25.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.281+0000 7f7894ff9640 1 -- 172.21.15.131:0/980308923 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f78981e6a60 con 0x7f789815f7e0 2024-05-17T04:09:25.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.460+0000 7f789da9c640 1 -- 172.21.15.131:0/980308923 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78980b6860 con 0x7f7878076300 2024-05-17T04:09:25.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.465+0000 7f7894ff9640 1 -- 172.21.15.131:0/980308923 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f78980b6860 con 0x7f7878076300 2024-05-17T04:09:25.470 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:25.471 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-05-17T04:09:25.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.469+0000 7f789da9c640 1 -- 172.21.15.131:0/980308923 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7878076300 msgr2=0x7f7878078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.469+0000 7f789da9c640 1 --2- 172.21.15.131:0/980308923 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7878076300 0x7f7878078810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f78880079a0 tx=0x7f7888008040 comp rx=0 tx=0).stop 2024-05-17T04:09:25.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.469+0000 7f789da9c640 1 -- 172.21.15.131:0/980308923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789815f7e0 msgr2=0x7f78980ce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.469+0000 7f789da9c640 1 --2- 172.21.15.131:0/980308923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789815f7e0 0x7f78980ce100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7890009eb0 tx=0x7f7890004a40 comp rx=0 tx=0).stop 2024-05-17T04:09:25.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.469+0000 7f789da9c640 1 -- 172.21.15.131:0/980308923 shutdown_connections 2024-05-17T04:09:25.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.469+0000 7f789da9c640 1 --2- 172.21.15.131:0/980308923 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7878076300 0x7f7878078810 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.469+0000 7f789da9c640 1 --2- 172.21.15.131:0/980308923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789815f7e0 0x7f78980ce100 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.469+0000 7f789da9c640 1 --2- 172.21.15.131:0/980308923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78980d3e10 0x7f78980ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.469+0000 7f789da9c640 1 --2- 172.21.15.131:0/980308923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f789806c6f0 0x7f78981561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.469+0000 7f789da9c640 1 -- 172.21.15.131:0/980308923 >> 172.21.15.131:0/980308923 conn(0x7f78980d5860 msgr2=0x7f789815d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:25.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.469+0000 7f789da9c640 1 -- 172.21.15.131:0/980308923 shutdown_connections 2024-05-17T04:09:25.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.469+0000 7f789da9c640 1 -- 172.21.15.131:0/980308923 wait complete. 2024-05-17T04:09:25.482 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-05-17T04:09:24.712011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003016"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608267+0000","last_change":"2024-05-17T04:09:05.395971+0000","last_active":"2024-05-17T04:09:11.608267+0000","last_peered":"2024-05-17T04:09:11.608267+0000","last_clean":"2024-05-17T04:09:11.608267+0000","last_became_active":"2024-05-17T04:09:05.395651+0000","last_became_peered":"2024-05-17T04:09:05.395651+0000","last_unstale":"2024-05-17T04:09:11.608267+0000","last_undegraded":"2024-05-17T04:09:11.608267+0000","last_fullsized":"2024-05-17T04:09:11.608267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:57:11.208612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608153+0000","last_change":"2024-05-17T04:09:06.397289+0000","last_active":"2024-05-17T04:09:11.608153+0000","last_peered":"2024-05-17T04:09:11.608153+0000","last_clean":"2024-05-17T04:09:11.608153+0000","last_became_active":"2024-05-17T04:09:06.396997+0000","last_became_peered":"2024-05-17T04:09:06.396997+0000","last_unstale":"2024-05-17T04:09:11.608153+0000","last_undegraded":"2024-05-17T04:09:11.608153+0000","last_fullsized":"2024-05-17T04:09:11.608153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607109+0000","last_change":"2024-05-17T04:09:10.610399+0000","last_active":"2024-05-17T04:09:11.607109+0000","last_peered":"2024-05-17T04:09:11.607109+0000","last_clean":"2024-05-17T04:09:11.607109+0000","last_became_active":"2024-05-17T04:09:10.609922+0000","last_became_peered":"2024-05-17T04:09:10.609922+0000","last_unstale":"2024-05-17T04:09:11.607109+0000","last_undegraded":"2024-05-17T04:09:11.607109+0000","last_fullsized":"2024-05-17T04:09:11.607109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:31:14.568941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608463+0000","last_change":"2024-05-17T04:09:05.395919+0000","last_active":"2024-05-17T04:09:11.608463+0000","last_peered":"2024-05-17T04:09:11.608463+0000","last_clean":"2024-05-17T04:09:11.608463+0000","last_became_active":"2024-05-17T04:09:05.395589+0000","last_became_peered":"2024-05-17T04:09:05.395589+0000","last_unstale":"2024-05-17T04:09:11.608463+0000","last_undegraded":"2024-05-17T04:09:11.608463+0000","last_fullsized":"2024-05-17T04:09:11.608463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:41:33.830645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607815+0000","last_change":"2024-05-17T04:09:06.414579+0000","last_active":"2024-05-17T04:09:11.607815+0000","last_peered":"2024-05-17T04:09:11.607815+0000","last_clean":"2024-05-17T04:09:11.607815+0000","last_became_active":"2024-05-17T04:09:06.414199+0000","last_became_peered":"2024-05-17T04:09:06.414199+0000","last_unstale":"2024-05-17T04:09:11.607815+0000","last_undegraded":"2024-05-17T04:09:11.607815+0000","last_fullsized":"2024-05-17T04:09:11.607815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424690+0000","last_change":"2024-05-17T04:09:10.422768+0000","last_active":"2024-05-17T04:09:11.424690+0000","last_peered":"2024-05-17T04:09:11.424690+0000","last_clean":"2024-05-17T04:09:11.424690+0000","last_became_active":"2024-05-17T04:09:10.422303+0000","last_became_peered":"2024-05-17T04:09:10.422303+0000","last_unstale":"2024-05-17T04:09:11.424690+0000","last_undegraded":"2024-05-17T04:09:11.424690+0000","last_fullsized":"2024-05-17T04:09:11.424690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:12.808010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608697+0000","last_change":"2024-05-17T04:09:05.398049+0000","last_active":"2024-05-17T04:09:11.608697+0000","last_peered":"2024-05-17T04:09:11.608697+0000","last_clean":"2024-05-17T04:09:11.608697+0000","last_became_active":"2024-05-17T04:09:05.397723+0000","last_became_peered":"2024-05-17T04:09:05.397723+0000","last_unstale":"2024-05-17T04:09:11.608697+0000","last_undegraded":"2024-05-17T04:09:11.608697+0000","last_fullsized":"2024-05-17T04:09:11.608697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:13:02.014037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426420+0000","last_change":"2024-05-17T04:09:06.410885+0000","last_active":"2024-05-17T04:09:11.426420+0000","last_peered":"2024-05-17T04:09:11.426420+0000","last_clean":"2024-05-17T04:09:11.426420+0000","last_became_active":"2024-05-17T04:09:06.410301+0000","last_became_peered":"2024-05-17T04:09:06.410301+0000","last_unstale":"2024-05-17T04:09:11.426420+0000","last_undegraded":"2024-05-17T04:09:11.426420+0000","last_fullsized":"2024-05-17T04:09:11.426420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:31.927628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425517+0000","last_change":"2024-05-17T04:09:10.424849+0000","last_active":"2024-05-17T04:09:11.425517+0000","last_peered":"2024-05-17T04:09:11.425517+0000","last_clean":"2024-05-17T04:09:11.425517+0000","last_became_active":"2024-05-17T04:09:10.423933+0000","last_became_peered":"2024-05-17T04:09:10.423933+0000","last_unstale":"2024-05-17T04:09:11.425517+0000","last_undegraded":"2024-05-17T04:09:11.425517+0000","last_fullsized":"2024-05-17T04:09:11.425517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:35.952081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608158+0000","last_change":"2024-05-17T04:09:05.398656+0000","last_active":"2024-05-17T04:09:11.608158+0000","last_peered":"2024-05-17T04:09:11.608158+0000","last_clean":"2024-05-17T04:09:11.608158+0000","last_became_active":"2024-05-17T04:09:05.398331+0000","last_became_peered":"2024-05-17T04:09:05.398331+0000","last_unstale":"2024-05-17T04:09:11.608158+0000","last_undegraded":"2024-05-17T04:09:11.608158+0000","last_fullsized":"2024-05-17T04:09:11.608158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426238+0000","last_change":"2024-05-17T04:09:06.406845+0000","last_active":"2024-05-17T04:09:11.426238+0000","last_peered":"2024-05-17T04:09:11.426238+0000","last_clean":"2024-05-17T04:09:11.426238+0000","last_became_active":"2024-05-17T04:09:06.406340+0000","last_became_peered":"2024-05-17T04:09:06.406340+0000","last_unstale":"2024-05-17T04:09:11.426238+0000","last_undegraded":"2024-05-17T04:09:11.426238+0000","last_fullsized":"2024-05-17T04:09:11.426238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:34.167127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425448+0000","last_change":"2024-05-17T04:09:10.422002+0000","last_active":"2024-05-17T04:09:11.425448+0000","last_peered":"2024-05-17T04:09:11.425448+0000","last_clean":"2024-05-17T04:09:11.425448+0000","last_became_active":"2024-05-17T04:09:10.421382+0000","last_became_peered":"2024-05-17T04:09:10.421382+0000","last_unstale":"2024-05-17T04:09:11.425448+0000","last_undegraded":"2024-05-17T04:09:11.425448+0000","last_fullsized":"2024-05-17T04:09:11.425448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:03:00.539137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607249+0000","last_change":"2024-05-17T04:09:06.405110+0000","last_active":"2024-05-17T04:09:11.607249+0000","last_peered":"2024-05-17T04:09:11.607249+0000","last_clean":"2024-05-17T04:09:11.607249+0000","last_became_active":"2024-05-17T04:09:06.404776+0000","last_became_peered":"2024-05-17T04:09:06.404776+0000","last_unstale":"2024-05-17T04:09:11.607249+0000","last_undegraded":"2024-05-17T04:09:11.607249+0000","last_fullsized":"2024-05-17T04:09:11.607249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608023+0000","last_change":"2024-05-17T04:09:05.399818+0000","last_active":"2024-05-17T04:09:11.608023+0000","last_peered":"2024-05-17T04:09:11.608023+0000","last_clean":"2024-05-17T04:09:11.608023+0000","last_became_active":"2024-05-17T04:09:05.399507+0000","last_became_peered":"2024-05-17T04:09:05.399507+0000","last_unstale":"2024-05-17T04:09:11.608023+0000","last_undegraded":"2024-05-17T04:09:11.608023+0000","last_fullsized":"2024-05-17T04:09:11.608023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:34.821170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426755+0000","last_change":"2024-05-17T04:09:10.420268+0000","last_active":"2024-05-17T04:09:11.426755+0000","last_peered":"2024-05-17T04:09:11.426755+0000","last_clean":"2024-05-17T04:09:11.426755+0000","last_became_active":"2024-05-17T04:09:10.419850+0000","last_became_peered":"2024-05-17T04:09:10.419850+0000","last_unstale":"2024-05-17T04:09:11.426755+0000","last_undegraded":"2024-05-17T04:09:11.426755+0000","last_fullsized":"2024-05-17T04:09:11.426755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:43.859624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608320+0000","last_change":"2024-05-17T04:09:06.395791+0000","last_active":"2024-05-17T04:09:11.608320+0000","last_peered":"2024-05-17T04:09:11.608320+0000","last_clean":"2024-05-17T04:09:11.608320+0000","last_became_active":"2024-05-17T04:09:06.395479+0000","last_became_peered":"2024-05-17T04:09:06.395479+0000","last_unstale":"2024-05-17T04:09:11.608320+0000","last_undegraded":"2024-05-17T04:09:11.608320+0000","last_fullsized":"2024-05-17T04:09:11.608320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515550+0000","last_change":"2024-05-17T04:09:05.396843+0000","last_active":"2024-05-17T04:09:11.515550+0000","last_peered":"2024-05-17T04:09:11.515550+0000","last_clean":"2024-05-17T04:09:11.515550+0000","last_became_active":"2024-05-17T04:09:05.396540+0000","last_became_peered":"2024-05-17T04:09:05.396540+0000","last_unstale":"2024-05-17T04:09:11.515550+0000","last_undegraded":"2024-05-17T04:09:11.515550+0000","last_fullsized":"2024-05-17T04:09:11.515550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:00.457470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425672+0000","last_change":"2024-05-17T04:09:10.423569+0000","last_active":"2024-05-17T04:09:11.425672+0000","last_peered":"2024-05-17T04:09:11.425672+0000","last_clean":"2024-05-17T04:09:11.425672+0000","last_became_active":"2024-05-17T04:09:10.423055+0000","last_became_peered":"2024-05-17T04:09:10.423055+0000","last_unstale":"2024-05-17T04:09:11.425672+0000","last_undegraded":"2024-05-17T04:09:11.425672+0000","last_fullsized":"2024-05-17T04:09:11.425672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:38.191579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607983+0000","last_change":"2024-05-17T04:09:06.402857+0000","last_active":"2024-05-17T04:09:11.607983+0000","last_peered":"2024-05-17T04:09:11.607983+0000","last_clean":"2024-05-17T04:09:11.607983+0000","last_became_active":"2024-05-17T04:09:06.402555+0000","last_became_peered":"2024-05-17T04:09:06.402555+0000","last_unstale":"2024-05-17T04:09:11.607983+0000","last_undegraded":"2024-05-17T04:09:11.607983+0000","last_fullsized":"2024-05-17T04:09:11.607983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514978+0000","last_change":"2024-05-17T04:09:05.395456+0000","last_active":"2024-05-17T04:09:11.514978+0000","last_peered":"2024-05-17T04:09:11.514978+0000","last_clean":"2024-05-17T04:09:11.514978+0000","last_became_active":"2024-05-17T04:09:05.394962+0000","last_became_peered":"2024-05-17T04:09:05.394962+0000","last_unstale":"2024-05-17T04:09:11.514978+0000","last_undegraded":"2024-05-17T04:09:11.514978+0000","last_fullsized":"2024-05-17T04:09:11.514978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515619+0000","last_change":"2024-05-17T04:09:10.611575+0000","last_active":"2024-05-17T04:09:11.515619+0000","last_peered":"2024-05-17T04:09:11.515619+0000","last_clean":"2024-05-17T04:09:11.515619+0000","last_became_active":"2024-05-17T04:09:10.610851+0000","last_became_peered":"2024-05-17T04:09:10.610851+0000","last_unstale":"2024-05-17T04:09:11.515619+0000","last_undegraded":"2024-05-17T04:09:11.515619+0000","last_fullsized":"2024-05-17T04:09:11.515619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:53:08.507830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425259+0000","last_change":"2024-05-17T04:09:06.394990+0000","last_active":"2024-05-17T04:09:11.425259+0000","last_peered":"2024-05-17T04:09:11.425259+0000","last_clean":"2024-05-17T04:09:11.425259+0000","last_became_active":"2024-05-17T04:09:06.394578+0000","last_became_peered":"2024-05-17T04:09:06.394578+0000","last_unstale":"2024-05-17T04:09:11.425259+0000","last_undegraded":"2024-05-17T04:09:11.425259+0000","last_fullsized":"2024-05-17T04:09:11.425259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:05.815923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607236+0000","last_change":"2024-05-17T04:09:05.403173+0000","last_active":"2024-05-17T04:09:11.607236+0000","last_peered":"2024-05-17T04:09:11.607236+0000","last_clean":"2024-05-17T04:09:11.607236+0000","last_became_active":"2024-05-17T04:09:05.402862+0000","last_became_peered":"2024-05-17T04:09:05.402862+0000","last_unstale":"2024-05-17T04:09:11.607236+0000","last_undegraded":"2024-05-17T04:09:11.607236+0000","last_fullsized":"2024-05-17T04:09:11.607236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:00.457470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425484+0000","last_change":"2024-05-17T04:09:10.424841+0000","last_active":"2024-05-17T04:09:11.425484+0000","last_peered":"2024-05-17T04:09:11.425484+0000","last_clean":"2024-05-17T04:09:11.425484+0000","last_became_active":"2024-05-17T04:09:10.423871+0000","last_became_peered":"2024-05-17T04:09:10.423871+0000","last_unstale":"2024-05-17T04:09:11.425484+0000","last_undegraded":"2024-05-17T04:09:11.425484+0000","last_fullsized":"2024-05-17T04:09:11.425484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:46.008630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608200+0000","last_change":"2024-05-17T04:09:06.397726+0000","last_active":"2024-05-17T04:09:11.608200+0000","last_peered":"2024-05-17T04:09:11.608200+0000","last_clean":"2024-05-17T04:09:11.608200+0000","last_became_active":"2024-05-17T04:09:06.396138+0000","last_became_peered":"2024-05-17T04:09:06.396138+0000","last_unstale":"2024-05-17T04:09:11.608200+0000","last_undegraded":"2024-05-17T04:09:11.608200+0000","last_fullsized":"2024-05-17T04:09:11.608200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608451+0000","last_change":"2024-05-17T04:09:05.395429+0000","last_active":"2024-05-17T04:09:11.608451+0000","last_peered":"2024-05-17T04:09:11.608451+0000","last_clean":"2024-05-17T04:09:11.608451+0000","last_became_active":"2024-05-17T04:09:05.394265+0000","last_became_peered":"2024-05-17T04:09:05.394265+0000","last_unstale":"2024-05-17T04:09:11.608451+0000","last_undegraded":"2024-05-17T04:09:11.608451+0000","last_fullsized":"2024-05-17T04:09:11.608451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425112+0000","last_change":"2024-05-17T04:09:10.608056+0000","last_active":"2024-05-17T04:09:11.425112+0000","last_peered":"2024-05-17T04:09:11.425112+0000","last_clean":"2024-05-17T04:09:11.425112+0000","last_became_active":"2024-05-17T04:09:10.607528+0000","last_became_peered":"2024-05-17T04:09:10.607528+0000","last_unstale":"2024-05-17T04:09:11.425112+0000","last_undegraded":"2024-05-17T04:09:11.425112+0000","last_fullsized":"2024-05-17T04:09:11.425112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:13.074744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607552+0000","last_change":"2024-05-17T04:09:06.403004+0000","last_active":"2024-05-17T04:09:11.607552+0000","last_peered":"2024-05-17T04:09:11.607552+0000","last_clean":"2024-05-17T04:09:11.607552+0000","last_became_active":"2024-05-17T04:09:06.402507+0000","last_became_peered":"2024-05-17T04:09:06.402507+0000","last_unstale":"2024-05-17T04:09:11.607552+0000","last_undegraded":"2024-05-17T04:09:11.607552+0000","last_fullsized":"2024-05-17T04:09:11.607552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:41.984177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515570+0000","last_change":"2024-05-17T04:09:05.399350+0000","last_active":"2024-05-17T04:09:11.515570+0000","last_peered":"2024-05-17T04:09:11.515570+0000","last_clean":"2024-05-17T04:09:11.515570+0000","last_became_active":"2024-05-17T04:09:05.399049+0000","last_became_peered":"2024-05-17T04:09:05.399049+0000","last_unstale":"2024-05-17T04:09:11.515570+0000","last_undegraded":"2024-05-17T04:09:11.515570+0000","last_fullsized":"2024-05-17T04:09:11.515570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607786+0000","last_change":"2024-05-17T04:09:10.611499+0000","last_active":"2024-05-17T04:09:11.607786+0000","last_peered":"2024-05-17T04:09:11.607786+0000","last_clean":"2024-05-17T04:09:11.607786+0000","last_became_active":"2024-05-17T04:09:10.611068+0000","last_became_peered":"2024-05-17T04:09:10.611068+0000","last_unstale":"2024-05-17T04:09:11.607786+0000","last_undegraded":"2024-05-17T04:09:11.607786+0000","last_fullsized":"2024-05-17T04:09:11.607786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:32:16.388318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515650+0000","last_change":"2024-05-17T04:09:06.399281+0000","last_active":"2024-05-17T04:09:11.515650+0000","last_peered":"2024-05-17T04:09:11.515650+0000","last_clean":"2024-05-17T04:09:11.515650+0000","last_became_active":"2024-05-17T04:09:06.398973+0000","last_became_peered":"2024-05-17T04:09:06.398973+0000","last_unstale":"2024-05-17T04:09:11.515650+0000","last_undegraded":"2024-05-17T04:09:11.515650+0000","last_fullsized":"2024-05-17T04:09:11.515650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608834+0000","last_change":"2024-05-17T04:09:05.402787+0000","last_active":"2024-05-17T04:09:11.608834+0000","last_peered":"2024-05-17T04:09:11.608834+0000","last_clean":"2024-05-17T04:09:11.608834+0000","last_became_active":"2024-05-17T04:09:05.402451+0000","last_became_peered":"2024-05-17T04:09:05.402451+0000","last_unstale":"2024-05-17T04:09:11.608834+0000","last_undegraded":"2024-05-17T04:09:11.608834+0000","last_fullsized":"2024-05-17T04:09:11.608834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607456+0000","last_change":"2024-05-17T04:09:10.608220+0000","last_active":"2024-05-17T04:09:11.607456+0000","last_peered":"2024-05-17T04:09:11.607456+0000","last_clean":"2024-05-17T04:09:11.607456+0000","last_became_active":"2024-05-17T04:09:10.607719+0000","last_became_peered":"2024-05-17T04:09:10.607719+0000","last_unstale":"2024-05-17T04:09:11.607456+0000","last_undegraded":"2024-05-17T04:09:11.607456+0000","last_fullsized":"2024-05-17T04:09:11.607456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:53:08.507830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426361+0000","last_change":"2024-05-17T04:09:06.406634+0000","last_active":"2024-05-17T04:09:11.426361+0000","last_peered":"2024-05-17T04:09:11.426361+0000","last_clean":"2024-05-17T04:09:11.426361+0000","last_became_active":"2024-05-17T04:09:06.406011+0000","last_became_peered":"2024-05-17T04:09:06.406011+0000","last_unstale":"2024-05-17T04:09:11.426361+0000","last_undegraded":"2024-05-17T04:09:11.426361+0000","last_fullsized":"2024-05-17T04:09:11.426361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:49.079670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515733+0000","last_change":"2024-05-17T04:09:05.395393+0000","last_active":"2024-05-17T04:09:11.515733+0000","last_peered":"2024-05-17T04:09:11.515733+0000","last_clean":"2024-05-17T04:09:11.515733+0000","last_became_active":"2024-05-17T04:09:05.395026+0000","last_became_peered":"2024-05-17T04:09:05.395026+0000","last_unstale":"2024-05-17T04:09:11.515733+0000","last_undegraded":"2024-05-17T04:09:11.515733+0000","last_fullsized":"2024-05-17T04:09:11.515733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514970+0000","last_change":"2024-05-17T04:09:10.426127+0000","last_active":"2024-05-17T04:09:11.514970+0000","last_peered":"2024-05-17T04:09:11.514970+0000","last_clean":"2024-05-17T04:09:11.514970+0000","last_became_active":"2024-05-17T04:09:10.425310+0000","last_became_peered":"2024-05-17T04:09:10.425310+0000","last_unstale":"2024-05-17T04:09:11.514970+0000","last_undegraded":"2024-05-17T04:09:11.514970+0000","last_fullsized":"2024-05-17T04:09:11.514970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:05:01.660626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426527+0000","last_change":"2024-05-17T04:09:06.396617+0000","last_active":"2024-05-17T04:09:11.426527+0000","last_peered":"2024-05-17T04:09:11.426527+0000","last_clean":"2024-05-17T04:09:11.426527+0000","last_became_active":"2024-05-17T04:09:06.396314+0000","last_became_peered":"2024-05-17T04:09:06.396314+0000","last_unstale":"2024-05-17T04:09:11.426527+0000","last_undegraded":"2024-05-17T04:09:11.426527+0000","last_fullsized":"2024-05-17T04:09:11.426527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:07.188086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425216+0000","last_change":"2024-05-17T04:09:05.394393+0000","last_active":"2024-05-17T04:09:11.425216+0000","last_peered":"2024-05-17T04:09:11.425216+0000","last_clean":"2024-05-17T04:09:11.425216+0000","last_became_active":"2024-05-17T04:09:05.393756+0000","last_became_peered":"2024-05-17T04:09:05.393756+0000","last_unstale":"2024-05-17T04:09:11.425216+0000","last_undegraded":"2024-05-17T04:09:11.425216+0000","last_fullsized":"2024-05-17T04:09:11.425216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515309+0000","last_change":"2024-05-17T04:09:10.419986+0000","last_active":"2024-05-17T04:09:11.515309+0000","last_peered":"2024-05-17T04:09:11.515309+0000","last_clean":"2024-05-17T04:09:11.515309+0000","last_became_active":"2024-05-17T04:09:10.419116+0000","last_became_peered":"2024-05-17T04:09:10.419116+0000","last_unstale":"2024-05-17T04:09:11.515309+0000","last_undegraded":"2024-05-17T04:09:11.515309+0000","last_fullsized":"2024-05-17T04:09:11.515309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:28.367001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514954+0000","last_change":"2024-05-17T04:09:06.407059+0000","last_active":"2024-05-17T04:09:11.514954+0000","last_peered":"2024-05-17T04:09:11.514954+0000","last_clean":"2024-05-17T04:09:11.514954+0000","last_became_active":"2024-05-17T04:09:06.406752+0000","last_became_peered":"2024-05-17T04:09:06.406752+0000","last_unstale":"2024-05-17T04:09:11.514954+0000","last_undegraded":"2024-05-17T04:09:11.514954+0000","last_fullsized":"2024-05-17T04:09:11.514954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.423948+0000","last_change":"2024-05-17T04:09:05.390296+0000","last_active":"2024-05-17T04:09:11.423948+0000","last_peered":"2024-05-17T04:09:11.423948+0000","last_clean":"2024-05-17T04:09:11.423948+0000","last_became_active":"2024-05-17T04:09:05.389917+0000","last_became_peered":"2024-05-17T04:09:05.389917+0000","last_unstale":"2024-05-17T04:09:11.423948+0000","last_undegraded":"2024-05-17T04:09:11.423948+0000","last_fullsized":"2024-05-17T04:09:11.423948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515762+0000","last_change":"2024-05-17T04:09:10.429919+0000","last_active":"2024-05-17T04:09:11.515762+0000","last_peered":"2024-05-17T04:09:11.515762+0000","last_clean":"2024-05-17T04:09:11.515762+0000","last_became_active":"2024-05-17T04:09:10.429394+0000","last_became_peered":"2024-05-17T04:09:10.429394+0000","last_unstale":"2024-05-17T04:09:11.515762+0000","last_undegraded":"2024-05-17T04:09:11.515762+0000","last_fullsized":"2024-05-17T04:09:11.515762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:44.081339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.606952+0000","last_change":"2024-05-17T04:09:06.403836+0000","last_active":"2024-05-17T04:09:11.606952+0000","last_peered":"2024-05-17T04:09:11.606952+0000","last_clean":"2024-05-17T04:09:11.606952+0000","last_became_active":"2024-05-17T04:09:06.403514+0000","last_became_peered":"2024-05-17T04:09:06.403514+0000","last_unstale":"2024-05-17T04:09:11.606952+0000","last_undegraded":"2024-05-17T04:09:11.606952+0000","last_fullsized":"2024-05-17T04:09:11.606952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:01:05.018624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607372+0000","last_change":"2024-05-17T04:09:05.401167+0000","last_active":"2024-05-17T04:09:11.607372+0000","last_peered":"2024-05-17T04:09:11.607372+0000","last_clean":"2024-05-17T04:09:11.607372+0000","last_became_active":"2024-05-17T04:09:05.400797+0000","last_became_peered":"2024-05-17T04:09:05.400797+0000","last_unstale":"2024-05-17T04:09:11.607372+0000","last_undegraded":"2024-05-17T04:09:11.607372+0000","last_fullsized":"2024-05-17T04:09:11.607372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:23:01.826205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607778+0000","last_change":"2024-05-17T04:09:10.607420+0000","last_active":"2024-05-17T04:09:11.607778+0000","last_peered":"2024-05-17T04:09:11.607778+0000","last_clean":"2024-05-17T04:09:11.607778+0000","last_became_active":"2024-05-17T04:09:10.606963+0000","last_became_peered":"2024-05-17T04:09:10.606963+0000","last_unstale":"2024-05-17T04:09:11.607778+0000","last_undegraded":"2024-05-17T04:09:11.607778+0000","last_fullsized":"2024-05-17T04:09:11.607778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:28.367001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607186+0000","last_change":"2024-05-17T04:09:06.414099+0000","last_active":"2024-05-17T04:09:11.607186+0000","last_peered":"2024-05-17T04:09:11.607186+0000","last_clean":"2024-05-17T04:09:11.607186+0000","last_became_active":"2024-05-17T04:09:06.413727+0000","last_became_peered":"2024-05-17T04:09:06.413727+0000","last_unstale":"2024-05-17T04:09:11.607186+0000","last_undegraded":"2024-05-17T04:09:11.607186+0000","last_fullsized":"2024-05-17T04:09:11.607186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424782+0000","last_change":"2024-05-17T04:09:05.395595+0000","last_active":"2024-05-17T04:09:11.424782+0000","last_peered":"2024-05-17T04:09:11.424782+0000","last_clean":"2024-05-17T04:09:11.424782+0000","last_became_active":"2024-05-17T04:09:05.395288+0000","last_became_peered":"2024-05-17T04:09:05.395288+0000","last_unstale":"2024-05-17T04:09:11.424782+0000","last_undegraded":"2024-05-17T04:09:11.424782+0000","last_fullsized":"2024-05-17T04:09:11.424782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607476+0000","last_change":"2024-05-17T04:08:56.447797+0000","last_active":"2024-05-17T04:09:11.607476+0000","last_peered":"2024-05-17T04:09:11.607476+0000","last_clean":"2024-05-17T04:09:11.607476+0000","last_became_active":"2024-05-17T04:08:56.446705+0000","last_became_peered":"2024-05-17T04:08:56.446705+0000","last_unstale":"2024-05-17T04:09:11.607476+0000","last_undegraded":"2024-05-17T04:09:11.607476+0000","last_fullsized":"2024-05-17T04:09:11.607476+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_clean_scrub_stamp":"2024-05-17T04:08:54.847367+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:40:00.515431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608157+0000","last_change":"2024-05-17T04:09:10.608442+0000","last_active":"2024-05-17T04:09:11.608157+0000","last_peered":"2024-05-17T04:09:11.608157+0000","last_clean":"2024-05-17T04:09:11.608157+0000","last_became_active":"2024-05-17T04:09:10.607993+0000","last_became_peered":"2024-05-17T04:09:10.607993+0000","last_unstale":"2024-05-17T04:09:11.608157+0000","last_undegraded":"2024-05-17T04:09:11.608157+0000","last_fullsized":"2024-05-17T04:09:11.608157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:53.104122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608435+0000","last_change":"2024-05-17T04:09:06.414021+0000","last_active":"2024-05-17T04:09:11.608435+0000","last_peered":"2024-05-17T04:09:11.608435+0000","last_clean":"2024-05-17T04:09:11.608435+0000","last_became_active":"2024-05-17T04:09:06.413481+0000","last_became_peered":"2024-05-17T04:09:06.413481+0000","last_unstale":"2024-05-17T04:09:11.608435+0000","last_undegraded":"2024-05-17T04:09:11.608435+0000","last_fullsized":"2024-05-17T04:09:11.608435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:31.927628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424257+0000","last_change":"2024-05-17T04:09:05.394878+0000","last_active":"2024-05-17T04:09:11.424257+0000","last_peered":"2024-05-17T04:09:11.424257+0000","last_clean":"2024-05-17T04:09:11.424257+0000","last_became_active":"2024-05-17T04:09:05.394529+0000","last_became_peered":"2024-05-17T04:09:05.394529+0000","last_unstale":"2024-05-17T04:09:11.424257+0000","last_undegraded":"2024-05-17T04:09:11.424257+0000","last_fullsized":"2024-05-17T04:09:11.424257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:41:33.830645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607795+0000","last_change":"2024-05-17T04:09:10.607640+0000","last_active":"2024-05-17T04:09:11.607795+0000","last_peered":"2024-05-17T04:09:11.607795+0000","last_clean":"2024-05-17T04:09:11.607795+0000","last_became_active":"2024-05-17T04:09:10.607137+0000","last_became_peered":"2024-05-17T04:09:10.607137+0000","last_unstale":"2024-05-17T04:09:11.607795+0000","last_undegraded":"2024-05-17T04:09:11.607795+0000","last_fullsized":"2024-05-17T04:09:11.607795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:17:35.952081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426630+0000","last_change":"2024-05-17T04:09:06.399777+0000","last_active":"2024-05-17T04:09:11.426630+0000","last_peered":"2024-05-17T04:09:11.426630+0000","last_clean":"2024-05-17T04:09:11.426630+0000","last_became_active":"2024-05-17T04:09:06.399443+0000","last_became_peered":"2024-05-17T04:09:06.399443+0000","last_unstale":"2024-05-17T04:09:11.426630+0000","last_undegraded":"2024-05-17T04:09:11.426630+0000","last_fullsized":"2024-05-17T04:09:11.426630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:39.835171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515423+0000","last_change":"2024-05-17T04:09:05.397664+0000","last_active":"2024-05-17T04:09:11.515423+0000","last_peered":"2024-05-17T04:09:11.515423+0000","last_clean":"2024-05-17T04:09:11.515423+0000","last_became_active":"2024-05-17T04:09:05.397386+0000","last_became_peered":"2024-05-17T04:09:05.397386+0000","last_unstale":"2024-05-17T04:09:11.515423+0000","last_undegraded":"2024-05-17T04:09:11.515423+0000","last_fullsized":"2024-05-17T04:09:11.515423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:10:06.180786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607683+0000","last_change":"2024-05-17T04:09:10.424457+0000","last_active":"2024-05-17T04:09:11.607683+0000","last_peered":"2024-05-17T04:09:11.607683+0000","last_clean":"2024-05-17T04:09:11.607683+0000","last_became_active":"2024-05-17T04:09:10.423487+0000","last_became_peered":"2024-05-17T04:09:10.423487+0000","last_unstale":"2024-05-17T04:09:11.607683+0000","last_undegraded":"2024-05-17T04:09:11.607683+0000","last_fullsized":"2024-05-17T04:09:11.607683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:14.612103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.609012+0000","last_change":"2024-05-17T04:09:06.411544+0000","last_active":"2024-05-17T04:09:11.609012+0000","last_peered":"2024-05-17T04:09:11.609012+0000","last_clean":"2024-05-17T04:09:11.609012+0000","last_became_active":"2024-05-17T04:09:06.411193+0000","last_became_peered":"2024-05-17T04:09:06.411193+0000","last_unstale":"2024-05-17T04:09:11.609012+0000","last_undegraded":"2024-05-17T04:09:11.609012+0000","last_fullsized":"2024-05-17T04:09:11.609012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:40.056886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424170+0000","last_change":"2024-05-17T04:09:05.390395+0000","last_active":"2024-05-17T04:09:11.424170+0000","last_peered":"2024-05-17T04:09:11.424170+0000","last_clean":"2024-05-17T04:09:11.424170+0000","last_became_active":"2024-05-17T04:09:05.389769+0000","last_became_peered":"2024-05-17T04:09:05.389769+0000","last_unstale":"2024-05-17T04:09:11.424170+0000","last_undegraded":"2024-05-17T04:09:11.424170+0000","last_fullsized":"2024-05-17T04:09:11.424170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424395+0000","last_change":"2024-05-17T04:09:10.610765+0000","last_active":"2024-05-17T04:09:11.424395+0000","last_peered":"2024-05-17T04:09:11.424395+0000","last_clean":"2024-05-17T04:09:11.424395+0000","last_became_active":"2024-05-17T04:09:10.610286+0000","last_became_peered":"2024-05-17T04:09:10.610286+0000","last_unstale":"2024-05-17T04:09:11.424395+0000","last_undegraded":"2024-05-17T04:09:11.424395+0000","last_fullsized":"2024-05-17T04:09:11.424395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:31:14.568941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608756+0000","last_change":"2024-05-17T04:09:06.408406+0000","last_active":"2024-05-17T04:09:11.608756+0000","last_peered":"2024-05-17T04:09:11.608756+0000","last_clean":"2024-05-17T04:09:11.608756+0000","last_became_active":"2024-05-17T04:09:06.405343+0000","last_became_peered":"2024-05-17T04:09:06.405343+0000","last_unstale":"2024-05-17T04:09:11.608756+0000","last_undegraded":"2024-05-17T04:09:11.608756+0000","last_fullsized":"2024-05-17T04:09:11.608756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:49.079670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426903+0000","last_change":"2024-05-17T04:09:05.396149+0000","last_active":"2024-05-17T04:09:11.426903+0000","last_peered":"2024-05-17T04:09:11.426903+0000","last_clean":"2024-05-17T04:09:11.426903+0000","last_became_active":"2024-05-17T04:09:05.395640+0000","last_became_peered":"2024-05-17T04:09:05.395640+0000","last_unstale":"2024-05-17T04:09:11.426903+0000","last_undegraded":"2024-05-17T04:09:11.426903+0000","last_fullsized":"2024-05-17T04:09:11.426903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:36:25.869388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424730+0000","last_change":"2024-05-17T04:09:10.420386+0000","last_active":"2024-05-17T04:09:11.424730+0000","last_peered":"2024-05-17T04:09:11.424730+0000","last_clean":"2024-05-17T04:09:11.424730+0000","last_became_active":"2024-05-17T04:09:10.419914+0000","last_became_peered":"2024-05-17T04:09:10.419914+0000","last_unstale":"2024-05-17T04:09:11.424730+0000","last_undegraded":"2024-05-17T04:09:11.424730+0000","last_fullsized":"2024-05-17T04:09:11.424730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:06.408047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607581+0000","last_change":"2024-05-17T04:09:06.408118+0000","last_active":"2024-05-17T04:09:11.607581+0000","last_peered":"2024-05-17T04:09:11.607581+0000","last_clean":"2024-05-17T04:09:11.607581+0000","last_became_active":"2024-05-17T04:09:06.406680+0000","last_became_peered":"2024-05-17T04:09:06.406680+0000","last_unstale":"2024-05-17T04:09:11.607581+0000","last_undegraded":"2024-05-17T04:09:11.607581+0000","last_fullsized":"2024-05-17T04:09:11.607581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:34.167127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.423794+0000","last_change":"2024-05-17T04:09:05.397048+0000","last_active":"2024-05-17T04:09:11.423794+0000","last_peered":"2024-05-17T04:09:11.423794+0000","last_clean":"2024-05-17T04:09:11.423794+0000","last_became_active":"2024-05-17T04:09:05.396745+0000","last_became_peered":"2024-05-17T04:09:05.396745+0000","last_unstale":"2024-05-17T04:09:11.423794+0000","last_undegraded":"2024-05-17T04:09:11.423794+0000","last_fullsized":"2024-05-17T04:09:11.423794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607578+0000","last_change":"2024-05-17T04:09:10.427098+0000","last_active":"2024-05-17T04:09:11.607578+0000","last_peered":"2024-05-17T04:09:11.607578+0000","last_clean":"2024-05-17T04:09:11.607578+0000","last_became_active":"2024-05-17T04:09:10.426559+0000","last_became_peered":"2024-05-17T04:09:10.426559+0000","last_unstale":"2024-05-17T04:09:11.607578+0000","last_undegraded":"2024-05-17T04:09:11.607578+0000","last_fullsized":"2024-05-17T04:09:11.607578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:44.081339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607896+0000","last_change":"2024-05-17T04:09:06.394018+0000","last_active":"2024-05-17T04:09:11.607896+0000","last_peered":"2024-05-17T04:09:11.607896+0000","last_clean":"2024-05-17T04:09:11.607896+0000","last_became_active":"2024-05-17T04:09:06.393664+0000","last_became_peered":"2024-05-17T04:09:06.393664+0000","last_unstale":"2024-05-17T04:09:11.607896+0000","last_undegraded":"2024-05-17T04:09:11.607896+0000","last_fullsized":"2024-05-17T04:09:11.607896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:07:56.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607640+0000","last_change":"2024-05-17T04:09:05.395140+0000","last_active":"2024-05-17T04:09:11.607640+0000","last_peered":"2024-05-17T04:09:11.607640+0000","last_clean":"2024-05-17T04:09:11.607640+0000","last_became_active":"2024-05-17T04:09:05.394556+0000","last_became_peered":"2024-05-17T04:09:05.394556+0000","last_unstale":"2024-05-17T04:09:11.607640+0000","last_undegraded":"2024-05-17T04:09:11.607640+0000","last_fullsized":"2024-05-17T04:09:11.607640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607361+0000","last_change":"2024-05-17T04:09:10.608635+0000","last_active":"2024-05-17T04:09:11.607361+0000","last_peered":"2024-05-17T04:09:11.607361+0000","last_clean":"2024-05-17T04:09:11.607361+0000","last_became_active":"2024-05-17T04:09:10.608151+0000","last_became_peered":"2024-05-17T04:09:10.608151+0000","last_unstale":"2024-05-17T04:09:11.607361+0000","last_undegraded":"2024-05-17T04:09:11.607361+0000","last_fullsized":"2024-05-17T04:09:11.607361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:32:44.289047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607892+0000","last_change":"2024-05-17T04:09:06.407790+0000","last_active":"2024-05-17T04:09:11.607892+0000","last_peered":"2024-05-17T04:09:11.607892+0000","last_clean":"2024-05-17T04:09:11.607892+0000","last_became_active":"2024-05-17T04:09:06.407484+0000","last_became_peered":"2024-05-17T04:09:06.407484+0000","last_unstale":"2024-05-17T04:09:11.607892+0000","last_undegraded":"2024-05-17T04:09:11.607892+0000","last_fullsized":"2024-05-17T04:09:11.607892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:39.835171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425090+0000","last_change":"2024-05-17T04:09:05.393381+0000","last_active":"2024-05-17T04:09:11.425090+0000","last_peered":"2024-05-17T04:09:11.425090+0000","last_clean":"2024-05-17T04:09:11.425090+0000","last_became_active":"2024-05-17T04:09:05.392480+0000","last_became_peered":"2024-05-17T04:09:05.392480+0000","last_unstale":"2024-05-17T04:09:11.425090+0000","last_undegraded":"2024-05-17T04:09:11.425090+0000","last_fullsized":"2024-05-17T04:09:11.425090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608339+0000","last_change":"2024-05-17T04:09:10.607929+0000","last_active":"2024-05-17T04:09:11.608339+0000","last_peered":"2024-05-17T04:09:11.608339+0000","last_clean":"2024-05-17T04:09:11.608339+0000","last_became_active":"2024-05-17T04:09:10.606975+0000","last_became_peered":"2024-05-17T04:09:10.606975+0000","last_unstale":"2024-05-17T04:09:11.608339+0000","last_undegraded":"2024-05-17T04:09:11.608339+0000","last_fullsized":"2024-05-17T04:09:11.608339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:36:14.040927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607173+0000","last_change":"2024-05-17T04:09:06.399704+0000","last_active":"2024-05-17T04:09:11.607173+0000","last_peered":"2024-05-17T04:09:11.607173+0000","last_clean":"2024-05-17T04:09:11.607173+0000","last_became_active":"2024-05-17T04:09:06.399395+0000","last_became_peered":"2024-05-17T04:09:06.399395+0000","last_unstale":"2024-05-17T04:09:11.607173+0000","last_undegraded":"2024-05-17T04:09:11.607173+0000","last_fullsized":"2024-05-17T04:09:11.607173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:33:02.204060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608048+0000","last_change":"2024-05-17T04:09:05.394133+0000","last_active":"2024-05-17T04:09:11.608048+0000","last_peered":"2024-05-17T04:09:11.608048+0000","last_clean":"2024-05-17T04:09:11.608048+0000","last_became_active":"2024-05-17T04:09:05.393854+0000","last_became_peered":"2024-05-17T04:09:05.393854+0000","last_unstale":"2024-05-17T04:09:11.608048+0000","last_undegraded":"2024-05-17T04:09:11.608048+0000","last_fullsized":"2024-05-17T04:09:11.608048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:41:33.830645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426113+0000","last_change":"2024-05-17T04:09:10.607826+0000","last_active":"2024-05-17T04:09:11.426113+0000","last_peered":"2024-05-17T04:09:11.426113+0000","last_clean":"2024-05-17T04:09:11.426113+0000","last_became_active":"2024-05-17T04:09:10.607382+0000","last_became_peered":"2024-05-17T04:09:10.607382+0000","last_unstale":"2024-05-17T04:09:11.426113+0000","last_undegraded":"2024-05-17T04:09:11.426113+0000","last_fullsized":"2024-05-17T04:09:11.426113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:55:48.002918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608335+0000","last_change":"2024-05-17T04:09:06.403425+0000","last_active":"2024-05-17T04:09:11.608335+0000","last_peered":"2024-05-17T04:09:11.608335+0000","last_clean":"2024-05-17T04:09:11.608335+0000","last_became_active":"2024-05-17T04:09:06.403093+0000","last_became_peered":"2024-05-17T04:09:06.403093+0000","last_unstale":"2024-05-17T04:09:11.608335+0000","last_undegraded":"2024-05-17T04:09:11.608335+0000","last_fullsized":"2024-05-17T04:09:11.608335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:41.984177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:15.993336+0000","last_change":"2024-05-17T04:09:05.393968+0000","last_active":"2024-05-17T04:09:15.993336+0000","last_peered":"2024-05-17T04:09:15.993336+0000","last_clean":"2024-05-17T04:09:15.993336+0000","last_became_active":"2024-05-17T04:09:05.393641+0000","last_became_peered":"2024-05-17T04:09:05.393641+0000","last_unstale":"2024-05-17T04:09:15.993336+0000","last_undegraded":"2024-05-17T04:09:15.993336+0000","last_fullsized":"2024-05-17T04:09:15.993336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515095+0000","last_change":"2024-05-17T04:09:10.424091+0000","last_active":"2024-05-17T04:09:11.515095+0000","last_peered":"2024-05-17T04:09:11.515095+0000","last_clean":"2024-05-17T04:09:11.515095+0000","last_became_active":"2024-05-17T04:09:10.423669+0000","last_became_peered":"2024-05-17T04:09:10.423669+0000","last_unstale":"2024-05-17T04:09:11.515095+0000","last_undegraded":"2024-05-17T04:09:11.515095+0000","last_fullsized":"2024-05-17T04:09:11.515095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:14.612103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425973+0000","last_change":"2024-05-17T04:09:06.395242+0000","last_active":"2024-05-17T04:09:11.425973+0000","last_peered":"2024-05-17T04:09:11.425973+0000","last_clean":"2024-05-17T04:09:11.425973+0000","last_became_active":"2024-05-17T04:09:06.394956+0000","last_became_peered":"2024-05-17T04:09:06.394956+0000","last_unstale":"2024-05-17T04:09:11.425973+0000","last_undegraded":"2024-05-17T04:09:11.425973+0000","last_fullsized":"2024-05-17T04:09:11.425973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:35.828470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515417+0000","last_change":"2024-05-17T04:09:05.395871+0000","last_active":"2024-05-17T04:09:11.515417+0000","last_peered":"2024-05-17T04:09:11.515417+0000","last_clean":"2024-05-17T04:09:11.515417+0000","last_became_active":"2024-05-17T04:09:05.395565+0000","last_became_peered":"2024-05-17T04:09:05.395565+0000","last_unstale":"2024-05-17T04:09:11.515417+0000","last_undegraded":"2024-05-17T04:09:11.515417+0000","last_fullsized":"2024-05-17T04:09:11.515417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:34.821170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425594+0000","last_change":"2024-05-17T04:09:10.422395+0000","last_active":"2024-05-17T04:09:11.425594+0000","last_peered":"2024-05-17T04:09:11.425594+0000","last_clean":"2024-05-17T04:09:11.425594+0000","last_became_active":"2024-05-17T04:09:10.421563+0000","last_became_peered":"2024-05-17T04:09:10.421563+0000","last_unstale":"2024-05-17T04:09:11.425594+0000","last_undegraded":"2024-05-17T04:09:11.425594+0000","last_fullsized":"2024-05-17T04:09:11.425594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:04:53.104122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608163+0000","last_change":"2024-05-17T04:09:06.407304+0000","last_active":"2024-05-17T04:09:11.608163+0000","last_peered":"2024-05-17T04:09:11.608163+0000","last_clean":"2024-05-17T04:09:11.608163+0000","last_became_active":"2024-05-17T04:09:06.406969+0000","last_became_peered":"2024-05-17T04:09:06.406969+0000","last_unstale":"2024-05-17T04:09:11.608163+0000","last_undegraded":"2024-05-17T04:09:11.608163+0000","last_fullsized":"2024-05-17T04:09:11.608163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426091+0000","last_change":"2024-05-17T04:09:05.396508+0000","last_active":"2024-05-17T04:09:11.426091+0000","last_peered":"2024-05-17T04:09:11.426091+0000","last_clean":"2024-05-17T04:09:11.426091+0000","last_became_active":"2024-05-17T04:09:05.396175+0000","last_became_peered":"2024-05-17T04:09:05.396175+0000","last_unstale":"2024-05-17T04:09:11.426091+0000","last_undegraded":"2024-05-17T04:09:11.426091+0000","last_fullsized":"2024-05-17T04:09:11.426091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607951+0000","last_change":"2024-05-17T04:09:10.426973+0000","last_active":"2024-05-17T04:09:11.607951+0000","last_peered":"2024-05-17T04:09:11.607951+0000","last_clean":"2024-05-17T04:09:11.607951+0000","last_became_active":"2024-05-17T04:09:10.426412+0000","last_became_peered":"2024-05-17T04:09:10.426412+0000","last_unstale":"2024-05-17T04:09:11.607951+0000","last_undegraded":"2024-05-17T04:09:11.607951+0000","last_fullsized":"2024-05-17T04:09:11.607951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:12:14.748809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425895+0000","last_change":"2024-05-17T04:09:06.403005+0000","last_active":"2024-05-17T04:09:11.425895+0000","last_peered":"2024-05-17T04:09:11.425895+0000","last_clean":"2024-05-17T04:09:11.425895+0000","last_became_active":"2024-05-17T04:09:06.402234+0000","last_became_peered":"2024-05-17T04:09:06.402234+0000","last_unstale":"2024-05-17T04:09:11.425895+0000","last_undegraded":"2024-05-17T04:09:11.425895+0000","last_fullsized":"2024-05-17T04:09:11.425895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:02:56.514685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608325+0000","last_change":"2024-05-17T04:09:05.398997+0000","last_active":"2024-05-17T04:09:11.608325+0000","last_peered":"2024-05-17T04:09:11.608325+0000","last_clean":"2024-05-17T04:09:11.608325+0000","last_became_active":"2024-05-17T04:09:05.398311+0000","last_became_peered":"2024-05-17T04:09:05.398311+0000","last_unstale":"2024-05-17T04:09:11.608325+0000","last_undegraded":"2024-05-17T04:09:11.608325+0000","last_fullsized":"2024-05-17T04:09:11.608325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:39:04.808622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607285+0000","last_change":"2024-05-17T04:09:10.611442+0000","last_active":"2024-05-17T04:09:11.607285+0000","last_peered":"2024-05-17T04:09:11.607285+0000","last_clean":"2024-05-17T04:09:11.607285+0000","last_became_active":"2024-05-17T04:09:10.610948+0000","last_became_peered":"2024-05-17T04:09:10.610948+0000","last_unstale":"2024-05-17T04:09:11.607285+0000","last_undegraded":"2024-05-17T04:09:11.607285+0000","last_fullsized":"2024-05-17T04:09:11.607285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:55:48.002918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607426+0000","last_change":"2024-05-17T04:09:10.610609+0000","last_active":"2024-05-17T04:09:11.607426+0000","last_peered":"2024-05-17T04:09:11.607426+0000","last_clean":"2024-05-17T04:09:11.607426+0000","last_became_active":"2024-05-17T04:09:10.610158+0000","last_became_peered":"2024-05-17T04:09:10.610158+0000","last_unstale":"2024-05-17T04:09:11.607426+0000","last_undegraded":"2024-05-17T04:09:11.607426+0000","last_fullsized":"2024-05-17T04:09:11.607426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:05:01.660626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514846+0000","last_change":"2024-05-17T04:09:06.405815+0000","last_active":"2024-05-17T04:09:11.514846+0000","last_peered":"2024-05-17T04:09:11.514846+0000","last_clean":"2024-05-17T04:09:11.514846+0000","last_became_active":"2024-05-17T04:09:06.405516+0000","last_became_peered":"2024-05-17T04:09:06.405516+0000","last_unstale":"2024-05-17T04:09:11.514846+0000","last_undegraded":"2024-05-17T04:09:11.514846+0000","last_fullsized":"2024-05-17T04:09:11.514846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426561+0000","last_change":"2024-05-17T04:09:05.392753+0000","last_active":"2024-05-17T04:09:11.426561+0000","last_peered":"2024-05-17T04:09:11.426561+0000","last_clean":"2024-05-17T04:09:11.426561+0000","last_became_active":"2024-05-17T04:09:05.392392+0000","last_became_peered":"2024-05-17T04:09:05.392392+0000","last_unstale":"2024-05-17T04:09:11.426561+0000","last_undegraded":"2024-05-17T04:09:11.426561+0000","last_fullsized":"2024-05-17T04:09:11.426561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:47:10.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608054+0000","last_change":"2024-05-17T04:09:10.425375+0000","last_active":"2024-05-17T04:09:11.608054+0000","last_peered":"2024-05-17T04:09:11.608054+0000","last_clean":"2024-05-17T04:09:11.608054+0000","last_became_active":"2024-05-17T04:09:10.424219+0000","last_became_peered":"2024-05-17T04:09:10.424219+0000","last_unstale":"2024-05-17T04:09:11.608054+0000","last_undegraded":"2024-05-17T04:09:11.608054+0000","last_fullsized":"2024-05-17T04:09:11.608054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:04:43.859624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607887+0000","last_change":"2024-05-17T04:09:06.398505+0000","last_active":"2024-05-17T04:09:11.607887+0000","last_peered":"2024-05-17T04:09:11.607887+0000","last_clean":"2024-05-17T04:09:11.607887+0000","last_became_active":"2024-05-17T04:09:06.398135+0000","last_became_peered":"2024-05-17T04:09:06.398135+0000","last_unstale":"2024-05-17T04:09:11.607887+0000","last_undegraded":"2024-05-17T04:09:11.607887+0000","last_fullsized":"2024-05-17T04:09:11.607887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:07:56.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607594+0000","last_change":"2024-05-17T04:09:05.396795+0000","last_active":"2024-05-17T04:09:11.607594+0000","last_peered":"2024-05-17T04:09:11.607594+0000","last_clean":"2024-05-17T04:09:11.607594+0000","last_became_active":"2024-05-17T04:09:05.396335+0000","last_became_peered":"2024-05-17T04:09:05.396335+0000","last_unstale":"2024-05-17T04:09:11.607594+0000","last_undegraded":"2024-05-17T04:09:11.607594+0000","last_fullsized":"2024-05-17T04:09:11.607594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:57:11.208612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607531+0000","last_change":"2024-05-17T04:09:05.393287+0000","last_active":"2024-05-17T04:09:11.607531+0000","last_peered":"2024-05-17T04:09:11.607531+0000","last_clean":"2024-05-17T04:09:11.607531+0000","last_became_active":"2024-05-17T04:09:05.392948+0000","last_became_peered":"2024-05-17T04:09:05.392948+0000","last_unstale":"2024-05-17T04:09:11.607531+0000","last_undegraded":"2024-05-17T04:09:11.607531+0000","last_fullsized":"2024-05-17T04:09:11.607531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:08.283007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607875+0000","last_change":"2024-05-17T04:09:06.403950+0000","last_active":"2024-05-17T04:09:11.607875+0000","last_peered":"2024-05-17T04:09:11.607875+0000","last_clean":"2024-05-17T04:09:11.607875+0000","last_became_active":"2024-05-17T04:09:06.403257+0000","last_became_peered":"2024-05-17T04:09:06.403257+0000","last_unstale":"2024-05-17T04:09:11.607875+0000","last_undegraded":"2024-05-17T04:09:11.607875+0000","last_fullsized":"2024-05-17T04:09:11.607875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424114+0000","last_change":"2024-05-17T04:09:10.424315+0000","last_active":"2024-05-17T04:09:11.424114+0000","last_peered":"2024-05-17T04:09:11.424114+0000","last_clean":"2024-05-17T04:09:11.424114+0000","last_became_active":"2024-05-17T04:09:10.423838+0000","last_became_peered":"2024-05-17T04:09:10.423838+0000","last_unstale":"2024-05-17T04:09:11.424114+0000","last_undegraded":"2024-05-17T04:09:11.424114+0000","last_fullsized":"2024-05-17T04:09:11.424114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:39:27.123196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608419+0000","last_change":"2024-05-17T04:09:05.398565+0000","last_active":"2024-05-17T04:09:11.608419+0000","last_peered":"2024-05-17T04:09:11.608419+0000","last_clean":"2024-05-17T04:09:11.608419+0000","last_became_active":"2024-05-17T04:09:05.398229+0000","last_became_peered":"2024-05-17T04:09:05.398229+0000","last_unstale":"2024-05-17T04:09:11.608419+0000","last_undegraded":"2024-05-17T04:09:11.608419+0000","last_fullsized":"2024-05-17T04:09:11.608419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:04.361408+0000","last_clean_scrub_stamp":"2024-05-17T04:09:04.361408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:43:19.836240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425580+0000","last_change":"2024-05-17T04:09:06.400725+0000","last_active":"2024-05-17T04:09:11.425580+0000","last_peered":"2024-05-17T04:09:11.425580+0000","last_clean":"2024-05-17T04:09:11.425580+0000","last_became_active":"2024-05-17T04:09:06.400391+0000","last_became_peered":"2024-05-17T04:09:06.400391+0000","last_unstale":"2024-05-17T04:09:11.425580+0000","last_undegraded":"2024-05-17T04:09:11.425580+0000","last_fullsized":"2024-05-17T04:09:11.425580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:00:09.290308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607875+0000","last_change":"2024-05-17T04:09:10.420250+0000","last_active":"2024-05-17T04:09:11.607875+0000","last_peered":"2024-05-17T04:09:11.607875+0000","last_clean":"2024-05-17T04:09:11.607875+0000","last_became_active":"2024-05-17T04:09:10.419846+0000","last_became_peered":"2024-05-17T04:09:10.419846+0000","last_unstale":"2024-05-17T04:09:11.607875+0000","last_undegraded":"2024-05-17T04:09:11.607875+0000","last_fullsized":"2024-05-17T04:09:11.607875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:09.393162+0000","last_clean_scrub_stamp":"2024-05-17T04:09:09.393162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:21:44.098959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607925+0000","last_change":"2024-05-17T04:09:06.395888+0000","last_active":"2024-05-17T04:09:11.607925+0000","last_peered":"2024-05-17T04:09:11.607925+0000","last_clean":"2024-05-17T04:09:11.607925+0000","last_became_active":"2024-05-17T04:09:06.395422+0000","last_became_peered":"2024-05-17T04:09:06.395422+0000","last_unstale":"2024-05-17T04:09:11.607925+0000","last_undegraded":"2024-05-17T04:09:11.607925+0000","last_fullsized":"2024-05-17T04:09:11.607925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:33:02.204060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.423823+0000","last_change":"2024-05-17T04:09:06.413727+0000","last_active":"2024-05-17T04:09:11.423823+0000","last_peered":"2024-05-17T04:09:11.423823+0000","last_clean":"2024-05-17T04:09:11.423823+0000","last_became_active":"2024-05-17T04:09:06.413402+0000","last_became_peered":"2024-05-17T04:09:06.413402+0000","last_unstale":"2024-05-17T04:09:11.423823+0000","last_undegraded":"2024-05-17T04:09:11.423823+0000","last_fullsized":"2024-05-17T04:09:11.423823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:01.464770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424975+0000","last_change":"2024-05-17T04:09:06.408357+0000","last_active":"2024-05-17T04:09:11.424975+0000","last_peered":"2024-05-17T04:09:11.424975+0000","last_clean":"2024-05-17T04:09:11.424975+0000","last_became_active":"2024-05-17T04:09:06.407758+0000","last_became_peered":"2024-05-17T04:09:06.407758+0000","last_unstale":"2024-05-17T04:09:11.424975+0000","last_undegraded":"2024-05-17T04:09:11.424975+0000","last_fullsized":"2024-05-17T04:09:11.424975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:24.342548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607783+0000","last_change":"2024-05-17T04:09:06.392141+0000","last_active":"2024-05-17T04:09:11.607783+0000","last_peered":"2024-05-17T04:09:11.607783+0000","last_clean":"2024-05-17T04:09:11.607783+0000","last_became_active":"2024-05-17T04:09:06.391676+0000","last_became_peered":"2024-05-17T04:09:06.391676+0000","last_unstale":"2024-05-17T04:09:11.607783+0000","last_undegraded":"2024-05-17T04:09:11.607783+0000","last_fullsized":"2024-05-17T04:09:11.607783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608443+0000","last_change":"2024-05-17T04:09:06.395595+0000","last_active":"2024-05-17T04:09:11.608443+0000","last_peered":"2024-05-17T04:09:11.608443+0000","last_clean":"2024-05-17T04:09:11.608443+0000","last_became_active":"2024-05-17T04:09:06.394124+0000","last_became_peered":"2024-05-17T04:09:06.394124+0000","last_unstale":"2024-05-17T04:09:11.608443+0000","last_undegraded":"2024-05-17T04:09:11.608443+0000","last_fullsized":"2024-05-17T04:09:11.608443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:33:34.167127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515269+0000","last_change":"2024-05-17T04:09:06.404994+0000","last_active":"2024-05-17T04:09:11.515269+0000","last_peered":"2024-05-17T04:09:11.515269+0000","last_clean":"2024-05-17T04:09:11.515269+0000","last_became_active":"2024-05-17T04:09:06.404667+0000","last_became_peered":"2024-05-17T04:09:06.404667+0000","last_unstale":"2024-05-17T04:09:11.515269+0000","last_undegraded":"2024-05-17T04:09:11.515269+0000","last_fullsized":"2024-05-17T04:09:11.515269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607898+0000","last_change":"2024-05-17T04:09:06.402279+0000","last_active":"2024-05-17T04:09:11.607898+0000","last_peered":"2024-05-17T04:09:11.607898+0000","last_clean":"2024-05-17T04:09:11.607898+0000","last_became_active":"2024-05-17T04:09:06.401947+0000","last_became_peered":"2024-05-17T04:09:06.401947+0000","last_unstale":"2024-05-17T04:09:11.607898+0000","last_undegraded":"2024-05-17T04:09:11.607898+0000","last_fullsized":"2024-05-17T04:09:11.607898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607463+0000","last_change":"2024-05-17T04:09:06.407232+0000","last_active":"2024-05-17T04:09:11.607463+0000","last_peered":"2024-05-17T04:09:11.607463+0000","last_clean":"2024-05-17T04:09:11.607463+0000","last_became_active":"2024-05-17T04:09:06.406929+0000","last_became_peered":"2024-05-17T04:09:06.406929+0000","last_unstale":"2024-05-17T04:09:11.607463+0000","last_undegraded":"2024-05-17T04:09:11.607463+0000","last_fullsized":"2024-05-17T04:09:11.607463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:02:56.514685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426472+0000","last_change":"2024-05-17T04:09:06.402162+0000","last_active":"2024-05-17T04:09:11.426472+0000","last_peered":"2024-05-17T04:09:11.426472+0000","last_clean":"2024-05-17T04:09:11.426472+0000","last_became_active":"2024-05-17T04:09:06.401853+0000","last_became_peered":"2024-05-17T04:09:06.401853+0000","last_unstale":"2024-05-17T04:09:11.426472+0000","last_undegraded":"2024-05-17T04:09:11.426472+0000","last_fullsized":"2024-05-17T04:09:11.426472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607445+0000","last_change":"2024-05-17T04:09:06.405967+0000","last_active":"2024-05-17T04:09:11.607445+0000","last_peered":"2024-05-17T04:09:11.607445+0000","last_clean":"2024-05-17T04:09:11.607445+0000","last_became_active":"2024-05-17T04:09:06.405658+0000","last_became_peered":"2024-05-17T04:09:06.405658+0000","last_unstale":"2024-05-17T04:09:11.607445+0000","last_undegraded":"2024-05-17T04:09:11.607445+0000","last_fullsized":"2024-05-17T04:09:11.607445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424870+0000","last_change":"2024-05-17T04:09:06.402392+0000","last_active":"2024-05-17T04:09:11.424870+0000","last_peered":"2024-05-17T04:09:11.424870+0000","last_clean":"2024-05-17T04:09:11.424870+0000","last_became_active":"2024-05-17T04:09:06.401547+0000","last_became_peered":"2024-05-17T04:09:06.401547+0000","last_unstale":"2024-05-17T04:09:11.424870+0000","last_undegraded":"2024-05-17T04:09:11.424870+0000","last_fullsized":"2024-05-17T04:09:11.424870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:04:57.636173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607524+0000","last_change":"2024-05-17T04:09:06.403901+0000","last_active":"2024-05-17T04:09:11.607524+0000","last_peered":"2024-05-17T04:09:11.607524+0000","last_clean":"2024-05-17T04:09:11.607524+0000","last_became_active":"2024-05-17T04:09:06.402890+0000","last_became_peered":"2024-05-17T04:09:06.402890+0000","last_unstale":"2024-05-17T04:09:11.607524+0000","last_undegraded":"2024-05-17T04:09:11.607524+0000","last_fullsized":"2024-05-17T04:09:11.607524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:07:56.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608474+0000","last_change":"2024-05-17T04:09:06.405422+0000","last_active":"2024-05-17T04:09:11.608474+0000","last_peered":"2024-05-17T04:09:11.608474+0000","last_clean":"2024-05-17T04:09:11.608474+0000","last_became_active":"2024-05-17T04:09:06.405094+0000","last_became_peered":"2024-05-17T04:09:06.405094+0000","last_unstale":"2024-05-17T04:09:11.608474+0000","last_undegraded":"2024-05-17T04:09:11.608474+0000","last_fullsized":"2024-05-17T04:09:11.608474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608609+0000","last_change":"2024-05-17T04:09:06.409849+0000","last_active":"2024-05-17T04:09:11.608609+0000","last_peered":"2024-05-17T04:09:11.608609+0000","last_clean":"2024-05-17T04:09:11.608609+0000","last_became_active":"2024-05-17T04:09:06.409168+0000","last_became_peered":"2024-05-17T04:09:06.409168+0000","last_unstale":"2024-05-17T04:09:11.608609+0000","last_undegraded":"2024-05-17T04:09:11.608609+0000","last_fullsized":"2024-05-17T04:09:11.608609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:04:57.636173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424161+0000","last_change":"2024-05-17T04:09:06.396066+0000","last_active":"2024-05-17T04:09:11.424161+0000","last_peered":"2024-05-17T04:09:11.424161+0000","last_clean":"2024-05-17T04:09:11.424161+0000","last_became_active":"2024-05-17T04:09:06.394962+0000","last_became_peered":"2024-05-17T04:09:06.394962+0000","last_unstale":"2024-05-17T04:09:11.424161+0000","last_undegraded":"2024-05-17T04:09:11.424161+0000","last_fullsized":"2024-05-17T04:09:11.424161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:35.828470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.426434+0000","last_change":"2024-05-17T04:09:06.405156+0000","last_active":"2024-05-17T04:09:11.426434+0000","last_peered":"2024-05-17T04:09:11.426434+0000","last_clean":"2024-05-17T04:09:11.426434+0000","last_became_active":"2024-05-17T04:09:06.404857+0000","last_became_peered":"2024-05-17T04:09:06.404857+0000","last_unstale":"2024-05-17T04:09:11.426434+0000","last_undegraded":"2024-05-17T04:09:11.426434+0000","last_fullsized":"2024-05-17T04:09:11.426434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:10.587650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425653+0000","last_change":"2024-05-17T04:09:06.404527+0000","last_active":"2024-05-17T04:09:11.425653+0000","last_peered":"2024-05-17T04:09:11.425653+0000","last_clean":"2024-05-17T04:09:11.425653+0000","last_became_active":"2024-05-17T04:09:06.404215+0000","last_became_peered":"2024-05-17T04:09:06.404215+0000","last_unstale":"2024-05-17T04:09:11.425653+0000","last_undegraded":"2024-05-17T04:09:11.425653+0000","last_fullsized":"2024-05-17T04:09:11.425653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:58:08.783557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.514907+0000","last_change":"2024-05-17T04:09:06.404828+0000","last_active":"2024-05-17T04:09:11.514907+0000","last_peered":"2024-05-17T04:09:11.514907+0000","last_clean":"2024-05-17T04:09:11.514907+0000","last_became_active":"2024-05-17T04:09:06.404512+0000","last_became_peered":"2024-05-17T04:09:06.404512+0000","last_unstale":"2024-05-17T04:09:11.514907+0000","last_undegraded":"2024-05-17T04:09:11.514907+0000","last_fullsized":"2024-05-17T04:09:11.514907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:08:56.454850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607167+0000","last_change":"2024-05-17T04:09:06.395825+0000","last_active":"2024-05-17T04:09:11.607167+0000","last_peered":"2024-05-17T04:09:11.607167+0000","last_clean":"2024-05-17T04:09:11.607167+0000","last_became_active":"2024-05-17T04:09:06.395519+0000","last_became_peered":"2024-05-17T04:09:06.395519+0000","last_unstale":"2024-05-17T04:09:11.607167+0000","last_undegraded":"2024-05-17T04:09:11.607167+0000","last_fullsized":"2024-05-17T04:09:11.607167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:24:33.148839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608216+0000","last_change":"2024-05-17T04:09:06.397289+0000","last_active":"2024-05-17T04:09:11.608216+0000","last_peered":"2024-05-17T04:09:11.608216+0000","last_clean":"2024-05-17T04:09:11.608216+0000","last_became_active":"2024-05-17T04:09:06.396970+0000","last_became_peered":"2024-05-17T04:09:06.396970+0000","last_unstale":"2024-05-17T04:09:11.608216+0000","last_undegraded":"2024-05-17T04:09:11.608216+0000","last_fullsized":"2024-05-17T04:09:11.608216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425858+0000","last_change":"2024-05-17T04:09:06.395813+0000","last_active":"2024-05-17T04:09:11.425858+0000","last_peered":"2024-05-17T04:09:11.425858+0000","last_clean":"2024-05-17T04:09:11.425858+0000","last_became_active":"2024-05-17T04:09:06.395523+0000","last_became_peered":"2024-05-17T04:09:06.395523+0000","last_unstale":"2024-05-17T04:09:11.425858+0000","last_undegraded":"2024-05-17T04:09:11.425858+0000","last_fullsized":"2024-05-17T04:09:11.425858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:35:01.464770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608123+0000","last_change":"2024-05-17T04:09:06.415051+0000","last_active":"2024-05-17T04:09:11.608123+0000","last_peered":"2024-05-17T04:09:11.608123+0000","last_clean":"2024-05-17T04:09:11.608123+0000","last_became_active":"2024-05-17T04:09:06.414567+0000","last_became_peered":"2024-05-17T04:09:06.414567+0000","last_unstale":"2024-05-17T04:09:11.608123+0000","last_undegraded":"2024-05-17T04:09:11.608123+0000","last_fullsized":"2024-05-17T04:09:11.608123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607819+0000","last_change":"2024-05-17T04:09:06.414418+0000","last_active":"2024-05-17T04:09:11.607819+0000","last_peered":"2024-05-17T04:09:11.607819+0000","last_clean":"2024-05-17T04:09:11.607819+0000","last_became_active":"2024-05-17T04:09:06.414073+0000","last_became_peered":"2024-05-17T04:09:06.414073+0000","last_unstale":"2024-05-17T04:09:11.607819+0000","last_undegraded":"2024-05-17T04:09:11.607819+0000","last_fullsized":"2024-05-17T04:09:11.607819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:38.475318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608958+0000","last_change":"2024-05-17T04:09:06.415334+0000","last_active":"2024-05-17T04:09:11.608958+0000","last_peered":"2024-05-17T04:09:11.608958+0000","last_clean":"2024-05-17T04:09:11.608958+0000","last_became_active":"2024-05-17T04:09:06.414983+0000","last_became_peered":"2024-05-17T04:09:06.414983+0000","last_unstale":"2024-05-17T04:09:11.608958+0000","last_undegraded":"2024-05-17T04:09:11.608958+0000","last_fullsized":"2024-05-17T04:09:11.608958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:28:24.342548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607791+0000","last_change":"2024-05-17T04:09:06.411128+0000","last_active":"2024-05-17T04:09:11.607791+0000","last_peered":"2024-05-17T04:09:11.607791+0000","last_clean":"2024-05-17T04:09:11.607791+0000","last_became_active":"2024-05-17T04:09:06.410770+0000","last_became_peered":"2024-05-17T04:09:06.410770+0000","last_unstale":"2024-05-17T04:09:11.607791+0000","last_undegraded":"2024-05-17T04:09:11.607791+0000","last_fullsized":"2024-05-17T04:09:11.607791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:33:02.204060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607458+0000","last_change":"2024-05-17T04:09:06.408726+0000","last_active":"2024-05-17T04:09:11.607458+0000","last_peered":"2024-05-17T04:09:11.607458+0000","last_clean":"2024-05-17T04:09:11.607458+0000","last_became_active":"2024-05-17T04:09:06.404912+0000","last_became_peered":"2024-05-17T04:09:06.404912+0000","last_unstale":"2024-05-17T04:09:11.607458+0000","last_undegraded":"2024-05-17T04:09:11.607458+0000","last_fullsized":"2024-05-17T04:09:11.607458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:02:56.514685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.424735+0000","last_change":"2024-05-17T04:09:06.408616+0000","last_active":"2024-05-17T04:09:11.424735+0000","last_peered":"2024-05-17T04:09:11.424735+0000","last_clean":"2024-05-17T04:09:11.424735+0000","last_became_active":"2024-05-17T04:09:06.408066+0000","last_became_peered":"2024-05-17T04:09:06.408066+0000","last_unstale":"2024-05-17T04:09:11.424735+0000","last_undegraded":"2024-05-17T04:09:11.424735+0000","last_fullsized":"2024-05-17T04:09:11.424735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:12:02.383594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607652+0000","last_change":"2024-05-17T04:09:06.402593+0000","last_active":"2024-05-17T04:09:11.607652+0000","last_peered":"2024-05-17T04:09:11.607652+0000","last_clean":"2024-05-17T04:09:11.607652+0000","last_became_active":"2024-05-17T04:09:06.402279+0000","last_became_peered":"2024-05-17T04:09:06.402279+0000","last_unstale":"2024-05-17T04:09:11.607652+0000","last_undegraded":"2024-05-17T04:09:11.607652+0000","last_fullsized":"2024-05-17T04:09:11.607652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:32:10.587650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.425778+0000","last_change":"2024-05-17T04:09:06.410616+0000","last_active":"2024-05-17T04:09:11.425778+0000","last_peered":"2024-05-17T04:09:11.425778+0000","last_clean":"2024-05-17T04:09:11.425778+0000","last_became_active":"2024-05-17T04:09:06.409954+0000","last_became_peered":"2024-05-17T04:09:06.409954+0000","last_unstale":"2024-05-17T04:09:11.425778+0000","last_undegraded":"2024-05-17T04:09:11.425778+0000","last_fullsized":"2024-05-17T04:09:11.425778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:47:41.984177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.607553+0000","last_change":"2024-05-17T04:09:06.386066+0000","last_active":"2024-05-17T04:09:11.607553+0000","last_peered":"2024-05-17T04:09:11.607553+0000","last_clean":"2024-05-17T04:09:11.607553+0000","last_became_active":"2024-05-17T04:09:06.385689+0000","last_became_peered":"2024-05-17T04:09:06.385689+0000","last_unstale":"2024-05-17T04:09:11.607553+0000","last_undegraded":"2024-05-17T04:09:11.607553+0000","last_fullsized":"2024-05-17T04:09:11.607553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:53:16.815156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.515522+0000","last_change":"2024-05-17T04:09:06.395571+0000","last_active":"2024-05-17T04:09:11.515522+0000","last_peered":"2024-05-17T04:09:11.515522+0000","last_clean":"2024-05-17T04:09:11.515522+0000","last_became_active":"2024-05-17T04:09:06.394746+0000","last_became_peered":"2024-05-17T04:09:06.394746+0000","last_unstale":"2024-05-17T04:09:11.515522+0000","last_undegraded":"2024-05-17T04:09:11.515522+0000","last_fullsized":"2024-05-17T04:09:11.515522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:17:09.050291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-17T04:09:11.608880+0000","last_change":"2024-05-17T04:09:06.409444+0000","last_active":"2024-05-17T04:09:11.608880+0000","last_peered":"2024-05-17T04:09:11.608880+0000","last_clean":"2024-05-17T04:09:11.608880+0000","last_became_active":"2024-05-17T04:09:06.409107+0000","last_became_peered":"2024-05-17T04:09:06.409107+0000","last_unstale":"2024-05-17T04:09:11.608880+0000","last_undegraded":"2024-05-17T04:09:11.608880+0000","last_fullsized":"2024-05-17T04:09:11.608880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:05.368709+0000","last_clean_scrub_stamp":"2024-05-17T04:09:05.368709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:53:04.483377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-17T04:09:25.487 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-17T04:09:25.487 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-17T04:09:25.488 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-17T04:09:25.488 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-17T04:09:25.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.630+0000 7fa276963640 1 Processor -- start 2024-05-17T04:09:25.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.630+0000 7fa276963640 1 -- start start 2024-05-17T04:09:25.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.632+0000 7fa276963640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa270071390 0x7fa2700717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.632+0000 7fa276963640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa2700b74c0 0x7fa2700b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.632+0000 7fa276963640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa270071ce0 con 0x7fa270163630 2024-05-17T04:09:25.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.632+0000 7fa276963640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa2700d0b90 con 0x7fa2700b74c0 2024-05-17T04:09:25.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.632+0000 7fa276963640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa2700d1ba0 con 0x7fa270071390 2024-05-17T04:09:25.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.632+0000 7fa26f7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa2700b74c0 0x7fa2700b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.632+0000 7fa26f7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa2700b74c0 0x7fa2700b78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57168/0 (socket says 172.21.15.131:57168) 2024-05-17T04:09:25.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.632+0000 7fa26f7fe640 1 -- 172.21.15.131:0/1780756636 learned_addr learned my addr 172.21.15.131:0/1780756636 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:25.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.632+0000 7fa26ffff640 1 --2- 172.21.15.131:0/1780756636 >> v2:172.21.15.150:3300/0 conn(0x7fa270071390 0x7fa2700717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.632+0000 7fa26f7fe640 1 -- 172.21.15.131:0/1780756636 >> v2:172.21.15.150:3300/0 conn(0x7fa270071390 msgr2=0x7fa2700717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:25.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.632+0000 7fa26f7fe640 1 --2- 172.21.15.131:0/1780756636 >> v2:172.21.15.150:3300/0 conn(0x7fa270071390 0x7fa2700717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.632+0000 7fa26f7fe640 1 -- 172.21.15.131:0/1780756636 >> v1:172.21.15.150:6789/0 conn(0x7fa270163630 legacy=0x7fa270163a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.632+0000 7fa26f7fe640 1 -- 172.21.15.131:0/1780756636 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2700d0de0 con 0x7fa2700b74c0 2024-05-17T04:09:25.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.633+0000 7fa26f7fe640 1 --2- 172.21.15.131:0/1780756636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2700b74c0 0x7fa2700b78d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa270074d50 tx=0x7fa26402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6c9ee00ab3e4d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:25.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.633+0000 7fa26effd640 1 -- 172.21.15.131:0/1780756636 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa264037070 con 0x7fa2700b74c0 2024-05-17T04:09:25.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.633+0000 7fa26effd640 1 -- 172.21.15.131:0/1780756636 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa264032440 con 0x7fa2700b74c0 2024-05-17T04:09:25.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.633+0000 7fa26effd640 1 -- 172.21.15.131:0/1780756636 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa264032810 con 0x7fa2700b74c0 2024-05-17T04:09:25.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.634+0000 7fa276963640 1 -- 172.21.15.131:0/1780756636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2700b74c0 msgr2=0x7fa2700b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.634+0000 7fa276963640 1 --2- 172.21.15.131:0/1780756636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2700b74c0 0x7fa2700b78d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa270074d50 tx=0x7fa26402a1e0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.634+0000 7fa276963640 1 -- 172.21.15.131:0/1780756636 shutdown_connections 2024-05-17T04:09:25.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.634+0000 7fa276963640 1 --2- 172.21.15.131:0/1780756636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2700b74c0 0x7fa2700b78d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.634+0000 7fa276963640 1 --2- 172.21.15.131:0/1780756636 >> v2:172.21.15.150:3300/0 conn(0x7fa270071390 0x7fa2700717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.634+0000 7fa276963640 1 -- 172.21.15.131:0/1780756636 >> 172.21.15.131:0/1780756636 conn(0x7fa2700735b0 msgr2=0x7fa2700739c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:25.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.634+0000 7fa276963640 1 -- 172.21.15.131:0/1780756636 shutdown_connections 2024-05-17T04:09:25.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.634+0000 7fa276963640 1 -- 172.21.15.131:0/1780756636 wait complete. 2024-05-17T04:09:25.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.636+0000 7fa276963640 1 Processor -- start 2024-05-17T04:09:25.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.636+0000 7fa276963640 1 -- start start 2024-05-17T04:09:25.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.637+0000 7fa276963640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa270071390 0x7fa270141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.637+0000 7fa276963640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2700b74c0 0x7fa270143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.637+0000 7fa276963640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa270163630 0x7fa27015b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.637+0000 7fa276963640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa2700d1680 con 0x7fa2700b74c0 2024-05-17T04:09:25.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.637+0000 7fa276963640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa2700d13a0 con 0x7fa270163630 2024-05-17T04:09:25.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.637+0000 7fa276963640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa270142820 con 0x7fa270071390 2024-05-17T04:09:25.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.637+0000 7fa26f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2700b74c0 0x7fa270143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.637+0000 7fa26f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2700b74c0 0x7fa270143f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57172/0 (socket says 172.21.15.131:57172) 2024-05-17T04:09:25.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.637+0000 7fa26f7fe640 1 -- 172.21.15.131:0/396238366 learned_addr learned my addr 172.21.15.131:0/396238366 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:25.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.638+0000 7fa274f00640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa270163630 0x7fa27015b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.638+0000 7fa26ffff640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa270071390 0x7fa270141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.638+0000 7fa26f7fe640 1 -- 172.21.15.131:0/396238366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa270071390 msgr2=0x7fa270141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.638+0000 7fa26f7fe640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa270071390 0x7fa270141ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.638+0000 7fa26f7fe640 1 -- 172.21.15.131:0/396238366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa270163630 msgr2=0x7fa27015b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.638+0000 7fa26f7fe640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa270163630 0x7fa27015b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.638+0000 7fa26f7fe640 1 -- 172.21.15.131:0/396238366 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa270144b30 con 0x7fa2700b74c0 2024-05-17T04:09:25.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.638+0000 7fa26ffff640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa270071390 0x7fa270141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:25.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.638+0000 7fa274f00640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa270163630 0x7fa27015b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:25.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.638+0000 7fa26f7fe640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2700b74c0 0x7fa270143f50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa26402a220 tx=0x7fa2640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:25.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.638+0000 7fa26cff9640 1 -- 172.21.15.131:0/396238366 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa264041030 con 0x7fa2700b74c0 2024-05-17T04:09:25.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.638+0000 7fa26cff9640 1 -- 172.21.15.131:0/396238366 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa264030440 con 0x7fa2700b74c0 2024-05-17T04:09:25.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.638+0000 7fa26cff9640 1 -- 172.21.15.131:0/396238366 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa264037040 con 0x7fa2700b74c0 2024-05-17T04:09:25.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.638+0000 7fa276963640 1 -- 172.21.15.131:0/396238366 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa270144e10 con 0x7fa2700b74c0 2024-05-17T04:09:25.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.638+0000 7fa276963640 1 -- 172.21.15.131:0/396238366 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2701453d0 con 0x7fa2700b74c0 2024-05-17T04:09:25.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.639+0000 7fa276963640 1 -- 172.21.15.131:0/396238366 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2700717a0 con 0x7fa2700b74c0 2024-05-17T04:09:25.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.640+0000 7fa26cff9640 1 -- 172.21.15.131:0/396238366 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa264044070 con 0x7fa2700b74c0 2024-05-17T04:09:25.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.640+0000 7fa26cff9640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa25c076300 0x7fa25c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.640+0000 7fa26cff9640 1 -- 172.21.15.131:0/396238366 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa2640b8010 con 0x7fa2700b74c0 2024-05-17T04:09:25.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.640+0000 7fa26ffff640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa25c076300 0x7fa25c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.641+0000 7fa26ffff640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa25c076300 0x7fa25c078810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa260009af0 tx=0x7fa260008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:25.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.645+0000 7fa26cff9640 1 -- 172.21.15.131:0/396238366 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa264081630 con 0x7fa2700b74c0 2024-05-17T04:09:25.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.863+0000 7fa276963640 1 -- 172.21.15.131:0/396238366 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa2700ce810 con 0x7fa2700b74c0 2024-05-17T04:09:25.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.864+0000 7fa26cff9640 1 -- 172.21.15.131:0/396238366 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa264080f30 con 0x7fa2700b74c0 2024-05-17T04:09:25.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:25.865 INFO:teuthology.orchestra.run.smithi131.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-17T04:09:25.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.866+0000 7fa276963640 1 -- 172.21.15.131:0/396238366 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa25c076300 msgr2=0x7fa25c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.866+0000 7fa276963640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa25c076300 0x7fa25c078810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa260009af0 tx=0x7fa260008040 comp rx=0 tx=0).stop 2024-05-17T04:09:25.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.866+0000 7fa276963640 1 -- 172.21.15.131:0/396238366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2700b74c0 msgr2=0x7fa270143f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.866+0000 7fa276963640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2700b74c0 0x7fa270143f50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa26402a220 tx=0x7fa2640046c0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.866+0000 7fa276963640 1 -- 172.21.15.131:0/396238366 shutdown_connections 2024-05-17T04:09:25.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.866+0000 7fa276963640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa25c076300 0x7fa25c078810 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.866+0000 7fa276963640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2700b74c0 0x7fa270143f50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.866+0000 7fa276963640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa270163630 0x7fa27015b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.866+0000 7fa276963640 1 --2- 172.21.15.131:0/396238366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa270071390 0x7fa270141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.866+0000 7fa276963640 1 -- 172.21.15.131:0/396238366 >> 172.21.15.131:0/396238366 conn(0x7fa2700735b0 msgr2=0x7fa27015d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:25.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.866+0000 7fa276963640 1 -- 172.21.15.131:0/396238366 shutdown_connections 2024-05-17T04:09:25.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.866+0000 7fa276963640 1 -- 172.21.15.131:0/396238366 wait complete. 2024-05-17T04:09:25.878 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-17T04:09:25.879 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T04:09:25.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.987+0000 7f223ccce640 1 Processor -- start 2024-05-17T04:09:25.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.987+0000 7f223ccce640 1 -- start start 2024-05-17T04:09:25.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.988+0000 7f223ccce640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2238146310 0x7f22380b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.988+0000 7f223ccce640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2238146720 0x7f22380b7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.988+0000 7f223ccce640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2238071980 con 0x7f2238161840 2024-05-17T04:09:25.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.988+0000 7f223ccce640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f2238071740 con 0x7f2238146720 2024-05-17T04:09:25.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.988+0000 7f223ccce640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2238071c60 con 0x7f2238146310 2024-05-17T04:09:25.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.988+0000 7f2236d9d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2238146720 0x7f22380b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.988+0000 7f2236d9d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2238146720 0x7f22380b7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57178/0 (socket says 172.21.15.131:57178) 2024-05-17T04:09:25.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.988+0000 7f2236d9d640 1 -- 172.21.15.131:0/1658479429 learned_addr learned my addr 172.21.15.131:0/1658479429 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:25.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.988+0000 7f2235d9b640 1 --2- 172.21.15.131:0/1658479429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2238146310 0x7f22380b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.989+0000 7f2236d9d640 1 -- 172.21.15.131:0/1658479429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2238146310 msgr2=0x7f22380b72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:25.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.989+0000 7f2236d9d640 1 --2- 172.21.15.131:0/1658479429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2238146310 0x7f22380b72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.989+0000 7f2236d9d640 1 -- 172.21.15.131:0/1658479429 >> v1:172.21.15.150:6789/0 conn(0x7f2238161840 legacy=0x7f2238071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.989+0000 7f2236d9d640 1 -- 172.21.15.131:0/1658479429 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2238071f40 con 0x7f2238146720 2024-05-17T04:09:25.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.989+0000 7f2236d9d640 1 --2- 172.21.15.131:0/1658479429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2238146720 0x7f22380b7810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2230009e50 tx=0x7f223002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90447023392cb2a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:25.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.989+0000 7f223559a640 1 -- 172.21.15.131:0/1658479429 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2230036070 con 0x7f2238146720 2024-05-17T04:09:25.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.989+0000 7f223559a640 1 -- 172.21.15.131:0/1658479429 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2230031600 con 0x7f2238146720 2024-05-17T04:09:25.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.989+0000 7f223559a640 1 -- 172.21.15.131:0/1658479429 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22300319d0 con 0x7f2238146720 2024-05-17T04:09:25.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.990+0000 7f223ccce640 1 -- 172.21.15.131:0/1658479429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2238146720 msgr2=0x7f22380b7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.990+0000 7f223ccce640 1 --2- 172.21.15.131:0/1658479429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2238146720 0x7f22380b7810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2230009e50 tx=0x7f223002a730 comp rx=0 tx=0).stop 2024-05-17T04:09:25.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.990+0000 7f223ccce640 1 -- 172.21.15.131:0/1658479429 shutdown_connections 2024-05-17T04:09:25.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.990+0000 7f223ccce640 1 --2- 172.21.15.131:0/1658479429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2238146720 0x7f22380b7810 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.990+0000 7f223ccce640 1 --2- 172.21.15.131:0/1658479429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2238146310 0x7f22380b72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.990+0000 7f223ccce640 1 -- 172.21.15.131:0/1658479429 >> 172.21.15.131:0/1658479429 conn(0x7f22380735b0 msgr2=0x7f22380739c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:25.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.990+0000 7f223ccce640 1 -- 172.21.15.131:0/1658479429 shutdown_connections 2024-05-17T04:09:25.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.990+0000 7f223ccce640 1 -- 172.21.15.131:0/1658479429 wait complete. 2024-05-17T04:09:25.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.992+0000 7f223ccce640 1 Processor -- start 2024-05-17T04:09:25.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.992+0000 7f223ccce640 1 -- start start 2024-05-17T04:09:25.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.993+0000 7f223ccce640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2238146310 0x7f22380cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.993+0000 7f223ccce640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2238146720 0x7f2238140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.993+0000 7f223ccce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2238161840 0x7f22381f7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:25.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f223ccce640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2238161c50 con 0x7f2238146720 2024-05-17T04:09:25.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f223ccce640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2238161320 con 0x7f2238161840 2024-05-17T04:09:25.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f223ccce640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2238161dd0 con 0x7f2238146310 2024-05-17T04:09:25.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f2235d9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2238146720 0x7f2238140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f2235d9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2238146720 0x7f2238140be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57180/0 (socket says 172.21.15.131:57180) 2024-05-17T04:09:25.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f2235d9b640 1 -- 172.21.15.131:0/1556722125 learned_addr learned my addr 172.21.15.131:0/1556722125 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:25.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f2236d9d640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2238161840 0x7f22381f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f223659c640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2238146310 0x7f22380cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:25.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f2235d9b640 1 -- 172.21.15.131:0/1556722125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2238146310 msgr2=0x7f22380cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f2235d9b640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2238146310 0x7f22380cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f2235d9b640 1 -- 172.21.15.131:0/1556722125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2238161840 msgr2=0x7f22381f7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:25.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f2235d9b640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2238161840 0x7f22381f7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:25.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f2235d9b640 1 -- 172.21.15.131:0/1556722125 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22380ce3b0 con 0x7f2238146720 2024-05-17T04:09:26.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f223659c640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2238146310 0x7f22380cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:26.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f2236d9d640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2238161840 0x7f22381f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:26.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f2235d9b640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2238146720 0x7f2238140be0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2238072500 tx=0x7f222c00d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:26.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f2226ffd640 1 -- 172.21.15.131:0/1556722125 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c0125f0 con 0x7f2238146720 2024-05-17T04:09:26.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f2226ffd640 1 -- 172.21.15.131:0/1556722125 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222c019070 con 0x7f2238146720 2024-05-17T04:09:26.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f2226ffd640 1 -- 172.21.15.131:0/1556722125 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c0129d0 con 0x7f2238146720 2024-05-17T04:09:26.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f223ccce640 1 -- 172.21.15.131:0/1556722125 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22381415f0 con 0x7f2238146720 2024-05-17T04:09:26.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.994+0000 7f223ccce640 1 -- 172.21.15.131:0/1556722125 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2238141bb0 con 0x7f2238146720 2024-05-17T04:09:26.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.995+0000 7f223ccce640 1 -- 172.21.15.131:0/1556722125 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2238071030 con 0x7f2238146720 2024-05-17T04:09:26.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.996+0000 7f2226ffd640 1 -- 172.21.15.131:0/1556722125 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f222c012b70 con 0x7f2238146720 2024-05-17T04:09:26.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.997+0000 7f2226ffd640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2218076300 0x7f2218078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:26.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.997+0000 7f2226ffd640 1 -- 172.21.15.131:0/1556722125 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f222c097a40 con 0x7f2238146720 2024-05-17T04:09:26.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.997+0000 7f223659c640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2218076300 0x7f2218078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:26.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:25.997+0000 7f223659c640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2218076300 0x7f2218078810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f22280016a0 tx=0x7f2228009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:26.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.001+0000 7f2226ffd640 1 -- 172.21.15.131:0/1556722125 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f222c023020 con 0x7f2238146720 2024-05-17T04:09:26.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.217+0000 7f223ccce640 1 -- 172.21.15.131:0/1556722125 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22380746c0 con 0x7f2238146720 2024-05-17T04:09:26.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.217+0000 7f2226ffd640 1 -- 172.21.15.131:0/1556722125 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5189 (secure 0 0 0) 0x7f222c060fd0 con 0x7f2238146720 2024-05-17T04:09:26.218 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:26.219 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2897828294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2897828294},{"type":"v1","addr":"172.21.15.131:6837","nonce":2897828294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/4068751282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4068751282},{"type":"v1","addr":"172.21.15.131:6836","nonce":4068751282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2776700884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2776700884},{"type":"v1","addr":"172.21.15.150:6834","nonce":2776700884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:05.755541+0000","modified":"2024-05-17T04:09:18.813988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2635477484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2635477484},{"type":"v1","addr":"172.21.15.150:6835","nonce":2635477484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-05-17T04:09:26.219 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-05-17T04:09:26.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.219+0000 7f223ccce640 1 -- 172.21.15.131:0/1556722125 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2218076300 msgr2=0x7f2218078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:26.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.219+0000 7f223ccce640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2218076300 0x7f2218078810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f22280016a0 tx=0x7f2228009040 comp rx=0 tx=0).stop 2024-05-17T04:09:26.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.219+0000 7f223ccce640 1 -- 172.21.15.131:0/1556722125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2238146720 msgr2=0x7f2238140be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:26.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.219+0000 7f223ccce640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2238146720 0x7f2238140be0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2238072500 tx=0x7f222c00d960 comp rx=0 tx=0).stop 2024-05-17T04:09:26.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.219+0000 7f223ccce640 1 -- 172.21.15.131:0/1556722125 shutdown_connections 2024-05-17T04:09:26.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.219+0000 7f223ccce640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2218076300 0x7f2218078810 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.219+0000 7f223ccce640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2238146720 0x7f2238140be0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.219+0000 7f223ccce640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2238161840 0x7f22381f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.219+0000 7f223ccce640 1 --2- 172.21.15.131:0/1556722125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2238146310 0x7f22380cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.219+0000 7f223ccce640 1 -- 172.21.15.131:0/1556722125 >> 172.21.15.131:0/1556722125 conn(0x7f22380735b0 msgr2=0x7f223815da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:26.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.219+0000 7f223ccce640 1 -- 172.21.15.131:0/1556722125 shutdown_connections 2024-05-17T04:09:26.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.219+0000 7f223ccce640 1 -- 172.21.15.131:0/1556722125 wait complete. 2024-05-17T04:09:26.232 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T04:09:26.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.341+0000 7f9902822640 1 Processor -- start 2024-05-17T04:09:26.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.341+0000 7f9902822640 1 -- start start 2024-05-17T04:09:26.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.342+0000 7f9902822640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98fc071d90 0x7f98fc15db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:26.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.342+0000 7f9902822640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f98fc15ecc0 0x7f98fc0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:26.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.342+0000 7f9902822640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98fc15e0e0 con 0x7f98fc0cdd40 2024-05-17T04:09:26.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.342+0000 7f9902822640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f98fc158010 con 0x7f98fc15ecc0 2024-05-17T04:09:26.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.342+0000 7f9902822640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f98fc15e3c0 con 0x7f98fc071d90 2024-05-17T04:09:26.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.342+0000 7f98fb7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f98fc15ecc0 0x7f98fc0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:26.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.343+0000 7f98fb7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f98fc15ecc0 0x7f98fc0cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57188/0 (socket says 172.21.15.131:57188) 2024-05-17T04:09:26.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.343+0000 7f9900dbf640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f98fc0cdd40 0x7f98fc0d13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:54766/0 (socket says 172.21.15.131:54766) 2024-05-17T04:09:26.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.343+0000 7f98fb7fe640 1 -- 172.21.15.131:0/503884301 learned_addr learned my addr 172.21.15.131:0/503884301 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:26.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.343+0000 7f98fbfff640 1 --2- 172.21.15.131:0/503884301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98fc071d90 0x7f98fc15db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:26.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.343+0000 7f98fb7fe640 1 -- 172.21.15.131:0/503884301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98fc071d90 msgr2=0x7f98fc15db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:26.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.343+0000 7f98fb7fe640 1 --2- 172.21.15.131:0/503884301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98fc071d90 0x7f98fc15db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.343+0000 7f98fb7fe640 1 -- 172.21.15.131:0/503884301 >> v1:172.21.15.131:6789/0 conn(0x7f98fc0cdd40 legacy=0x7f98fc0d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:26.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.343+0000 7f98fb7fe640 1 -- 172.21.15.131:0/503884301 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc15e6a0 con 0x7f98fc15ecc0 2024-05-17T04:09:26.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.343+0000 7f98fbfff640 1 --2- 172.21.15.131:0/503884301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98fc071d90 0x7f98fc15db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:26.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.344+0000 7f98fb7fe640 1 --2- 172.21.15.131:0/503884301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98fc15ecc0 0x7f98fc0cd800 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009870 tx=0x7f98f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94affa2d080c750 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:26.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.344+0000 7f98faffd640 1 -- 172.21.15.131:0/503884301 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0037070 con 0x7f98fc15ecc0 2024-05-17T04:09:26.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.344+0000 7f98faffd640 1 -- 172.21.15.131:0/503884301 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f0032440 con 0x7f98fc15ecc0 2024-05-17T04:09:26.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.344+0000 7f98faffd640 1 -- 172.21.15.131:0/503884301 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0032810 con 0x7f98fc15ecc0 2024-05-17T04:09:26.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.344+0000 7f9902822640 1 -- 172.21.15.131:0/503884301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98fc15ecc0 msgr2=0x7f98fc0cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:26.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.344+0000 7f9902822640 1 --2- 172.21.15.131:0/503884301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98fc15ecc0 0x7f98fc0cd800 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009870 tx=0x7f98f002a270 comp rx=0 tx=0).stop 2024-05-17T04:09:26.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.344+0000 7f9902822640 1 -- 172.21.15.131:0/503884301 shutdown_connections 2024-05-17T04:09:26.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.344+0000 7f9902822640 1 --2- 172.21.15.131:0/503884301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98fc15ecc0 0x7f98fc0cd800 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.344+0000 7f9902822640 1 --2- 172.21.15.131:0/503884301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98fc071d90 0x7f98fc15db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.344+0000 7f9902822640 1 -- 172.21.15.131:0/503884301 >> 172.21.15.131:0/503884301 conn(0x7f98fc0d2fd0 msgr2=0x7f98fc0d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:26.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.344+0000 7f9902822640 1 -- 172.21.15.131:0/503884301 shutdown_connections 2024-05-17T04:09:26.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.344+0000 7f9902822640 1 -- 172.21.15.131:0/503884301 wait complete. 2024-05-17T04:09:26.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.346+0000 7f9902822640 1 Processor -- start 2024-05-17T04:09:26.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.346+0000 7f9902822640 1 -- start start 2024-05-17T04:09:26.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f9902822640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98fc071d90 0x7f98fc156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:26.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f9902822640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98fc0cdd40 0x7f98fc1f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:26.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f9902822640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98fc15ecc0 0x7f98fc0b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:26.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f9902822640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc0d2a50 con 0x7f98fc0cdd40 2024-05-17T04:09:26.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f9902822640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc0d28d0 con 0x7f98fc15ecc0 2024-05-17T04:09:26.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f9902822640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f98fc15f0d0 con 0x7f98fc071d90 2024-05-17T04:09:26.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f98fb7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98fc0cdd40 0x7f98fc1f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:26.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f98fb7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98fc0cdd40 0x7f98fc1f5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57204/0 (socket says 172.21.15.131:57204) 2024-05-17T04:09:26.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f98fb7fe640 1 -- 172.21.15.131:0/1730176482 learned_addr learned my addr 172.21.15.131:0/1730176482 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:26.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f98fbfff640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98fc071d90 0x7f98fc156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:26.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f9900dbf640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98fc15ecc0 0x7f98fc0b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:26.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f98fb7fe640 1 -- 172.21.15.131:0/1730176482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98fc071d90 msgr2=0x7f98fc156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:26.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f98fb7fe640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98fc071d90 0x7f98fc156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f98fb7fe640 1 -- 172.21.15.131:0/1730176482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98fc15ecc0 msgr2=0x7f98fc0b7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:26.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f98fb7fe640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98fc15ecc0 0x7f98fc0b7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f98fb7fe640 1 -- 172.21.15.131:0/1730176482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc0b2380 con 0x7f98fc0cdd40 2024-05-17T04:09:26.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f98fbfff640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98fc071d90 0x7f98fc156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:26.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f9900dbf640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98fc15ecc0 0x7f98fc0b7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:26.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f98fb7fe640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98fc0cdd40 0x7f98fc1f5d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f98f0000c00 tx=0x7f98f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:26.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f98f8ff9640 1 -- 172.21.15.131:0/1730176482 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0041020 con 0x7f98fc0cdd40 2024-05-17T04:09:26.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f98f8ff9640 1 -- 172.21.15.131:0/1730176482 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f00306c0 con 0x7f98fc0cdd40 2024-05-17T04:09:26.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.348+0000 7f9902822640 1 -- 172.21.15.131:0/1730176482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98fc1f6960 con 0x7f98fc0cdd40 2024-05-17T04:09:26.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.349+0000 7f98f8ff9640 1 -- 172.21.15.131:0/1730176482 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0037040 con 0x7f98fc0cdd40 2024-05-17T04:09:26.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.349+0000 7f9902822640 1 -- 172.21.15.131:0/1730176482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98fc1f96f0 con 0x7f98fc0cdd40 2024-05-17T04:09:26.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.349+0000 7f9902822640 1 -- 172.21.15.131:0/1730176482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98fc1f6c40 con 0x7f98fc0cdd40 2024-05-17T04:09:26.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.350+0000 7f98f8ff9640 1 -- 172.21.15.131:0/1730176482 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f98f0044020 con 0x7f98fc0cdd40 2024-05-17T04:09:26.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.351+0000 7f98f8ff9640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f98e8076300 0x7f98e8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:26.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.351+0000 7f98f8ff9640 1 -- 172.21.15.131:0/1730176482 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f98f00b8100 con 0x7f98fc0cdd40 2024-05-17T04:09:26.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.351+0000 7f98fbfff640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f98e8076300 0x7f98e8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:26.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.351+0000 7f98fbfff640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f98e8076300 0x7f98e8078810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0cef40 tx=0x7f98ec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:26.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.355+0000 7f98f8ff9640 1 -- 172.21.15.131:0/1730176482 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f98fc1f6c40 con 0x7f98fc0cdd40 2024-05-17T04:09:26.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.573+0000 7f9902822640 1 -- 172.21.15.131:0/1730176482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98fc15db00 con 0x7f98fc0cdd40 2024-05-17T04:09:26.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.574+0000 7f98f8ff9640 1 -- 172.21.15.131:0/1730176482 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5189 (secure 0 0 0) 0x7f98f004b030 con 0x7f98fc0cdd40 2024-05-17T04:09:26.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:26.575 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2897828294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2897828294},{"type":"v1","addr":"172.21.15.131:6837","nonce":2897828294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/4068751282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4068751282},{"type":"v1","addr":"172.21.15.131:6836","nonce":4068751282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2776700884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2776700884},{"type":"v1","addr":"172.21.15.150:6834","nonce":2776700884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:05.755541+0000","modified":"2024-05-17T04:09:18.813988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2635477484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2635477484},{"type":"v1","addr":"172.21.15.150:6835","nonce":2635477484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-05-17T04:09:26.575 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-05-17T04:09:26.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.576+0000 7f9902822640 1 -- 172.21.15.131:0/1730176482 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f98e8076300 msgr2=0x7f98e8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:26.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.576+0000 7f9902822640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f98e8076300 0x7f98e8078810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0cef40 tx=0x7f98ec008040 comp rx=0 tx=0).stop 2024-05-17T04:09:26.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.576+0000 7f9902822640 1 -- 172.21.15.131:0/1730176482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98fc0cdd40 msgr2=0x7f98fc1f5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:26.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.576+0000 7f9902822640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98fc0cdd40 0x7f98fc1f5d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f98f0000c00 tx=0x7f98f00046c0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.576+0000 7f9902822640 1 -- 172.21.15.131:0/1730176482 shutdown_connections 2024-05-17T04:09:26.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.576+0000 7f9902822640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f98e8076300 0x7f98e8078810 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.576+0000 7f9902822640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98fc0cdd40 0x7f98fc1f5d10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.576+0000 7f9902822640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98fc15ecc0 0x7f98fc0b7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.576+0000 7f9902822640 1 --2- 172.21.15.131:0/1730176482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98fc071d90 0x7f98fc156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.576+0000 7f9902822640 1 -- 172.21.15.131:0/1730176482 >> 172.21.15.131:0/1730176482 conn(0x7f98fc0d2fd0 msgr2=0x7f98fc0b6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:26.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.576+0000 7f9902822640 1 -- 172.21.15.131:0/1730176482 shutdown_connections 2024-05-17T04:09:26.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.576+0000 7f9902822640 1 -- 172.21.15.131:0/1730176482 wait complete. 2024-05-17T04:09:26.589 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:09:26.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.699+0000 7fc9e5cac640 1 Processor -- start 2024-05-17T04:09:26.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.700+0000 7fc9e5cac640 1 -- start start 2024-05-17T04:09:26.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.701+0000 7fc9e5cac640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e00cd720 0x7fc9e00d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:26.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.701+0000 7fc9e5cac640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc9e006fa60 0x7fc9e015f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:26.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.701+0000 7fc9e5cac640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e00d1990 con 0x7fc9e00d1580 2024-05-17T04:09:26.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.701+0000 7fc9e5cac640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc9e0160930 con 0x7fc9e006fa60 2024-05-17T04:09:26.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.701+0000 7fc9e5cac640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e006e870 con 0x7fc9e00cd720 2024-05-17T04:09:26.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.701+0000 7fc9dffff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc9e006fa60 0x7fc9e015f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:26.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.701+0000 7fc9deffd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fc9e00d1580 0x7fc9e006f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:54772/0 (socket says 172.21.15.131:54772) 2024-05-17T04:09:26.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.701+0000 7fc9dffff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc9e006fa60 0x7fc9e015f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57210/0 (socket says 172.21.15.131:57210) 2024-05-17T04:09:26.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.701+0000 7fc9deffd640 1 -- 172.21.15.131:0/1968072935 learned_addr learned my addr 172.21.15.131:0/1968072935 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:26.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.701+0000 7fc9df7fe640 1 --2- 172.21.15.131:0/1968072935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e00cd720 0x7fc9e00d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:26.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.701+0000 7fc9dffff640 1 -- 172.21.15.131:0/1968072935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e00cd720 msgr2=0x7fc9e00d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:26.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.701+0000 7fc9dffff640 1 --2- 172.21.15.131:0/1968072935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e00cd720 0x7fc9e00d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.701+0000 7fc9dffff640 1 -- 172.21.15.131:0/1968072935 >> v1:172.21.15.131:6789/0 conn(0x7fc9e00d1580 legacy=0x7fc9e006f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:26.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.701+0000 7fc9dffff640 1 -- 172.21.15.131:0/1968072935 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e006eb50 con 0x7fc9e006fa60 2024-05-17T04:09:26.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.701+0000 7fc9df7fe640 1 --2- 172.21.15.131:0/1968072935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e00cd720 0x7fc9e00d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:26.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.702+0000 7fc9dffff640 1 --2- 172.21.15.131:0/1968072935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e006fa60 0x7fc9e015f730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009d90 tx=0x7fc9d802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218e8d4ea584a9e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:26.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.702+0000 7fc9de7fc640 1 -- 172.21.15.131:0/1968072935 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8007740 con 0x7fc9e006fa60 2024-05-17T04:09:26.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.702+0000 7fc9de7fc640 1 -- 172.21.15.131:0/1968072935 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d80078e0 con 0x7fc9e006fa60 2024-05-17T04:09:26.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.702+0000 7fc9de7fc640 1 -- 172.21.15.131:0/1968072935 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8007cb0 con 0x7fc9e006fa60 2024-05-17T04:09:26.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.703+0000 7fc9e5cac640 1 -- 172.21.15.131:0/1968072935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e006fa60 msgr2=0x7fc9e015f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:26.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.703+0000 7fc9e5cac640 1 --2- 172.21.15.131:0/1968072935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e006fa60 0x7fc9e015f730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009d90 tx=0x7fc9d802a660 comp rx=0 tx=0).stop 2024-05-17T04:09:26.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.703+0000 7fc9e5cac640 1 -- 172.21.15.131:0/1968072935 shutdown_connections 2024-05-17T04:09:26.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.703+0000 7fc9e5cac640 1 --2- 172.21.15.131:0/1968072935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e006fa60 0x7fc9e015f730 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.703+0000 7fc9e5cac640 1 --2- 172.21.15.131:0/1968072935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e00cd720 0x7fc9e00d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.703+0000 7fc9e5cac640 1 -- 172.21.15.131:0/1968072935 >> 172.21.15.131:0/1968072935 conn(0x7fc9e00b4e40 msgr2=0x7fc9e00b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:26.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.703+0000 7fc9e5cac640 1 -- 172.21.15.131:0/1968072935 shutdown_connections 2024-05-17T04:09:26.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.703+0000 7fc9e5cac640 1 -- 172.21.15.131:0/1968072935 wait complete. 2024-05-17T04:09:26.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.705+0000 7fc9e5cac640 1 Processor -- start 2024-05-17T04:09:26.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.705+0000 7fc9e5cac640 1 -- start start 2024-05-17T04:09:26.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.706+0000 7fc9e5cac640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e006fa60 0x7fc9e0154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:26.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.706+0000 7fc9e5cac640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9e00cd720 0x7fc9e0162130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:26.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.706+0000 7fc9e5cac640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e00d1580 0x7fc9e0162670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:26.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.706+0000 7fc9e5cac640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e006fff0 con 0x7fc9e006fa60 2024-05-17T04:09:26.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.706+0000 7fc9e5cac640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e006fe70 con 0x7fc9e00cd720 2024-05-17T04:09:26.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.706+0000 7fc9e5cac640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e015fc70 con 0x7fc9e00d1580 2024-05-17T04:09:26.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.706+0000 7fc9df7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e006fa60 0x7fc9e0154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:26.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.706+0000 7fc9df7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e006fa60 0x7fc9e0154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57226/0 (socket says 172.21.15.131:57226) 2024-05-17T04:09:26.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.706+0000 7fc9df7fe640 1 -- 172.21.15.131:0/1380378965 learned_addr learned my addr 172.21.15.131:0/1380378965 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:26.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.707+0000 7fc9dffff640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e00d1580 0x7fc9e0162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:26.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.707+0000 7fc9deffd640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9e00cd720 0x7fc9e0162130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:26.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.707+0000 7fc9df7fe640 1 -- 172.21.15.131:0/1380378965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e00d1580 msgr2=0x7fc9e0162670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:26.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.707+0000 7fc9df7fe640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e00d1580 0x7fc9e0162670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.707+0000 7fc9df7fe640 1 -- 172.21.15.131:0/1380378965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9e00cd720 msgr2=0x7fc9e0162130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:26.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.707+0000 7fc9df7fe640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9e00cd720 0x7fc9e0162130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.707+0000 7fc9df7fe640 1 -- 172.21.15.131:0/1380378965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e0154dc0 con 0x7fc9e006fa60 2024-05-17T04:09:26.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.707+0000 7fc9dffff640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e00d1580 0x7fc9e0162670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:26.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.707+0000 7fc9deffd640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9e00cd720 0x7fc9e0162130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:26.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.707+0000 7fc9df7fe640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e006fa60 0x7fc9e0154880 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000d800 tx=0x7fc9d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:26.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.707+0000 7fc9c7fff640 1 -- 172.21.15.131:0/1380378965 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0004030 con 0x7fc9e006fa60 2024-05-17T04:09:26.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.707+0000 7fc9c7fff640 1 -- 172.21.15.131:0/1380378965 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d00041d0 con 0x7fc9e006fa60 2024-05-17T04:09:26.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.707+0000 7fc9e5cac640 1 -- 172.21.15.131:0/1380378965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e0160e60 con 0x7fc9e006fa60 2024-05-17T04:09:26.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.707+0000 7fc9c7fff640 1 -- 172.21.15.131:0/1380378965 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d000b6c0 con 0x7fc9e006fa60 2024-05-17T04:09:26.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.707+0000 7fc9e5cac640 1 -- 172.21.15.131:0/1380378965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e0161420 con 0x7fc9e006fa60 2024-05-17T04:09:26.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.708+0000 7fc9e5cac640 1 -- 172.21.15.131:0/1380378965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e015f730 con 0x7fc9e006fa60 2024-05-17T04:09:26.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.709+0000 7fc9c7fff640 1 -- 172.21.15.131:0/1380378965 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc9d000b860 con 0x7fc9e006fa60 2024-05-17T04:09:26.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.710+0000 7fc9c7fff640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc9cc0762d0 0x7fc9cc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:26.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.710+0000 7fc9deffd640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc9cc0762d0 0x7fc9cc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:26.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.710+0000 7fc9c7fff640 1 -- 172.21.15.131:0/1380378965 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc9d0097b90 con 0x7fc9e006fa60 2024-05-17T04:09:26.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.710+0000 7fc9deffd640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc9cc0762d0 0x7fc9cc0787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0072390 tx=0x7fc9d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:26.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.714+0000 7fc9c7fff640 1 -- 172.21.15.131:0/1380378965 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc9e0154dc0 con 0x7fc9e006fa60 2024-05-17T04:09:26.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.895+0000 7fc9e5cac640 1 -- 172.21.15.131:0/1380378965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9e00c69a0 con 0x7fc9e006fa60 2024-05-17T04:09:26.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.896+0000 7fc9c7fff640 1 -- 172.21.15.131:0/1380378965 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fc9d00611b0 con 0x7fc9e006fa60 2024-05-17T04:09:26.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:26.897 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":24,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:09:10.777455+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:03.633460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:04.707669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-17T04:09:08.400498+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:09:26.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.898+0000 7fc9e5cac640 1 -- 172.21.15.131:0/1380378965 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc9cc0762d0 msgr2=0x7fc9cc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.898+0000 7fc9e5cac640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc9cc0762d0 0x7fc9cc0787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0072390 tx=0x7fc9d4009040 comp rx=0 tx=0).stop 2024-05-17T04:09:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.898+0000 7fc9e5cac640 1 -- 172.21.15.131:0/1380378965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e006fa60 msgr2=0x7fc9e0154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.898+0000 7fc9e5cac640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e006fa60 0x7fc9e0154880 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000d800 tx=0x7fc9d000dcc0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.898+0000 7fc9e5cac640 1 -- 172.21.15.131:0/1380378965 shutdown_connections 2024-05-17T04:09:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.898+0000 7fc9e5cac640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc9cc0762d0 0x7fc9cc0787e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.898+0000 7fc9e5cac640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e00d1580 0x7fc9e0162670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.898+0000 7fc9e5cac640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9e00cd720 0x7fc9e0162130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.898+0000 7fc9e5cac640 1 --2- 172.21.15.131:0/1380378965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e006fa60 0x7fc9e0154880 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.898+0000 7fc9e5cac640 1 -- 172.21.15.131:0/1380378965 >> 172.21.15.131:0/1380378965 conn(0x7fc9e00b4e40 msgr2=0x7fc9e0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:26.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.898+0000 7fc9e5cac640 1 -- 172.21.15.131:0/1380378965 shutdown_connections 2024-05-17T04:09:26.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:26.898+0000 7fc9e5cac640 1 -- 172.21.15.131:0/1380378965 wait complete. 2024-05-17T04:09:26.911 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T04:09:27.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.021+0000 7f9b22f7a640 1 Processor -- start 2024-05-17T04:09:27.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.021+0000 7f9b22f7a640 1 -- start start 2024-05-17T04:09:27.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.022+0000 7f9b22f7a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b1c0ce2c0 0x7f9b1c0cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.022+0000 7f9b22f7a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9b1c06c6f0 0x7f9b1c06cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.022+0000 7f9b22f7a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b1c0b5550 con 0x7f9b1c0cfb90 2024-05-17T04:09:27.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.022+0000 7f9b22f7a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9b1c0b5e10 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.022+0000 7f9b22f7a640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f9b1c0b62a0 con 0x7f9b1c0ce2c0 2024-05-17T04:09:27.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.022+0000 7f9b21517640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9b1c06c6f0 0x7f9b1c06cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.023+0000 7f9b21517640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9b1c06c6f0 0x7f9b1c06cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57238/0 (socket says 172.21.15.131:57238) 2024-05-17T04:09:27.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.023+0000 7f9b21517640 1 -- 172.21.15.131:0/1796662845 learned_addr learned my addr 172.21.15.131:0/1796662845 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:27.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.023+0000 7f9b20d16640 1 --2- 172.21.15.131:0/1796662845 >> v2:172.21.15.150:3300/0 conn(0x7f9b1c0ce2c0 0x7f9b1c0cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.023+0000 7f9b21517640 1 -- 172.21.15.131:0/1796662845 >> v2:172.21.15.150:3300/0 conn(0x7f9b1c0ce2c0 msgr2=0x7f9b1c0cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:27.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.023+0000 7f9b21517640 1 --2- 172.21.15.131:0/1796662845 >> v2:172.21.15.150:3300/0 conn(0x7f9b1c0ce2c0 0x7f9b1c0cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.023+0000 7f9b21517640 1 -- 172.21.15.131:0/1796662845 >> v1:172.21.15.150:6789/0 conn(0x7f9b1c0cfb90 legacy=0x7f9b1c0cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:27.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.023+0000 7f9b21517640 1 -- 172.21.15.131:0/1796662845 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1c0b57c0 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.023+0000 7f9b21517640 1 --2- 172.21.15.131:0/1796662845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c06c6f0 0x7f9b1c06cb00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c074890 tx=0x7f9b1402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d906672f02ce368 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:27.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.024+0000 7f9b137fe640 1 -- 172.21.15.131:0/1796662845 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14037070 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.024+0000 7f9b137fe640 1 -- 172.21.15.131:0/1796662845 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b14032440 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.024+0000 7f9b137fe640 1 -- 172.21.15.131:0/1796662845 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14032810 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.024+0000 7f9b22f7a640 1 -- 172.21.15.131:0/1796662845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c06c6f0 msgr2=0x7f9b1c06cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.024+0000 7f9b22f7a640 1 --2- 172.21.15.131:0/1796662845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c06c6f0 0x7f9b1c06cb00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c074890 tx=0x7f9b1402a1e0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.024+0000 7f9b22f7a640 1 -- 172.21.15.131:0/1796662845 shutdown_connections 2024-05-17T04:09:27.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.024+0000 7f9b22f7a640 1 --2- 172.21.15.131:0/1796662845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c06c6f0 0x7f9b1c06cb00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.024+0000 7f9b22f7a640 1 --2- 172.21.15.131:0/1796662845 >> v2:172.21.15.150:3300/0 conn(0x7f9b1c0ce2c0 0x7f9b1c0cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.024+0000 7f9b22f7a640 1 -- 172.21.15.131:0/1796662845 >> 172.21.15.131:0/1796662845 conn(0x7f9b1c0b36d0 msgr2=0x7f9b1c0d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:27.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.024+0000 7f9b22f7a640 1 -- 172.21.15.131:0/1796662845 shutdown_connections 2024-05-17T04:09:27.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.024+0000 7f9b22f7a640 1 -- 172.21.15.131:0/1796662845 wait complete. 2024-05-17T04:09:27.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.026+0000 7f9b22f7a640 1 Processor -- start 2024-05-17T04:09:27.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.026+0000 7f9b22f7a640 1 -- start start 2024-05-17T04:09:27.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b22f7a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c06c6f0 0x7f9b1c130ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b22f7a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b1c0ce2c0 0x7f9b1c15cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b22f7a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0cfb90 0x7f9b1c0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b22f7a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c0b40f0 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b22f7a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c0b44d0 con 0x7f9b1c0ce2c0 2024-05-17T04:09:27.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b22f7a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9b1c0b4270 con 0x7f9b1c0cfb90 2024-05-17T04:09:27.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b20d16640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c06c6f0 0x7f9b1c130ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b20d16640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c06c6f0 0x7f9b1c130ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57252/0 (socket says 172.21.15.131:57252) 2024-05-17T04:09:27.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b20d16640 1 -- 172.21.15.131:0/1203474539 learned_addr learned my addr 172.21.15.131:0/1203474539 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:27.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b21517640 1 --2- 172.21.15.131:0/1203474539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0cfb90 0x7f9b1c0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b13fff640 1 --2- 172.21.15.131:0/1203474539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b1c0ce2c0 0x7f9b1c15cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b20d16640 1 -- 172.21.15.131:0/1203474539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0cfb90 msgr2=0x7f9b1c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b20d16640 1 --2- 172.21.15.131:0/1203474539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0cfb90 0x7f9b1c0c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b20d16640 1 -- 172.21.15.131:0/1203474539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b1c0ce2c0 msgr2=0x7f9b1c15cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b20d16640 1 --2- 172.21.15.131:0/1203474539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b1c0ce2c0 0x7f9b1c15cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b20d16640 1 -- 172.21.15.131:0/1203474539 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1c0c8680 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b21517640 1 --2- 172.21.15.131:0/1203474539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0cfb90 0x7f9b1c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:27.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b20d16640 1 --2- 172.21.15.131:0/1203474539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c06c6f0 0x7f9b1c130ef0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9b18007e70 tx=0x7f9b1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:27.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b117fa640 1 -- 172.21.15.131:0/1203474539 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18014420 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b117fa640 1 -- 172.21.15.131:0/1203474539 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b18019070 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b22f7a640 1 -- 172.21.15.131:0/1203474539 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1c0c8960 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b117fa640 1 -- 172.21.15.131:0/1203474539 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b180147e0 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.028+0000 7f9b22f7a640 1 -- 172.21.15.131:0/1203474539 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b1c0c8f20 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.030+0000 7f9b22f7a640 1 -- 172.21.15.131:0/1203474539 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b1c0d0910 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.030+0000 7f9b117fa640 1 -- 172.21.15.131:0/1203474539 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9b18014980 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.031+0000 7f9b117fa640 1 --2- 172.21.15.131:0/1203474539 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9b08076300 0x7f9b08078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.031+0000 7f9b13fff640 1 --2- 172.21.15.131:0/1203474539 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9b08076300 0x7f9b08078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.031+0000 7f9b117fa640 1 -- 172.21.15.131:0/1203474539 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9b180981a0 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.031+0000 7f9b13fff640 1 --2- 172.21.15.131:0/1203474539 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9b08076300 0x7f9b08078810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c006fd0 tx=0x7f9b0c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:27.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.035+0000 7f9b117fa640 1 -- 172.21.15.131:0/1203474539 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9b18061730 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.251+0000 7f9b22f7a640 1 -- 172.21.15.131:0/1203474539 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b1c06df00 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.252+0000 7f9b117fa640 1 -- 172.21.15.131:0/1203474539 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5189 (secure 0 0 0) 0x7f9b18061030 con 0x7f9b1c06c6f0 2024-05-17T04:09:27.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:27.253 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2897828294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2897828294},{"type":"v1","addr":"172.21.15.131:6837","nonce":2897828294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/4068751282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4068751282},{"type":"v1","addr":"172.21.15.131:6836","nonce":4068751282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2776700884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2776700884},{"type":"v1","addr":"172.21.15.150:6834","nonce":2776700884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:05.755541+0000","modified":"2024-05-17T04:09:18.813988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2635477484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2635477484},{"type":"v1","addr":"172.21.15.150:6835","nonce":2635477484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-05-17T04:09:27.253 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-05-17T04:09:27.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.254+0000 7f9b22f7a640 1 -- 172.21.15.131:0/1203474539 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9b08076300 msgr2=0x7f9b08078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.254+0000 7f9b22f7a640 1 --2- 172.21.15.131:0/1203474539 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9b08076300 0x7f9b08078810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c006fd0 tx=0x7f9b0c008040 comp rx=0 tx=0).stop 2024-05-17T04:09:27.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.254+0000 7f9b22f7a640 1 -- 172.21.15.131:0/1203474539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c06c6f0 msgr2=0x7f9b1c130ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.254+0000 7f9b22f7a640 1 --2- 172.21.15.131:0/1203474539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c06c6f0 0x7f9b1c130ef0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9b18007e70 tx=0x7f9b1800e4b0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.254+0000 7f9b22f7a640 1 -- 172.21.15.131:0/1203474539 shutdown_connections 2024-05-17T04:09:27.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.254+0000 7f9b22f7a640 1 --2- 172.21.15.131:0/1203474539 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9b08076300 0x7f9b08078810 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.254+0000 7f9b22f7a640 1 --2- 172.21.15.131:0/1203474539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b1c0cfb90 0x7f9b1c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.254+0000 7f9b22f7a640 1 --2- 172.21.15.131:0/1203474539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b1c0ce2c0 0x7f9b1c15cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.254+0000 7f9b22f7a640 1 --2- 172.21.15.131:0/1203474539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c06c6f0 0x7f9b1c130ef0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.254+0000 7f9b22f7a640 1 -- 172.21.15.131:0/1203474539 >> 172.21.15.131:0/1203474539 conn(0x7f9b1c0b36d0 msgr2=0x7f9b1c15fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:27.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.254+0000 7f9b22f7a640 1 -- 172.21.15.131:0/1203474539 shutdown_connections 2024-05-17T04:09:27.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.254+0000 7f9b22f7a640 1 -- 172.21.15.131:0/1203474539 wait complete. 2024-05-17T04:09:27.669 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-17T04:09:05.755541+0000', 'modified': '2024-05-17T04:09:18.813988+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4309': {'gid': 4309, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/2635477484', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6833', 'nonce': 2635477484}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 2635477484}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4309, 'qdb_cluster': [4309]} 2024-05-17T04:09:27.670 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-17T04:09:27.670 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-17T04:09:27.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.782+0000 7fb7322fd640 1 Processor -- start 2024-05-17T04:09:27.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.782+0000 7fb7322fd640 1 -- start start 2024-05-17T04:09:27.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.784+0000 7fb7322fd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb72c071390 0x7fb72c0717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.784+0000 7fb7322fd640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72c071ce0 con 0x7fb72c0b74c0 2024-05-17T04:09:27.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.784+0000 7fb7322fd640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72c0d0de0 con 0x7fb72c163630 2024-05-17T04:09:27.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.784+0000 7fb7322fd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c0d0b90 con 0x7fb72c071390 2024-05-17T04:09:27.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.784+0000 7fb723fff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb72c0b74c0 0x7fb72c0b78d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:54788/0 (socket says 172.21.15.131:54788) 2024-05-17T04:09:27.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.784+0000 7fb723fff640 1 -- 172.21.15.131:0/1939038366 learned_addr learned my addr 172.21.15.131:0/1939038366 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:27.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.784+0000 7fb72bfff640 1 --2- 172.21.15.131:0/1939038366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb72c071390 0x7fb72c0717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.784+0000 7fb72b7fe640 1 -- 172.21.15.131:0/1939038366 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112820438 0 0) 0x7fb714001110 con 0x7fb72c0b74c0 2024-05-17T04:09:27.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.784+0000 7fb72b7fe640 1 -- 172.21.15.131:0/1939038366 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb718003520 con 0x7fb72c0b74c0 2024-05-17T04:09:27.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.784+0000 7fb72b7fe640 1 -- 172.21.15.131:0/1939038366 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1709480105 0 0) 0x7fb72c0d0de0 con 0x7fb72c163630 2024-05-17T04:09:27.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.784+0000 7fb72b7fe640 1 -- 172.21.15.131:0/1939038366 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb714001110 con 0x7fb72c163630 2024-05-17T04:09:27.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.784+0000 7fb72bfff640 1 -- 172.21.15.131:0/1939038366 >> v1:172.21.15.150:6789/0 conn(0x7fb72c163630 legacy=0x7fb72c163a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.784+0000 7fb72bfff640 1 -- 172.21.15.131:0/1939038366 >> v1:172.21.15.131:6789/0 conn(0x7fb72c0b74c0 legacy=0x7fb72c0b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.784+0000 7fb72b7fe640 1 -- 172.21.15.131:0/1939038366 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3213620808 0 0) 0x7fb718003520 con 0x7fb72c0b74c0 2024-05-17T04:09:27.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.784+0000 7fb72bfff640 1 -- 172.21.15.131:0/1939038366 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c0d10c0 con 0x7fb72c071390 2024-05-17T04:09:27.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.785+0000 7fb72bfff640 1 --2- 172.21.15.131:0/1939038366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb72c071390 0x7fb72c0717a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0097d0 tx=0x7fb71c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea9977e1d8b9101b server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:27.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.785+0000 7fb72b7fe640 1 -- 172.21.15.131:0/1939038366 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c037070 con 0x7fb72c071390 2024-05-17T04:09:27.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.785+0000 7fb72b7fe640 1 -- 172.21.15.131:0/1939038366 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb71c02ab90 con 0x7fb72c071390 2024-05-17T04:09:27.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.785+0000 7fb72b7fe640 1 -- 172.21.15.131:0/1939038366 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7140018c0 con 0x7fb72c071390 2024-05-17T04:09:27.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.786+0000 7fb7322fd640 1 -- 172.21.15.131:0/1939038366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb72c071390 msgr2=0x7fb72c0717a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.786+0000 7fb7322fd640 1 --2- 172.21.15.131:0/1939038366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb72c071390 0x7fb72c0717a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0097d0 tx=0x7fb71c02a100 comp rx=0 tx=0).stop 2024-05-17T04:09:27.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.786+0000 7fb7322fd640 1 -- 172.21.15.131:0/1939038366 shutdown_connections 2024-05-17T04:09:27.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.786+0000 7fb7322fd640 1 --2- 172.21.15.131:0/1939038366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb72c071390 0x7fb72c0717a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.786+0000 7fb7322fd640 1 -- 172.21.15.131:0/1939038366 >> 172.21.15.131:0/1939038366 conn(0x7fb72c0735b0 msgr2=0x7fb72c0739c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:27.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.786+0000 7fb7322fd640 1 -- 172.21.15.131:0/1939038366 shutdown_connections 2024-05-17T04:09:27.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.786+0000 7fb7322fd640 1 -- 172.21.15.131:0/1939038366 wait complete. 2024-05-17T04:09:27.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.788+0000 7fb7322fd640 1 Processor -- start 2024-05-17T04:09:27.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.788+0000 7fb7322fd640 1 -- start start 2024-05-17T04:09:27.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.789+0000 7fb7322fd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb72c071390 0x7fb72c144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.789+0000 7fb7322fd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb72c0b74c0 0x7fb72c143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.789+0000 7fb7322fd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb72c163630 0x7fb72c144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.789+0000 7fb7322fd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c0d1680 con 0x7fb72c071390 2024-05-17T04:09:27.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.789+0000 7fb7322fd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c0d1ba0 con 0x7fb72c163630 2024-05-17T04:09:27.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.789+0000 7fb7322fd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c142820 con 0x7fb72c0b74c0 2024-05-17T04:09:27.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.789+0000 7fb72bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb72c071390 0x7fb72c144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.789+0000 7fb72bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb72c071390 0x7fb72c144d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57268/0 (socket says 172.21.15.131:57268) 2024-05-17T04:09:27.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.789+0000 7fb72bfff640 1 -- 172.21.15.131:0/1672353153 learned_addr learned my addr 172.21.15.131:0/1672353153 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:27.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.790+0000 7fb723fff640 1 --2- 172.21.15.131:0/1672353153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb72c0b74c0 0x7fb72c143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.790+0000 7fb72bfff640 1 -- 172.21.15.131:0/1672353153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb72c0b74c0 msgr2=0x7fb72c143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.790+0000 7fb72bfff640 1 --2- 172.21.15.131:0/1672353153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb72c0b74c0 0x7fb72c143f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.790+0000 7fb73089a640 1 --2- 172.21.15.131:0/1672353153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb72c163630 0x7fb72c144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.790+0000 7fb72bfff640 1 -- 172.21.15.131:0/1672353153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb72c163630 msgr2=0x7fb72c144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.790+0000 7fb72bfff640 1 --2- 172.21.15.131:0/1672353153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb72c163630 0x7fb72c144480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.790+0000 7fb72bfff640 1 -- 172.21.15.131:0/1672353153 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c15a2d0 con 0x7fb72c071390 2024-05-17T04:09:27.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.790+0000 7fb72bfff640 1 --2- 172.21.15.131:0/1672353153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb72c071390 0x7fb72c144d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0097d0 tx=0x7fb71c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:27.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.790+0000 7fb7297fa640 1 -- 172.21.15.131:0/1672353153 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c042020 con 0x7fb72c071390 2024-05-17T04:09:27.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.790+0000 7fb7297fa640 1 -- 172.21.15.131:0/1672353153 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb71c03d670 con 0x7fb72c071390 2024-05-17T04:09:27.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.790+0000 7fb7322fd640 1 -- 172.21.15.131:0/1672353153 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72c15a5b0 con 0x7fb72c071390 2024-05-17T04:09:27.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.790+0000 7fb7297fa640 1 -- 172.21.15.131:0/1672353153 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c037040 con 0x7fb72c071390 2024-05-17T04:09:27.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.790+0000 7fb7322fd640 1 -- 172.21.15.131:0/1672353153 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72c15ab70 con 0x7fb72c071390 2024-05-17T04:09:27.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.792+0000 7fb7297fa640 1 -- 172.21.15.131:0/1672353153 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb71c045020 con 0x7fb72c071390 2024-05-17T04:09:27.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.793+0000 7fb7297fa640 1 --2- 172.21.15.131:0/1672353153 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb70c0762d0 0x7fb70c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.793+0000 7fb7297fa640 1 -- 172.21.15.131:0/1672353153 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb71c0b82b0 con 0x7fb72c071390 2024-05-17T04:09:27.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.793+0000 7fb723fff640 1 --2- 172.21.15.131:0/1672353153 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb70c0762d0 0x7fb70c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.793+0000 7fb723fff640 1 --2- 172.21.15.131:0/1672353153 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb70c0762d0 0x7fb70c0787e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb72c140bd0 tx=0x7fb714009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:27.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.794+0000 7fb7391b9740 1 Processor -- start 2024-05-17T04:09:27.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.794+0000 7fb7391b9740 1 -- start start 2024-05-17T04:09:27.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb7391b9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d62c270 0x55ea8da13fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb7391b9740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d6033b0 0x55ea8da15e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb7391b9740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8d9cb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb7391b9740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ea8d941c80 con 0x55ea8d60b590 2024-05-17T04:09:27.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb7391b9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55ea8d931820 con 0x55ea8d62c270 2024-05-17T04:09:27.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb7391b9740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55ea8d935860 con 0x55ea8d6033b0 2024-05-17T04:09:27.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb73089a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8d9cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb73089a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8d9cb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57280/0 (socket says 172.21.15.131:57280) 2024-05-17T04:09:27.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb73089a640 1 -- 172.21.15.131:0/3320892291 learned_addr learned my addr 172.21.15.131:0/3320892291 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:27.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb72bfff640 1 --2- 172.21.15.131:0/3320892291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d62c270 0x55ea8da13fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb723fff640 1 --2- 172.21.15.131:0/3320892291 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d6033b0 0x55ea8da15e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb73089a640 1 -- 172.21.15.131:0/3320892291 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d6033b0 msgr2=0x55ea8da15e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:27.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb73089a640 1 --2- 172.21.15.131:0/3320892291 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d6033b0 0x55ea8da15e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb73089a640 1 -- 172.21.15.131:0/3320892291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d62c270 msgr2=0x55ea8da13fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:27.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb73089a640 1 --2- 172.21.15.131:0/3320892291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d62c270 0x55ea8da13fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb73089a640 1 -- 172.21.15.131:0/3320892291 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea8d8fbb40 con 0x55ea8d60b590 2024-05-17T04:09:27.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.795+0000 7fb73089a640 1 --2- 172.21.15.131:0/3320892291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8d9cb280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb724001cf0 tx=0x7fb7240020f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e671466e97490f server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:27.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.796+0000 7fb721ffb640 1 -- 172.21.15.131:0/3320892291 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb724016030 con 0x55ea8d60b590 2024-05-17T04:09:27.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.796+0000 7fb721ffb640 1 -- 172.21.15.131:0/3320892291 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb724006b50 con 0x55ea8d60b590 2024-05-17T04:09:27.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.796+0000 7fb721ffb640 1 -- 172.21.15.131:0/3320892291 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72400da60 con 0x55ea8d60b590 2024-05-17T04:09:27.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.796+0000 7fb7391b9740 1 -- 172.21.15.131:0/3320892291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 msgr2=0x55ea8d9cb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.796+0000 7fb7391b9740 1 --2- 172.21.15.131:0/3320892291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8d9cb280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb724001cf0 tx=0x7fb7240020f0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.796+0000 7fb7391b9740 1 -- 172.21.15.131:0/3320892291 shutdown_connections 2024-05-17T04:09:27.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.796+0000 7fb7391b9740 1 --2- 172.21.15.131:0/3320892291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8d9cb280 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.796+0000 7fb7391b9740 1 --2- 172.21.15.131:0/3320892291 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d6033b0 0x55ea8da15e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.796+0000 7fb7391b9740 1 --2- 172.21.15.131:0/3320892291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d62c270 0x55ea8da13fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.796+0000 7fb7391b9740 1 -- 172.21.15.131:0/3320892291 >> 172.21.15.131:0/3320892291 conn(0x55ea8d6203c0 msgr2=0x55ea8da15710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:27.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.796+0000 7fb7391b9740 1 -- 172.21.15.131:0/3320892291 shutdown_connections 2024-05-17T04:09:27.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.796+0000 7fb7391b9740 1 -- 172.21.15.131:0/3320892291 wait complete. 2024-05-17T04:09:27.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.797+0000 7fb7391b9740 1 -- start start 2024-05-17T04:09:27.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.798+0000 7fb7391b9740 1 Processor -- start 2024-05-17T04:09:27.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb7391b9740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d6033b0 0x55ea8da12630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb7391b9740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8da24680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb7391b9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d62c270 0x55ea8da0eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb7391b9740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ea8d6a6620 con 0x55ea8d60b590 2024-05-17T04:09:27.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb7391b9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55ea8d8ee4c0 con 0x55ea8d62c270 2024-05-17T04:09:27.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb7391b9740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55ea8da25170 con 0x55ea8d6033b0 2024-05-17T04:09:27.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb7391b9740 10 client.0 _ll_register_callbacks cb 0x55ea8d92b900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-17T04:09:27.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb723fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8da24680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb723fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8da24680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57292/0 (socket says 172.21.15.131:57292) 2024-05-17T04:09:27.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb723fff640 1 -- 172.21.15.131:0/1189502102 learned_addr learned my addr 172.21.15.131:0/1189502102 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:27.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb72bfff640 1 --2- 172.21.15.131:0/1189502102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d6033b0 0x55ea8da12630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb73089a640 1 --2- 172.21.15.131:0/1189502102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d62c270 0x55ea8da0eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb723fff640 1 -- 172.21.15.131:0/1189502102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d6033b0 msgr2=0x55ea8da12630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:27.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb723fff640 1 --2- 172.21.15.131:0/1189502102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d6033b0 0x55ea8da12630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb723fff640 1 -- 172.21.15.131:0/1189502102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d62c270 msgr2=0x55ea8da0eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:27.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb723fff640 1 --2- 172.21.15.131:0/1189502102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d62c270 0x55ea8da0eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb723fff640 1 -- 172.21.15.131:0/1189502102 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea8d8f9b80 con 0x55ea8d60b590 2024-05-17T04:09:27.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb723fff640 1 --2- 172.21.15.131:0/1189502102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8da24680 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb714007650 tx=0x7fb714001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3883716d990a8f6b server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.799+0000 7fb70affd640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-05-17T04:09:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.800+0000 7fb70affd640 1 -- 172.21.15.131:0/1189502102 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb714027060 con 0x55ea8d60b590 2024-05-17T04:09:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.800+0000 7fb70affd640 1 -- 172.21.15.131:0/1189502102 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb714012620 con 0x55ea8d60b590 2024-05-17T04:09:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.800+0000 7fb7391b9740 1 -- 172.21.15.131:0/1189502102 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb724006b50 con 0x55ea8d60b590 2024-05-17T04:09:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.800+0000 7fb70affd640 1 -- 172.21.15.131:0/1189502102 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fb714012820 con 0x55ea8d60b590 2024-05-17T04:09:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.800+0000 7fb7391b9740 10 client.4686 fetch_fsmap learned FSMap version 8 2024-05-17T04:09:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.800+0000 7fb7391b9740 1 -- 172.21.15.131:0/1189502102 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55ea8d697850 con 0x55ea8d60b590 2024-05-17T04:09:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.800+0000 7fb70affd640 1 -- 172.21.15.131:0/1189502102 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb724006b50 con 0x55ea8d60b590 2024-05-17T04:09:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.800+0000 7fb70affd640 1 -- 172.21.15.131:0/1189502102 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fb7140129c0 con 0x55ea8d60b590 2024-05-17T04:09:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.800+0000 7fb7391b9740 10 client.4686 fetch_fsmap finished waiting for FSMap version 8 2024-05-17T04:09:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.800+0000 7fb7391b9740 10 client.4686 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-17T04:09:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.800+0000 7fb7391b9740 20 client.4686 populate_metadata read hostname 'smithi131' 2024-05-17T04:09:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.800+0000 7fb7391b9740 1 --2- 172.21.15.131:0/1189502102 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55ea8d5eae40 0x55ea8da101e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.800+0000 7fb7391b9740 4 client.4686 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-17T04:09:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.800+0000 7fb7391b9740 1 -- 172.21.15.131:0/1189502102 --> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea8d8d3780 con 0x55ea8d5eae40 2024-05-17T04:09:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.800+0000 7fb72bfff640 1 --2- 172.21.15.131:0/1189502102 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55ea8d5eae40 0x55ea8da101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.801+0000 7fb70affd640 10 client.4686 ms_handle_connect on v2:172.21.15.150:6833/2635477484 2024-05-17T04:09:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.801+0000 7fb72bfff640 1 --2- 172.21.15.131:0/1189502102 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55ea8d5eae40 0x55ea8da101e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a0be6ec9e9e7111 server_cookie=2a185eb3a381e8dd in_seq=0 out_seq=0 2024-05-17T04:09:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.801+0000 7fb70affd640 1 -- 172.21.15.131:0/1189502102 <== mds.0 v2:172.21.15.150:6833/2635477484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ea8d8d3780 con 0x55ea8d5eae40 2024-05-17T04:09:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.801+0000 7fb70affd640 10 client.4686 handle_command_reply: tid=0 2024-05-17T04:09:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.802+0000 7fb7391b9740 1 client.4686 shutdown 2024-05-17T04:09:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.802+0000 7fb7391b9740 1 -- 172.21.15.131:0/1189502102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 msgr2=0x55ea8da24680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.802+0000 7fb7391b9740 1 --2- 172.21.15.131:0/1189502102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8da24680 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb714007650 tx=0x7fb714001020 comp rx=0 tx=0).stop 2024-05-17T04:09:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.802+0000 7fb7391b9740 1 -- 172.21.15.131:0/1189502102 shutdown_connections 2024-05-17T04:09:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.802+0000 7fb7391b9740 1 --2- 172.21.15.131:0/1189502102 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55ea8d5eae40 0x55ea8da101e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.802+0000 7fb7391b9740 1 --2- 172.21.15.131:0/1189502102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8da24680 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.802+0000 7fb7391b9740 1 --2- 172.21.15.131:0/1189502102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d62c270 0x55ea8da0eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.802+0000 7fb7391b9740 1 --2- 172.21.15.131:0/1189502102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d6033b0 0x55ea8da12630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.802+0000 7fb70affd640 0 client.4686 ms_handle_reset on v2:172.21.15.150:6833/2635477484 2024-05-17T04:09:27.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.802+0000 7fb7391b9740 1 -- 172.21.15.131:0/1189502102 >> 172.21.15.131:0/1189502102 conn(0x55ea8d6203c0 msgr2=0x55ea8da189c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:27.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.802+0000 7fb7391b9740 1 -- 172.21.15.131:0/1189502102 shutdown_connections 2024-05-17T04:09:27.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.802+0000 7fb7391b9740 1 -- 172.21.15.131:0/1189502102 wait complete. 2024-05-17T04:09:27.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.802+0000 7fb7391b9740 20 client.4686 trim_cache size 0 max 16384 2024-05-17T04:09:27.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.821+0000 7fb7391b9740 1 Processor -- start 2024-05-17T04:09:27.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.821+0000 7fb7391b9740 1 -- start start 2024-05-17T04:09:27.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.822+0000 7fb7391b9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d6033b0 0x55ea8d9cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.822+0000 7fb7391b9740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8da0c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.822+0000 7fb7391b9740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d62c270 0x55ea8da0cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.822+0000 7fb7391b9740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c202740 con 0x55ea8d60b590 2024-05-17T04:09:27.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.822+0000 7fb7391b9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c201ad0 con 0x55ea8d6033b0 2024-05-17T04:09:27.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.822+0000 7fb7391b9740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c2020f0 con 0x55ea8d62c270 2024-05-17T04:09:27.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.822+0000 7fb723fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8da0c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.822+0000 7fb723fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8da0c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57296/0 (socket says 172.21.15.131:57296) 2024-05-17T04:09:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.822+0000 7fb723fff640 1 -- 172.21.15.131:0/3268832251 learned_addr learned my addr 172.21.15.131:0/3268832251 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.823+0000 7fb72bfff640 1 --2- 172.21.15.131:0/3268832251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d6033b0 0x55ea8d9cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.823+0000 7fb73089a640 1 --2- 172.21.15.131:0/3268832251 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d62c270 0x55ea8da0cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.823+0000 7fb723fff640 1 -- 172.21.15.131:0/3268832251 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d62c270 msgr2=0x55ea8da0cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.823+0000 7fb723fff640 1 --2- 172.21.15.131:0/3268832251 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d62c270 0x55ea8da0cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.823+0000 7fb723fff640 1 -- 172.21.15.131:0/3268832251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d6033b0 msgr2=0x55ea8d9cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.823+0000 7fb723fff640 1 --2- 172.21.15.131:0/3268832251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d6033b0 0x55ea8d9cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.823+0000 7fb723fff640 1 -- 172.21.15.131:0/3268832251 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea8d70e6b0 con 0x55ea8d60b590 2024-05-17T04:09:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.823+0000 7fb72bfff640 1 --2- 172.21.15.131:0/3268832251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d6033b0 0x55ea8d9cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.823+0000 7fb723fff640 1 --2- 172.21.15.131:0/3268832251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8da0c9f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb714005880 tx=0x7fb71401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9d5de4808cd872 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.823+0000 7fb7217fa640 1 -- 172.21.15.131:0/3268832251 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb714012620 con 0x55ea8d60b590 2024-05-17T04:09:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.823+0000 7fb7217fa640 1 -- 172.21.15.131:0/3268832251 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb714018070 con 0x55ea8d60b590 2024-05-17T04:09:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.823+0000 7fb7217fa640 1 -- 172.21.15.131:0/3268832251 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7140129c0 con 0x55ea8d60b590 2024-05-17T04:09:27.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.824+0000 7fb7391b9740 1 -- 172.21.15.131:0/3268832251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 msgr2=0x55ea8da0c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.824+0000 7fb7391b9740 1 --2- 172.21.15.131:0/3268832251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8da0c9f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb714005880 tx=0x7fb71401c000 comp rx=0 tx=0).stop 2024-05-17T04:09:27.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.824+0000 7fb7391b9740 1 -- 172.21.15.131:0/3268832251 shutdown_connections 2024-05-17T04:09:27.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.824+0000 7fb7391b9740 1 --2- 172.21.15.131:0/3268832251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8da0c9f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.824+0000 7fb7391b9740 1 --2- 172.21.15.131:0/3268832251 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d62c270 0x55ea8da0cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.824+0000 7fb7391b9740 1 --2- 172.21.15.131:0/3268832251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d6033b0 0x55ea8d9cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.824+0000 7fb7391b9740 1 -- 172.21.15.131:0/3268832251 >> 172.21.15.131:0/3268832251 conn(0x55ea8d6203c0 msgr2=0x55ea8d9c6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:27.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.824+0000 7fb7391b9740 1 -- 172.21.15.131:0/3268832251 shutdown_connections 2024-05-17T04:09:27.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.824+0000 7fb7391b9740 1 -- 172.21.15.131:0/3268832251 wait complete. 2024-05-17T04:09:27.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.825+0000 7fb7391b9740 1 -- start start 2024-05-17T04:09:27.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.825+0000 7fb7391b9740 1 Processor -- start 2024-05-17T04:09:27.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.826+0000 7fb7391b9740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d6033b0 0x55ea8d9c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.826+0000 7fb7391b9740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8d9ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.826+0000 7fb7391b9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d62c270 0x55ea8da945d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.826+0000 7fb7391b9740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ea8da0f470 con 0x55ea8d60b590 2024-05-17T04:09:27.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.826+0000 7fb7391b9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55ea8da24fd0 con 0x55ea8d62c270 2024-05-17T04:09:27.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.826+0000 7fb7391b9740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55ea8da0d780 con 0x55ea8d6033b0 2024-05-17T04:09:27.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.826+0000 7fb7391b9740 10 client.0 _ll_register_callbacks cb 0x7fb7140059b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-17T04:09:27.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.826+0000 7fb723fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8d9ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.826+0000 7fb723fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8d9ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57302/0 (socket says 172.21.15.131:57302) 2024-05-17T04:09:27.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.826+0000 7fb723fff640 1 -- 172.21.15.131:0/2043448289 learned_addr learned my addr 172.21.15.131:0/2043448289 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:27.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.826+0000 7fb723fff640 1 -- 172.21.15.131:0/2043448289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d6033b0 msgr2=0x55ea8d9c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:27.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.826+0000 7fb723fff640 1 --2- 172.21.15.131:0/2043448289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d6033b0 0x55ea8d9c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb723fff640 1 -- 172.21.15.131:0/2043448289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d62c270 msgr2=0x55ea8da945d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:27.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb723fff640 1 --2- 172.21.15.131:0/2043448289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d62c270 0x55ea8da945d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb723fff640 1 -- 172.21.15.131:0/2043448289 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea8da0e150 con 0x55ea8d60b590 2024-05-17T04:09:27.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb723fff640 1 --2- 172.21.15.131:0/2043448289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8d9ca2c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb71402e040 tx=0x7fb714012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca5d693c4be323b server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:27.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb70affd640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-05-17T04:09:27.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb70affd640 1 -- 172.21.15.131:0/2043448289 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb714042060 con 0x55ea8d60b590 2024-05-17T04:09:27.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb70affd640 1 -- 172.21.15.131:0/2043448289 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb7140047e0 con 0x55ea8d60b590 2024-05-17T04:09:27.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb7391b9740 1 -- 172.21.15.131:0/2043448289 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb714018070 con 0x55ea8d60b590 2024-05-17T04:09:27.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb70affd640 1 -- 172.21.15.131:0/2043448289 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fb714048050 con 0x55ea8d60b590 2024-05-17T04:09:27.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb7391b9740 10 client.4692 fetch_fsmap learned FSMap version 8 2024-05-17T04:09:27.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb7391b9740 1 -- 172.21.15.131:0/2043448289 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55ea8d9f93e0 con 0x55ea8d60b590 2024-05-17T04:09:27.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb70affd640 1 -- 172.21.15.131:0/2043448289 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb714018070 con 0x55ea8d60b590 2024-05-17T04:09:27.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb70affd640 1 -- 172.21.15.131:0/2043448289 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fb71404b020 con 0x55ea8d60b590 2024-05-17T04:09:27.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb7391b9740 10 client.4692 fetch_fsmap finished waiting for FSMap version 8 2024-05-17T04:09:27.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb7391b9740 10 client.4692 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-17T04:09:27.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb7391b9740 20 client.4692 populate_metadata read hostname 'smithi131' 2024-05-17T04:09:27.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb7391b9740 1 --2- 172.21.15.131:0/2043448289 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55ea8da94ec0 0x55ea8da23de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:27.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb7391b9740 4 client.4692 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-17T04:09:27.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.827+0000 7fb7391b9740 1 -- 172.21.15.131:0/2043448289 --> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] -- command(tid 0: {"prefix": "status"}) -- 0x55ea8d9fb130 con 0x55ea8da94ec0 2024-05-17T04:09:27.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb72bfff640 1 --2- 172.21.15.131:0/2043448289 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55ea8da94ec0 0x55ea8da23de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:27.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb70affd640 10 client.4692 ms_handle_connect on v2:172.21.15.150:6833/2635477484 2024-05-17T04:09:27.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb72bfff640 1 --2- 172.21.15.131:0/2043448289 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55ea8da94ec0 0x55ea8da23de0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d91d2168aaa9ac3 server_cookie=911fbbb3303b3b25 in_seq=0 out_seq=0 2024-05-17T04:09:27.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb70affd640 1 -- 172.21.15.131:0/2043448289 <== mds.0 v2:172.21.15.150:6833/2635477484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55ea8d9fb130 con 0x55ea8da94ec0 2024-05-17T04:09:27.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb70affd640 10 client.4692 handle_command_reply: tid=0 2024-05-17T04:09:27.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb7391b9740 1 client.4692 shutdown 2024-05-17T04:09:27.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb7391b9740 1 -- 172.21.15.131:0/2043448289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 msgr2=0x55ea8d9ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb7391b9740 1 --2- 172.21.15.131:0/2043448289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8d9ca2c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb71402e040 tx=0x7fb714012000 comp rx=0 tx=0).stop 2024-05-17T04:09:27.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb7391b9740 1 -- 172.21.15.131:0/2043448289 shutdown_connections 2024-05-17T04:09:27.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb7391b9740 1 --2- 172.21.15.131:0/2043448289 >> [v2:172.21.15.150:6833/2635477484,v1:172.21.15.150:6835/2635477484] conn(0x55ea8da94ec0 0x55ea8da23de0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb7391b9740 1 --2- 172.21.15.131:0/2043448289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea8d60b590 0x55ea8d9ca2c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb70affd640 0 client.4692 ms_handle_reset on v2:172.21.15.150:6833/2635477484 2024-05-17T04:09:27.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb7391b9740 1 --2- 172.21.15.131:0/2043448289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ea8d62c270 0x55ea8da945d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb7391b9740 1 --2- 172.21.15.131:0/2043448289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ea8d6033b0 0x55ea8d9c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb7391b9740 1 -- 172.21.15.131:0/2043448289 >> 172.21.15.131:0/2043448289 conn(0x55ea8d6203c0 msgr2=0x55ea8d9cb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:27.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb7391b9740 1 -- 172.21.15.131:0/2043448289 shutdown_connections 2024-05-17T04:09:27.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.828+0000 7fb7391b9740 1 -- 172.21.15.131:0/2043448289 wait complete. 2024-05-17T04:09:27.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.829+0000 7fb7391b9740 20 client.4692 trim_cache size 0 max 16384 2024-05-17T04:09:27.836 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T04:09:27.836 INFO:teuthology.orchestra.run.smithi131.stdout: "cluster_fsid": "c9e29f2b-51db-4d2a-bace-3a87edcda397", 2024-05-17T04:09:27.836 INFO:teuthology.orchestra.run.smithi131.stdout: "whoami": 0, 2024-05-17T04:09:27.836 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4309, 2024-05-17T04:09:27.836 INFO:teuthology.orchestra.run.smithi131.stdout: "want_state": "up:active", 2024-05-17T04:09:27.836 INFO:teuthology.orchestra.run.smithi131.stdout: "state": "up:active", 2024-05-17T04:09:27.837 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs", 2024-05-17T04:09:27.837 INFO:teuthology.orchestra.run.smithi131.stdout: "rank_uptime": 21.451384105999999, 2024-05-17T04:09:27.837 INFO:teuthology.orchestra.run.smithi131.stdout: "mdsmap_epoch": 8, 2024-05-17T04:09:27.837 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch": 24, 2024-05-17T04:09:27.837 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch_barrier": 24, 2024-05-17T04:09:27.837 INFO:teuthology.orchestra.run.smithi131.stdout: "uptime": 27.467951370000002 2024-05-17T04:09:27.837 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T04:09:27.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.829+0000 7fb7322fd640 1 -- 172.21.15.131:0/1672353153 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb70c0762d0 msgr2=0x7fb70c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.829+0000 7fb7322fd640 1 --2- 172.21.15.131:0/1672353153 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb70c0762d0 0x7fb70c0787e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb72c140bd0 tx=0x7fb714009040 comp rx=0 tx=0).stop 2024-05-17T04:09:27.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.829+0000 7fb7322fd640 1 -- 172.21.15.131:0/1672353153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb72c071390 msgr2=0x7fb72c144d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:27.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.829+0000 7fb7322fd640 1 --2- 172.21.15.131:0/1672353153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb72c071390 0x7fb72c144d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0097d0 tx=0x7fb71c0046c0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.829+0000 7fb7322fd640 1 -- 172.21.15.131:0/1672353153 shutdown_connections 2024-05-17T04:09:27.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.829+0000 7fb7322fd640 1 --2- 172.21.15.131:0/1672353153 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb70c0762d0 0x7fb70c0787e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.829+0000 7fb7322fd640 1 --2- 172.21.15.131:0/1672353153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb72c163630 0x7fb72c144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.829+0000 7fb7322fd640 1 --2- 172.21.15.131:0/1672353153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb72c0b74c0 0x7fb72c143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.829+0000 7fb7322fd640 1 --2- 172.21.15.131:0/1672353153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb72c071390 0x7fb72c144d10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:27.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.829+0000 7fb7322fd640 1 -- 172.21.15.131:0/1672353153 >> 172.21.15.131:0/1672353153 conn(0x7fb72c0735b0 msgr2=0x7fb72c163a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:27.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.829+0000 7fb7322fd640 1 -- 172.21.15.131:0/1672353153 shutdown_connections 2024-05-17T04:09:27.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:27.829+0000 7fb7322fd640 1 -- 172.21.15.131:0/1672353153 wait complete. 2024-05-17T04:09:27.841 INFO:teuthology.run_tasks:Running task sequential... 2024-05-17T04:09:27.853 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-17T04:09:27.853 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-17T04:09:27.853 INFO:teuthology.task.print:Enabling mgr modules 2024-05-17T04:09:27.854 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-17T04:09:27.884 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-17T04:09:27.885 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-17T04:09:27.885 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-17T04:09:27.885 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-17T04:09:27.885 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-17T04:09:27.885 INFO:tasks.ceph_fuse:client.2 config is {} 2024-05-17T04:09:27.885 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-17T04:09:27.885 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-17T04:09:27.885 INFO:tasks.ceph_fuse:client.1 config is {} 2024-05-17T04:09:27.886 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-17T04:09:27.886 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-17T04:09:27.886 INFO:tasks.ceph_fuse:client.3 config is {} 2024-05-17T04:09:27.886 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-17T04:09:27.886 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-17T04:09:27.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:27.886 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-05-17T04:09:27.902 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-17T04:09:27.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:27.903 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-17T04:09:27.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:27.969 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2024-05-17T04:09:28.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:28.064 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-05-17T04:09:28.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:28.083 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-05-17T04:09:28.155 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2024-05-17T04:09:28.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T04:09:28.157 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-17T04:09:28.157 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-17T04:09:28.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.268+0000 7fa1e3b3c640 1 Processor -- start 2024-05-17T04:09:28.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.269+0000 7fa1e3b3c640 1 -- start start 2024-05-17T04:09:28.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.270+0000 7fa1e3b3c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa1dc0d02f0 0x7fa1dc15d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:28.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.270+0000 7fa1e3b3c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1dc0b4970 0x7fa1dc0b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:28.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.270+0000 7fa1e3b3c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa1dc0b4d80 0x7fa1dc0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:28.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.270+0000 7fa1e3b3c640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa1dc0b3f00 con 0x7fa1dc0b4d80 2024-05-17T04:09:28.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.270+0000 7fa1e3b3c640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa1dc15d870 con 0x7fa1dc0d02f0 2024-05-17T04:09:28.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.270+0000 7fa1e3b3c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa1dc0d0820 con 0x7fa1dc0b4970 2024-05-17T04:09:28.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.270+0000 7fa1e20d9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa1dc0b4d80 0x7fa1dc0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:28.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.270+0000 7fa1e20d9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa1dc0b4d80 0x7fa1dc0b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57306/0 (socket says 172.21.15.131:57306) 2024-05-17T04:09:28.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.270+0000 7fa1e20d9640 1 -- 172.21.15.131:0/121796270 learned_addr learned my addr 172.21.15.131:0/121796270 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:28.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.270+0000 7fa1e10d7640 1 --2- 172.21.15.131:0/121796270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1dc0b4970 0x7fa1dc0b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:28.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.270+0000 7fa1e18d8640 1 --2- 172.21.15.131:0/121796270 >> v2:172.21.15.150:3300/0 conn(0x7fa1dc0d02f0 0x7fa1dc15d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:28.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.271+0000 7fa1e20d9640 1 -- 172.21.15.131:0/121796270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1dc0b4970 msgr2=0x7fa1dc0b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:28.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.271+0000 7fa1e20d9640 1 --2- 172.21.15.131:0/121796270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1dc0b4970 0x7fa1dc0b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:28.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.271+0000 7fa1e20d9640 1 -- 172.21.15.131:0/121796270 >> v2:172.21.15.150:3300/0 conn(0x7fa1dc0d02f0 msgr2=0x7fa1dc15d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:28.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.271+0000 7fa1e20d9640 1 --2- 172.21.15.131:0/121796270 >> v2:172.21.15.150:3300/0 conn(0x7fa1dc0d02f0 0x7fa1dc15d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:28.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.271+0000 7fa1e20d9640 1 -- 172.21.15.131:0/121796270 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1dc0b4170 con 0x7fa1dc0b4d80 2024-05-17T04:09:28.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.271+0000 7fa1e20d9640 1 --2- 172.21.15.131:0/121796270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1dc0b4d80 0x7fa1dc0b5c30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc072070 tx=0x7fa1d402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee49ca06a3b97ff0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:28.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.271+0000 7fa1e08d6640 1 -- 172.21.15.131:0/121796270 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4037070 con 0x7fa1dc0b4d80 2024-05-17T04:09:28.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.271+0000 7fa1e08d6640 1 -- 172.21.15.131:0/121796270 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d4032440 con 0x7fa1dc0b4d80 2024-05-17T04:09:28.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.271+0000 7fa1e08d6640 1 -- 172.21.15.131:0/121796270 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4032810 con 0x7fa1dc0b4d80 2024-05-17T04:09:28.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.272+0000 7fa1e3b3c640 1 -- 172.21.15.131:0/121796270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1dc0b4d80 msgr2=0x7fa1dc0b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:28.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.272+0000 7fa1e3b3c640 1 --2- 172.21.15.131:0/121796270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1dc0b4d80 0x7fa1dc0b5c30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc072070 tx=0x7fa1d402a140 comp rx=0 tx=0).stop 2024-05-17T04:09:28.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.272+0000 7fa1e3b3c640 1 -- 172.21.15.131:0/121796270 shutdown_connections 2024-05-17T04:09:28.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.272+0000 7fa1e3b3c640 1 --2- 172.21.15.131:0/121796270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1dc0b4d80 0x7fa1dc0b5c30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:28.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.272+0000 7fa1e3b3c640 1 --2- 172.21.15.131:0/121796270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1dc0b4970 0x7fa1dc0b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:28.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.272+0000 7fa1e3b3c640 1 --2- 172.21.15.131:0/121796270 >> v2:172.21.15.150:3300/0 conn(0x7fa1dc0d02f0 0x7fa1dc15d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:28.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.272+0000 7fa1e3b3c640 1 -- 172.21.15.131:0/121796270 >> 172.21.15.131:0/121796270 conn(0x7fa1dc0b36d0 msgr2=0x7fa1dc0d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:28.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.272+0000 7fa1e3b3c640 1 -- 172.21.15.131:0/121796270 shutdown_connections 2024-05-17T04:09:28.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.272+0000 7fa1e3b3c640 1 -- 172.21.15.131:0/121796270 wait complete. 2024-05-17T04:09:28.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.274+0000 7fa1e3b3c640 1 Processor -- start 2024-05-17T04:09:28.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.274+0000 7fa1e3b3c640 1 -- start start 2024-05-17T04:09:28.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.275+0000 7fa1e3b3c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1dc0b4970 0x7fa1dc14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:28.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.275+0000 7fa1e3b3c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1dc0d02f0 0x7fa1dc1566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:28.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.275+0000 7fa1e3b3c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1dc06c6f0 0x7fa1dc06cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:28.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.275+0000 7fa1e3b3c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc0cd7c0 con 0x7fa1dc0b4970 2024-05-17T04:09:28.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.275+0000 7fa1e3b3c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc0d0b00 con 0x7fa1dc0d02f0 2024-05-17T04:09:28.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.275+0000 7fa1e3b3c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa1dc0cd940 con 0x7fa1dc06c6f0 2024-05-17T04:09:28.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1e18d8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1dc0b4970 0x7fa1dc14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:28.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1e18d8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1dc0b4970 0x7fa1dc14ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57322/0 (socket says 172.21.15.131:57322) 2024-05-17T04:09:28.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1e18d8640 1 -- 172.21.15.131:0/792491439 learned_addr learned my addr 172.21.15.131:0/792491439 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:28.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1e20d9640 1 --2- 172.21.15.131:0/792491439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1dc06c6f0 0x7fa1dc06cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:28.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1e10d7640 1 --2- 172.21.15.131:0/792491439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1dc0d02f0 0x7fa1dc1566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:28.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1e18d8640 1 -- 172.21.15.131:0/792491439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1dc06c6f0 msgr2=0x7fa1dc06cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:28.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1e18d8640 1 --2- 172.21.15.131:0/792491439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1dc06c6f0 0x7fa1dc06cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:28.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1e18d8640 1 -- 172.21.15.131:0/792491439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1dc0d02f0 msgr2=0x7fa1dc1566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:28.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1e18d8640 1 --2- 172.21.15.131:0/792491439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1dc0d02f0 0x7fa1dc1566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:28.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1e18d8640 1 -- 172.21.15.131:0/792491439 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1dc14bfb0 con 0x7fa1dc0b4970 2024-05-17T04:09:28.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1e18d8640 1 --2- 172.21.15.131:0/792491439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1dc0b4970 0x7fa1dc14ba70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00efc0 tx=0x7fa1cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:28.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1da7fc640 1 -- 172.21.15.131:0/792491439 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc018020 con 0x7fa1dc0b4970 2024-05-17T04:09:28.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1da7fc640 1 -- 172.21.15.131:0/792491439 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1cc014480 con 0x7fa1dc0b4970 2024-05-17T04:09:28.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1e3b3c640 1 -- 172.21.15.131:0/792491439 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1dc06d040 con 0x7fa1dc0b4970 2024-05-17T04:09:28.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1da7fc640 1 -- 172.21.15.131:0/792491439 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc014850 con 0x7fa1dc0b4970 2024-05-17T04:09:28.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.276+0000 7fa1e3b3c640 1 -- 172.21.15.131:0/792491439 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1dc157410 con 0x7fa1dc0b4970 2024-05-17T04:09:28.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.277+0000 7fa1e3b3c640 1 -- 172.21.15.131:0/792491439 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1dc0b4d80 con 0x7fa1dc0b4970 2024-05-17T04:09:28.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.278+0000 7fa1da7fc640 1 -- 172.21.15.131:0/792491439 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa1cc005d10 con 0x7fa1dc0b4970 2024-05-17T04:09:28.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.278+0000 7fa1da7fc640 1 --2- 172.21.15.131:0/792491439 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa1c80762d0 0x7fa1c80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:28.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.278+0000 7fa1da7fc640 1 -- 172.21.15.131:0/792491439 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa1cc098730 con 0x7fa1dc0b4970 2024-05-17T04:09:28.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.278+0000 7fa1e10d7640 1 --2- 172.21.15.131:0/792491439 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa1c80762d0 0x7fa1c80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:28.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.279+0000 7fa1e10d7640 1 --2- 172.21.15.131:0/792491439 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa1c80762d0 0x7fa1c80787e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc14c2c0 tx=0x7fa1d0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:28.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.283+0000 7fa1da7fc640 1 -- 172.21.15.131:0/792491439 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa1cc022030 con 0x7fa1dc0b4970 2024-05-17T04:09:28.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.507+0000 7fa1e3b3c640 1 -- 172.21.15.131:0/792491439 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa1dc06dab0 con 0x7fa1dc0b4970 2024-05-17T04:09:28.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.507+0000 7fa1da7fc640 1 -- 172.21.15.131:0/792491439 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fa1dc06d040 con 0x7fa1dc0b4970 2024-05-17T04:09:28.509 INFO:teuthology.orchestra.run.smithi131.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-17T04:09:28.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.509+0000 7fa1e3b3c640 1 -- 172.21.15.131:0/792491439 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa1c80762d0 msgr2=0x7fa1c80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:28.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.509+0000 7fa1e3b3c640 1 --2- 172.21.15.131:0/792491439 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa1c80762d0 0x7fa1c80787e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc14c2c0 tx=0x7fa1d0008040 comp rx=0 tx=0).stop 2024-05-17T04:09:28.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.509+0000 7fa1e3b3c640 1 -- 172.21.15.131:0/792491439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1dc0b4970 msgr2=0x7fa1dc14ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:28.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.509+0000 7fa1e3b3c640 1 --2- 172.21.15.131:0/792491439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1dc0b4970 0x7fa1dc14ba70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00efc0 tx=0x7fa1cc00c490 comp rx=0 tx=0).stop 2024-05-17T04:09:28.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.509+0000 7fa1e3b3c640 1 -- 172.21.15.131:0/792491439 shutdown_connections 2024-05-17T04:09:28.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.509+0000 7fa1e3b3c640 1 --2- 172.21.15.131:0/792491439 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa1c80762d0 0x7fa1c80787e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:28.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.509+0000 7fa1e3b3c640 1 --2- 172.21.15.131:0/792491439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1dc06c6f0 0x7fa1dc06cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:28.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.509+0000 7fa1e3b3c640 1 --2- 172.21.15.131:0/792491439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1dc0d02f0 0x7fa1dc1566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:28.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.509+0000 7fa1e3b3c640 1 --2- 172.21.15.131:0/792491439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1dc0b4970 0x7fa1dc14ba70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:28.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.509+0000 7fa1e3b3c640 1 -- 172.21.15.131:0/792491439 >> 172.21.15.131:0/792491439 conn(0x7fa1dc0b36d0 msgr2=0x7fa1dc0ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:28.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.510+0000 7fa1e3b3c640 1 -- 172.21.15.131:0/792491439 shutdown_connections 2024-05-17T04:09:28.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28.510+0000 7fa1e3b3c640 1 -- 172.21.15.131:0/792491439 wait complete. 2024-05-17T04:09:28.522 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-17T04:09:28.522 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-17T04:09:28.522 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-05-17T04:09:28.522 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-17T04:09:28.522 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-17T04:09:28.522 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-17T04:09:28.523 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-17T04:09:28.523 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-17T04:09:28.523 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-17T04:09:28.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:28.523 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-05-17T04:09:28.538 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-17T04:09:28.539 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-17T04:09:28.539 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-05-17T04:09:28.539 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:28.539 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-05-17T04:09:28.539 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:28.539 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:09:28.539 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:28.539 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-05-17T04:09:28.539 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:09:28.539 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:28.539 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-05-17T04:09:28.539 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:09:28.540 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:28.540 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-17T04:09:28.540 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:28.540 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-17T04:09:28.540 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42665sec preferred_lft 42665sec 2024-05-17T04:09:28.540 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2024-05-17T04:09:28.540 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:28.540 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-17T04:09:28.540 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:28.540 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-05-17T04:09:28.541 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add name ceph-brx type bridge 2024-05-17T04:09:28.541 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr flush dev ceph-brx 2024-05-17T04:09:28.541 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set ceph-brx up 2024-05-17T04:09:28.541 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-17T04:09:28.541 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-05-17T04:09:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:28.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:28.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:28.677 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-17T04:09:28.701 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-05-17T04:09:28.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:28.702 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-05-17T04:09:28.759 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-05-17T04:09:28.759 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-17T04:09:28.760 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-17T04:09:28.760 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-17T04:09:28.760 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-17T04:09:28.760 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:28.760 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-05-17T04:09:28.760 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-17T04:09:28.760 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-17T04:09:28.760 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-17T04:09:28.760 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-05-17T04:09:28.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:28.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:28.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:28.889 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-05-17T04:09:28.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:28.910 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2024-05-17T04:09:28.975 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:28.975 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-05-17T04:09:28.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T04:09:28.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-17T04:09:28.975 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-05-17T04:09:29.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:29.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:29.098 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-17T04:09:29.098 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:29.098 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-05-17T04:09:29.098 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-17T04:09:29.098 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-17T04:09:29.098 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-17T04:09:29.098 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-17T04:09:29.098 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-17T04:09:29.098 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-05-17T04:09:29.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:29.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:29.217 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:29.217 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-05-17T04:09:29.217 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2024-05-17T04:09:29.217 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.0 master ceph-brx 2024-05-17T04:09:29.218 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-05-17T04:09:29.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:29.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:29.297 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-17T04:09:29.297 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-17T04:09:29.298 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-17T04:09:29.327 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-17T04:09:29.327 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-17T04:09:29.328 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-17T04:09:29.388 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-05-17T04:09:29.467 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-05-17T04:09:29.528 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-05-17T04:09:29.529 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-05-17T04:09:29.529 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-05-17T04:09:29.529 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-05-17T04:09:29.529 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-05-17T04:09:29.529 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-05-17T04:09:29.529 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-05-17T04:09:29.529 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-05-17T04:09:29.529 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-05-17T04:09:29.529 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-05-17T04:09:29.530 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-05-17T04:09:29.530 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/selinux 2024-05-17T04:09:29.530 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-05-17T04:09:29.530 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-05-17T04:09:29.530 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-05-17T04:09:29.530 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-05-17T04:09:29.530 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-05-17T04:09:29.530 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-05-17T04:09:29.530 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-05-17T04:09:29.530 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysctl.service 2024-05-17T04:09:29.531 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-17T04:09:29.531 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-17T04:09:29.531 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/nfs/rpc_pipefs 2024-05-17T04:09:29.531 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-05-17T04:09:29.531 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-05-17T04:09:29.531 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-0 2024-05-17T04:09:29.531 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-1 2024-05-17T04:09:29.531 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-2 2024-05-17T04:09:29.531 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-3 2024-05-17T04:09:29.531 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-05-17T04:09:29.532 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T04:09:29.532 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T04:09:29.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:29.532 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-05-17T04:09:29.594 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-17T04:09:29.594 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-17T04:09:29.639 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-05-17T04:09:29.664 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-05-17T04:09:29.727 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-05-17T04:09:29.727 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-05-17T04:09:29.727 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-05-17T04:09:29.727 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-05-17T04:09:29.727 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-05-17T04:09:29.727 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-05-17T04:09:29.727 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-05-17T04:09:29.727 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-05-17T04:09:29.727 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-05-17T04:09:29.727 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-05-17T04:09:29.728 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-05-17T04:09:29.728 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/selinux 2024-05-17T04:09:29.728 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-05-17T04:09:29.728 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-05-17T04:09:29.728 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-05-17T04:09:29.728 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-05-17T04:09:29.728 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-05-17T04:09:29.728 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-05-17T04:09:29.728 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-05-17T04:09:29.728 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysctl.service 2024-05-17T04:09:29.729 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-17T04:09:29.729 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-17T04:09:29.729 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/nfs/rpc_pipefs 2024-05-17T04:09:29.729 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-05-17T04:09:29.729 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-05-17T04:09:29.729 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-0 2024-05-17T04:09:29.729 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-1 2024-05-17T04:09:29.729 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-2 2024-05-17T04:09:29.729 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-3 2024-05-17T04:09:29.730 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-05-17T04:09:29.730 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T04:09:29.730 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T04:09:29.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:29.730 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-05-17T04:09:29.732 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi131.stderr:2024-05-17T04:09:29.731+0000 7f9753998480 -1 init, newargv = 0x7f9744001250 newargc=15 2024-05-17T04:09:29.732 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi131.stderr:ceph-fuse[46518]: starting ceph client 2024-05-17T04:09:29.736 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi131.stderr:ceph-fuse[46518]: starting fuse 2024-05-17T04:09:29.749 INFO:teuthology.orchestra.run.smithi131.stdout:41 2024-05-17T04:09:29.750 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-05-17T04:09:29.750 DEBUG:teuthology.orchestra.run.smithi131:> sudo stdin-killer -- python3 -c ' 2024-05-17T04:09:29.750 DEBUG:teuthology.orchestra.run.smithi131:> import glob 2024-05-17T04:09:29.750 DEBUG:teuthology.orchestra.run.smithi131:> import re 2024-05-17T04:09:29.750 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-05-17T04:09:29.750 DEBUG:teuthology.orchestra.run.smithi131:> import subprocess 2024-05-17T04:09:29.750 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:09:29.750 DEBUG:teuthology.orchestra.run.smithi131:> def _find_admin_socket(client_name): 2024-05-17T04:09:29.750 DEBUG:teuthology.orchestra.run.smithi131:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> files = glob.glob(asok_path) 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> # Given a non-glob path, it better be there 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> if "*" not in asok_path: 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> assert(len(files) == 1) 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> return files[0] 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> for f in files: 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> contents = proc_f.read() 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> if mountpoint in contents: 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> return f 2024-05-17T04:09:29.751 DEBUG:teuthology.orchestra.run.smithi131:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-17T04:09:29.752 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:09:29.752 DEBUG:teuthology.orchestra.run.smithi131:> print(_find_admin_socket("client.0")) 2024-05-17T04:09:29.752 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-05-17T04:09:29.870 INFO:teuthology.orchestra.run.smithi131.stdout:/var/run/ceph/ceph-client.0.46518.asok 2024-05-17T04:09:29.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:29.880 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46518.asok 2024-05-17T04:09:29.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:29.881 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46518.asok status 2024-05-17T04:09:30.028 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T04:09:30.028 INFO:teuthology.orchestra.run.smithi131.stdout: "metadata": { 2024-05-17T04:09:30.028 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_sha1": "931809a9e5d295bd61984693cac44fe131ded4bc", 2024-05-17T04:09:30.028 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_version": "ceph version 19.0.0-3794-g931809a9 (931809a9e5d295bd61984693cac44fe131ded4bc) squid (dev)", 2024-05-17T04:09:30.028 INFO:teuthology.orchestra.run.smithi131.stdout: "entity_id": "0", 2024-05-17T04:09:30.029 INFO:teuthology.orchestra.run.smithi131.stdout: "hostname": "smithi131", 2024-05-17T04:09:30.029 INFO:teuthology.orchestra.run.smithi131.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-17T04:09:30.029 INFO:teuthology.orchestra.run.smithi131.stdout: "pid": "46518", 2024-05-17T04:09:30.029 INFO:teuthology.orchestra.run.smithi131.stdout: "root": "/" 2024-05-17T04:09:30.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:30.029 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_count": 0, 2024-05-17T04:09:30.029 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_pinned_count": 0, 2024-05-17T04:09:30.029 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4704, 2024-05-17T04:09:30.030 INFO:teuthology.orchestra.run.smithi131.stdout: "inst": { 2024-05-17T04:09:30.030 INFO:teuthology.orchestra.run.smithi131.stdout: "name": { 2024-05-17T04:09:30.030 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "client", 2024-05-17T04:09:30.030 INFO:teuthology.orchestra.run.smithi131.stdout: "num": 4704 2024-05-17T04:09:30.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:30.030 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-05-17T04:09:30.030 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-05-17T04:09:30.030 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.1:0", 2024-05-17T04:09:30.030 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 3112561382 2024-05-17T04:09:30.031 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:30.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:30.031 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-05-17T04:09:30.031 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-05-17T04:09:30.031 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.1:0", 2024-05-17T04:09:30.031 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 3112561382 2024-05-17T04:09:30.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:30.031 INFO:teuthology.orchestra.run.smithi131.stdout: "inst_str": "client.4704 192.168.0.1:0/3112561382", 2024-05-17T04:09:30.031 INFO:teuthology.orchestra.run.smithi131.stdout: "addr_str": "192.168.0.1:0/3112561382", 2024-05-17T04:09:30.032 INFO:teuthology.orchestra.run.smithi131.stdout: "inode_count": 1, 2024-05-17T04:09:30.032 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_epoch": 8, 2024-05-17T04:09:30.032 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch": 24, 2024-05-17T04:09:30.032 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch_barrier": 0, 2024-05-17T04:09:30.032 INFO:teuthology.orchestra.run.smithi131.stdout: "blocklisted": false, 2024-05-17T04:09:30.032 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs" 2024-05-17T04:09:30.032 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T04:09:30.038 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-17T04:09:30.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.147+0000 7fd6a7cdf640 1 Processor -- start 2024-05-17T04:09:30.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.147+0000 7fd6a7cdf640 1 -- start start 2024-05-17T04:09:30.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.148+0000 7fd6a7cdf640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a00b79e0 0x7fd6a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:30.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.148+0000 7fd6a7cdf640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a0071980 con 0x7fd6a0146310 2024-05-17T04:09:30.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.148+0000 7fd6a7cdf640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a0071c60 con 0x7fd6a0161840 2024-05-17T04:09:30.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.148+0000 7fd6a7cdf640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a0071740 con 0x7fd6a00b79e0 2024-05-17T04:09:30.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.148+0000 7fd6a527a640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd6a0146310 0x7fd6a00b72d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:54790/0 (socket says 172.21.15.131:54790) 2024-05-17T04:09:30.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.148+0000 7fd6a527a640 1 -- 172.21.15.131:0/4222148897 learned_addr learned my addr 172.21.15.131:0/4222148897 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:30.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.149+0000 7fd6a627c640 1 --2- 172.21.15.131:0/4222148897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a00b79e0 0x7fd6a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:30.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.149+0000 7fd6a4a79640 1 -- 172.21.15.131:0/4222148897 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842616091 0 0) 0x7fd6a0071980 con 0x7fd6a0146310 2024-05-17T04:09:30.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.149+0000 7fd6a4a79640 1 -- 172.21.15.131:0/4222148897 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd68c003520 con 0x7fd6a0146310 2024-05-17T04:09:30.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.149+0000 7fd6a4a79640 1 -- 172.21.15.131:0/4222148897 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1246062808 0 0) 0x7fd6a0071c60 con 0x7fd6a0161840 2024-05-17T04:09:30.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.149+0000 7fd6a4a79640 1 -- 172.21.15.131:0/4222148897 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6a0071980 con 0x7fd6a0161840 2024-05-17T04:09:30.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.149+0000 7fd6a4a79640 1 -- 172.21.15.131:0/4222148897 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 294225132 0 0) 0x7fd68c003520 con 0x7fd6a0146310 2024-05-17T04:09:30.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.149+0000 7fd6a627c640 1 -- 172.21.15.131:0/4222148897 >> v1:172.21.15.150:6789/0 conn(0x7fd6a0161840 legacy=0x7fd6a0071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:30.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.149+0000 7fd6a627c640 1 -- 172.21.15.131:0/4222148897 >> v1:172.21.15.131:6789/0 conn(0x7fd6a0146310 legacy=0x7fd6a00b72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:30.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.149+0000 7fd6a627c640 1 -- 172.21.15.131:0/4222148897 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a0071f40 con 0x7fd6a00b79e0 2024-05-17T04:09:30.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.150+0000 7fd6a627c640 1 --2- 172.21.15.131:0/4222148897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a00b79e0 0x7fd6a006d190 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6980097d0 tx=0x7fd69802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=969201c03d1c6923 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:30.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.150+0000 7fd6a4a79640 1 -- 172.21.15.131:0/4222148897 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698037070 con 0x7fd6a00b79e0 2024-05-17T04:09:30.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.150+0000 7fd6a4a79640 1 -- 172.21.15.131:0/4222148897 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69802ac30 con 0x7fd6a00b79e0 2024-05-17T04:09:30.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.150+0000 7fd6a4a79640 1 -- 172.21.15.131:0/4222148897 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690001710 con 0x7fd6a00b79e0 2024-05-17T04:09:30.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.151+0000 7fd6a7cdf640 1 -- 172.21.15.131:0/4222148897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a00b79e0 msgr2=0x7fd6a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:30.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.151+0000 7fd6a7cdf640 1 --2- 172.21.15.131:0/4222148897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a00b79e0 0x7fd6a006d190 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6980097d0 tx=0x7fd69802a1a0 comp rx=0 tx=0).stop 2024-05-17T04:09:30.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.151+0000 7fd6a7cdf640 1 -- 172.21.15.131:0/4222148897 shutdown_connections 2024-05-17T04:09:30.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.151+0000 7fd6a7cdf640 1 --2- 172.21.15.131:0/4222148897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a00b79e0 0x7fd6a006d190 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:30.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.151+0000 7fd6a7cdf640 1 -- 172.21.15.131:0/4222148897 >> 172.21.15.131:0/4222148897 conn(0x7fd6a00735b0 msgr2=0x7fd6a00739c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:30.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.151+0000 7fd6a7cdf640 1 -- 172.21.15.131:0/4222148897 shutdown_connections 2024-05-17T04:09:30.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.151+0000 7fd6a7cdf640 1 -- 172.21.15.131:0/4222148897 wait complete. 2024-05-17T04:09:30.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.152+0000 7fd6a7cdf640 1 Processor -- start 2024-05-17T04:09:30.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.152+0000 7fd6a7cdf640 1 -- start start 2024-05-17T04:09:30.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a7cdf640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a0146310 0x7fd6a00cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:30.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a7cdf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a0161840 0x7fd6a015cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:30.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a7cdf640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6a00aa440 0x7fd6a00aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:30.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a7cdf640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a0161c50 con 0x7fd6a0161840 2024-05-17T04:09:30.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a7cdf640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a0161320 con 0x7fd6a00aa440 2024-05-17T04:09:30.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a7cdf640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a0161dd0 con 0x7fd6a0146310 2024-05-17T04:09:30.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a527a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a0161840 0x7fd6a015cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:30.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a527a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a0161840 0x7fd6a015cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57336/0 (socket says 172.21.15.131:57336) 2024-05-17T04:09:30.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a527a640 1 -- 172.21.15.131:0/872465052 learned_addr learned my addr 172.21.15.131:0/872465052 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:30.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a627c640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6a00aa440 0x7fd6a00aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:30.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a5a7b640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a0146310 0x7fd6a00cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:30.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a527a640 1 -- 172.21.15.131:0/872465052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a0146310 msgr2=0x7fd6a00cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:30.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a527a640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a0146310 0x7fd6a00cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:30.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a527a640 1 -- 172.21.15.131:0/872465052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6a00aa440 msgr2=0x7fd6a00aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:30.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a527a640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6a00aa440 0x7fd6a00aa850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:30.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a527a640 1 -- 172.21.15.131:0/872465052 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a00aad90 con 0x7fd6a0161840 2024-05-17T04:09:30.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a627c640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6a00aa440 0x7fd6a00aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:30.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a5a7b640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a0146310 0x7fd6a00cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:30.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a527a640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a0161840 0x7fd6a015cbb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd69000c4b0 tx=0x7fd69000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:30.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6967fc640 1 -- 172.21.15.131:0/872465052 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690018070 con 0x7fd6a0161840 2024-05-17T04:09:30.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6967fc640 1 -- 172.21.15.131:0/872465052 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd690007500 con 0x7fd6a0161840 2024-05-17T04:09:30.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6a7cdf640 1 -- 172.21.15.131:0/872465052 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a00cd4c0 con 0x7fd6a0161840 2024-05-17T04:09:30.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.154+0000 7fd6967fc640 1 -- 172.21.15.131:0/872465052 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690004a20 con 0x7fd6a0161840 2024-05-17T04:09:30.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.155+0000 7fd6a7cdf640 1 -- 172.21.15.131:0/872465052 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a00cda80 con 0x7fd6a0161840 2024-05-17T04:09:30.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.156+0000 7fd6a7cdf640 1 -- 172.21.15.131:0/872465052 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a0146720 con 0x7fd6a0161840 2024-05-17T04:09:30.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.156+0000 7fd6967fc640 1 -- 172.21.15.131:0/872465052 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd690004bc0 con 0x7fd6a0161840 2024-05-17T04:09:30.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.157+0000 7fd6967fc640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd6840762d0 0x7fd6840787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:30.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.157+0000 7fd6a5a7b640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd6840762d0 0x7fd6840787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:30.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.157+0000 7fd6967fc640 1 -- 172.21.15.131:0/872465052 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd690096d10 con 0x7fd6a0161840 2024-05-17T04:09:30.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.157+0000 7fd6a5a7b640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd6840762d0 0x7fd6840787e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd69c007fd0 tx=0x7fd69c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:30.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.161+0000 7fd6967fc640 1 -- 172.21.15.131:0/872465052 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd6a00aad90 con 0x7fd6a0161840 2024-05-17T04:09:30.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.381+0000 7fd6a7cdf640 1 -- 172.21.15.131:0/872465052 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd6a00746c0 con 0x7fd6a0161840 2024-05-17T04:09:30.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.382+0000 7fd6967fc640 1 -- 172.21.15.131:0/872465052 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fd690060220 con 0x7fd6a0161840 2024-05-17T04:09:30.384 INFO:teuthology.orchestra.run.smithi131.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-17T04:09:30.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.383+0000 7fd6a7cdf640 1 -- 172.21.15.131:0/872465052 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd6840762d0 msgr2=0x7fd6840787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:30.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.384+0000 7fd6a7cdf640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd6840762d0 0x7fd6840787e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd69c007fd0 tx=0x7fd69c009040 comp rx=0 tx=0).stop 2024-05-17T04:09:30.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.384+0000 7fd6a7cdf640 1 -- 172.21.15.131:0/872465052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a0161840 msgr2=0x7fd6a015cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:30.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.384+0000 7fd6a7cdf640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a0161840 0x7fd6a015cbb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd69000c4b0 tx=0x7fd69000c970 comp rx=0 tx=0).stop 2024-05-17T04:09:30.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.384+0000 7fd6a7cdf640 1 -- 172.21.15.131:0/872465052 shutdown_connections 2024-05-17T04:09:30.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.384+0000 7fd6a7cdf640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd6840762d0 0x7fd6840787e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:30.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.384+0000 7fd6a7cdf640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a0161840 0x7fd6a015cbb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:30.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.384+0000 7fd6a7cdf640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6a00aa440 0x7fd6a00aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:30.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.384+0000 7fd6a7cdf640 1 --2- 172.21.15.131:0/872465052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a0146310 0x7fd6a00cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:30.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.384+0000 7fd6a7cdf640 1 -- 172.21.15.131:0/872465052 >> 172.21.15.131:0/872465052 conn(0x7fd6a00735b0 msgr2=0x7fd6a0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:30.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.384+0000 7fd6a7cdf640 1 -- 172.21.15.131:0/872465052 shutdown_connections 2024-05-17T04:09:30.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30.384+0000 7fd6a7cdf640 1 -- 172.21.15.131:0/872465052 wait complete. 2024-05-17T04:09:30.396 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-17T04:09:30.397 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-17T04:09:30.397 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-05-17T04:09:30.397 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-17T04:09:30.397 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-17T04:09:30.397 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-17T04:09:30.397 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-17T04:09:30.397 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-17T04:09:30.397 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-17T04:09:30.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:30.397 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-05-17T04:09:30.414 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-17T04:09:30.414 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-17T04:09:30.414 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-05-17T04:09:30.414 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:30.414 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-05-17T04:09:30.414 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:30.414 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:09:30.414 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:30.414 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-05-17T04:09:30.415 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:09:30.415 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:30.415 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-05-17T04:09:30.415 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:09:30.415 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:30.415 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-17T04:09:30.415 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:30.415 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-17T04:09:30.415 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42663sec preferred_lft 42663sec 2024-05-17T04:09:30.415 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2024-05-17T04:09:30.415 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:30.415 INFO:teuthology.orchestra.run.smithi131.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-17T04:09:30.415 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether b6:67:b9:f7:d5:84 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:30.415 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-17T04:09:30.416 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:30.416 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::4cae:6fff:fe57:53f7/64 scope link 2024-05-17T04:09:30.416 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:30.416 INFO:teuthology.orchestra.run.smithi131.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-17T04:09:30.416 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether b6:67:b9:f7:d5:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T04:09:30.416 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::b467:b9ff:fef7:d584/64 scope link tentative 2024-05-17T04:09:30.416 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:30.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:30.416 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-17T04:09:30.478 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-05-17T04:09:30.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:30.480 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-05-17T04:09:30.537 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-05-17T04:09:30.537 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-17T04:09:30.537 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-17T04:09:30.537 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-17T04:09:30.538 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-17T04:09:30.538 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:30.538 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-05-17T04:09:30.538 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-17T04:09:30.538 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-17T04:09:30.538 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-17T04:09:30.538 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-05-17T04:09:30.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:30.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:30.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:30.665 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-05-17T04:09:30.681 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-17T04:09:30.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:30.681 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2024-05-17T04:09:30.736 INFO:teuthology.orchestra.run.smithi131.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-17T04:09:30.737 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:30.737 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-05-17T04:09:30.737 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-17T04:09:30.737 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-17T04:09:30.737 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-05-17T04:09:30.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:30.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:30.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:30.855 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-17T04:09:30.879 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-17T04:09:30.879 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-17T04:09:30.879 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-05-17T04:09:30.879 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:30.879 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-05-17T04:09:30.880 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:30.880 INFO:teuthology.orchestra.run.smithi131.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-17T04:09:30.880 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 6a:d9:1f:82:b9:10 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-17T04:09:30.880 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-17T04:09:30.880 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:30.880 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::68d9:1fff:fe82:b910/64 scope link 2024-05-17T04:09:30.880 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:30.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:30.882 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-17T04:09:30.947 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-17T04:09:30.947 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-17T04:09:30.947 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-05-17T04:09:30.947 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:30.947 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-05-17T04:09:30.947 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:30.947 INFO:teuthology.orchestra.run.smithi131.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-17T04:09:30.947 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 6a:d9:1f:82:b9:10 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-17T04:09:30.947 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-17T04:09:30.947 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:30.948 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::68d9:1fff:fe82:b910/64 scope link 2024-05-17T04:09:30.948 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:30.949 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-17T04:09:30.949 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:30.949 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-05-17T04:09:30.949 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-17T04:09:30.949 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-17T04:09:30.949 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-17T04:09:30.950 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-17T04:09:30.950 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-17T04:09:30.950 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-05-17T04:09:31.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:31.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:31.101 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:31.101 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-05-17T04:09:31.101 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.1 up 2024-05-17T04:09:31.102 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.1 master ceph-brx 2024-05-17T04:09:31.102 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-05-17T04:09:31.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:31.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:31.178 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-05-17T04:09:31.178 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-17T04:09:31.178 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-17T04:09:31.205 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-17T04:09:31.206 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-17T04:09:31.206 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-17T04:09:31.261 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-05-17T04:09:31.326 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-05-17T04:09:31.382 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-05-17T04:09:31.382 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-05-17T04:09:31.382 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-05-17T04:09:31.383 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-05-17T04:09:31.383 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-05-17T04:09:31.383 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-05-17T04:09:31.383 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-05-17T04:09:31.383 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-05-17T04:09:31.383 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-05-17T04:09:31.383 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-05-17T04:09:31.383 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-05-17T04:09:31.383 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/selinux 2024-05-17T04:09:31.383 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-05-17T04:09:31.383 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-05-17T04:09:31.383 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-05-17T04:09:31.383 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-05-17T04:09:31.384 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-05-17T04:09:31.384 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-05-17T04:09:31.384 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-05-17T04:09:31.384 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysctl.service 2024-05-17T04:09:31.384 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-17T04:09:31.384 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-17T04:09:31.384 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/nfs/rpc_pipefs 2024-05-17T04:09:31.384 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-05-17T04:09:31.384 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-05-17T04:09:31.384 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-0 2024-05-17T04:09:31.384 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-1 2024-05-17T04:09:31.384 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-2 2024-05-17T04:09:31.384 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-3 2024-05-17T04:09:31.384 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-05-17T04:09:31.385 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T04:09:31.385 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T04:09:31.385 INFO:teuthology.orchestra.run.smithi131.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-17T04:09:31.385 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-17T04:09:31.385 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-17T04:09:31.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:31.385 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-05-17T04:09:31.438 INFO:teuthology.orchestra.run.smithi131.stdout:41 2024-05-17T04:09:31.439 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-05-17T04:09:31.439 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-05-17T04:09:31.482 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-05-17T04:09:31.507 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-05-17T04:09:31.566 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-05-17T04:09:31.566 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-05-17T04:09:31.566 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-05-17T04:09:31.566 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-05-17T04:09:31.566 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-05-17T04:09:31.566 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-05-17T04:09:31.566 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-05-17T04:09:31.567 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-05-17T04:09:31.567 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-05-17T04:09:31.567 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-05-17T04:09:31.567 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-05-17T04:09:31.567 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/selinux 2024-05-17T04:09:31.567 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-05-17T04:09:31.567 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-05-17T04:09:31.567 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-05-17T04:09:31.567 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-05-17T04:09:31.567 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-05-17T04:09:31.567 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-05-17T04:09:31.567 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-05-17T04:09:31.567 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysctl.service 2024-05-17T04:09:31.567 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-17T04:09:31.568 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-17T04:09:31.568 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/nfs/rpc_pipefs 2024-05-17T04:09:31.568 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-05-17T04:09:31.568 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-05-17T04:09:31.568 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-0 2024-05-17T04:09:31.568 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-1 2024-05-17T04:09:31.568 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-2 2024-05-17T04:09:31.568 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-3 2024-05-17T04:09:31.568 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-05-17T04:09:31.568 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T04:09:31.568 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T04:09:31.569 INFO:teuthology.orchestra.run.smithi131.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-17T04:09:31.569 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-17T04:09:31.569 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-17T04:09:31.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:31.569 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-05-17T04:09:31.576 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi131.stderr:2024-05-17T04:09:31.575+0000 7f0be753f480 -1 init, newargv = 0x55d4eafcda60 newargc=15 2024-05-17T04:09:31.576 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi131.stderr:ceph-fuse[47016]: starting ceph client 2024-05-17T04:09:31.581 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi131.stderr:ceph-fuse[47016]: starting fuse 2024-05-17T04:09:31.591 INFO:teuthology.orchestra.run.smithi131.stdout:41 2024-05-17T04:09:31.591 INFO:teuthology.orchestra.run.smithi131.stdout:43 2024-05-17T04:09:31.591 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 43] 2024-05-17T04:09:31.591 DEBUG:teuthology.orchestra.run.smithi131:> sudo stdin-killer -- python3 -c ' 2024-05-17T04:09:31.591 DEBUG:teuthology.orchestra.run.smithi131:> import glob 2024-05-17T04:09:31.591 DEBUG:teuthology.orchestra.run.smithi131:> import re 2024-05-17T04:09:31.591 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-05-17T04:09:31.591 DEBUG:teuthology.orchestra.run.smithi131:> import subprocess 2024-05-17T04:09:31.592 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:09:31.592 DEBUG:teuthology.orchestra.run.smithi131:> def _find_admin_socket(client_name): 2024-05-17T04:09:31.592 DEBUG:teuthology.orchestra.run.smithi131:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-05-17T04:09:31.592 DEBUG:teuthology.orchestra.run.smithi131:> files = glob.glob(asok_path) 2024-05-17T04:09:31.592 DEBUG:teuthology.orchestra.run.smithi131:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-05-17T04:09:31.592 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:09:31.592 DEBUG:teuthology.orchestra.run.smithi131:> # Given a non-glob path, it better be there 2024-05-17T04:09:31.592 DEBUG:teuthology.orchestra.run.smithi131:> if "*" not in asok_path: 2024-05-17T04:09:31.592 DEBUG:teuthology.orchestra.run.smithi131:> assert(len(files) == 1) 2024-05-17T04:09:31.592 DEBUG:teuthology.orchestra.run.smithi131:> return files[0] 2024-05-17T04:09:31.592 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:09:31.592 DEBUG:teuthology.orchestra.run.smithi131:> for f in files: 2024-05-17T04:09:31.592 DEBUG:teuthology.orchestra.run.smithi131:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-17T04:09:31.592 DEBUG:teuthology.orchestra.run.smithi131:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-17T04:09:31.592 DEBUG:teuthology.orchestra.run.smithi131:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-17T04:09:31.593 DEBUG:teuthology.orchestra.run.smithi131:> contents = proc_f.read() 2024-05-17T04:09:31.593 DEBUG:teuthology.orchestra.run.smithi131:> if mountpoint in contents: 2024-05-17T04:09:31.593 DEBUG:teuthology.orchestra.run.smithi131:> return f 2024-05-17T04:09:31.593 DEBUG:teuthology.orchestra.run.smithi131:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-17T04:09:31.593 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:09:31.593 DEBUG:teuthology.orchestra.run.smithi131:> print(_find_admin_socket("client.2")) 2024-05-17T04:09:31.593 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-05-17T04:09:31.709 INFO:teuthology.orchestra.run.smithi131.stdout:/var/run/ceph/ceph-client.2.47016.asok 2024-05-17T04:09:31.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:31.721 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.47016.asok 2024-05-17T04:09:31.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:31.721 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.47016.asok status 2024-05-17T04:09:31.864 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T04:09:31.865 INFO:teuthology.orchestra.run.smithi131.stdout: "metadata": { 2024-05-17T04:09:31.865 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_sha1": "931809a9e5d295bd61984693cac44fe131ded4bc", 2024-05-17T04:09:31.865 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_version": "ceph version 19.0.0-3794-g931809a9 (931809a9e5d295bd61984693cac44fe131ded4bc) squid (dev)", 2024-05-17T04:09:31.865 INFO:teuthology.orchestra.run.smithi131.stdout: "entity_id": "2", 2024-05-17T04:09:31.865 INFO:teuthology.orchestra.run.smithi131.stdout: "hostname": "smithi131", 2024-05-17T04:09:31.865 INFO:teuthology.orchestra.run.smithi131.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-05-17T04:09:31.865 INFO:teuthology.orchestra.run.smithi131.stdout: "pid": "47016", 2024-05-17T04:09:31.865 INFO:teuthology.orchestra.run.smithi131.stdout: "root": "/" 2024-05-17T04:09:31.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:31.865 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_count": 0, 2024-05-17T04:09:31.865 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_pinned_count": 0, 2024-05-17T04:09:31.866 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4716, 2024-05-17T04:09:31.866 INFO:teuthology.orchestra.run.smithi131.stdout: "inst": { 2024-05-17T04:09:31.866 INFO:teuthology.orchestra.run.smithi131.stdout: "name": { 2024-05-17T04:09:31.866 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "client", 2024-05-17T04:09:31.866 INFO:teuthology.orchestra.run.smithi131.stdout: "num": 4716 2024-05-17T04:09:31.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:31.866 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-05-17T04:09:31.866 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-05-17T04:09:31.866 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.2:0", 2024-05-17T04:09:31.866 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 1207717403 2024-05-17T04:09:31.866 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:31.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:31.866 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-05-17T04:09:31.866 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-05-17T04:09:31.867 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.2:0", 2024-05-17T04:09:31.867 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 1207717403 2024-05-17T04:09:31.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:31.867 INFO:teuthology.orchestra.run.smithi131.stdout: "inst_str": "client.4716 192.168.0.2:0/1207717403", 2024-05-17T04:09:31.867 INFO:teuthology.orchestra.run.smithi131.stdout: "addr_str": "192.168.0.2:0/1207717403", 2024-05-17T04:09:31.867 INFO:teuthology.orchestra.run.smithi131.stdout: "inode_count": 1, 2024-05-17T04:09:31.867 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_epoch": 8, 2024-05-17T04:09:31.867 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch": 24, 2024-05-17T04:09:31.867 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch_barrier": 0, 2024-05-17T04:09:31.867 INFO:teuthology.orchestra.run.smithi131.stdout: "blocklisted": false, 2024-05-17T04:09:31.867 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs" 2024-05-17T04:09:31.867 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T04:09:31.873 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-17T04:09:31.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.983+0000 7fc223a26640 1 Processor -- start 2024-05-17T04:09:31.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.983+0000 7fc223a26640 1 -- start start 2024-05-17T04:09:31.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.984+0000 7fc223a26640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc21c0d0ca0 0x7fc21c15f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:31.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.984+0000 7fc223a26640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc21c0d02f0 0x7fc21c0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:31.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.984+0000 7fc223a26640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc21c0cd8c0 con 0x7fc21c06e090 2024-05-17T04:09:31.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.984+0000 7fc223a26640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc21c06f0d0 con 0x7fc21c0d0ca0 2024-05-17T04:09:31.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.984+0000 7fc223a26640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc21c06e830 con 0x7fc21c0d02f0 2024-05-17T04:09:31.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.984+0000 7fc2217c2640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc21c0d0ca0 0x7fc21c15f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:31.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.984+0000 7fc2217c2640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc21c0d0ca0 0x7fc21c15f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57338/0 (socket says 172.21.15.131:57338) 2024-05-17T04:09:31.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.985+0000 7fc2217c2640 1 -- 172.21.15.131:0/170420658 learned_addr learned my addr 172.21.15.131:0/170420658 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:31.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.985+0000 7fc221fc3640 1 --2- 172.21.15.131:0/170420658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc21c0d02f0 0x7fc21c0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:31.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.985+0000 7fc2217c2640 1 -- 172.21.15.131:0/170420658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc21c0d02f0 msgr2=0x7fc21c0cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:31.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.985+0000 7fc2217c2640 1 --2- 172.21.15.131:0/170420658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc21c0d02f0 0x7fc21c0cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:31.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.985+0000 7fc2217c2640 1 -- 172.21.15.131:0/170420658 >> v1:172.21.15.150:6789/0 conn(0x7fc21c06e090 legacy=0x7fc21c0cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:31.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.985+0000 7fc2217c2640 1 -- 172.21.15.131:0/170420658 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21c06eb10 con 0x7fc21c0d0ca0 2024-05-17T04:09:31.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.985+0000 7fc221fc3640 1 --2- 172.21.15.131:0/170420658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc21c0d02f0 0x7fc21c0cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:31.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.986+0000 7fc2217c2640 1 --2- 172.21.15.131:0/170420658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c0d0ca0 0x7fc21c15f7c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc218009870 tx=0x7fc21802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5e3e3d4317e46a server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:31.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.986+0000 7fc213fff640 1 -- 172.21.15.131:0/170420658 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218037070 con 0x7fc21c0d0ca0 2024-05-17T04:09:31.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.986+0000 7fc213fff640 1 -- 172.21.15.131:0/170420658 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc218032440 con 0x7fc21c0d0ca0 2024-05-17T04:09:31.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.986+0000 7fc213fff640 1 -- 172.21.15.131:0/170420658 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218032810 con 0x7fc21c0d0ca0 2024-05-17T04:09:31.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.986+0000 7fc223a26640 1 -- 172.21.15.131:0/170420658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c0d0ca0 msgr2=0x7fc21c15f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:31.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.986+0000 7fc223a26640 1 --2- 172.21.15.131:0/170420658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c0d0ca0 0x7fc21c15f7c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc218009870 tx=0x7fc21802a1c0 comp rx=0 tx=0).stop 2024-05-17T04:09:31.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.986+0000 7fc223a26640 1 -- 172.21.15.131:0/170420658 shutdown_connections 2024-05-17T04:09:31.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.986+0000 7fc223a26640 1 --2- 172.21.15.131:0/170420658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc21c0d02f0 0x7fc21c0cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:31.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.986+0000 7fc223a26640 1 --2- 172.21.15.131:0/170420658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c0d0ca0 0x7fc21c15f7c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:31.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.986+0000 7fc223a26640 1 -- 172.21.15.131:0/170420658 >> 172.21.15.131:0/170420658 conn(0x7fc21c0b4e40 msgr2=0x7fc21c0b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:31.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.987+0000 7fc223a26640 1 -- 172.21.15.131:0/170420658 shutdown_connections 2024-05-17T04:09:31.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.987+0000 7fc223a26640 1 -- 172.21.15.131:0/170420658 wait complete. 2024-05-17T04:09:31.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.988+0000 7fc223a26640 1 Processor -- start 2024-05-17T04:09:31.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.988+0000 7fc223a26640 1 -- start start 2024-05-17T04:09:31.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc223a26640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc21c06e090 0x7fc21c0b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:31.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc223a26640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc21c0d0ca0 0x7fc21c0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:31.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc223a26640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c0ccd90 0x7fc21c0ce900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:31.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc223a26640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c0ce2e0 con 0x7fc21c0ccd90 2024-05-17T04:09:31.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc223a26640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c06e4a0 con 0x7fc21c06e090 2024-05-17T04:09:31.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc223a26640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc21c0ce460 con 0x7fc21c0d0ca0 2024-05-17T04:09:31.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc221fc3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c0ccd90 0x7fc21c0ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:31.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc221fc3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c0ccd90 0x7fc21c0ce900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57346/0 (socket says 172.21.15.131:57346) 2024-05-17T04:09:31.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc221fc3640 1 -- 172.21.15.131:0/3619731712 learned_addr learned my addr 172.21.15.131:0/3619731712 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:31.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc2217c2640 1 --2- 172.21.15.131:0/3619731712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc21c06e090 0x7fc21c0b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:31.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc220fc1640 1 --2- 172.21.15.131:0/3619731712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc21c0d0ca0 0x7fc21c0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:31.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc221fc3640 1 -- 172.21.15.131:0/3619731712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc21c0d0ca0 msgr2=0x7fc21c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:31.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc221fc3640 1 --2- 172.21.15.131:0/3619731712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc21c0d0ca0 0x7fc21c0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:31.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc221fc3640 1 -- 172.21.15.131:0/3619731712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc21c06e090 msgr2=0x7fc21c0b7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:31.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc221fc3640 1 --2- 172.21.15.131:0/3619731712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc21c06e090 0x7fc21c0b7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:31.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc221fc3640 1 -- 172.21.15.131:0/3619731712 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21c0c9210 con 0x7fc21c0ccd90 2024-05-17T04:09:31.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc221fc3640 1 --2- 172.21.15.131:0/3619731712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c0ccd90 0x7fc21c0ce900 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc214007dc0 tx=0x7fc21400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:31.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc211ffb640 1 -- 172.21.15.131:0/3619731712 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21401a070 con 0x7fc21c0ccd90 2024-05-17T04:09:31.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc211ffb640 1 -- 172.21.15.131:0/3619731712 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc214003990 con 0x7fc21c0ccd90 2024-05-17T04:09:31.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.990+0000 7fc223a26640 1 -- 172.21.15.131:0/3619731712 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21c0c8a90 con 0x7fc21c0ccd90 2024-05-17T04:09:31.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.991+0000 7fc211ffb640 1 -- 172.21.15.131:0/3619731712 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214003d80 con 0x7fc21c0ccd90 2024-05-17T04:09:31.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.991+0000 7fc223a26640 1 -- 172.21.15.131:0/3619731712 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21c0b7220 con 0x7fc21c0ccd90 2024-05-17T04:09:31.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.992+0000 7fc223a26640 1 -- 172.21.15.131:0/3619731712 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc21c0cdda0 con 0x7fc21c0ccd90 2024-05-17T04:09:31.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.993+0000 7fc211ffb640 1 -- 172.21.15.131:0/3619731712 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc21401d070 con 0x7fc21c0ccd90 2024-05-17T04:09:31.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.993+0000 7fc211ffb640 1 --2- 172.21.15.131:0/3619731712 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc2000762d0 0x7fc2000787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:31.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.993+0000 7fc2217c2640 1 --2- 172.21.15.131:0/3619731712 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc2000762d0 0x7fc2000787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:31.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.993+0000 7fc211ffb640 1 -- 172.21.15.131:0/3619731712 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc214097a80 con 0x7fc21c0ccd90 2024-05-17T04:09:31.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.994+0000 7fc2217c2640 1 --2- 172.21.15.131:0/3619731712 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc2000762d0 0x7fc2000787e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc218034000 tx=0x7fc21802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:31.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:31.998+0000 7fc211ffb640 1 -- 172.21.15.131:0/3619731712 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc214010070 con 0x7fc21c0ccd90 2024-05-17T04:09:32.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:32.214+0000 7fc223a26640 1 -- 172.21.15.131:0/3619731712 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc21c0c8cc0 con 0x7fc21c0ccd90 2024-05-17T04:09:32.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:32.215+0000 7fc211ffb640 1 -- 172.21.15.131:0/3619731712 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fc214060a50 con 0x7fc21c0ccd90 2024-05-17T04:09:32.216 INFO:teuthology.orchestra.run.smithi131.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-17T04:09:32.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:32.217+0000 7fc223a26640 1 -- 172.21.15.131:0/3619731712 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc2000762d0 msgr2=0x7fc2000787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:32.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:32.217+0000 7fc223a26640 1 --2- 172.21.15.131:0/3619731712 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc2000762d0 0x7fc2000787e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc218034000 tx=0x7fc21802e000 comp rx=0 tx=0).stop 2024-05-17T04:09:32.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:32.217+0000 7fc223a26640 1 -- 172.21.15.131:0/3619731712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c0ccd90 msgr2=0x7fc21c0ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:32.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:32.217+0000 7fc223a26640 1 --2- 172.21.15.131:0/3619731712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c0ccd90 0x7fc21c0ce900 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc214007dc0 tx=0x7fc21400d4a0 comp rx=0 tx=0).stop 2024-05-17T04:09:32.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:32.217+0000 7fc223a26640 1 -- 172.21.15.131:0/3619731712 shutdown_connections 2024-05-17T04:09:32.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:32.217+0000 7fc223a26640 1 --2- 172.21.15.131:0/3619731712 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc2000762d0 0x7fc2000787e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:32.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:32.217+0000 7fc223a26640 1 --2- 172.21.15.131:0/3619731712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c0ccd90 0x7fc21c0ce900 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:32.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:32.217+0000 7fc223a26640 1 --2- 172.21.15.131:0/3619731712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc21c0d0ca0 0x7fc21c0c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:32.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:32.217+0000 7fc223a26640 1 --2- 172.21.15.131:0/3619731712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc21c06e090 0x7fc21c0b7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:32.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:32.217+0000 7fc223a26640 1 -- 172.21.15.131:0/3619731712 >> 172.21.15.131:0/3619731712 conn(0x7fc21c0b4e40 msgr2=0x7fc21c070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:32.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:32.217+0000 7fc223a26640 1 -- 172.21.15.131:0/3619731712 shutdown_connections 2024-05-17T04:09:32.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:32.217+0000 7fc223a26640 1 -- 172.21.15.131:0/3619731712 wait complete. 2024-05-17T04:09:32.229 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-17T04:09:32.229 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-17T04:09:32.229 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-05-17T04:09:32.229 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-17T04:09:32.229 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-17T04:09:32.229 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-17T04:09:32.229 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-17T04:09:32.229 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-17T04:09:32.229 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-17T04:09:32.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:32.230 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-05-17T04:09:32.250 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-17T04:09:32.251 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-17T04:09:32.251 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-05-17T04:09:32.251 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:32.251 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-05-17T04:09:32.251 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:32.251 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:09:32.251 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:32.251 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-05-17T04:09:32.251 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:09:32.251 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:32.251 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-05-17T04:09:32.251 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:09:32.252 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:32.252 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-17T04:09:32.252 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:32.252 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-17T04:09:32.252 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42673sec preferred_lft 42673sec 2024-05-17T04:09:32.252 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2024-05-17T04:09:32.252 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:32.252 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-17T04:09:32.252 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:32.252 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-05-17T04:09:32.252 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add name ceph-brx type bridge 2024-05-17T04:09:32.253 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr flush dev ceph-brx 2024-05-17T04:09:32.253 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set ceph-brx up 2024-05-17T04:09:32.253 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-17T04:09:32.253 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-05-17T04:09:32.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:32.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:32.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:32.521 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-17T04:09:32.547 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-05-17T04:09:32.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:32.549 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-05-17T04:09:32.624 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-05-17T04:09:32.624 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-17T04:09:32.624 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-17T04:09:32.624 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-17T04:09:32.624 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-17T04:09:32.625 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:32.625 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-05-17T04:09:32.625 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-17T04:09:32.625 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-17T04:09:32.625 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-17T04:09:32.625 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-05-17T04:09:32.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:32.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:32.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:32.910 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-05-17T04:09:32.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:32.926 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2024-05-17T04:09:32.981 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:32.981 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-05-17T04:09:32.981 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-17T04:09:32.982 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-17T04:09:32.982 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-05-17T04:09:33.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:33.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:33.099 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-17T04:09:33.100 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:33.100 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-05-17T04:09:33.100 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-17T04:09:33.100 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-17T04:09:33.100 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-17T04:09:33.100 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-17T04:09:33.100 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-17T04:09:33.100 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-05-17T04:09:33.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:33.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:33.235 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:33.235 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-05-17T04:09:33.235 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-05-17T04:09:33.235 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.0 master ceph-brx 2024-05-17T04:09:33.235 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-05-17T04:09:33.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:33.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:33.312 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-05-17T04:09:33.313 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-17T04:09:33.313 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-17T04:09:33.330 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-17T04:09:33.331 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-17T04:09:33.331 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-17T04:09:33.387 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-05-17T04:09:33.453 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-05-17T04:09:33.510 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-05-17T04:09:33.510 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-05-17T04:09:33.510 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-05-17T04:09:33.510 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-05-17T04:09:33.510 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-05-17T04:09:33.511 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-05-17T04:09:33.511 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-05-17T04:09:33.511 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-05-17T04:09:33.511 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-05-17T04:09:33.511 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-05-17T04:09:33.511 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-05-17T04:09:33.511 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/selinux 2024-05-17T04:09:33.511 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-05-17T04:09:33.511 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-05-17T04:09:33.511 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-05-17T04:09:33.511 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-05-17T04:09:33.511 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-05-17T04:09:33.511 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-05-17T04:09:33.512 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-05-17T04:09:33.512 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysctl.service 2024-05-17T04:09:33.512 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-17T04:09:33.512 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-17T04:09:33.512 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/nfs/rpc_pipefs 2024-05-17T04:09:33.512 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-05-17T04:09:33.512 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-05-17T04:09:33.512 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-05-17T04:09:33.512 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-05-17T04:09:33.512 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-05-17T04:09:33.512 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-05-17T04:09:33.512 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-05-17T04:09:33.512 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-17T04:09:33.513 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-17T04:09:33.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:33.513 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-05-17T04:09:33.565 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-17T04:09:33.565 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-05-17T04:09:33.607 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-05-17T04:09:33.631 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-05-17T04:09:33.689 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-05-17T04:09:33.689 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-05-17T04:09:33.689 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-05-17T04:09:33.689 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-05-17T04:09:33.689 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-05-17T04:09:33.689 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-05-17T04:09:33.689 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-05-17T04:09:33.689 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-05-17T04:09:33.689 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-05-17T04:09:33.690 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-05-17T04:09:33.690 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-05-17T04:09:33.690 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/selinux 2024-05-17T04:09:33.690 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-05-17T04:09:33.690 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-05-17T04:09:33.690 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-05-17T04:09:33.690 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-05-17T04:09:33.690 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-05-17T04:09:33.690 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-05-17T04:09:33.690 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-05-17T04:09:33.690 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysctl.service 2024-05-17T04:09:33.690 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-17T04:09:33.690 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-17T04:09:33.691 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/nfs/rpc_pipefs 2024-05-17T04:09:33.691 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-05-17T04:09:33.691 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-05-17T04:09:33.691 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-05-17T04:09:33.691 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-05-17T04:09:33.691 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-05-17T04:09:33.691 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-05-17T04:09:33.691 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-05-17T04:09:33.691 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-17T04:09:33.691 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-17T04:09:33.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:33.692 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-05-17T04:09:33.705 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:2024-05-17T04:09:33.705+0000 7f8ff8c8d480 -1 init, newargv = 0x7f8fdc005eb0 newargc=15 2024-05-17T04:09:33.705 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[43342]: starting ceph client 2024-05-17T04:09:33.711 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[43342]: starting fuse 2024-05-17T04:09:33.722 INFO:teuthology.orchestra.run.smithi150.stdout:42 2024-05-17T04:09:33.722 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-05-17T04:09:33.722 DEBUG:teuthology.orchestra.run.smithi150:> sudo stdin-killer -- python3 -c ' 2024-05-17T04:09:33.722 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2024-05-17T04:09:33.722 DEBUG:teuthology.orchestra.run.smithi150:> import re 2024-05-17T04:09:33.722 DEBUG:teuthology.orchestra.run.smithi150:> import os 2024-05-17T04:09:33.723 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2024-05-17T04:09:33.723 DEBUG:teuthology.orchestra.run.smithi150:> 2024-05-17T04:09:33.723 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2024-05-17T04:09:33.723 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-05-17T04:09:33.723 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2024-05-17T04:09:33.723 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-05-17T04:09:33.723 DEBUG:teuthology.orchestra.run.smithi150:> 2024-05-17T04:09:33.723 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2024-05-17T04:09:33.723 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2024-05-17T04:09:33.723 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2024-05-17T04:09:33.723 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2024-05-17T04:09:33.723 DEBUG:teuthology.orchestra.run.smithi150:> 2024-05-17T04:09:33.723 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2024-05-17T04:09:33.723 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-17T04:09:33.723 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-17T04:09:33.724 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-17T04:09:33.724 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2024-05-17T04:09:33.724 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2024-05-17T04:09:33.724 DEBUG:teuthology.orchestra.run.smithi150:> return f 2024-05-17T04:09:33.724 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-17T04:09:33.724 DEBUG:teuthology.orchestra.run.smithi150:> 2024-05-17T04:09:33.724 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.1")) 2024-05-17T04:09:33.724 DEBUG:teuthology.orchestra.run.smithi150:> ' 2024-05-17T04:09:33.840 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.1.43342.asok 2024-05-17T04:09:33.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:33.850 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43342.asok 2024-05-17T04:09:33.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:33.851 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43342.asok status 2024-05-17T04:09:33.994 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-05-17T04:09:33.994 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2024-05-17T04:09:33.994 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "931809a9e5d295bd61984693cac44fe131ded4bc", 2024-05-17T04:09:33.994 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 19.0.0-3794-g931809a9 (931809a9e5d295bd61984693cac44fe131ded4bc) squid (dev)", 2024-05-17T04:09:33.994 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "1", 2024-05-17T04:09:33.994 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2024-05-17T04:09:33.994 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-05-17T04:09:33.994 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "43342", 2024-05-17T04:09:33.995 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2024-05-17T04:09:33.995 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-17T04:09:33.995 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2024-05-17T04:09:33.995 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2024-05-17T04:09:33.995 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4690, 2024-05-17T04:09:33.995 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2024-05-17T04:09:33.995 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2024-05-17T04:09:33.995 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2024-05-17T04:09:33.995 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4690 2024-05-17T04:09:33.995 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-17T04:09:33.995 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-05-17T04:09:33.996 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-05-17T04:09:33.996 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-05-17T04:09:33.996 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2900448676 2024-05-17T04:09:33.996 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-17T04:09:33.996 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-17T04:09:33.996 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-05-17T04:09:33.996 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-05-17T04:09:33.996 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-05-17T04:09:33.996 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2900448676 2024-05-17T04:09:33.996 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-17T04:09:33.996 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4690 192.168.0.1:0/2900448676", 2024-05-17T04:09:33.997 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.1:0/2900448676", 2024-05-17T04:09:33.997 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2024-05-17T04:09:33.997 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 8, 2024-05-17T04:09:33.997 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 24, 2024-05-17T04:09:33.997 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2024-05-17T04:09:33.997 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2024-05-17T04:09:33.997 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2024-05-17T04:09:33.997 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-05-17T04:09:34.002 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-17T04:09:34.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.124+0000 7f910b8ce640 1 Processor -- start 2024-05-17T04:09:34.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.125+0000 7f910b8ce640 1 -- start start 2024-05-17T04:09:34.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.126+0000 7f910b8ce640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9104071d90 0x7f910415db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:34.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.126+0000 7f910b8ce640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f910415ecc0 0x7f91040cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:34.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.126+0000 7f910b8ce640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f91040cdd40 0x7f91040d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:34.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.126+0000 7f910b8ce640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9104158010 con 0x7f91040cdd40 2024-05-17T04:09:34.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.126+0000 7f910b8ce640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f910415e0e0 con 0x7f9104071d90 2024-05-17T04:09:34.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.126+0000 7f910b8ce640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f910415e3c0 con 0x7f910415ecc0 2024-05-17T04:09:34.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.126+0000 7f9109e6b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f91040cdd40 0x7f91040d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:34.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.126+0000 7f9109e6b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f91040cdd40 0x7f91040d13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57358/0 (socket says 172.21.15.131:57358) 2024-05-17T04:09:34.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.126+0000 7f9109e6b640 1 -- 172.21.15.131:0/1143339304 learned_addr learned my addr 172.21.15.131:0/1143339304 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:34.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.126+0000 7f9108e69640 1 --2- 172.21.15.131:0/1143339304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f910415ecc0 0x7f91040cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:34.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.126+0000 7f910966a640 1 --2- 172.21.15.131:0/1143339304 >> v2:172.21.15.150:3300/0 conn(0x7f9104071d90 0x7f910415db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:34.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.127+0000 7f9109e6b640 1 -- 172.21.15.131:0/1143339304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f910415ecc0 msgr2=0x7f91040cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:34.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.127+0000 7f9109e6b640 1 --2- 172.21.15.131:0/1143339304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f910415ecc0 0x7f91040cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:34.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.127+0000 7f9109e6b640 1 -- 172.21.15.131:0/1143339304 >> v2:172.21.15.150:3300/0 conn(0x7f9104071d90 msgr2=0x7f910415db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:34.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.127+0000 7f9109e6b640 1 --2- 172.21.15.131:0/1143339304 >> v2:172.21.15.150:3300/0 conn(0x7f9104071d90 0x7f910415db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:34.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.127+0000 7f9109e6b640 1 -- 172.21.15.131:0/1143339304 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910415e6a0 con 0x7f91040cdd40 2024-05-17T04:09:34.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.127+0000 7f9109e6b640 1 --2- 172.21.15.131:0/1143339304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91040cdd40 0x7f91040d13b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9104073d30 tx=0x7f90fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df3e4c7f694e760 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:34.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.128+0000 7f90fbfff640 1 -- 172.21.15.131:0/1143339304 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc037070 con 0x7f91040cdd40 2024-05-17T04:09:34.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.128+0000 7f90fbfff640 1 -- 172.21.15.131:0/1143339304 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90fc032440 con 0x7f91040cdd40 2024-05-17T04:09:34.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.128+0000 7f90fbfff640 1 -- 172.21.15.131:0/1143339304 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc032810 con 0x7f91040cdd40 2024-05-17T04:09:34.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.128+0000 7f910b8ce640 1 -- 172.21.15.131:0/1143339304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91040cdd40 msgr2=0x7f91040d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:34.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.128+0000 7f910b8ce640 1 --2- 172.21.15.131:0/1143339304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91040cdd40 0x7f91040d13b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9104073d30 tx=0x7f90fc02a1e0 comp rx=0 tx=0).stop 2024-05-17T04:09:34.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.128+0000 7f910b8ce640 1 -- 172.21.15.131:0/1143339304 shutdown_connections 2024-05-17T04:09:34.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.128+0000 7f910b8ce640 1 --2- 172.21.15.131:0/1143339304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91040cdd40 0x7f91040d13b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:34.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.128+0000 7f910b8ce640 1 --2- 172.21.15.131:0/1143339304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f910415ecc0 0x7f91040cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:34.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.128+0000 7f910b8ce640 1 --2- 172.21.15.131:0/1143339304 >> v2:172.21.15.150:3300/0 conn(0x7f9104071d90 0x7f910415db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:34.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.128+0000 7f910b8ce640 1 -- 172.21.15.131:0/1143339304 >> 172.21.15.131:0/1143339304 conn(0x7f91040d2fd0 msgr2=0x7f91040d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:34.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.128+0000 7f910b8ce640 1 -- 172.21.15.131:0/1143339304 shutdown_connections 2024-05-17T04:09:34.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.128+0000 7f910b8ce640 1 -- 172.21.15.131:0/1143339304 wait complete. 2024-05-17T04:09:34.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.130+0000 7f910b8ce640 1 Processor -- start 2024-05-17T04:09:34.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.130+0000 7f910b8ce640 1 -- start start 2024-05-17T04:09:34.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f910b8ce640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9104071d90 0x7f91040cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f910b8ce640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91040cdd40 0x7f9104150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f910b8ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f910415ecc0 0x7f9104145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f910b8ce640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f91040d2a50 con 0x7f91040cdd40 2024-05-17T04:09:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f910b8ce640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f91040d28d0 con 0x7f910415ecc0 2024-05-17T04:09:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f910b8ce640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f910415f0d0 con 0x7f9104071d90 2024-05-17T04:09:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f9108e69640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91040cdd40 0x7f9104150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f9108e69640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91040cdd40 0x7f9104150ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:57370/0 (socket says 172.21.15.131:57370) 2024-05-17T04:09:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f9108e69640 1 -- 172.21.15.131:0/1381976843 learned_addr learned my addr 172.21.15.131:0/1381976843 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f9109e6b640 1 --2- 172.21.15.131:0/1381976843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f910415ecc0 0x7f9104145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:34.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f910966a640 1 --2- 172.21.15.131:0/1381976843 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9104071d90 0x7f91040cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:34.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f9108e69640 1 -- 172.21.15.131:0/1381976843 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9104071d90 msgr2=0x7f91040cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:34.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f9108e69640 1 --2- 172.21.15.131:0/1381976843 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9104071d90 0x7f91040cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:34.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f9108e69640 1 -- 172.21.15.131:0/1381976843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f910415ecc0 msgr2=0x7f9104145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:34.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f9108e69640 1 --2- 172.21.15.131:0/1381976843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f910415ecc0 0x7f9104145ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:34.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f9108e69640 1 -- 172.21.15.131:0/1381976843 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91040ca580 con 0x7f91040cdd40 2024-05-17T04:09:34.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f910966a640 1 --2- 172.21.15.131:0/1381976843 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9104071d90 0x7f91040cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:34.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f9108e69640 1 --2- 172.21.15.131:0/1381976843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91040cdd40 0x7f9104150ef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f90f400e870 tx=0x7f90f400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:34.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f90f9ffb640 1 -- 172.21.15.131:0/1381976843 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4017070 con 0x7f91040cdd40 2024-05-17T04:09:34.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f90f9ffb640 1 -- 172.21.15.131:0/1381976843 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f400ee60 con 0x7f91040cdd40 2024-05-17T04:09:34.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f910b8ce640 1 -- 172.21.15.131:0/1381976843 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91040ca860 con 0x7f91040cdd40 2024-05-17T04:09:34.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.132+0000 7f90f9ffb640 1 -- 172.21.15.131:0/1381976843 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f400cb60 con 0x7f91040cdd40 2024-05-17T04:09:34.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.133+0000 7f910b8ce640 1 -- 172.21.15.131:0/1381976843 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91040cae20 con 0x7f91040cdd40 2024-05-17T04:09:34.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.134+0000 7f910b8ce640 1 -- 172.21.15.131:0/1381976843 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f910415db00 con 0x7f91040cdd40 2024-05-17T04:09:34.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.134+0000 7f90f9ffb640 1 -- 172.21.15.131:0/1381976843 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f90f401a070 con 0x7f91040cdd40 2024-05-17T04:09:34.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.135+0000 7f90f9ffb640 1 --2- 172.21.15.131:0/1381976843 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f90e80762d0 0x7f90e80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:34.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.135+0000 7f90f9ffb640 1 -- 172.21.15.131:0/1381976843 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f90f4097830 con 0x7f91040cdd40 2024-05-17T04:09:34.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.135+0000 7f910966a640 1 --2- 172.21.15.131:0/1381976843 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f90e80762d0 0x7f90e80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:34.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.135+0000 7f910966a640 1 --2- 172.21.15.131:0/1381976843 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f90e80762d0 0x7f90e80787e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f91040cef40 tx=0x7f910000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:34.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.139+0000 7f90f9ffb640 1 -- 172.21.15.131:0/1381976843 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f90f4060dc0 con 0x7f91040cdd40 2024-05-17T04:09:34.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.356+0000 7f910b8ce640 1 -- 172.21.15.131:0/1381976843 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f91040b2710 con 0x7f91040cdd40 2024-05-17T04:09:34.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.356+0000 7f90f9ffb640 1 -- 172.21.15.131:0/1381976843 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f90f40606c0 con 0x7f91040cdd40 2024-05-17T04:09:34.358 INFO:teuthology.orchestra.run.smithi131.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-17T04:09:34.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.358+0000 7f910b8ce640 1 -- 172.21.15.131:0/1381976843 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f90e80762d0 msgr2=0x7f90e80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:34.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.358+0000 7f910b8ce640 1 --2- 172.21.15.131:0/1381976843 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f90e80762d0 0x7f90e80787e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f91040cef40 tx=0x7f910000b040 comp rx=0 tx=0).stop 2024-05-17T04:09:34.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.358+0000 7f910b8ce640 1 -- 172.21.15.131:0/1381976843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91040cdd40 msgr2=0x7f9104150ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:34.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.358+0000 7f910b8ce640 1 --2- 172.21.15.131:0/1381976843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91040cdd40 0x7f9104150ef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f90f400e870 tx=0x7f90f400ed30 comp rx=0 tx=0).stop 2024-05-17T04:09:34.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.359+0000 7f910b8ce640 1 -- 172.21.15.131:0/1381976843 shutdown_connections 2024-05-17T04:09:34.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.359+0000 7f910b8ce640 1 --2- 172.21.15.131:0/1381976843 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f90e80762d0 0x7f90e80787e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:34.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.359+0000 7f910b8ce640 1 --2- 172.21.15.131:0/1381976843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91040cdd40 0x7f9104150ef0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:34.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.359+0000 7f910b8ce640 1 --2- 172.21.15.131:0/1381976843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f910415ecc0 0x7f9104145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:34.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.359+0000 7f910b8ce640 1 --2- 172.21.15.131:0/1381976843 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9104071d90 0x7f91040cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:34.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.359+0000 7f910b8ce640 1 -- 172.21.15.131:0/1381976843 >> 172.21.15.131:0/1381976843 conn(0x7f91040d2fd0 msgr2=0x7f91040b6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:34.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.359+0000 7f910b8ce640 1 -- 172.21.15.131:0/1381976843 shutdown_connections 2024-05-17T04:09:34.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:34.359+0000 7f910b8ce640 1 -- 172.21.15.131:0/1381976843 wait complete. 2024-05-17T04:09:34.371 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-17T04:09:34.371 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-17T04:09:34.371 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-05-17T04:09:34.371 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-17T04:09:34.371 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-17T04:09:34.371 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-17T04:09:34.371 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-17T04:09:34.371 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-17T04:09:34.371 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-17T04:09:34.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:34.371 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-05-17T04:09:34.389 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-17T04:09:34.389 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-17T04:09:34.389 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-05-17T04:09:34.389 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:34.389 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-05-17T04:09:34.389 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:34.390 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:09:34.390 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:34.390 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-05-17T04:09:34.390 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:09:34.390 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:34.390 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-05-17T04:09:34.390 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:09:34.390 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:34.390 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-17T04:09:34.390 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:34.390 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-17T04:09:34.390 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42671sec preferred_lft 42671sec 2024-05-17T04:09:34.390 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2024-05-17T04:09:34.391 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:34.391 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-17T04:09:34.391 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1e:e2:52:a6:59:a0 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:09:34.391 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-17T04:09:34.391 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:34.391 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::1cfe:e6ff:fe60:b293/64 scope link 2024-05-17T04:09:34.391 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:34.391 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-17T04:09:34.391 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 1e:e2:52:a6:59:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-17T04:09:34.391 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::1ce2:52ff:fea6:59a0/64 scope link 2024-05-17T04:09:34.391 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:34.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:34.392 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-17T04:09:34.454 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-05-17T04:09:34.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:34.455 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-05-17T04:09:34.511 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-05-17T04:09:34.511 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-17T04:09:34.511 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-17T04:09:34.511 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-17T04:09:34.512 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-17T04:09:34.512 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:34.512 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-05-17T04:09:34.512 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-17T04:09:34.512 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-17T04:09:34.512 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-17T04:09:34.512 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-05-17T04:09:34.604 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:34.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:34.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:34.643 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-05-17T04:09:34.658 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-17T04:09:34.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:34.659 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2024-05-17T04:09:34.714 INFO:teuthology.orchestra.run.smithi150.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-17T04:09:34.714 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:34.715 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-05-17T04:09:34.715 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-17T04:09:34.715 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-17T04:09:34.715 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-05-17T04:09:34.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:34.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:34.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:34.832 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-17T04:09:34.856 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-17T04:09:34.856 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-17T04:09:34.856 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-05-17T04:09:34.856 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:34.857 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-05-17T04:09:34.857 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:34.857 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-17T04:09:34.857 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 96:7c:fb:06:5b:8b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-17T04:09:34.857 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-17T04:09:34.857 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:34.857 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::947c:fbff:fe06:5b8b/64 scope link 2024-05-17T04:09:34.857 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:34.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:34.858 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-17T04:09:34.924 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-17T04:09:34.924 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-17T04:09:34.924 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-05-17T04:09:34.924 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:34.924 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-05-17T04:09:34.924 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:34.924 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-17T04:09:34.924 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 96:7c:fb:06:5b:8b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-17T04:09:34.924 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-17T04:09:34.924 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:34.924 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::947c:fbff:fe06:5b8b/64 scope link 2024-05-17T04:09:34.925 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:09:34.925 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-17T04:09:34.926 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:34.926 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-05-17T04:09:34.926 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-17T04:09:34.926 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-17T04:09:34.926 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-17T04:09:34.926 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-17T04:09:34.926 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-17T04:09:34.926 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-05-17T04:09:35.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:35.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:35.079 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:09:35.080 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-05-17T04:09:35.080 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.1 up 2024-05-17T04:09:35.080 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.1 master ceph-brx 2024-05-17T04:09:35.080 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-05-17T04:09:35.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:09:35.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:35.157 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-05-17T04:09:35.157 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-17T04:09:35.157 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-17T04:09:35.172 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-17T04:09:35.172 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-17T04:09:35.172 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-17T04:09:35.226 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-05-17T04:09:35.292 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-05-17T04:09:35.349 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-05-17T04:09:35.349 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-05-17T04:09:35.349 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-05-17T04:09:35.349 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-05-17T04:09:35.349 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-05-17T04:09:35.349 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-05-17T04:09:35.349 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-05-17T04:09:35.349 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-05-17T04:09:35.349 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-05-17T04:09:35.349 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-05-17T04:09:35.349 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-05-17T04:09:35.350 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/selinux 2024-05-17T04:09:35.350 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-05-17T04:09:35.350 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-05-17T04:09:35.350 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-05-17T04:09:35.350 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-05-17T04:09:35.350 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-05-17T04:09:35.350 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-05-17T04:09:35.350 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-05-17T04:09:35.350 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysctl.service 2024-05-17T04:09:35.350 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-17T04:09:35.350 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-17T04:09:35.350 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/nfs/rpc_pipefs 2024-05-17T04:09:35.351 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-05-17T04:09:35.351 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-05-17T04:09:35.351 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-05-17T04:09:35.351 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-05-17T04:09:35.351 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-05-17T04:09:35.351 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-05-17T04:09:35.351 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-05-17T04:09:35.351 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-17T04:09:35.351 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-17T04:09:35.351 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-17T04:09:35.351 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-17T04:09:35.351 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-17T04:09:35.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:35.352 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-05-17T04:09:35.404 INFO:teuthology.orchestra.run.smithi150.stdout:42 2024-05-17T04:09:35.405 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2024-05-17T04:09:35.405 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-05-17T04:09:35.448 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-05-17T04:09:35.472 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-05-17T04:09:35.530 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-05-17T04:09:35.530 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-05-17T04:09:35.530 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-05-17T04:09:35.530 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-05-17T04:09:35.530 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-05-17T04:09:35.531 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-05-17T04:09:35.531 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-05-17T04:09:35.531 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-05-17T04:09:35.531 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-05-17T04:09:35.531 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-05-17T04:09:35.531 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-05-17T04:09:35.531 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/selinux 2024-05-17T04:09:35.531 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-05-17T04:09:35.531 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-05-17T04:09:35.531 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-05-17T04:09:35.531 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-05-17T04:09:35.531 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-05-17T04:09:35.531 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-05-17T04:09:35.532 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-05-17T04:09:35.532 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysctl.service 2024-05-17T04:09:35.532 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-17T04:09:35.532 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-17T04:09:35.532 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/nfs/rpc_pipefs 2024-05-17T04:09:35.532 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-05-17T04:09:35.532 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-05-17T04:09:35.532 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-05-17T04:09:35.532 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-05-17T04:09:35.532 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-05-17T04:09:35.532 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-05-17T04:09:35.532 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-05-17T04:09:35.532 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-17T04:09:35.533 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-17T04:09:35.533 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-17T04:09:35.533 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-17T04:09:35.533 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-17T04:09:35.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:35.533 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-05-17T04:09:35.540 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi150.stderr:2024-05-17T04:09:35.539+0000 7f802d3d3480 -1 init, newargv = 0x7f801c001080 newargc=15 2024-05-17T04:09:35.540 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi150.stderr:ceph-fuse[43798]: starting ceph client 2024-05-17T04:09:35.545 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi150.stderr:ceph-fuse[43798]: starting fuse 2024-05-17T04:09:35.555 INFO:teuthology.orchestra.run.smithi150.stdout:42 2024-05-17T04:09:35.555 INFO:teuthology.orchestra.run.smithi150.stdout:43 2024-05-17T04:09:35.556 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 43] 2024-05-17T04:09:35.556 DEBUG:teuthology.orchestra.run.smithi150:> sudo stdin-killer -- python3 -c ' 2024-05-17T04:09:35.556 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2024-05-17T04:09:35.556 DEBUG:teuthology.orchestra.run.smithi150:> import re 2024-05-17T04:09:35.556 DEBUG:teuthology.orchestra.run.smithi150:> import os 2024-05-17T04:09:35.556 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2024-05-17T04:09:35.556 DEBUG:teuthology.orchestra.run.smithi150:> 2024-05-17T04:09:35.556 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2024-05-17T04:09:35.556 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-05-17T04:09:35.556 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2024-05-17T04:09:35.556 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-05-17T04:09:35.556 DEBUG:teuthology.orchestra.run.smithi150:> 2024-05-17T04:09:35.556 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2024-05-17T04:09:35.557 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2024-05-17T04:09:35.557 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2024-05-17T04:09:35.557 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2024-05-17T04:09:35.557 DEBUG:teuthology.orchestra.run.smithi150:> 2024-05-17T04:09:35.557 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2024-05-17T04:09:35.557 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-17T04:09:35.557 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-17T04:09:35.557 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-17T04:09:35.557 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2024-05-17T04:09:35.557 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2024-05-17T04:09:35.557 DEBUG:teuthology.orchestra.run.smithi150:> return f 2024-05-17T04:09:35.557 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-17T04:09:35.557 DEBUG:teuthology.orchestra.run.smithi150:> 2024-05-17T04:09:35.557 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.3")) 2024-05-17T04:09:35.557 DEBUG:teuthology.orchestra.run.smithi150:> ' 2024-05-17T04:09:35.674 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.3.43798.asok 2024-05-17T04:09:35.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-17T04:09:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:09:35.684 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.43798.asok 2024-05-17T04:09:35.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:35.684 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.43798.asok status 2024-05-17T04:09:35.828 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-05-17T04:09:35.828 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2024-05-17T04:09:35.828 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "931809a9e5d295bd61984693cac44fe131ded4bc", 2024-05-17T04:09:35.828 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 19.0.0-3794-g931809a9 (931809a9e5d295bd61984693cac44fe131ded4bc) squid (dev)", 2024-05-17T04:09:35.828 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "3", 2024-05-17T04:09:35.828 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2024-05-17T04:09:35.828 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-05-17T04:09:35.828 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "43798", 2024-05-17T04:09:35.828 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2024-05-17T04:09:35.828 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-17T04:09:35.828 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2024-05-17T04:09:35.829 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2024-05-17T04:09:35.829 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4702, 2024-05-17T04:09:35.829 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2024-05-17T04:09:35.829 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2024-05-17T04:09:35.829 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2024-05-17T04:09:35.829 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4702 2024-05-17T04:09:35.829 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-17T04:09:35.829 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-05-17T04:09:35.829 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-05-17T04:09:35.829 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.2:0", 2024-05-17T04:09:35.829 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2585363501 2024-05-17T04:09:35.829 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-17T04:09:35.829 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-17T04:09:35.830 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-05-17T04:09:35.830 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-05-17T04:09:35.830 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.2:0", 2024-05-17T04:09:35.830 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2585363501 2024-05-17T04:09:35.830 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-17T04:09:35.830 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4702 192.168.0.2:0/2585363501", 2024-05-17T04:09:35.830 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.2:0/2585363501", 2024-05-17T04:09:35.830 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2024-05-17T04:09:35.830 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 8, 2024-05-17T04:09:35.830 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 24, 2024-05-17T04:09:35.830 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2024-05-17T04:09:35.830 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2024-05-17T04:09:35.831 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2024-05-17T04:09:35.831 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-05-17T04:09:35.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:35.836 DEBUG:teuthology.orchestra.run.smithi131:> stat --file-system '--printf=%T 2024-05-17T04:09:35.836 DEBUG:teuthology.orchestra.run.smithi131:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-17T04:09:35.856 INFO:teuthology.orchestra.run.smithi131.stdout:fuseblk 2024-05-17T04:09:35.856 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-17T04:09:35.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:35.857 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-17T04:09:35.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:35.928 DEBUG:teuthology.orchestra.run.smithi131:> stat --file-system '--printf=%T 2024-05-17T04:09:35.928 DEBUG:teuthology.orchestra.run.smithi131:> ' -- /home/ubuntu/cephtest/mnt.2 2024-05-17T04:09:35.986 INFO:teuthology.orchestra.run.smithi131.stdout:fuseblk 2024-05-17T04:09:35.986 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-05-17T04:09:35.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:35.987 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-17T04:09:36.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:36.054 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2024-05-17T04:09:36.054 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.1 2024-05-17T04:09:36.066 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:09:36.070 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2024-05-17T04:09:36.071 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-05-17T04:09:36.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:36.071 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-17T04:09:36.098 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:09:36.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:36.137 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2024-05-17T04:09:36.137 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.3 2024-05-17T04:09:36.220 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2024-05-17T04:09:36.221 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-05-17T04:09:36.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:36.221 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-17T04:09:36.286 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-17T04:09:36.358 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-17T04:09:36.359 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:09:36.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.477+0000 7fbd1bbeb640 1 Processor -- start 2024-05-17T04:09:36.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.477+0000 7fbd1bbeb640 1 -- start start 2024-05-17T04:09:36.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.479+0000 7fbd1bbeb640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbd1406d100 0x7fbd140cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:36.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.479+0000 7fbd1bbeb640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd1406d830 con 0x7fbd14073e20 2024-05-17T04:09:36.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.479+0000 7fbd1bbeb640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd1406db10 con 0x7fbd14073300 2024-05-17T04:09:36.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.479+0000 7fbd1bbeb640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fbd140b4090 con 0x7fbd1406d100 2024-05-17T04:09:36.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.479+0000 7fbd1a188640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fbd14073e20 0x7fbd140b4520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:58732/0 (socket says 172.21.15.131:58732) 2024-05-17T04:09:36.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.479+0000 7fbd1a188640 1 -- 172.21.15.131:0/2427609674 learned_addr learned my addr 172.21.15.131:0/2427609674 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:36.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.479+0000 7fbd19987640 1 --2- 172.21.15.131:0/2427609674 >> v2:172.21.15.150:3300/0 conn(0x7fbd1406d100 0x7fbd140cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:36.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.479+0000 7fbd18985640 1 -- 172.21.15.131:0/2427609674 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610048901 0 0) 0x7fbd1406d830 con 0x7fbd14073e20 2024-05-17T04:09:36.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.479+0000 7fbd18985640 1 -- 172.21.15.131:0/2427609674 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcfc003520 con 0x7fbd14073e20 2024-05-17T04:09:36.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.479+0000 7fbd19987640 1 -- 172.21.15.131:0/2427609674 >> v1:172.21.15.150:6789/0 conn(0x7fbd14073300 legacy=0x7fbd14073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:36.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.479+0000 7fbd19987640 1 -- 172.21.15.131:0/2427609674 >> v1:172.21.15.131:6789/0 conn(0x7fbd14073e20 legacy=0x7fbd140b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:36.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.479+0000 7fbd18985640 1 -- 172.21.15.131:0/2427609674 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 903147879 0 0) 0x7fbd1406db10 con 0x7fbd14073300 2024-05-17T04:09:36.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.480+0000 7fbd19987640 1 -- 172.21.15.131:0/2427609674 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1406ddf0 con 0x7fbd1406d100 2024-05-17T04:09:36.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.480+0000 7fbd19987640 1 --2- 172.21.15.131:0/2427609674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd1406d100 0x7fbd140cd500 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00a940 tx=0x7fbd0c02b5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=872dc1697d353b33 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:36.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.480+0000 7fbd18985640 1 -- 172.21.15.131:0/2427609674 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00b040 con 0x7fbd1406d100 2024-05-17T04:09:36.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.480+0000 7fbd18985640 1 -- 172.21.15.131:0/2427609674 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0c030510 con 0x7fbd1406d100 2024-05-17T04:09:36.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.480+0000 7fbd18985640 1 -- 172.21.15.131:0/2427609674 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0308e0 con 0x7fbd1406d100 2024-05-17T04:09:36.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.481+0000 7fbd1bbeb640 1 -- 172.21.15.131:0/2427609674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd1406d100 msgr2=0x7fbd140cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:36.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.481+0000 7fbd1bbeb640 1 --2- 172.21.15.131:0/2427609674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd1406d100 0x7fbd140cd500 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00a940 tx=0x7fbd0c02b5e0 comp rx=0 tx=0).stop 2024-05-17T04:09:36.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.481+0000 7fbd1bbeb640 1 -- 172.21.15.131:0/2427609674 shutdown_connections 2024-05-17T04:09:36.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.481+0000 7fbd1bbeb640 1 --2- 172.21.15.131:0/2427609674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd1406d100 0x7fbd140cd500 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:36.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.481+0000 7fbd1bbeb640 1 -- 172.21.15.131:0/2427609674 >> 172.21.15.131:0/2427609674 conn(0x7fbd140b36d0 msgr2=0x7fbd140d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:36.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.481+0000 7fbd1bbeb640 1 -- 172.21.15.131:0/2427609674 shutdown_connections 2024-05-17T04:09:36.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.481+0000 7fbd1bbeb640 1 -- 172.21.15.131:0/2427609674 wait complete. 2024-05-17T04:09:36.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.483+0000 7fbd1bbeb640 1 Processor -- start 2024-05-17T04:09:36.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.483+0000 7fbd1bbeb640 1 -- start start 2024-05-17T04:09:36.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.484+0000 7fbd1bbeb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd1406d100 0x7fbd14140b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:36.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.484+0000 7fbd1bbeb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd14073300 0x7fbd1413bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:36.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.484+0000 7fbd1bbeb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd14073e20 0x7fbd1413d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:36.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.484+0000 7fbd1bbeb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbd140d1640 con 0x7fbd1406d100 2024-05-17T04:09:36.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.484+0000 7fbd1bbeb640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbd140d14c0 con 0x7fbd14073e20 2024-05-17T04:09:36.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.484+0000 7fbd1bbeb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbd140d17c0 con 0x7fbd14073300 2024-05-17T04:09:36.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.484+0000 7fbd19987640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd1406d100 0x7fbd14140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:36.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.484+0000 7fbd19987640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd1406d100 0x7fbd14140b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33296/0 (socket says 172.21.15.131:33296) 2024-05-17T04:09:36.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.484+0000 7fbd19987640 1 -- 172.21.15.131:0/3333903390 learned_addr learned my addr 172.21.15.131:0/3333903390 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:36.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.485+0000 7fbd1a188640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd14073e20 0x7fbd1413d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:36.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.485+0000 7fbd19186640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd14073300 0x7fbd1413bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:36.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.485+0000 7fbd19987640 1 -- 172.21.15.131:0/3333903390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd14073300 msgr2=0x7fbd1413bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:36.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.485+0000 7fbd19987640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd14073300 0x7fbd1413bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:36.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.485+0000 7fbd19987640 1 -- 172.21.15.131:0/3333903390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd14073e20 msgr2=0x7fbd1413d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:36.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.485+0000 7fbd19987640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd14073e20 0x7fbd1413d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:36.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.485+0000 7fbd19987640 1 -- 172.21.15.131:0/3333903390 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd14141080 con 0x7fbd1406d100 2024-05-17T04:09:36.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.485+0000 7fbd19186640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd14073300 0x7fbd1413bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:36.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.485+0000 7fbd1a188640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd14073e20 0x7fbd1413d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:36.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.485+0000 7fbd19987640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd1406d100 0x7fbd14140b40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00aa60 tx=0x7fbd0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:36.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.485+0000 7fbd127fc640 1 -- 172.21.15.131:0/3333903390 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c03b870 con 0x7fbd1406d100 2024-05-17T04:09:36.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.485+0000 7fbd127fc640 1 -- 172.21.15.131:0/3333903390 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0c040070 con 0x7fbd1406d100 2024-05-17T04:09:36.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.485+0000 7fbd127fc640 1 -- 172.21.15.131:0/3333903390 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c03bc50 con 0x7fbd1406d100 2024-05-17T04:09:36.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.485+0000 7fbd1bbeb640 1 -- 172.21.15.131:0/3333903390 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd1415b920 con 0x7fbd1406d100 2024-05-17T04:09:36.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.485+0000 7fbd1bbeb640 1 -- 172.21.15.131:0/3333903390 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd1415bee0 con 0x7fbd1406d100 2024-05-17T04:09:36.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.486+0000 7fbd1bbeb640 1 -- 172.21.15.131:0/3333903390 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd140cd500 con 0x7fbd1406d100 2024-05-17T04:09:36.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.487+0000 7fbd127fc640 1 -- 172.21.15.131:0/3333903390 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbd0c045460 con 0x7fbd1406d100 2024-05-17T04:09:36.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.487+0000 7fbd127fc640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbd000762d0 0x7fbd000787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:36.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.487+0000 7fbd127fc640 1 -- 172.21.15.131:0/3333903390 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbd0c0b80b0 con 0x7fbd1406d100 2024-05-17T04:09:36.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.487+0000 7fbd19186640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbd000762d0 0x7fbd000787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:36.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.488+0000 7fbd19186640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbd000762d0 0x7fbd000787e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd14144d60 tx=0x7fbd08009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:36.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.492+0000 7fbd127fc640 1 -- 172.21.15.131:0/3333903390 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbd0c00a020 con 0x7fbd1406d100 2024-05-17T04:09:36.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.673+0000 7fbd1bbeb640 1 -- 172.21.15.131:0/3333903390 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd14068dd0 con 0x7fbd1406d100 2024-05-17T04:09:36.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.674+0000 7fbd127fc640 1 -- 172.21.15.131:0/3333903390 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fbd0c081650 con 0x7fbd1406d100 2024-05-17T04:09:36.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:36.675 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":24,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:09:10.777455+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:03.633460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:04.707669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-17T04:09:08.400498+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:09:36.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.676+0000 7fbd1bbeb640 1 -- 172.21.15.131:0/3333903390 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbd000762d0 msgr2=0x7fbd000787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:36.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.676+0000 7fbd1bbeb640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbd000762d0 0x7fbd000787e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd14144d60 tx=0x7fbd08009040 comp rx=0 tx=0).stop 2024-05-17T04:09:36.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.676+0000 7fbd1bbeb640 1 -- 172.21.15.131:0/3333903390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd1406d100 msgr2=0x7fbd14140b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:36.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.676+0000 7fbd1bbeb640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd1406d100 0x7fbd14140b40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00aa60 tx=0x7fbd0c004730 comp rx=0 tx=0).stop 2024-05-17T04:09:36.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.676+0000 7fbd1bbeb640 1 -- 172.21.15.131:0/3333903390 shutdown_connections 2024-05-17T04:09:36.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.676+0000 7fbd1bbeb640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbd000762d0 0x7fbd000787e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:36.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.676+0000 7fbd1bbeb640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd14073e20 0x7fbd1413d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:36.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.676+0000 7fbd1bbeb640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd14073300 0x7fbd1413bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:36.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.676+0000 7fbd1bbeb640 1 --2- 172.21.15.131:0/3333903390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd1406d100 0x7fbd14140b40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:36.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.676+0000 7fbd1bbeb640 1 -- 172.21.15.131:0/3333903390 >> 172.21.15.131:0/3333903390 conn(0x7fbd140b36d0 msgr2=0x7fbd141422f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:36.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.676+0000 7fbd1bbeb640 1 -- 172.21.15.131:0/3333903390 shutdown_connections 2024-05-17T04:09:36.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.676+0000 7fbd1bbeb640 1 -- 172.21.15.131:0/3333903390 wait complete. 2024-05-17T04:09:36.689 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-17T04:08:54.724090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-17T04:09:03.633460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-17T04:09:04.707669+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-17T04:09:08.400498+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-17T04:09:36.689 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-17T04:09:36.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.804+0000 7fa36939f640 1 Processor -- start 2024-05-17T04:09:36.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.804+0000 7fa36939f640 1 -- start start 2024-05-17T04:09:36.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.805+0000 7fa36939f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa36415f810 0x7fa3640d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:36.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.805+0000 7fa36939f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa3640b8870 0x7fa3640b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:36.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.805+0000 7fa36939f640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa36406ca90 con 0x7fa3640d3ed0 2024-05-17T04:09:36.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.805+0000 7fa36939f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa3640d0d70 con 0x7fa3640b8870 2024-05-17T04:09:36.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.805+0000 7fa36939f640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa36406cd70 con 0x7fa36415f810 2024-05-17T04:09:36.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.806+0000 7fa35bfff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa3640b8870 0x7fa3640b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:36.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.806+0000 7fa35bfff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa3640b8870 0x7fa3640b8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33302/0 (socket says 172.21.15.131:33302) 2024-05-17T04:09:36.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.806+0000 7fa35bfff640 1 -- 172.21.15.131:0/1177616345 learned_addr learned my addr 172.21.15.131:0/1177616345 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:36.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.806+0000 7fa362ffd640 1 --2- 172.21.15.131:0/1177616345 >> v2:172.21.15.150:3300/0 conn(0x7fa36415f810 0x7fa3640d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:36.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.806+0000 7fa35bfff640 1 -- 172.21.15.131:0/1177616345 >> v2:172.21.15.150:3300/0 conn(0x7fa36415f810 msgr2=0x7fa3640d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:36.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.806+0000 7fa35bfff640 1 --2- 172.21.15.131:0/1177616345 >> v2:172.21.15.150:3300/0 conn(0x7fa36415f810 0x7fa3640d0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:36.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.806+0000 7fa35bfff640 1 -- 172.21.15.131:0/1177616345 >> v1:172.21.15.150:6789/0 conn(0x7fa3640d3ed0 legacy=0x7fa3640d42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:36.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.806+0000 7fa35bfff640 1 -- 172.21.15.131:0/1177616345 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36406d050 con 0x7fa3640b8870 2024-05-17T04:09:36.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.806+0000 7fa362ffd640 1 --2- 172.21.15.131:0/1177616345 >> v2:172.21.15.150:3300/0 conn(0x7fa36415f810 0x7fa3640d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:36.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.807+0000 7fa35bfff640 1 --2- 172.21.15.131:0/1177616345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3640b8870 0x7fa3640b8c80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa36408e200 tx=0x7fa34c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe801a9e9eaae627 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:36.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.807+0000 7fa3627fc640 1 -- 172.21.15.131:0/1177616345 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c037070 con 0x7fa3640b8870 2024-05-17T04:09:36.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.807+0000 7fa3627fc640 1 -- 172.21.15.131:0/1177616345 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa34c032440 con 0x7fa3640b8870 2024-05-17T04:09:36.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.807+0000 7fa3627fc640 1 -- 172.21.15.131:0/1177616345 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c032810 con 0x7fa3640b8870 2024-05-17T04:09:36.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.808+0000 7fa36939f640 1 -- 172.21.15.131:0/1177616345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3640b8870 msgr2=0x7fa3640b8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:36.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.808+0000 7fa36939f640 1 --2- 172.21.15.131:0/1177616345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3640b8870 0x7fa3640b8c80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa36408e200 tx=0x7fa34c02a270 comp rx=0 tx=0).stop 2024-05-17T04:09:36.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.808+0000 7fa36939f640 1 -- 172.21.15.131:0/1177616345 shutdown_connections 2024-05-17T04:09:36.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.808+0000 7fa36939f640 1 --2- 172.21.15.131:0/1177616345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3640b8870 0x7fa3640b8c80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:36.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.808+0000 7fa36939f640 1 --2- 172.21.15.131:0/1177616345 >> v2:172.21.15.150:3300/0 conn(0x7fa36415f810 0x7fa3640d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:36.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.808+0000 7fa36939f640 1 -- 172.21.15.131:0/1177616345 >> 172.21.15.131:0/1177616345 conn(0x7fa3640d59a0 msgr2=0x7fa3640b6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:36.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.808+0000 7fa36939f640 1 -- 172.21.15.131:0/1177616345 shutdown_connections 2024-05-17T04:09:36.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.808+0000 7fa36939f640 1 -- 172.21.15.131:0/1177616345 wait complete. 2024-05-17T04:09:36.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.809+0000 7fa36939f640 1 Processor -- start 2024-05-17T04:09:36.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.809+0000 7fa36939f640 1 -- start start 2024-05-17T04:09:36.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa36939f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3640b8870 0x7fa3641ea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:36.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa36939f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3640d3ed0 0x7fa3641525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:36.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa36939f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa36415f810 0x7fa364156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:36.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa36939f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa36406c6f0 con 0x7fa36415f810 2024-05-17T04:09:36.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa36939f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa36406d610 con 0x7fa3640d3ed0 2024-05-17T04:09:36.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa36939f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa36406c870 con 0x7fa3640b8870 2024-05-17T04:09:36.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa3637fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa36415f810 0x7fa364156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:36.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa3637fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa36415f810 0x7fa364156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33306/0 (socket says 172.21.15.131:33306) 2024-05-17T04:09:36.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa3637fe640 1 -- 172.21.15.131:0/3281322215 learned_addr learned my addr 172.21.15.131:0/3281322215 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:36.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa35bfff640 1 --2- 172.21.15.131:0/3281322215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3640d3ed0 0x7fa3641525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:36.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa362ffd640 1 --2- 172.21.15.131:0/3281322215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3640b8870 0x7fa3641ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:36.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa3637fe640 1 -- 172.21.15.131:0/3281322215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3640b8870 msgr2=0x7fa3641ea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:36.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa3637fe640 1 --2- 172.21.15.131:0/3281322215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3640b8870 0x7fa3641ea6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:36.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa3637fe640 1 -- 172.21.15.131:0/3281322215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3640d3ed0 msgr2=0x7fa3641525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:36.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa3637fe640 1 --2- 172.21.15.131:0/3281322215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3640d3ed0 0x7fa3641525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:36.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa3637fe640 1 -- 172.21.15.131:0/3281322215 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa364158d70 con 0x7fa36415f810 2024-05-17T04:09:36.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa3637fe640 1 --2- 172.21.15.131:0/3281322215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa36415f810 0x7fa364156440 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00c700 tx=0x7fa35c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:36.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa35b7fe640 1 -- 172.21.15.131:0/3281322215 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c003b70 con 0x7fa36415f810 2024-05-17T04:09:36.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa35b7fe640 1 -- 172.21.15.131:0/3281322215 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa35c003d10 con 0x7fa36415f810 2024-05-17T04:09:36.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa36939f640 1 -- 172.21.15.131:0/3281322215 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa364159050 con 0x7fa36415f810 2024-05-17T04:09:36.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.811+0000 7fa35b7fe640 1 -- 172.21.15.131:0/3281322215 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c00aa50 con 0x7fa36415f810 2024-05-17T04:09:36.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.812+0000 7fa36939f640 1 -- 172.21.15.131:0/3281322215 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa364156f80 con 0x7fa36415f810 2024-05-17T04:09:36.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.812+0000 7fa36939f640 1 -- 172.21.15.131:0/3281322215 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa364068dd0 con 0x7fa36415f810 2024-05-17T04:09:36.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.813+0000 7fa35b7fe640 1 -- 172.21.15.131:0/3281322215 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa35c00abf0 con 0x7fa36415f810 2024-05-17T04:09:36.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.814+0000 7fa35b7fe640 1 --2- 172.21.15.131:0/3281322215 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa344076300 0x7fa344078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:36.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.814+0000 7fa35b7fe640 1 -- 172.21.15.131:0/3281322215 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa35c0975d0 con 0x7fa36415f810 2024-05-17T04:09:36.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.814+0000 7fa362ffd640 1 --2- 172.21.15.131:0/3281322215 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa344076300 0x7fa344078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:36.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.814+0000 7fa362ffd640 1 --2- 172.21.15.131:0/3281322215 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa344076300 0x7fa344078810 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa354006fd0 tx=0x7fa354008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:36.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.819+0000 7fa35b7fe640 1 -- 172.21.15.131:0/3281322215 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa364068dd0 con 0x7fa36415f810 2024-05-17T04:09:36.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.996+0000 7fa36939f640 1 -- 172.21.15.131:0/3281322215 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa364153a50 con 0x7fa36415f810 2024-05-17T04:09:36.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.997+0000 7fa35b7fe640 1 -- 172.21.15.131:0/3281322215 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fa35c060630 con 0x7fa36415f810 2024-05-17T04:09:36.998 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-05-17T04:09:37.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.999+0000 7fa36939f640 1 -- 172.21.15.131:0/3281322215 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa344076300 msgr2=0x7fa344078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.999+0000 7fa36939f640 1 --2- 172.21.15.131:0/3281322215 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa344076300 0x7fa344078810 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa354006fd0 tx=0x7fa354008040 comp rx=0 tx=0).stop 2024-05-17T04:09:37.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.999+0000 7fa36939f640 1 -- 172.21.15.131:0/3281322215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa36415f810 msgr2=0x7fa364156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.999+0000 7fa36939f640 1 --2- 172.21.15.131:0/3281322215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa36415f810 0x7fa364156440 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00c700 tx=0x7fa35c00cbc0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.999+0000 7fa36939f640 1 -- 172.21.15.131:0/3281322215 shutdown_connections 2024-05-17T04:09:37.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.999+0000 7fa36939f640 1 --2- 172.21.15.131:0/3281322215 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa344076300 0x7fa344078810 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.999+0000 7fa36939f640 1 --2- 172.21.15.131:0/3281322215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa36415f810 0x7fa364156440 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.999+0000 7fa36939f640 1 --2- 172.21.15.131:0/3281322215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3640d3ed0 0x7fa3641525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.999+0000 7fa36939f640 1 --2- 172.21.15.131:0/3281322215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3640b8870 0x7fa3641ea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.999+0000 7fa36939f640 1 -- 172.21.15.131:0/3281322215 >> 172.21.15.131:0/3281322215 conn(0x7fa3640d59a0 msgr2=0x7fa3641554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:37.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.999+0000 7fa36939f640 1 -- 172.21.15.131:0/3281322215 shutdown_connections 2024-05-17T04:09:37.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:36.999+0000 7fa36939f640 1 -- 172.21.15.131:0/3281322215 wait complete. 2024-05-17T04:09:37.011 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-17T04:09:37.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.125+0000 7f52efdd2640 1 Processor -- start 2024-05-17T04:09:37.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.125+0000 7f52efdd2640 1 -- start start 2024-05-17T04:09:37.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.125+0000 7f52efdd2640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f52e80d29b0 0x7f52e8161910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.125+0000 7f52efdd2640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e8161130 con 0x7f52e815d760 2024-05-17T04:09:37.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.125+0000 7f52efdd2640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e80b3320 con 0x7f52e80cfcc0 2024-05-17T04:09:37.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.125+0000 7f52efdd2640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f52e80b3600 con 0x7f52e80d29b0 2024-05-17T04:09:37.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.125+0000 7f52edb6e640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f52e815d760 0x7f52e80b2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:58736/0 (socket says 172.21.15.131:58736) 2024-05-17T04:09:37.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.125+0000 7f52ed36d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f52e80d29b0 0x7f52e8161910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.125+0000 7f52edb6e640 1 -- 172.21.15.131:0/551267897 learned_addr learned my addr 172.21.15.131:0/551267897 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:37.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.126+0000 7f52ed36d640 1 -- 172.21.15.131:0/551267897 >> v1:172.21.15.150:6789/0 conn(0x7f52e80cfcc0 legacy=0x7f52e80d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.126+0000 7f52ed36d640 1 -- 172.21.15.131:0/551267897 >> v1:172.21.15.131:6789/0 conn(0x7f52e815d760 legacy=0x7f52e80b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.126+0000 7f52ed36d640 1 -- 172.21.15.131:0/551267897 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e80b38e0 con 0x7f52e80d29b0 2024-05-17T04:09:37.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.126+0000 7f52ed36d640 1 --2- 172.21.15.131:0/551267897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80d29b0 0x7f52e8161910 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f52d80097a0 tx=0x7f52d802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a95ff1f30eaa398 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:37.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.126+0000 7f52ecb6c640 1 -- 172.21.15.131:0/551267897 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8037070 con 0x7f52e80d29b0 2024-05-17T04:09:37.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.127+0000 7f52ecb6c640 1 -- 172.21.15.131:0/551267897 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d8032440 con 0x7f52e80d29b0 2024-05-17T04:09:37.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.127+0000 7f52ecb6c640 1 -- 172.21.15.131:0/551267897 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8032810 con 0x7f52e80d29b0 2024-05-17T04:09:37.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.127+0000 7f52efdd2640 1 -- 172.21.15.131:0/551267897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80d29b0 msgr2=0x7f52e8161910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.127+0000 7f52efdd2640 1 --2- 172.21.15.131:0/551267897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80d29b0 0x7f52e8161910 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f52d80097a0 tx=0x7f52d802a230 comp rx=0 tx=0).stop 2024-05-17T04:09:37.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.127+0000 7f52efdd2640 1 -- 172.21.15.131:0/551267897 shutdown_connections 2024-05-17T04:09:37.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.127+0000 7f52efdd2640 1 --2- 172.21.15.131:0/551267897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80d29b0 0x7f52e8161910 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.127+0000 7f52efdd2640 1 -- 172.21.15.131:0/551267897 >> 172.21.15.131:0/551267897 conn(0x7f52e80b4e40 msgr2=0x7f52e80b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:37.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.127+0000 7f52efdd2640 1 -- 172.21.15.131:0/551267897 shutdown_connections 2024-05-17T04:09:37.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.127+0000 7f52efdd2640 1 -- 172.21.15.131:0/551267897 wait complete. 2024-05-17T04:09:37.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.129+0000 7f52efdd2640 1 Processor -- start 2024-05-17T04:09:37.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.129+0000 7f52efdd2640 1 -- start start 2024-05-17T04:09:37.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.130+0000 7f52efdd2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52e80cfcc0 0x7f52e80c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.130+0000 7f52efdd2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80d29b0 0x7f52e815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.130+0000 7f52efdd2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52e815d760 0x7f52e81fd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.130+0000 7f52efdd2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f52e8161fd0 con 0x7f52e80d29b0 2024-05-17T04:09:37.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52efdd2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f52e8161e50 con 0x7f52e80cfcc0 2024-05-17T04:09:37.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52efdd2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f52e80b5f60 con 0x7f52e815d760 2024-05-17T04:09:37.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52ed36d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80d29b0 0x7f52e815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52ed36d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80d29b0 0x7f52e815a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33332/0 (socket says 172.21.15.131:33332) 2024-05-17T04:09:37.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52ed36d640 1 -- 172.21.15.131:0/371209882 learned_addr learned my addr 172.21.15.131:0/371209882 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:37.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52edb6e640 1 --2- 172.21.15.131:0/371209882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52e80cfcc0 0x7f52e80c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52ee36f640 1 --2- 172.21.15.131:0/371209882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52e815d760 0x7f52e81fd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52ed36d640 1 -- 172.21.15.131:0/371209882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52e815d760 msgr2=0x7f52e81fd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52ed36d640 1 --2- 172.21.15.131:0/371209882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52e815d760 0x7f52e81fd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52ed36d640 1 -- 172.21.15.131:0/371209882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52e80cfcc0 msgr2=0x7f52e80c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52ed36d640 1 --2- 172.21.15.131:0/371209882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52e80cfcc0 0x7f52e80c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52ed36d640 1 -- 172.21.15.131:0/371209882 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e80cc4c0 con 0x7f52e80d29b0 2024-05-17T04:09:37.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52ed36d640 1 --2- 172.21.15.131:0/371209882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80d29b0 0x7f52e815a3e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f52d80098c0 tx=0x7f52d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:37.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52de7fc640 1 -- 172.21.15.131:0/371209882 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8037040 con 0x7f52e80d29b0 2024-05-17T04:09:37.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52de7fc640 1 -- 172.21.15.131:0/371209882 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d8030770 con 0x7f52e80d29b0 2024-05-17T04:09:37.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52efdd2640 1 -- 172.21.15.131:0/371209882 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e80cc7a0 con 0x7f52e80d29b0 2024-05-17T04:09:37.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52de7fc640 1 -- 172.21.15.131:0/371209882 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8030b40 con 0x7f52e80d29b0 2024-05-17T04:09:37.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.131+0000 7f52efdd2640 1 -- 172.21.15.131:0/371209882 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e80ccd60 con 0x7f52e80d29b0 2024-05-17T04:09:37.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.132+0000 7f52efdd2640 1 -- 172.21.15.131:0/371209882 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e80cc230 con 0x7f52e80d29b0 2024-05-17T04:09:37.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.133+0000 7f52de7fc640 1 -- 172.21.15.131:0/371209882 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f52d8044020 con 0x7f52e80d29b0 2024-05-17T04:09:37.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.133+0000 7f52de7fc640 1 --2- 172.21.15.131:0/371209882 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f52cc0762d0 0x7f52cc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.134+0000 7f52de7fc640 1 -- 172.21.15.131:0/371209882 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f52d80b7f80 con 0x7f52e80d29b0 2024-05-17T04:09:37.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.134+0000 7f52edb6e640 1 --2- 172.21.15.131:0/371209882 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f52cc0762d0 0x7f52cc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.134+0000 7f52edb6e640 1 --2- 172.21.15.131:0/371209882 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f52cc0762d0 0x7f52cc0787e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f52e4000f60 tx=0x7f52e4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:37.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.138+0000 7f52de7fc640 1 -- 172.21.15.131:0/371209882 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f52d8032e20 con 0x7f52e80d29b0 2024-05-17T04:09:37.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.318+0000 7f52efdd2640 1 -- 172.21.15.131:0/371209882 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f52e80ccfa0 con 0x7f52e80d29b0 2024-05-17T04:09:37.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.320+0000 7f52de7fc640 1 -- 172.21.15.131:0/371209882 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f52e80ccfa0 con 0x7f52e80d29b0 2024-05-17T04:09:37.320 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-05-17T04:09:37.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.322+0000 7f52efdd2640 1 -- 172.21.15.131:0/371209882 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f52cc0762d0 msgr2=0x7f52cc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.322+0000 7f52efdd2640 1 --2- 172.21.15.131:0/371209882 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f52cc0762d0 0x7f52cc0787e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f52e4000f60 tx=0x7f52e4009040 comp rx=0 tx=0).stop 2024-05-17T04:09:37.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.322+0000 7f52efdd2640 1 -- 172.21.15.131:0/371209882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80d29b0 msgr2=0x7f52e815a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.322+0000 7f52efdd2640 1 --2- 172.21.15.131:0/371209882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80d29b0 0x7f52e815a3e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f52d80098c0 tx=0x7f52d80046c0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.322+0000 7f52efdd2640 1 -- 172.21.15.131:0/371209882 shutdown_connections 2024-05-17T04:09:37.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.322+0000 7f52efdd2640 1 --2- 172.21.15.131:0/371209882 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f52cc0762d0 0x7f52cc0787e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.322+0000 7f52efdd2640 1 --2- 172.21.15.131:0/371209882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80d29b0 0x7f52e815a3e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.322+0000 7f52efdd2640 1 --2- 172.21.15.131:0/371209882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52e815d760 0x7f52e81fd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.322+0000 7f52efdd2640 1 --2- 172.21.15.131:0/371209882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52e80cfcc0 0x7f52e80c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.322+0000 7f52efdd2640 1 -- 172.21.15.131:0/371209882 >> 172.21.15.131:0/371209882 conn(0x7f52e80b4e40 msgr2=0x7f52e80b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:37.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.322+0000 7f52efdd2640 1 -- 172.21.15.131:0/371209882 shutdown_connections 2024-05-17T04:09:37.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.322+0000 7f52efdd2640 1 -- 172.21.15.131:0/371209882 wait complete. 2024-05-17T04:09:37.333 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-17T04:09:37.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.448+0000 7fe3bae9e640 1 Processor -- start 2024-05-17T04:09:37.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.448+0000 7fe3bae9e640 1 -- start start 2024-05-17T04:09:37.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.449+0000 7fe3bae9e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe3b40cf4c0 0x7fe3b415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.449+0000 7fe3bae9e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b40cfa10 0x7fe3b40cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.449+0000 7fe3bae9e640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b40d0360 con 0x7fe3b40d1510 2024-05-17T04:09:37.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.449+0000 7fe3bae9e640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe3b40c8ac0 con 0x7fe3b40cf4c0 2024-05-17T04:09:37.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.449+0000 7fe3bae9e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe3b40cd7b0 con 0x7fe3b40cfa10 2024-05-17T04:09:37.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.449+0000 7fe3b3fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe3b40cf4c0 0x7fe3b415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.449+0000 7fe3b3fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe3b40cf4c0 0x7fe3b415d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33336/0 (socket says 172.21.15.131:33336) 2024-05-17T04:09:37.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.449+0000 7fe3b3fff640 1 -- 172.21.15.131:0/898517161 learned_addr learned my addr 172.21.15.131:0/898517161 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:37.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.450+0000 7fe3b943b640 1 --2- 172.21.15.131:0/898517161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b40cfa10 0x7fe3b40cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.450+0000 7fe3b3fff640 1 -- 172.21.15.131:0/898517161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b40cfa10 msgr2=0x7fe3b40cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:37.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.450+0000 7fe3b3fff640 1 --2- 172.21.15.131:0/898517161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b40cfa10 0x7fe3b40cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.450+0000 7fe3b3fff640 1 -- 172.21.15.131:0/898517161 >> v1:172.21.15.150:6789/0 conn(0x7fe3b40d1510 legacy=0x7fe3b40c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.450+0000 7fe3b3fff640 1 -- 172.21.15.131:0/898517161 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b40720e0 con 0x7fe3b40cf4c0 2024-05-17T04:09:37.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.450+0000 7fe3b943b640 1 --2- 172.21.15.131:0/898517161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b40cfa10 0x7fe3b40cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:37.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.450+0000 7fe3b3fff640 1 --2- 172.21.15.131:0/898517161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3b40cf4c0 0x7fe3b415d4f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009870 tx=0x7fe3a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535f723d710dda65 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:37.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.451+0000 7fe3b37fe640 1 -- 172.21.15.131:0/898517161 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0037070 con 0x7fe3b40cf4c0 2024-05-17T04:09:37.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.451+0000 7fe3b37fe640 1 -- 172.21.15.131:0/898517161 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3a0032440 con 0x7fe3b40cf4c0 2024-05-17T04:09:37.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.451+0000 7fe3b37fe640 1 -- 172.21.15.131:0/898517161 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0032810 con 0x7fe3b40cf4c0 2024-05-17T04:09:37.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.451+0000 7fe3bae9e640 1 -- 172.21.15.131:0/898517161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3b40cf4c0 msgr2=0x7fe3b415d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.451+0000 7fe3bae9e640 1 --2- 172.21.15.131:0/898517161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3b40cf4c0 0x7fe3b415d4f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009870 tx=0x7fe3a002a270 comp rx=0 tx=0).stop 2024-05-17T04:09:37.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.451+0000 7fe3bae9e640 1 -- 172.21.15.131:0/898517161 shutdown_connections 2024-05-17T04:09:37.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.451+0000 7fe3bae9e640 1 --2- 172.21.15.131:0/898517161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b40cfa10 0x7fe3b40cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.451+0000 7fe3bae9e640 1 --2- 172.21.15.131:0/898517161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3b40cf4c0 0x7fe3b415d4f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.451+0000 7fe3bae9e640 1 -- 172.21.15.131:0/898517161 >> 172.21.15.131:0/898517161 conn(0x7fe3b40b4cd0 msgr2=0x7fe3b40b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:37.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.451+0000 7fe3bae9e640 1 -- 172.21.15.131:0/898517161 shutdown_connections 2024-05-17T04:09:37.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.451+0000 7fe3bae9e640 1 -- 172.21.15.131:0/898517161 wait complete. 2024-05-17T04:09:37.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.453+0000 7fe3bae9e640 1 Processor -- start 2024-05-17T04:09:37.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.453+0000 7fe3bae9e640 1 -- start start 2024-05-17T04:09:37.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.454+0000 7fe3bae9e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b40cf4c0 0x7fe3b4151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.454+0000 7fe3bae9e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3b40cfa10 0x7fe3b41e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.454+0000 7fe3bae9e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b40d1510 0x7fe3b41e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3bae9e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b40cefa0 con 0x7fe3b40cfa10 2024-05-17T04:09:37.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3bae9e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b40723c0 con 0x7fe3b40d1510 2024-05-17T04:09:37.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3bae9e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe3b40cdf90 con 0x7fe3b40cf4c0 2024-05-17T04:09:37.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3b3fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3b40cfa10 0x7fe3b41e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3b3fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3b40cfa10 0x7fe3b41e6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33352/0 (socket says 172.21.15.131:33352) 2024-05-17T04:09:37.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3b3fff640 1 -- 172.21.15.131:0/1435282685 learned_addr learned my addr 172.21.15.131:0/1435282685 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:37.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3b943b640 1 --2- 172.21.15.131:0/1435282685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b40d1510 0x7fe3b41e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3b8c3a640 1 --2- 172.21.15.131:0/1435282685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b40cf4c0 0x7fe3b4151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3b3fff640 1 -- 172.21.15.131:0/1435282685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b40cf4c0 msgr2=0x7fe3b4151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3b3fff640 1 --2- 172.21.15.131:0/1435282685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b40cf4c0 0x7fe3b4151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3b3fff640 1 -- 172.21.15.131:0/1435282685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b40d1510 msgr2=0x7fe3b41e7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3b3fff640 1 --2- 172.21.15.131:0/1435282685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b40d1510 0x7fe3b41e7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3b3fff640 1 -- 172.21.15.131:0/1435282685 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b41e7c70 con 0x7fe3b40cfa10 2024-05-17T04:09:37.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3b3fff640 1 --2- 172.21.15.131:0/1435282685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3b40cfa10 0x7fe3b41e6e40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0000c00 tx=0x7fe3a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:37.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3b17fa640 1 -- 172.21.15.131:0/1435282685 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0041020 con 0x7fe3b40cfa10 2024-05-17T04:09:37.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3b17fa640 1 -- 172.21.15.131:0/1435282685 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3a00306c0 con 0x7fe3b40cfa10 2024-05-17T04:09:37.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3bae9e640 1 -- 172.21.15.131:0/1435282685 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b40cabf0 con 0x7fe3b40cfa10 2024-05-17T04:09:37.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3b17fa640 1 -- 172.21.15.131:0/1435282685 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0037040 con 0x7fe3b40cfa10 2024-05-17T04:09:37.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.455+0000 7fe3bae9e640 1 -- 172.21.15.131:0/1435282685 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b40cb1b0 con 0x7fe3b40cfa10 2024-05-17T04:09:37.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.456+0000 7fe3bae9e640 1 -- 172.21.15.131:0/1435282685 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b415d4f0 con 0x7fe3b40cfa10 2024-05-17T04:09:37.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.457+0000 7fe3b17fa640 1 -- 172.21.15.131:0/1435282685 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe3a0044020 con 0x7fe3b40cfa10 2024-05-17T04:09:37.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.458+0000 7fe3b17fa640 1 --2- 172.21.15.131:0/1435282685 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe3980762d0 0x7fe3980787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.458+0000 7fe3b17fa640 1 -- 172.21.15.131:0/1435282685 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe3a00b81a0 con 0x7fe3b40cfa10 2024-05-17T04:09:37.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.458+0000 7fe3b8c3a640 1 --2- 172.21.15.131:0/1435282685 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe3980762d0 0x7fe3980787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.458+0000 7fe3b8c3a640 1 --2- 172.21.15.131:0/1435282685 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe3980762d0 0x7fe3980787e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80015e0 tx=0x7fe3a8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:37.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.462+0000 7fe3b17fa640 1 -- 172.21.15.131:0/1435282685 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe3a004b030 con 0x7fe3b40cfa10 2024-05-17T04:09:37.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.642+0000 7fe3bae9e640 1 -- 172.21.15.131:0/1435282685 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe3b40ccb60 con 0x7fe3b40cfa10 2024-05-17T04:09:37.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.642+0000 7fe3b17fa640 1 -- 172.21.15.131:0/1435282685 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fe3b41e7c70 con 0x7fe3b40cfa10 2024-05-17T04:09:37.643 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-05-17T04:09:37.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.644+0000 7fe3bae9e640 1 -- 172.21.15.131:0/1435282685 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe3980762d0 msgr2=0x7fe3980787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.644+0000 7fe3bae9e640 1 --2- 172.21.15.131:0/1435282685 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe3980762d0 0x7fe3980787e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80015e0 tx=0x7fe3a8009040 comp rx=0 tx=0).stop 2024-05-17T04:09:37.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.644+0000 7fe3bae9e640 1 -- 172.21.15.131:0/1435282685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3b40cfa10 msgr2=0x7fe3b41e6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.644+0000 7fe3bae9e640 1 --2- 172.21.15.131:0/1435282685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3b40cfa10 0x7fe3b41e6e40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0000c00 tx=0x7fe3a00046c0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.645+0000 7fe3bae9e640 1 -- 172.21.15.131:0/1435282685 shutdown_connections 2024-05-17T04:09:37.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.645+0000 7fe3bae9e640 1 --2- 172.21.15.131:0/1435282685 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe3980762d0 0x7fe3980787e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.645+0000 7fe3bae9e640 1 --2- 172.21.15.131:0/1435282685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3b40cfa10 0x7fe3b41e6e40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.645+0000 7fe3bae9e640 1 --2- 172.21.15.131:0/1435282685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b40d1510 0x7fe3b41e7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.645+0000 7fe3bae9e640 1 --2- 172.21.15.131:0/1435282685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b40cf4c0 0x7fe3b4151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.645+0000 7fe3bae9e640 1 -- 172.21.15.131:0/1435282685 >> 172.21.15.131:0/1435282685 conn(0x7fe3b40b4cd0 msgr2=0x7fe3b40b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:37.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.645+0000 7fe3bae9e640 1 -- 172.21.15.131:0/1435282685 shutdown_connections 2024-05-17T04:09:37.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.645+0000 7fe3bae9e640 1 -- 172.21.15.131:0/1435282685 wait complete. 2024-05-17T04:09:37.656 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-17T04:09:37.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.770+0000 7fa209b3c640 1 Processor -- start 2024-05-17T04:09:37.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.770+0000 7fa209b3c640 1 -- start start 2024-05-17T04:09:37.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.772+0000 7fa209b3c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2040afcb0 0x7fa2040b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.772+0000 7fa209b3c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa2040b1270 0x7fa20406c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.772+0000 7fa209b3c640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2040b1680 con 0x7fa20415f6b0 2024-05-17T04:09:37.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.772+0000 7fa209b3c640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa20415fac0 con 0x7fa2040b1270 2024-05-17T04:09:37.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.772+0000 7fa209b3c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa2040b4440 con 0x7fa2040afcb0 2024-05-17T04:09:37.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.772+0000 7fa202ffd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2040afcb0 0x7fa2040b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.772+0000 7fa203fff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa2040b1270 0x7fa20406c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.772+0000 7fa202ffd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2040afcb0 0x7fa2040b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:60448/0 (socket says 172.21.15.131:60448) 2024-05-17T04:09:37.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.772+0000 7fa202ffd640 1 -- 172.21.15.131:0/614594065 learned_addr learned my addr 172.21.15.131:0/614594065 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:37.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.772+0000 7fa2037fe640 1 --1- 172.21.15.131:0/614594065 >> v1:172.21.15.150:6789/0 conn(0x7fa20415f6b0 0x7fa2040b3d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:60054/0 (socket says 172.21.15.131:60054) 2024-05-17T04:09:37.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.772+0000 7fa202ffd640 1 -- 172.21.15.131:0/614594065 >> v2:172.21.15.150:3300/0 conn(0x7fa2040b1270 msgr2=0x7fa20406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:37.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.772+0000 7fa202ffd640 1 --2- 172.21.15.131:0/614594065 >> v2:172.21.15.150:3300/0 conn(0x7fa2040b1270 0x7fa20406c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.772+0000 7fa202ffd640 1 -- 172.21.15.131:0/614594065 >> v1:172.21.15.150:6789/0 conn(0x7fa20415f6b0 legacy=0x7fa2040b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.772+0000 7fa202ffd640 1 -- 172.21.15.131:0/614594065 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2040aec10 con 0x7fa2040afcb0 2024-05-17T04:09:37.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.772+0000 7fa203fff640 1 --2- 172.21.15.131:0/614594065 >> v2:172.21.15.150:3300/0 conn(0x7fa2040b1270 0x7fa20406c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:37.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.773+0000 7fa202ffd640 1 --2- 172.21.15.131:0/614594065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2040afcb0 0x7fa2040b0d30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009e50 tx=0x7fa1f802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74a7303646019328 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:37.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.773+0000 7fa2027fc640 1 -- 172.21.15.131:0/614594065 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8036070 con 0x7fa2040afcb0 2024-05-17T04:09:37.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.773+0000 7fa2027fc640 1 -- 172.21.15.131:0/614594065 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f8031600 con 0x7fa2040afcb0 2024-05-17T04:09:37.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.773+0000 7fa2027fc640 1 -- 172.21.15.131:0/614594065 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80319d0 con 0x7fa2040afcb0 2024-05-17T04:09:37.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.774+0000 7fa209b3c640 1 -- 172.21.15.131:0/614594065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2040afcb0 msgr2=0x7fa2040b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.774+0000 7fa209b3c640 1 --2- 172.21.15.131:0/614594065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2040afcb0 0x7fa2040b0d30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009e50 tx=0x7fa1f802a680 comp rx=0 tx=0).stop 2024-05-17T04:09:37.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.774+0000 7fa209b3c640 1 -- 172.21.15.131:0/614594065 shutdown_connections 2024-05-17T04:09:37.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.774+0000 7fa209b3c640 1 --2- 172.21.15.131:0/614594065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2040afcb0 0x7fa2040b0d30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.774+0000 7fa209b3c640 1 --2- 172.21.15.131:0/614594065 >> v2:172.21.15.150:3300/0 conn(0x7fa2040b1270 0x7fa20406c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.774+0000 7fa209b3c640 1 -- 172.21.15.131:0/614594065 >> 172.21.15.131:0/614594065 conn(0x7fa204073170 msgr2=0x7fa204073580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:37.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.774+0000 7fa209b3c640 1 -- 172.21.15.131:0/614594065 shutdown_connections 2024-05-17T04:09:37.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.774+0000 7fa209b3c640 1 -- 172.21.15.131:0/614594065 wait complete. 2024-05-17T04:09:37.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.776+0000 7fa209b3c640 1 Processor -- start 2024-05-17T04:09:37.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.776+0000 7fa209b3c640 1 -- start start 2024-05-17T04:09:37.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.777+0000 7fa209b3c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2040afcb0 0x7fa20415bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.777+0000 7fa209b3c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2040b1270 0x7fa204156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.777+0000 7fa209b3c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa20415f6b0 0x7fa204162fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.777+0000 7fa209b3c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa2040af4b0 con 0x7fa2040b1270 2024-05-17T04:09:37.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.777+0000 7fa209b3c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa2040af1d0 con 0x7fa2040afcb0 2024-05-17T04:09:37.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.777+0000 7fa209b3c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa2040af790 con 0x7fa20415f6b0 2024-05-17T04:09:37.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.777+0000 7fa202ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2040b1270 0x7fa204156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.778+0000 7fa202ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2040b1270 0x7fa204156720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33358/0 (socket says 172.21.15.131:33358) 2024-05-17T04:09:37.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.778+0000 7fa202ffd640 1 -- 172.21.15.131:0/4182067588 learned_addr learned my addr 172.21.15.131:0/4182067588 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:37.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.778+0000 7fa203fff640 1 --2- 172.21.15.131:0/4182067588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa20415f6b0 0x7fa204162fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.778+0000 7fa2037fe640 1 --2- 172.21.15.131:0/4182067588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2040afcb0 0x7fa20415bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.778+0000 7fa202ffd640 1 -- 172.21.15.131:0/4182067588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa20415f6b0 msgr2=0x7fa204162fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.778+0000 7fa202ffd640 1 --2- 172.21.15.131:0/4182067588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa20415f6b0 0x7fa204162fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.778+0000 7fa202ffd640 1 -- 172.21.15.131:0/4182067588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2040afcb0 msgr2=0x7fa20415bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.778+0000 7fa202ffd640 1 --2- 172.21.15.131:0/4182067588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2040afcb0 0x7fa20415bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.778+0000 7fa202ffd640 1 -- 172.21.15.131:0/4182067588 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa204156c60 con 0x7fa2040b1270 2024-05-17T04:09:37.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.778+0000 7fa2037fe640 1 --2- 172.21.15.131:0/4182067588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2040afcb0 0x7fa20415bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:37.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.778+0000 7fa202ffd640 1 --2- 172.21.15.131:0/4182067588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2040b1270 0x7fa204156720 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8034040 tx=0x7fa1f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:37.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.778+0000 7fa1ebfff640 1 -- 172.21.15.131:0/4182067588 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8036050 con 0x7fa2040b1270 2024-05-17T04:09:37.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.778+0000 7fa1ebfff640 1 -- 172.21.15.131:0/4182067588 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f8042070 con 0x7fa2040b1270 2024-05-17T04:09:37.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.778+0000 7fa1ebfff640 1 -- 172.21.15.131:0/4182067588 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8009510 con 0x7fa2040b1270 2024-05-17T04:09:37.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.778+0000 7fa209b3c640 1 -- 172.21.15.131:0/4182067588 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa204161f00 con 0x7fa2040b1270 2024-05-17T04:09:37.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.779+0000 7fa209b3c640 1 -- 172.21.15.131:0/4182067588 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2041624c0 con 0x7fa2040b1270 2024-05-17T04:09:37.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.779+0000 7fa209b3c640 1 -- 172.21.15.131:0/4182067588 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2040ae850 con 0x7fa2040b1270 2024-05-17T04:09:37.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.780+0000 7fa1ebfff640 1 -- 172.21.15.131:0/4182067588 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa1f8007c70 con 0x7fa2040b1270 2024-05-17T04:09:37.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.781+0000 7fa1ebfff640 1 --2- 172.21.15.131:0/4182067588 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa1f00762d0 0x7fa1f00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:37.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.781+0000 7fa1ebfff640 1 -- 172.21.15.131:0/4182067588 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa1f80b8750 con 0x7fa2040b1270 2024-05-17T04:09:37.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.781+0000 7fa2037fe640 1 --2- 172.21.15.131:0/4182067588 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa1f00762d0 0x7fa1f00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:37.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.781+0000 7fa2037fe640 1 --2- 172.21.15.131:0/4182067588 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa1f00762d0 0x7fa1f00787e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4007fd0 tx=0x7fa1f4007d40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:37.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.785+0000 7fa1ebfff640 1 -- 172.21.15.131:0/4182067588 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa1f8081d70 con 0x7fa2040b1270 2024-05-17T04:09:37.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.961+0000 7fa209b3c640 1 -- 172.21.15.131:0/4182067588 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa20406fce0 con 0x7fa2040b1270 2024-05-17T04:09:37.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.962+0000 7fa1ebfff640 1 -- 172.21.15.131:0/4182067588 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7fa1f8081670 con 0x7fa2040b1270 2024-05-17T04:09:37.962 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-05-17T04:09:37.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.964+0000 7fa209b3c640 1 -- 172.21.15.131:0/4182067588 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa1f00762d0 msgr2=0x7fa1f00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.964+0000 7fa209b3c640 1 --2- 172.21.15.131:0/4182067588 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa1f00762d0 0x7fa1f00787e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4007fd0 tx=0x7fa1f4007d40 comp rx=0 tx=0).stop 2024-05-17T04:09:37.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.964+0000 7fa209b3c640 1 -- 172.21.15.131:0/4182067588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2040b1270 msgr2=0x7fa204156720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:37.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.964+0000 7fa209b3c640 1 --2- 172.21.15.131:0/4182067588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2040b1270 0x7fa204156720 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8034040 tx=0x7fa1f8004a40 comp rx=0 tx=0).stop 2024-05-17T04:09:37.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.964+0000 7fa209b3c640 1 -- 172.21.15.131:0/4182067588 shutdown_connections 2024-05-17T04:09:37.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.964+0000 7fa209b3c640 1 --2- 172.21.15.131:0/4182067588 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa1f00762d0 0x7fa1f00787e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.964+0000 7fa209b3c640 1 --2- 172.21.15.131:0/4182067588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2040b1270 0x7fa204156720 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.964+0000 7fa209b3c640 1 --2- 172.21.15.131:0/4182067588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa20415f6b0 0x7fa204162fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.964+0000 7fa209b3c640 1 --2- 172.21.15.131:0/4182067588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2040afcb0 0x7fa20415bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:37.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.964+0000 7fa209b3c640 1 -- 172.21.15.131:0/4182067588 >> 172.21.15.131:0/4182067588 conn(0x7fa204073170 msgr2=0x7fa2040b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:37.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.964+0000 7fa209b3c640 1 -- 172.21.15.131:0/4182067588 shutdown_connections 2024-05-17T04:09:37.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:37.964+0000 7fa209b3c640 1 -- 172.21.15.131:0/4182067588 wait complete. 2024-05-17T04:09:37.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-05-17T04:09:38.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.085+0000 7f70e5b7f640 1 Processor -- start 2024-05-17T04:09:38.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.085+0000 7f70e5b7f640 1 -- start start 2024-05-17T04:09:38.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70e5b7f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f70e00d02f0 0x7f70e015f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:38.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70e5b7f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70e006e090 0x7f70e00cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:38.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70e5b7f640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e00cd8c0 con 0x7f70e00d0ca0 2024-05-17T04:09:38.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70e5b7f640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f70e006f0d0 con 0x7f70e00d02f0 2024-05-17T04:09:38.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70e5b7f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f70e006e830 con 0x7f70e006e090 2024-05-17T04:09:38.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70dffff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70e006e090 0x7f70e00cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:38.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70deffd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f70e00d02f0 0x7f70e015f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:38.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70dffff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70e006e090 0x7f70e00cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:60470/0 (socket says 172.21.15.131:60470) 2024-05-17T04:09:38.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70df7fe640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f70e00d0ca0 0x7f70e00cfbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:60064/0 (socket says 172.21.15.131:60064) 2024-05-17T04:09:38.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70deffd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f70e00d02f0 0x7f70e015f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:52382/0 (socket says 172.21.15.131:52382) 2024-05-17T04:09:38.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70dffff640 1 -- 172.21.15.131:0/3622367766 learned_addr learned my addr 172.21.15.131:0/3622367766 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:38.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70dffff640 1 -- 172.21.15.131:0/3622367766 >> v2:172.21.15.150:3300/0 conn(0x7f70e00d02f0 msgr2=0x7f70e015f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:38.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70dffff640 1 --2- 172.21.15.131:0/3622367766 >> v2:172.21.15.150:3300/0 conn(0x7f70e00d02f0 0x7f70e015f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70dffff640 1 -- 172.21.15.131:0/3622367766 >> v1:172.21.15.150:6789/0 conn(0x7f70e00d0ca0 legacy=0x7f70e00cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:38.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70dffff640 1 -- 172.21.15.131:0/3622367766 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e006eb10 con 0x7f70e006e090 2024-05-17T04:09:38.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.087+0000 7f70deffd640 1 --2- 172.21.15.131:0/3622367766 >> v2:172.21.15.150:3300/0 conn(0x7f70e00d02f0 0x7f70e015f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:38.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.088+0000 7f70dffff640 1 --2- 172.21.15.131:0/3622367766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70e006e090 0x7f70e00cdda0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009870 tx=0x7f70d802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2be776cd22b3ee97 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:38.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.088+0000 7f70de7fc640 1 -- 172.21.15.131:0/3622367766 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8037070 con 0x7f70e006e090 2024-05-17T04:09:38.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.088+0000 7f70de7fc640 1 -- 172.21.15.131:0/3622367766 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d8032440 con 0x7f70e006e090 2024-05-17T04:09:38.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.088+0000 7f70de7fc640 1 -- 172.21.15.131:0/3622367766 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8032810 con 0x7f70e006e090 2024-05-17T04:09:38.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.089+0000 7f70e5b7f640 1 -- 172.21.15.131:0/3622367766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70e006e090 msgr2=0x7f70e00cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:38.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.089+0000 7f70e5b7f640 1 --2- 172.21.15.131:0/3622367766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70e006e090 0x7f70e00cdda0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009870 tx=0x7f70d802a1c0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.089+0000 7f70e5b7f640 1 -- 172.21.15.131:0/3622367766 shutdown_connections 2024-05-17T04:09:38.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.089+0000 7f70e5b7f640 1 --2- 172.21.15.131:0/3622367766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70e006e090 0x7f70e00cdda0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.089+0000 7f70e5b7f640 1 --2- 172.21.15.131:0/3622367766 >> v2:172.21.15.150:3300/0 conn(0x7f70e00d02f0 0x7f70e015f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.089+0000 7f70e5b7f640 1 -- 172.21.15.131:0/3622367766 >> 172.21.15.131:0/3622367766 conn(0x7f70e00b4e40 msgr2=0x7f70e00b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:38.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.089+0000 7f70e5b7f640 1 -- 172.21.15.131:0/3622367766 shutdown_connections 2024-05-17T04:09:38.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.089+0000 7f70e5b7f640 1 -- 172.21.15.131:0/3622367766 wait complete. 2024-05-17T04:09:38.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.091+0000 7f70e5b7f640 1 Processor -- start 2024-05-17T04:09:38.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.091+0000 7f70e5b7f640 1 -- start start 2024-05-17T04:09:38.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.092+0000 7f70e5b7f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70e006e090 0x7f70e00b8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:38.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.092+0000 7f70e5b7f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70e00d0ca0 0x7f70e0071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:38.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.092+0000 7f70e5b7f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70e00ca700 0x7f70e0071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:38.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.092+0000 7f70e5b7f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f70e00ce2e0 con 0x7f70e00ca700 2024-05-17T04:09:38.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.092+0000 7f70e5b7f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f70e006e4a0 con 0x7f70e00d0ca0 2024-05-17T04:09:38.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.092+0000 7f70e5b7f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f70e00ce460 con 0x7f70e006e090 2024-05-17T04:09:38.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.092+0000 7f70dffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70e00ca700 0x7f70e0071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:38.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.092+0000 7f70dffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70e00ca700 0x7f70e0071ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33362/0 (socket says 172.21.15.131:33362) 2024-05-17T04:09:38.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.092+0000 7f70dffff640 1 -- 172.21.15.131:0/915090215 learned_addr learned my addr 172.21.15.131:0/915090215 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:38.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.093+0000 7f70df7fe640 1 --2- 172.21.15.131:0/915090215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70e006e090 0x7f70e00b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:38.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.093+0000 7f70deffd640 1 --2- 172.21.15.131:0/915090215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70e00d0ca0 0x7f70e0071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:38.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.093+0000 7f70dffff640 1 -- 172.21.15.131:0/915090215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70e006e090 msgr2=0x7f70e00b8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:38.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.093+0000 7f70dffff640 1 --2- 172.21.15.131:0/915090215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70e006e090 0x7f70e00b8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.093+0000 7f70dffff640 1 -- 172.21.15.131:0/915090215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70e00d0ca0 msgr2=0x7f70e0071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:38.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.093+0000 7f70dffff640 1 --2- 172.21.15.131:0/915090215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70e00d0ca0 0x7f70e0071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.093+0000 7f70dffff640 1 -- 172.21.15.131:0/915090215 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e00c73a0 con 0x7f70e00ca700 2024-05-17T04:09:38.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.093+0000 7f70dffff640 1 --2- 172.21.15.131:0/915090215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70e00ca700 0x7f70e0071ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70d802a200 tx=0x7f70d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:38.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.093+0000 7f70c7fff640 1 -- 172.21.15.131:0/915090215 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8041020 con 0x7f70e00ca700 2024-05-17T04:09:38.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.093+0000 7f70c7fff640 1 -- 172.21.15.131:0/915090215 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d803d640 con 0x7f70e00ca700 2024-05-17T04:09:38.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.093+0000 7f70e5b7f640 1 -- 172.21.15.131:0/915090215 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e00c7680 con 0x7f70e00ca700 2024-05-17T04:09:38.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.093+0000 7f70c7fff640 1 -- 172.21.15.131:0/915090215 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8037040 con 0x7f70e00ca700 2024-05-17T04:09:38.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.093+0000 7f70e5b7f640 1 -- 172.21.15.131:0/915090215 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e00c7c40 con 0x7f70e00ca700 2024-05-17T04:09:38.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.094+0000 7f70e5b7f640 1 -- 172.21.15.131:0/915090215 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e00cdda0 con 0x7f70e00ca700 2024-05-17T04:09:38.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.095+0000 7f70c7fff640 1 -- 172.21.15.131:0/915090215 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f70d8044020 con 0x7f70e00ca700 2024-05-17T04:09:38.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.095+0000 7f70c7fff640 1 --2- 172.21.15.131:0/915090215 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f70cc076300 0x7f70cc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:38.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.095+0000 7f70c7fff640 1 -- 172.21.15.131:0/915090215 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f70d80b7e90 con 0x7f70e00ca700 2024-05-17T04:09:38.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.095+0000 7f70df7fe640 1 --2- 172.21.15.131:0/915090215 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f70cc076300 0x7f70cc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:38.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.096+0000 7f70df7fe640 1 --2- 172.21.15.131:0/915090215 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f70cc076300 0x7f70cc078810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f70d00012e0 tx=0x7f70d0001640 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:38.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.100+0000 7f70c7fff640 1 -- 172.21.15.131:0/915090215 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f70d804b030 con 0x7f70e00ca700 2024-05-17T04:09:38.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.349+0000 7f70e5b7f640 1 -- 172.21.15.131:0/915090215 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f70e00c7130 con 0x7f70e00ca700 2024-05-17T04:09:38.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.738+0000 7f70c7fff640 1 -- 172.21.15.131:0/915090215 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v56) ==== 147+0+0 (secure 0 0 0) 0x7f70d8080e70 con 0x7f70e00ca700 2024-05-17T04:09:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.740+0000 7f70e5b7f640 1 -- 172.21.15.131:0/915090215 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f70cc076300 msgr2=0x7f70cc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.740+0000 7f70e5b7f640 1 --2- 172.21.15.131:0/915090215 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f70cc076300 0x7f70cc078810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f70d00012e0 tx=0x7f70d0001640 comp rx=0 tx=0).stop 2024-05-17T04:09:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.740+0000 7f70e5b7f640 1 -- 172.21.15.131:0/915090215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70e00ca700 msgr2=0x7f70e0071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.740+0000 7f70e5b7f640 1 --2- 172.21.15.131:0/915090215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70e00ca700 0x7f70e0071ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70d802a200 tx=0x7f70d80046c0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.740+0000 7f70e5b7f640 1 -- 172.21.15.131:0/915090215 shutdown_connections 2024-05-17T04:09:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.740+0000 7f70e5b7f640 1 --2- 172.21.15.131:0/915090215 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f70cc076300 0x7f70cc078810 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.740+0000 7f70e5b7f640 1 --2- 172.21.15.131:0/915090215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70e00ca700 0x7f70e0071ab0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.740+0000 7f70e5b7f640 1 --2- 172.21.15.131:0/915090215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70e00d0ca0 0x7f70e0071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.740+0000 7f70e5b7f640 1 --2- 172.21.15.131:0/915090215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70e006e090 0x7f70e00b8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.741+0000 7f70e5b7f640 1 -- 172.21.15.131:0/915090215 >> 172.21.15.131:0/915090215 conn(0x7f70e00b4e40 msgr2=0x7f70e0162360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.741+0000 7f70e5b7f640 1 -- 172.21.15.131:0/915090215 shutdown_connections 2024-05-17T04:09:38.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.741+0000 7f70e5b7f640 1 -- 172.21.15.131:0/915090215 wait complete. 2024-05-17T04:09:38.753 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-17T04:09:38.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.868+0000 7fa47c5d3640 1 Processor -- start 2024-05-17T04:09:38.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.868+0000 7fa47c5d3640 1 -- start start 2024-05-17T04:09:38.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.869+0000 7fa47c5d3640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa47415f520 0x7fa47406dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:38.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.869+0000 7fa47c5d3640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa47406c940 con 0x7fa47415f930 2024-05-17T04:09:38.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.869+0000 7fa47c5d3640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa47406cc20 con 0x7fa4740d4590 2024-05-17T04:09:38.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.869+0000 7fa47c5d3640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa47406d700 con 0x7fa47415f520 2024-05-17T04:09:38.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.869+0000 7fa479b6e640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa47415f930 0x7fa4740d3e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:58752/0 (socket says 172.21.15.131:58752) 2024-05-17T04:09:38.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.869+0000 7fa479b6e640 1 -- 172.21.15.131:0/855747922 learned_addr learned my addr 172.21.15.131:0/855747922 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:38.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47a36f640 1 --2- 172.21.15.131:0/855747922 >> v2:172.21.15.150:3300/0 conn(0x7fa47415f520 0x7fa47406dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:38.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4241669515 0 0) 0x7fa47406c940 con 0x7fa47415f930 2024-05-17T04:09:38.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa460003520 con 0x7fa47415f930 2024-05-17T04:09:38.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3107317666 0 0) 0x7fa47406cc20 con 0x7fa4740d4590 2024-05-17T04:09:38.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa47406c940 con 0x7fa4740d4590 2024-05-17T04:09:38.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 16333623 0 0) 0x7fa460003520 con 0x7fa47415f930 2024-05-17T04:09:38.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 >> v2:172.21.15.150:3300/0 conn(0x7fa47415f520 msgr2=0x7fa47406dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:38.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 --2- 172.21.15.131:0/855747922 >> v2:172.21.15.150:3300/0 conn(0x7fa47415f520 0x7fa47406dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 >> v1:172.21.15.150:6789/0 conn(0x7fa4740d4590 legacy=0x7fa4740cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:38.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47406cf00 con 0x7fa47415f930 2024-05-17T04:09:38.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7fa4640016f0 con 0x7fa47415f930 2024-05-17T04:09:38.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 >> v1:172.21.15.131:6789/0 conn(0x7fa47415f930 legacy=0x7fa4740d3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:38.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 --2- 172.21.15.131:0/855747922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa460003c80 0x7fa4600040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:38.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 --2- 172.21.15.131:0/855747922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa460004800 0x7fa460004c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:38.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 --2- 172.21.15.131:0/855747922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa460005380 0x7fa46000ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:38.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa47406d700 con 0x7fa460005380 2024-05-17T04:09:38.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa46000c320 con 0x7fa460004800 2024-05-17T04:09:38.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa46000c520 con 0x7fa460003c80 2024-05-17T04:09:38.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47ab70640 1 --2- 172.21.15.131:0/855747922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa460005380 0x7fa46000ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:38.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa479b6e640 1 --2- 172.21.15.131:0/855747922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa460004800 0x7fa460004c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:38.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.870+0000 7fa47a36f640 1 --2- 172.21.15.131:0/855747922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa460003c80 0x7fa4600040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:38.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.871+0000 7fa47ab70640 1 -- 172.21.15.131:0/855747922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa460003c80 msgr2=0x7fa4600040d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:38.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.871+0000 7fa47ab70640 1 --2- 172.21.15.131:0/855747922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa460003c80 0x7fa4600040d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.871+0000 7fa47ab70640 1 -- 172.21.15.131:0/855747922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa460004800 msgr2=0x7fa460004c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:38.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.871+0000 7fa47ab70640 1 --2- 172.21.15.131:0/855747922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa460004800 0x7fa460004c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.871+0000 7fa47ab70640 1 -- 172.21.15.131:0/855747922 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa460003520 con 0x7fa460005380 2024-05-17T04:09:38.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.871+0000 7fa47ab70640 1 -- 172.21.15.131:0/855747922 reap_dead start 2024-05-17T04:09:38.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.871+0000 7fa47ab70640 1 --2- 172.21.15.131:0/855747922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa460005380 0x7fa46000ba40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa46c001fd0 tx=0x7fa460005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7685d766bfebba98 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:38.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.871+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c001c20 con 0x7fa460005380 2024-05-17T04:09:38.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.871+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa46c003b70 con 0x7fa460005380 2024-05-17T04:09:38.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.871+0000 7fa47936d640 1 -- 172.21.15.131:0/855747922 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c0050d0 con 0x7fa460005380 2024-05-17T04:09:38.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.872+0000 7fa47c5d3640 1 -- 172.21.15.131:0/855747922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa460005380 msgr2=0x7fa46000ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:38.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.872+0000 7fa47c5d3640 1 --2- 172.21.15.131:0/855747922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa460005380 0x7fa46000ba40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa46c001fd0 tx=0x7fa460005830 comp rx=0 tx=0).stop 2024-05-17T04:09:38.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.872+0000 7fa47c5d3640 1 -- 172.21.15.131:0/855747922 shutdown_connections 2024-05-17T04:09:38.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.872+0000 7fa47c5d3640 1 --2- 172.21.15.131:0/855747922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa460005380 0x7fa46000ba40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.872+0000 7fa47c5d3640 1 -- 172.21.15.131:0/855747922 >> 172.21.15.131:0/855747922 conn(0x7fa4740d5960 msgr2=0x7fa4740b6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:38.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.872+0000 7fa47c5d3640 1 -- 172.21.15.131:0/855747922 shutdown_connections 2024-05-17T04:09:38.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.872+0000 7fa47c5d3640 1 -- 172.21.15.131:0/855747922 wait complete. 2024-05-17T04:09:38.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.874+0000 7fa47c5d3640 1 Processor -- start 2024-05-17T04:09:38.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.874+0000 7fa47c5d3640 1 -- start start 2024-05-17T04:09:38.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.875+0000 7fa47c5d3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa460005380 0x7fa47414c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:38.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.875+0000 7fa47c5d3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4741617a0 0x7fa474161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:38.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.875+0000 7fa47c5d3640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4740d3a40 0x7fa4740d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:38.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.875+0000 7fa47c5d3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa4740b49d0 con 0x7fa460005380 2024-05-17T04:09:38.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.875+0000 7fa47c5d3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa47406c6f0 con 0x7fa4741617a0 2024-05-17T04:09:38.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.875+0000 7fa47c5d3640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa47406dae0 con 0x7fa4740d3a40 2024-05-17T04:09:38.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.875+0000 7fa47a36f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa460005380 0x7fa47414c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:38.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.875+0000 7fa47a36f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa460005380 0x7fa47414c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33388/0 (socket says 172.21.15.131:33388) 2024-05-17T04:09:38.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.875+0000 7fa47a36f640 1 -- 172.21.15.131:0/4265891089 learned_addr learned my addr 172.21.15.131:0/4265891089 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:38.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.876+0000 7fa479b6e640 1 --2- 172.21.15.131:0/4265891089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4741617a0 0x7fa474161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:38.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.876+0000 7fa47ab70640 1 --2- 172.21.15.131:0/4265891089 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4740d3a40 0x7fa4740d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:38.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.876+0000 7fa47a36f640 1 -- 172.21.15.131:0/4265891089 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4740d3a40 msgr2=0x7fa4740d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:38.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.876+0000 7fa47a36f640 1 --2- 172.21.15.131:0/4265891089 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4740d3a40 0x7fa4740d3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.876+0000 7fa47a36f640 1 -- 172.21.15.131:0/4265891089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4741617a0 msgr2=0x7fa474161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:38.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.876+0000 7fa47a36f640 1 --2- 172.21.15.131:0/4265891089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4741617a0 0x7fa474161bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:38.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.876+0000 7fa47a36f640 1 -- 172.21.15.131:0/4265891089 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47414cbf0 con 0x7fa460005380 2024-05-17T04:09:38.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.876+0000 7fa479b6e640 1 --2- 172.21.15.131:0/4265891089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4741617a0 0x7fa474161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:38.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.876+0000 7fa47a36f640 1 --2- 172.21.15.131:0/4265891089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa460005380 0x7fa47414c6b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa4700118e0 tx=0x7fa470011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:38.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.876+0000 7fa46affd640 1 -- 172.21.15.131:0/4265891089 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47000faf0 con 0x7fa460005380 2024-05-17T04:09:38.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.876+0000 7fa46affd640 1 -- 172.21.15.131:0/4265891089 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47000fc90 con 0x7fa460005380 2024-05-17T04:09:38.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.876+0000 7fa47c5d3640 1 -- 172.21.15.131:0/4265891089 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4740d4390 con 0x7fa460005380 2024-05-17T04:09:38.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.876+0000 7fa46affd640 1 -- 172.21.15.131:0/4265891089 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470014440 con 0x7fa460005380 2024-05-17T04:09:38.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.876+0000 7fa47c5d3640 1 -- 172.21.15.131:0/4265891089 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa474160040 con 0x7fa460005380 2024-05-17T04:09:38.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.877+0000 7fa47c5d3640 1 -- 172.21.15.131:0/4265891089 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa47406de70 con 0x7fa460005380 2024-05-17T04:09:38.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.878+0000 7fa46affd640 1 -- 172.21.15.131:0/4265891089 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa470012040 con 0x7fa460005380 2024-05-17T04:09:38.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.878+0000 7fa46affd640 1 --2- 172.21.15.131:0/4265891089 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa4580762d0 0x7fa4580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:38.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.878+0000 7fa479b6e640 1 --2- 172.21.15.131:0/4265891089 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa4580762d0 0x7fa4580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:38.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.878+0000 7fa46affd640 1 -- 172.21.15.131:0/4265891089 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa470098090 con 0x7fa460005380 2024-05-17T04:09:38.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.879+0000 7fa479b6e640 1 --2- 172.21.15.131:0/4265891089 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa4580762d0 0x7fa4580787e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa464001240 tx=0x7fa464009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:38.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:38.883+0000 7fa46affd640 1 -- 172.21.15.131:0/4265891089 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa4740d4390 con 0x7fa460005380 2024-05-17T04:09:39.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.061+0000 7fa47c5d3640 1 -- 172.21.15.131:0/4265891089 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa4740b9bc0 con 0x7fa460005380 2024-05-17T04:09:39.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.065+0000 7fa46affd640 1 -- 172.21.15.131:0/4265891089 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fa47414cbf0 con 0x7fa460005380 2024-05-17T04:09:39.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.067+0000 7fa47c5d3640 1 -- 172.21.15.131:0/4265891089 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa4580762d0 msgr2=0x7fa4580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:39.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.067+0000 7fa47c5d3640 1 --2- 172.21.15.131:0/4265891089 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa4580762d0 0x7fa4580787e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa464001240 tx=0x7fa464009040 comp rx=0 tx=0).stop 2024-05-17T04:09:39.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.067+0000 7fa47c5d3640 1 -- 172.21.15.131:0/4265891089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa460005380 msgr2=0x7fa47414c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:39.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.067+0000 7fa47c5d3640 1 --2- 172.21.15.131:0/4265891089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa460005380 0x7fa47414c6b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa4700118e0 tx=0x7fa470011da0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.067+0000 7fa47c5d3640 1 -- 172.21.15.131:0/4265891089 shutdown_connections 2024-05-17T04:09:39.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.067+0000 7fa47c5d3640 1 --2- 172.21.15.131:0/4265891089 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa4580762d0 0x7fa4580787e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.067+0000 7fa47c5d3640 1 --2- 172.21.15.131:0/4265891089 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4740d3a40 0x7fa4740d3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.067+0000 7fa47c5d3640 1 --2- 172.21.15.131:0/4265891089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4741617a0 0x7fa474161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.067+0000 7fa47c5d3640 1 --2- 172.21.15.131:0/4265891089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa460005380 0x7fa47414c6b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.067+0000 7fa47c5d3640 1 -- 172.21.15.131:0/4265891089 >> 172.21.15.131:0/4265891089 conn(0x7fa4740d5960 msgr2=0x7fa47415cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:39.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.067+0000 7fa47c5d3640 1 -- 172.21.15.131:0/4265891089 shutdown_connections 2024-05-17T04:09:39.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.067+0000 7fa47c5d3640 1 -- 172.21.15.131:0/4265891089 wait complete. 2024-05-17T04:09:39.079 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-17T04:09:39.079 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-17T04:09:39.114 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-17T04:09:39.174 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-17T04:09:39.174 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:09:39.174 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T04:09:39.191 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:09:39.191 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T04:09:39.247 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-17T04:09:39.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.403+0000 7f063364e640 1 Processor -- start 2024-05-17T04:09:39.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.403+0000 7f063364e640 1 -- start start 2024-05-17T04:09:39.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.404+0000 7f063364e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f062c0d27e0 0x7f062c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:39.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.404+0000 7f063364e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f062c071c80 0x7f062c0d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:39.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.404+0000 7f063364e640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062c15dad0 con 0x7f062c0cdc80 2024-05-17T04:09:39.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.404+0000 7f063364e640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f062c072090 con 0x7f062c071c80 2024-05-17T04:09:39.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.404+0000 7f063364e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f062c0ce090 con 0x7f062c0d27e0 2024-05-17T04:09:39.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.404+0000 7f0631beb640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f062c071c80 0x7f062c0d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:39.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.404+0000 7f0631beb640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f062c071c80 0x7f062c0d0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33398/0 (socket says 172.21.15.131:33398) 2024-05-17T04:09:39.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.404+0000 7f0631beb640 1 -- 172.21.15.131:0/3956297160 learned_addr learned my addr 172.21.15.131:0/3956297160 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:39.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.405+0000 7f06313ea640 1 --2- 172.21.15.131:0/3956297160 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f062c0d27e0 0x7f062c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:39.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.405+0000 7f0631beb640 1 -- 172.21.15.131:0/3956297160 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f062c0d27e0 msgr2=0x7f062c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:39.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.405+0000 7f0631beb640 1 --2- 172.21.15.131:0/3956297160 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f062c0d27e0 0x7f062c0cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.405+0000 7f0631beb640 1 -- 172.21.15.131:0/3956297160 >> v1:172.21.15.150:6789/0 conn(0x7f062c0cdc80 legacy=0x7f062c071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:39.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.405+0000 7f0631beb640 1 -- 172.21.15.131:0/3956297160 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062c15dd40 con 0x7f062c071c80 2024-05-17T04:09:39.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.406+0000 7f0631beb640 1 --2- 172.21.15.131:0/3956297160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f062c071c80 0x7f062c0d0cc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0624009e50 tx=0x7f062402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537f8048e181cc59 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:39.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.406+0000 7f0623fff640 1 -- 172.21.15.131:0/3956297160 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0624036070 con 0x7f062c071c80 2024-05-17T04:09:39.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.406+0000 7f0623fff640 1 -- 172.21.15.131:0/3956297160 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0624031600 con 0x7f062c071c80 2024-05-17T04:09:39.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.406+0000 7f0623fff640 1 -- 172.21.15.131:0/3956297160 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06240319d0 con 0x7f062c071c80 2024-05-17T04:09:39.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.407+0000 7f063364e640 1 -- 172.21.15.131:0/3956297160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f062c071c80 msgr2=0x7f062c0d0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:39.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.407+0000 7f063364e640 1 --2- 172.21.15.131:0/3956297160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f062c071c80 0x7f062c0d0cc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0624009e50 tx=0x7f062402a710 comp rx=0 tx=0).stop 2024-05-17T04:09:39.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.407+0000 7f063364e640 1 -- 172.21.15.131:0/3956297160 shutdown_connections 2024-05-17T04:09:39.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.407+0000 7f063364e640 1 --2- 172.21.15.131:0/3956297160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f062c071c80 0x7f062c0d0cc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.407+0000 7f063364e640 1 --2- 172.21.15.131:0/3956297160 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f062c0d27e0 0x7f062c0cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.407+0000 7f063364e640 1 -- 172.21.15.131:0/3956297160 >> 172.21.15.131:0/3956297160 conn(0x7f062c0b4c60 msgr2=0x7f062c0b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:39.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.407+0000 7f063364e640 1 -- 172.21.15.131:0/3956297160 shutdown_connections 2024-05-17T04:09:39.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.407+0000 7f063364e640 1 -- 172.21.15.131:0/3956297160 wait complete. 2024-05-17T04:09:39.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.409+0000 7f063364e640 1 Processor -- start 2024-05-17T04:09:39.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.409+0000 7f063364e640 1 -- start start 2024-05-17T04:09:39.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f063364e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f062c071c80 0x7f062c1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:39.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f063364e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f062c0cdc80 0x7f062c155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:39.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f063364e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f062c0d27e0 0x7f062c1e7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:39.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f063364e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f062c0722d0 con 0x7f062c0cdc80 2024-05-17T04:09:39.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f063364e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f062c15e300 con 0x7f062c071c80 2024-05-17T04:09:39.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f063364e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f062c15e820 con 0x7f062c0d27e0 2024-05-17T04:09:39.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f0630be9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f062c0cdc80 0x7f062c155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:39.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f0630be9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f062c0cdc80 0x7f062c155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33402/0 (socket says 172.21.15.131:33402) 2024-05-17T04:09:39.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f0630be9640 1 -- 172.21.15.131:0/2562697675 learned_addr learned my addr 172.21.15.131:0/2562697675 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:39.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f0631beb640 1 --2- 172.21.15.131:0/2562697675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f062c0d27e0 0x7f062c1e7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:39.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f06313ea640 1 --2- 172.21.15.131:0/2562697675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f062c071c80 0x7f062c1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:39.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f0631beb640 1 -- 172.21.15.131:0/2562697675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f062c071c80 msgr2=0x7f062c1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:39.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f0631beb640 1 --2- 172.21.15.131:0/2562697675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f062c071c80 0x7f062c1569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f0631beb640 1 -- 172.21.15.131:0/2562697675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f062c0cdc80 msgr2=0x7f062c155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:39.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f0631beb640 1 --2- 172.21.15.131:0/2562697675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f062c0cdc80 0x7f062c155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f0631beb640 1 -- 172.21.15.131:0/2562697675 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062c159710 con 0x7f062c0d27e0 2024-05-17T04:09:39.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.410+0000 7f0630be9640 1 --2- 172.21.15.131:0/2562697675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f062c0cdc80 0x7f062c155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:39.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.411+0000 7f0631beb640 1 --2- 172.21.15.131:0/2562697675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f062c0d27e0 0x7f062c1e7e20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0624030000 tx=0x7f0624004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:39.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.411+0000 7f0621ffb640 1 -- 172.21.15.131:0/2562697675 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0624036050 con 0x7f062c0d27e0 2024-05-17T04:09:39.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.411+0000 7f0621ffb640 1 -- 172.21.15.131:0/2562697675 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0624042070 con 0x7f062c0d27e0 2024-05-17T04:09:39.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.411+0000 7f063364e640 1 -- 172.21.15.131:0/2562697675 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062c0b69c0 con 0x7f062c0d27e0 2024-05-17T04:09:39.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.411+0000 7f0621ffb640 1 -- 172.21.15.131:0/2562697675 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0624009510 con 0x7f062c0d27e0 2024-05-17T04:09:39.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.411+0000 7f063364e640 1 -- 172.21.15.131:0/2562697675 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f062c0b6f80 con 0x7f062c0d27e0 2024-05-17T04:09:39.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.412+0000 7f063364e640 1 -- 172.21.15.131:0/2562697675 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f062c159480 con 0x7f062c0d27e0 2024-05-17T04:09:39.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.413+0000 7f0621ffb640 1 -- 172.21.15.131:0/2562697675 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0624007bf0 con 0x7f062c0d27e0 2024-05-17T04:09:39.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.413+0000 7f0621ffb640 1 --2- 172.21.15.131:0/2562697675 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f06100762d0 0x7f06100787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:39.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.414+0000 7f06313ea640 1 --2- 172.21.15.131:0/2562697675 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f06100762d0 0x7f06100787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:39.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.414+0000 7f0621ffb640 1 -- 172.21.15.131:0/2562697675 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f06240b85d0 con 0x7f062c0d27e0 2024-05-17T04:09:39.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.414+0000 7f06313ea640 1 --2- 172.21.15.131:0/2562697675 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f06100762d0 0x7f06100787e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0628009aa0 tx=0x7f0628009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:39.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.418+0000 7f0621ffb640 1 -- 172.21.15.131:0/2562697675 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0624081500 con 0x7f062c0d27e0 2024-05-17T04:09:39.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.619+0000 7f063364e640 1 -- 172.21.15.131:0/2562697675 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f062c0cd740 con 0x7f062c0d27e0 2024-05-17T04:09:39.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.620+0000 7f0621ffb640 1 -- 172.21.15.131:0/2562697675 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f0624085800 con 0x7f062c0d27e0 2024-05-17T04:09:39.620 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-05-17T04:09:39.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.622+0000 7f063364e640 1 -- 172.21.15.131:0/2562697675 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f06100762d0 msgr2=0x7f06100787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:39.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.622+0000 7f063364e640 1 --2- 172.21.15.131:0/2562697675 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f06100762d0 0x7f06100787e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0628009aa0 tx=0x7f0628009190 comp rx=0 tx=0).stop 2024-05-17T04:09:39.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.622+0000 7f063364e640 1 -- 172.21.15.131:0/2562697675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f062c0d27e0 msgr2=0x7f062c1e7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:39.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.622+0000 7f063364e640 1 --2- 172.21.15.131:0/2562697675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f062c0d27e0 0x7f062c1e7e20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0624030000 tx=0x7f0624004a40 comp rx=0 tx=0).stop 2024-05-17T04:09:39.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.622+0000 7f063364e640 1 -- 172.21.15.131:0/2562697675 shutdown_connections 2024-05-17T04:09:39.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.622+0000 7f063364e640 1 --2- 172.21.15.131:0/2562697675 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f06100762d0 0x7f06100787e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.622+0000 7f063364e640 1 --2- 172.21.15.131:0/2562697675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f062c0cdc80 0x7f062c155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.622+0000 7f063364e640 1 --2- 172.21.15.131:0/2562697675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f062c0d27e0 0x7f062c1e7e20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.622+0000 7f063364e640 1 --2- 172.21.15.131:0/2562697675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f062c071c80 0x7f062c1569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.622+0000 7f063364e640 1 -- 172.21.15.131:0/2562697675 >> 172.21.15.131:0/2562697675 conn(0x7f062c0b4c60 msgr2=0x7f062c0b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:39.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.623+0000 7f063364e640 1 -- 172.21.15.131:0/2562697675 shutdown_connections 2024-05-17T04:09:39.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.623+0000 7f063364e640 1 -- 172.21.15.131:0/2562697675 wait complete. 2024-05-17T04:09:39.635 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:09:39.635 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T04:09:39.652 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-17T04:09:39.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.808+0000 7fa878617640 1 Processor -- start 2024-05-17T04:09:39.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.808+0000 7fa878617640 1 -- start start 2024-05-17T04:09:39.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa878617640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8700d02a0 0x7fa8700cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:39.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa878617640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa87006c6f0 0x7fa87006cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:39.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa878617640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8700b5550 con 0x7fa8700ce2c0 2024-05-17T04:09:39.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa878617640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa8700b5e10 con 0x7fa8700d02a0 2024-05-17T04:09:39.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa878617640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa8700b62a0 con 0x7fa87006c6f0 2024-05-17T04:09:39.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa8763b3640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa8700ce2c0 0x7fa8700cfb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:58756/0 (socket says 172.21.15.131:58756) 2024-05-17T04:09:39.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa8763b3640 1 -- 172.21.15.131:0/1014855764 learned_addr learned my addr 172.21.15.131:0/1014855764 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:39.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa876bb4640 1 --2- 172.21.15.131:0/1014855764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa87006c6f0 0x7fa87006cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:39.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa875bb2640 1 --2- 172.21.15.131:0/1014855764 >> v2:172.21.15.150:3300/0 conn(0x7fa8700d02a0 0x7fa8700cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:39.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa8753b1640 1 -- 172.21.15.131:0/1014855764 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1809960434 0 0) 0x7fa8700b5550 con 0x7fa8700ce2c0 2024-05-17T04:09:39.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa8753b1640 1 -- 172.21.15.131:0/1014855764 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa85c003520 con 0x7fa8700ce2c0 2024-05-17T04:09:39.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa8753b1640 1 -- 172.21.15.131:0/1014855764 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2655210143 0 0) 0x7fa85c003520 con 0x7fa8700ce2c0 2024-05-17T04:09:39.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa8753b1640 1 -- 172.21.15.131:0/1014855764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa87006c6f0 msgr2=0x7fa87006cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:39.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa8753b1640 1 --2- 172.21.15.131:0/1014855764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa87006c6f0 0x7fa87006cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa8753b1640 1 -- 172.21.15.131:0/1014855764 >> v2:172.21.15.150:3300/0 conn(0x7fa8700d02a0 msgr2=0x7fa8700cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:39.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa8753b1640 1 --2- 172.21.15.131:0/1014855764 >> v2:172.21.15.150:3300/0 conn(0x7fa8700d02a0 0x7fa8700cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.810+0000 7fa8753b1640 1 -- 172.21.15.131:0/1014855764 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8700b57c0 con 0x7fa8700ce2c0 2024-05-17T04:09:39.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa8753b1640 1 -- 172.21.15.131:0/1014855764 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7fa8640016f0 con 0x7fa8700ce2c0 2024-05-17T04:09:39.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa8753b1640 1 -- 172.21.15.131:0/1014855764 >> v1:172.21.15.131:6789/0 conn(0x7fa8700ce2c0 legacy=0x7fa8700cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:39.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa8753b1640 1 --2- 172.21.15.131:0/1014855764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa87006c6f0 0x7fa85c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:39.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa8753b1640 1 --2- 172.21.15.131:0/1014855764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa85c003fd0 0x7fa85c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:39.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa8753b1640 1 --2- 172.21.15.131:0/1014855764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa85c004d40 0x7fa85c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:39.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa8753b1640 1 -- 172.21.15.131:0/1014855764 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa8700b5e10 con 0x7fa85c004d40 2024-05-17T04:09:39.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa8753b1640 1 -- 172.21.15.131:0/1014855764 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa8700b62a0 con 0x7fa85c003fd0 2024-05-17T04:09:39.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa8753b1640 1 -- 172.21.15.131:0/1014855764 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa85c00bac0 con 0x7fa87006c6f0 2024-05-17T04:09:39.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa876bb4640 1 --2- 172.21.15.131:0/1014855764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa85c004d40 0x7fa85c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:39.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa875bb2640 1 --2- 172.21.15.131:0/1014855764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa85c003fd0 0x7fa85c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:39.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa8763b3640 1 --2- 172.21.15.131:0/1014855764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa87006c6f0 0x7fa85c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:39.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa876bb4640 1 -- 172.21.15.131:0/1014855764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa87006c6f0 msgr2=0x7fa85c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:39.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa876bb4640 1 --2- 172.21.15.131:0/1014855764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa87006c6f0 0x7fa85c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa876bb4640 1 -- 172.21.15.131:0/1014855764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa85c003fd0 msgr2=0x7fa85c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:39.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa876bb4640 1 --2- 172.21.15.131:0/1014855764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa85c003fd0 0x7fa85c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa876bb4640 1 -- 172.21.15.131:0/1014855764 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85c003520 con 0x7fa85c004d40 2024-05-17T04:09:39.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.811+0000 7fa8763b3640 1 --2- 172.21.15.131:0/1014855764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa87006c6f0 0x7fa85c003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:39.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.812+0000 7fa876bb4640 1 --2- 172.21.15.131:0/1014855764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa85c004d40 0x7fa85c005150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa87015d940 tx=0x7fa85c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc8f14ce590e8e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:39.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.812+0000 7fa8753b1640 1 -- 172.21.15.131:0/1014855764 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868009c10 con 0x7fa85c004d40 2024-05-17T04:09:39.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.812+0000 7fa8753b1640 1 -- 172.21.15.131:0/1014855764 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa868036070 con 0x7fa85c004d40 2024-05-17T04:09:39.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.812+0000 7fa8753b1640 1 -- 172.21.15.131:0/1014855764 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8680317f0 con 0x7fa85c004d40 2024-05-17T04:09:39.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.813+0000 7fa878617640 1 -- 172.21.15.131:0/1014855764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa85c004d40 msgr2=0x7fa85c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:39.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.813+0000 7fa878617640 1 --2- 172.21.15.131:0/1014855764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa85c004d40 0x7fa85c005150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa87015d940 tx=0x7fa85c005830 comp rx=0 tx=0).stop 2024-05-17T04:09:39.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.813+0000 7fa876bb4640 1 -- 172.21.15.131:0/1014855764 reap_dead start 2024-05-17T04:09:39.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.813+0000 7fa878617640 1 -- 172.21.15.131:0/1014855764 shutdown_connections 2024-05-17T04:09:39.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.813+0000 7fa878617640 1 -- 172.21.15.131:0/1014855764 >> 172.21.15.131:0/1014855764 conn(0x7fa8700b36d0 msgr2=0x7fa8700d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:39.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.813+0000 7fa878617640 1 -- 172.21.15.131:0/1014855764 shutdown_connections 2024-05-17T04:09:39.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.813+0000 7fa878617640 1 -- 172.21.15.131:0/1014855764 wait complete. 2024-05-17T04:09:39.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.815+0000 7fa878617640 1 Processor -- start 2024-05-17T04:09:39.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.815+0000 7fa878617640 1 -- start start 2024-05-17T04:09:39.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.816+0000 7fa878617640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa85c004d40 0x7fa8700aa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:39.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.816+0000 7fa878617640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa870142350 0x7fa870140100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:39.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.816+0000 7fa878617640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8701f7140 0x7fa8701f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:39.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.816+0000 7fa878617640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa8700b40f0 con 0x7fa85c004d40 2024-05-17T04:09:39.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.816+0000 7fa878617640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa8700b44d0 con 0x7fa870142350 2024-05-17T04:09:39.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.816+0000 7fa878617640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa8700b4270 con 0x7fa8701f7140 2024-05-17T04:09:39.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.816+0000 7fa8763b3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa85c004d40 0x7fa8700aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:39.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.816+0000 7fa8763b3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa85c004d40 0x7fa8700aa560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33424/0 (socket says 172.21.15.131:33424) 2024-05-17T04:09:39.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.816+0000 7fa8763b3640 1 -- 172.21.15.131:0/2731364349 learned_addr learned my addr 172.21.15.131:0/2731364349 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:39.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.817+0000 7fa875bb2640 1 --2- 172.21.15.131:0/2731364349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa870142350 0x7fa870140100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:39.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.817+0000 7fa876bb4640 1 --2- 172.21.15.131:0/2731364349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8701f7140 0x7fa8701f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:39.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.817+0000 7fa8763b3640 1 -- 172.21.15.131:0/2731364349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8701f7140 msgr2=0x7fa8701f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:39.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.817+0000 7fa8763b3640 1 --2- 172.21.15.131:0/2731364349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8701f7140 0x7fa8701f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.817+0000 7fa8763b3640 1 -- 172.21.15.131:0/2731364349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa870142350 msgr2=0x7fa870140100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:39.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.817+0000 7fa8763b3640 1 --2- 172.21.15.131:0/2731364349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa870142350 0x7fa870140100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:39.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.817+0000 7fa8763b3640 1 -- 172.21.15.131:0/2731364349 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8701f7a90 con 0x7fa85c004d40 2024-05-17T04:09:39.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.817+0000 7fa8763b3640 1 --2- 172.21.15.131:0/2731364349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa85c004d40 0x7fa8700aa560 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa86400e8f0 tx=0x7fa86400edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:39.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.817+0000 7fa862ffd640 1 -- 172.21.15.131:0/2731364349 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86400c870 con 0x7fa85c004d40 2024-05-17T04:09:39.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.817+0000 7fa862ffd640 1 -- 172.21.15.131:0/2731364349 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa864018070 con 0x7fa85c004d40 2024-05-17T04:09:39.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.817+0000 7fa878617640 1 -- 172.21.15.131:0/2731364349 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87014d930 con 0x7fa85c004d40 2024-05-17T04:09:39.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.817+0000 7fa862ffd640 1 -- 172.21.15.131:0/2731364349 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86400cc10 con 0x7fa85c004d40 2024-05-17T04:09:39.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.817+0000 7fa878617640 1 -- 172.21.15.131:0/2731364349 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa870142da0 con 0x7fa85c004d40 2024-05-17T04:09:39.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.818+0000 7fa878617640 1 -- 172.21.15.131:0/2731364349 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8700d0910 con 0x7fa85c004d40 2024-05-17T04:09:39.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.819+0000 7fa862ffd640 1 -- 172.21.15.131:0/2731364349 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa864013420 con 0x7fa85c004d40 2024-05-17T04:09:39.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.819+0000 7fa862ffd640 1 --2- 172.21.15.131:0/2731364349 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa854076300 0x7fa854078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:39.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.820+0000 7fa875bb2640 1 --2- 172.21.15.131:0/2731364349 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa854076300 0x7fa854078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:39.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.820+0000 7fa862ffd640 1 -- 172.21.15.131:0/2731364349 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa864097650 con 0x7fa85c004d40 2024-05-17T04:09:39.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.820+0000 7fa875bb2640 1 --2- 172.21.15.131:0/2731364349 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa854076300 0x7fa854078810 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa870146c20 tx=0x7fa86c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:39.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:39.824+0000 7fa862ffd640 1 -- 172.21.15.131:0/2731364349 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa8701f7a90 con 0x7fa85c004d40 2024-05-17T04:09:40.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.018+0000 7fa878617640 1 -- 172.21.15.131:0/2731364349 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa8700cfdc0 con 0x7fa85c004d40 2024-05-17T04:09:40.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.018+0000 7fa862ffd640 1 -- 172.21.15.131:0/2731364349 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fa864060be0 con 0x7fa85c004d40 2024-05-17T04:09:40.018 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-05-17T04:09:40.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.020+0000 7fa878617640 1 -- 172.21.15.131:0/2731364349 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa854076300 msgr2=0x7fa854078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.020+0000 7fa878617640 1 --2- 172.21.15.131:0/2731364349 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa854076300 0x7fa854078810 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa870146c20 tx=0x7fa86c008040 comp rx=0 tx=0).stop 2024-05-17T04:09:40.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.020+0000 7fa878617640 1 -- 172.21.15.131:0/2731364349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa85c004d40 msgr2=0x7fa8700aa560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.020+0000 7fa878617640 1 --2- 172.21.15.131:0/2731364349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa85c004d40 0x7fa8700aa560 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa86400e8f0 tx=0x7fa86400edb0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.020+0000 7fa878617640 1 -- 172.21.15.131:0/2731364349 shutdown_connections 2024-05-17T04:09:40.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.020+0000 7fa878617640 1 --2- 172.21.15.131:0/2731364349 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa854076300 0x7fa854078810 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.020+0000 7fa878617640 1 --2- 172.21.15.131:0/2731364349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8701f7140 0x7fa8701f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.020+0000 7fa878617640 1 --2- 172.21.15.131:0/2731364349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa870142350 0x7fa870140100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.020+0000 7fa878617640 1 --2- 172.21.15.131:0/2731364349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa85c004d40 0x7fa8700aa560 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.020+0000 7fa878617640 1 -- 172.21.15.131:0/2731364349 >> 172.21.15.131:0/2731364349 conn(0x7fa8700b36d0 msgr2=0x7fa870068910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:40.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.020+0000 7fa878617640 1 -- 172.21.15.131:0/2731364349 shutdown_connections 2024-05-17T04:09:40.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.020+0000 7fa878617640 1 -- 172.21.15.131:0/2731364349 wait complete. 2024-05-17T04:09:40.032 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi131.front.sepia.ceph.com... 2024-05-17T04:09:40.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:40.032 DEBUG:teuthology.orchestra.run.smithi131:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-17T04:09:40.057 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T04:09:40.057 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-05-17T04:09:40.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:40.057 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-17T04:09:40.113 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:09:40.113 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T04:09:40.132 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:09:40.132 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T04:09:40.189 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-17T04:09:40.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.300+0000 7efdeb58c640 1 Processor -- start 2024-05-17T04:09:40.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.301+0000 7efdeb58c640 1 -- start start 2024-05-17T04:09:40.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.302+0000 7efdeb58c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efde40b1290 0x7efde40d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.302+0000 7efdeb58c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde40d04b0 con 0x7efde40d1910 2024-05-17T04:09:40.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.302+0000 7efdeb58c640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde40d1d20 con 0x7efde40d11a0 2024-05-17T04:09:40.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.302+0000 7efdeb58c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7efde40b17e0 con 0x7efde40b1290 2024-05-17T04:09:40.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.302+0000 7efde9328640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7efde40d1910 0x7efde415f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:58770/0 (socket says 172.21.15.131:58770) 2024-05-17T04:09:40.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.302+0000 7efde9328640 1 -- 172.21.15.131:0/3028403512 learned_addr learned my addr 172.21.15.131:0/3028403512 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:40.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.302+0000 7efde8b27640 1 --2- 172.21.15.131:0/3028403512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efde40b1290 0x7efde40d0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.302+0000 7efdd7fff640 1 -- 172.21.15.131:0/3028403512 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1152536098 0 0) 0x7efde40d04b0 con 0x7efde40d1910 2024-05-17T04:09:40.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.302+0000 7efdd7fff640 1 -- 172.21.15.131:0/3028403512 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdd0003520 con 0x7efde40d1910 2024-05-17T04:09:40.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efdd7fff640 1 -- 172.21.15.131:0/3028403512 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3818959442 0 0) 0x7efdd0003520 con 0x7efde40d1910 2024-05-17T04:09:40.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efdd7fff640 1 -- 172.21.15.131:0/3028403512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efde40b1290 msgr2=0x7efde40d0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:40.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efdd7fff640 1 --2- 172.21.15.131:0/3028403512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efde40b1290 0x7efde40d0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efdd7fff640 1 -- 172.21.15.131:0/3028403512 >> v1:172.21.15.150:6789/0 conn(0x7efde40d11a0 legacy=0x7efde40cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efdd7fff640 1 -- 172.21.15.131:0/3028403512 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde40ae900 con 0x7efde40d1910 2024-05-17T04:09:40.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efdd7fff640 1 -- 172.21.15.131:0/3028403512 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7efdd80016f0 con 0x7efde40d1910 2024-05-17T04:09:40.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efdd7fff640 1 -- 172.21.15.131:0/3028403512 >> v1:172.21.15.131:6789/0 conn(0x7efde40d1910 legacy=0x7efde415f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efdd7fff640 1 --2- 172.21.15.131:0/3028403512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdd00039e0 0x7efdd0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efdd7fff640 1 --2- 172.21.15.131:0/3028403512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efde40b1290 0x7efdd0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efdd7fff640 1 --2- 172.21.15.131:0/3028403512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd0004d40 0x7efdd0005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efdd7fff640 1 -- 172.21.15.131:0/3028403512 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efde40b17e0 con 0x7efdd0004d40 2024-05-17T04:09:40.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efdd7fff640 1 -- 172.21.15.131:0/3028403512 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efdd000bb50 con 0x7efdd00039e0 2024-05-17T04:09:40.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efdd7fff640 1 -- 172.21.15.131:0/3028403512 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7efdd000bd00 con 0x7efde40b1290 2024-05-17T04:09:40.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efde9b29640 1 --2- 172.21.15.131:0/3028403512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd0004d40 0x7efdd0005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efde9328640 1 --2- 172.21.15.131:0/3028403512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdd00039e0 0x7efdd0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efde8b27640 1 --2- 172.21.15.131:0/3028403512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efde40b1290 0x7efdd0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efde9b29640 1 -- 172.21.15.131:0/3028403512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efde40b1290 msgr2=0x7efdd0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:40.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efde9b29640 1 --2- 172.21.15.131:0/3028403512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efde40b1290 0x7efdd0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efde9b29640 1 -- 172.21.15.131:0/3028403512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdd00039e0 msgr2=0x7efdd0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:40.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efde9b29640 1 --2- 172.21.15.131:0/3028403512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdd00039e0 0x7efdd0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.303+0000 7efde9b29640 1 -- 172.21.15.131:0/3028403512 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd0003520 con 0x7efdd0004d40 2024-05-17T04:09:40.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.304+0000 7efde9b29640 1 --2- 172.21.15.131:0/3028403512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd0004d40 0x7efdd0005170 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efddc001f10 tx=0x7efdd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881b41d54a931c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:40.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.304+0000 7efdd7fff640 1 -- 172.21.15.131:0/3028403512 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc036070 con 0x7efdd0004d40 2024-05-17T04:09:40.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.304+0000 7efdd7fff640 1 -- 172.21.15.131:0/3028403512 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efddc031600 con 0x7efdd0004d40 2024-05-17T04:09:40.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.304+0000 7efdd7fff640 1 -- 172.21.15.131:0/3028403512 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc001b30 con 0x7efdd0004d40 2024-05-17T04:09:40.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.305+0000 7efdeb58c640 1 -- 172.21.15.131:0/3028403512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd0004d40 msgr2=0x7efdd0005170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.305+0000 7efdeb58c640 1 --2- 172.21.15.131:0/3028403512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd0004d40 0x7efdd0005170 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efddc001f10 tx=0x7efdd0005830 comp rx=0 tx=0).stop 2024-05-17T04:09:40.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.305+0000 7efde9b29640 1 -- 172.21.15.131:0/3028403512 reap_dead start 2024-05-17T04:09:40.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.305+0000 7efdeb58c640 1 -- 172.21.15.131:0/3028403512 shutdown_connections 2024-05-17T04:09:40.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.305+0000 7efdeb58c640 1 -- 172.21.15.131:0/3028403512 >> 172.21.15.131:0/3028403512 conn(0x7efde40ce990 msgr2=0x7efde40ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:40.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.305+0000 7efdeb58c640 1 -- 172.21.15.131:0/3028403512 shutdown_connections 2024-05-17T04:09:40.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.305+0000 7efdeb58c640 1 -- 172.21.15.131:0/3028403512 wait complete. 2024-05-17T04:09:40.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.307+0000 7efdeb58c640 1 Processor -- start 2024-05-17T04:09:40.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.307+0000 7efdeb58c640 1 -- start start 2024-05-17T04:09:40.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efdeb58c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efde41622b0 0x7efde41f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efdeb58c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efde40b7ad0 0x7efde406f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efdeb58c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efde406f980 0x7efde41f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efdeb58c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efde4163ed0 con 0x7efde40b7ad0 2024-05-17T04:09:40.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efdeb58c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efde40d0740 con 0x7efde41622b0 2024-05-17T04:09:40.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efdeb58c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7efde4164050 con 0x7efde406f980 2024-05-17T04:09:40.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efde8b27640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efde40b7ad0 0x7efde406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efde8b27640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efde40b7ad0 0x7efde406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33440/0 (socket says 172.21.15.131:33440) 2024-05-17T04:09:40.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efde8b27640 1 -- 172.21.15.131:0/1859812105 learned_addr learned my addr 172.21.15.131:0/1859812105 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:40.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efde9328640 1 --2- 172.21.15.131:0/1859812105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efde41622b0 0x7efde41f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efde9b29640 1 --2- 172.21.15.131:0/1859812105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efde406f980 0x7efde41f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efde8b27640 1 -- 172.21.15.131:0/1859812105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efde406f980 msgr2=0x7efde41f9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efde8b27640 1 --2- 172.21.15.131:0/1859812105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efde406f980 0x7efde41f9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efde8b27640 1 -- 172.21.15.131:0/1859812105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efde41622b0 msgr2=0x7efde41f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efde8b27640 1 --2- 172.21.15.131:0/1859812105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efde41622b0 0x7efde41f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.308+0000 7efde8b27640 1 -- 172.21.15.131:0/1859812105 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde406fd90 con 0x7efde40b7ad0 2024-05-17T04:09:40.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.309+0000 7efde8b27640 1 --2- 172.21.15.131:0/1859812105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efde40b7ad0 0x7efde406f440 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efde00119a0 tx=0x7efde0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:40.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.309+0000 7efdd5ffb640 1 -- 172.21.15.131:0/1859812105 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde000faf0 con 0x7efde40b7ad0 2024-05-17T04:09:40.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.309+0000 7efdd5ffb640 1 -- 172.21.15.131:0/1859812105 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde000fc90 con 0x7efde40b7ad0 2024-05-17T04:09:40.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.309+0000 7efdeb58c640 1 -- 172.21.15.131:0/1859812105 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde40b51e0 con 0x7efde40b7ad0 2024-05-17T04:09:40.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.309+0000 7efdd5ffb640 1 -- 172.21.15.131:0/1859812105 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde0014440 con 0x7efde40b7ad0 2024-05-17T04:09:40.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.309+0000 7efdeb58c640 1 -- 172.21.15.131:0/1859812105 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde415f950 con 0x7efde40b7ad0 2024-05-17T04:09:40.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.310+0000 7efdeb58c640 1 -- 172.21.15.131:0/1859812105 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde40ccd90 con 0x7efde40b7ad0 2024-05-17T04:09:40.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.311+0000 7efdd5ffb640 1 -- 172.21.15.131:0/1859812105 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efde0012040 con 0x7efde40b7ad0 2024-05-17T04:09:40.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.311+0000 7efdd5ffb640 1 --2- 172.21.15.131:0/1859812105 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7efdc80762d0 0x7efdc80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.311+0000 7efdd5ffb640 1 -- 172.21.15.131:0/1859812105 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efde0097e40 con 0x7efde40b7ad0 2024-05-17T04:09:40.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.311+0000 7efde9328640 1 --2- 172.21.15.131:0/1859812105 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7efdc80762d0 0x7efdc80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.312+0000 7efde9328640 1 --2- 172.21.15.131:0/1859812105 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7efdc80762d0 0x7efdc80787e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efde406c7c0 tx=0x7efdd80078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:40.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.319+0000 7efdd5ffb640 1 -- 172.21.15.131:0/1859812105 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efde406fd90 con 0x7efde40b7ad0 2024-05-17T04:09:40.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.527+0000 7efdeb58c640 1 -- 172.21.15.131:0/1859812105 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efde4070710 con 0x7efde40b7ad0 2024-05-17T04:09:40.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.527+0000 7efdd5ffb640 1 -- 172.21.15.131:0/1859812105 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7efde0019030 con 0x7efde40b7ad0 2024-05-17T04:09:40.528 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-05-17T04:09:40.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.529+0000 7efdeb58c640 1 -- 172.21.15.131:0/1859812105 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7efdc80762d0 msgr2=0x7efdc80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.529+0000 7efdeb58c640 1 --2- 172.21.15.131:0/1859812105 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7efdc80762d0 0x7efdc80787e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efde406c7c0 tx=0x7efdd80078f0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.529+0000 7efdeb58c640 1 -- 172.21.15.131:0/1859812105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efde40b7ad0 msgr2=0x7efde406f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.529+0000 7efdeb58c640 1 --2- 172.21.15.131:0/1859812105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efde40b7ad0 0x7efde406f440 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efde00119a0 tx=0x7efde0011e60 comp rx=0 tx=0).stop 2024-05-17T04:09:40.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.529+0000 7efdeb58c640 1 -- 172.21.15.131:0/1859812105 shutdown_connections 2024-05-17T04:09:40.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.529+0000 7efdeb58c640 1 --2- 172.21.15.131:0/1859812105 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7efdc80762d0 0x7efdc80787e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.529+0000 7efdeb58c640 1 --2- 172.21.15.131:0/1859812105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efde40b7ad0 0x7efde406f440 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.529+0000 7efdeb58c640 1 --2- 172.21.15.131:0/1859812105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efde406f980 0x7efde41f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.529+0000 7efdeb58c640 1 --2- 172.21.15.131:0/1859812105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efde41622b0 0x7efde41f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.529+0000 7efdeb58c640 1 -- 172.21.15.131:0/1859812105 >> 172.21.15.131:0/1859812105 conn(0x7efde40ce990 msgr2=0x7efde40b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:40.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.529+0000 7efdeb58c640 1 -- 172.21.15.131:0/1859812105 shutdown_connections 2024-05-17T04:09:40.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.529+0000 7efdeb58c640 1 -- 172.21.15.131:0/1859812105 wait complete. 2024-05-17T04:09:40.540 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:09:40.541 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T04:09:40.560 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-17T04:09:40.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.672+0000 7fd165a64640 1 Processor -- start 2024-05-17T04:09:40.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.672+0000 7fd165a64640 1 -- start start 2024-05-17T04:09:40.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.674+0000 7fd165a64640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16015f690 0x7fd1600afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.674+0000 7fd165a64640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1600aebc0 con 0x7fd1600b1440 2024-05-17T04:09:40.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.674+0000 7fd165a64640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1600aeea0 con 0x7fd1600b3d30 2024-05-17T04:09:40.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.674+0000 7fd165a64640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd1600b3140 con 0x7fd16015f690 2024-05-17T04:09:40.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.674+0000 7fd15ffff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd1600b1440 0x7fd16006c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:58772/0 (socket says 172.21.15.131:58772) 2024-05-17T04:09:40.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.674+0000 7fd15ffff640 1 -- 172.21.15.131:0/2227515709 learned_addr learned my addr 172.21.15.131:0/2227515709 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:40.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.674+0000 7fd15f7fe640 1 --2- 172.21.15.131:0/2227515709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16015f690 0x7fd1600afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.674+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4283407578 0 0) 0x7fd1600aebc0 con 0x7fd1600b1440 2024-05-17T04:09:40.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.674+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd148003520 con 0x7fd1600b1440 2024-05-17T04:09:40.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1419197073 0 0) 0x7fd1600aeea0 con 0x7fd1600b3d30 2024-05-17T04:09:40.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1600aebc0 con 0x7fd1600b3d30 2024-05-17T04:09:40.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1271133178 0 0) 0x7fd148003520 con 0x7fd1600b1440 2024-05-17T04:09:40.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16015f690 msgr2=0x7fd1600afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:40.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15e7fc640 1 --2- 172.21.15.131:0/2227515709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16015f690 0x7fd1600afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 >> v1:172.21.15.150:6789/0 conn(0x7fd1600b3d30 legacy=0x7fd1600b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1600af180 con 0x7fd1600b1440 2024-05-17T04:09:40.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7fd158001a70 con 0x7fd1600b1440 2024-05-17T04:09:40.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 >> v1:172.21.15.131:6789/0 conn(0x7fd1600b1440 legacy=0x7fd16006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15e7fc640 1 --2- 172.21.15.131:0/2227515709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd148003c60 0x7fd1480040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15e7fc640 1 --2- 172.21.15.131:0/2227515709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16015f690 0x7fd148004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15e7fc640 1 --2- 172.21.15.131:0/2227515709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd148004db0 0x7fd148005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd14800bbf0 con 0x7fd148003c60 2024-05-17T04:09:40.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd14800bda0 con 0x7fd148004db0 2024-05-17T04:09:40.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd14800bfa0 con 0x7fd16015f690 2024-05-17T04:09:40.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15f7fe640 1 --2- 172.21.15.131:0/2227515709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd148003c60 0x7fd1480040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15ffff640 1 --2- 172.21.15.131:0/2227515709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd148004db0 0x7fd148005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15effd640 1 --2- 172.21.15.131:0/2227515709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16015f690 0x7fd148004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15f7fe640 1 -- 172.21.15.131:0/2227515709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16015f690 msgr2=0x7fd148004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:40.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15f7fe640 1 --2- 172.21.15.131:0/2227515709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16015f690 0x7fd148004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15f7fe640 1 -- 172.21.15.131:0/2227515709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd148004db0 msgr2=0x7fd148005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:40.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15f7fe640 1 --2- 172.21.15.131:0/2227515709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd148004db0 0x7fd148005280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.675+0000 7fd15f7fe640 1 -- 172.21.15.131:0/2227515709 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd148003520 con 0x7fd148003c60 2024-05-17T04:09:40.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.676+0000 7fd15f7fe640 1 --2- 172.21.15.131:0/2227515709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd148003c60 0x7fd1480040b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd150009a90 tx=0x7fd148005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64dfeb4fbe5fdb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:40.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.676+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150036070 con 0x7fd148003c60 2024-05-17T04:09:40.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.676+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd150031400 con 0x7fd148003c60 2024-05-17T04:09:40.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.676+0000 7fd15e7fc640 1 -- 172.21.15.131:0/2227515709 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150009690 con 0x7fd148003c60 2024-05-17T04:09:40.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.677+0000 7fd165a64640 1 -- 172.21.15.131:0/2227515709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd148003c60 msgr2=0x7fd1480040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.677+0000 7fd165a64640 1 --2- 172.21.15.131:0/2227515709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd148003c60 0x7fd1480040b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd150009a90 tx=0x7fd148005830 comp rx=0 tx=0).stop 2024-05-17T04:09:40.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.677+0000 7fd15ffff640 1 -- 172.21.15.131:0/2227515709 reap_dead start 2024-05-17T04:09:40.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.677+0000 7fd165a64640 1 -- 172.21.15.131:0/2227515709 shutdown_connections 2024-05-17T04:09:40.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.677+0000 7fd165a64640 1 -- 172.21.15.131:0/2227515709 >> 172.21.15.131:0/2227515709 conn(0x7fd160073150 msgr2=0x7fd160073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:40.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.677+0000 7fd165a64640 1 -- 172.21.15.131:0/2227515709 shutdown_connections 2024-05-17T04:09:40.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.677+0000 7fd165a64640 1 -- 172.21.15.131:0/2227515709 wait complete. 2024-05-17T04:09:40.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.678+0000 7fd165a64640 1 Processor -- start 2024-05-17T04:09:40.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.679+0000 7fd165a64640 1 -- start start 2024-05-17T04:09:40.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd165a64640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd148003c60 0x7fd16014f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd165a64640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1601f54a0 0x7fd160158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd165a64640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd160159140 0x7fd1600c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd165a64640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd1600ae850 con 0x7fd148003c60 2024-05-17T04:09:40.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd165a64640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd1600af740 con 0x7fd1601f54a0 2024-05-17T04:09:40.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd165a64640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd1600b4140 con 0x7fd160159140 2024-05-17T04:09:40.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd15f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd148003c60 0x7fd16014f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd15f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd148003c60 0x7fd16014f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33458/0 (socket says 172.21.15.131:33458) 2024-05-17T04:09:40.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd15f7fe640 1 -- 172.21.15.131:0/987436482 learned_addr learned my addr 172.21.15.131:0/987436482 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:40.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd15ffff640 1 --2- 172.21.15.131:0/987436482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd160159140 0x7fd1600c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd15effd640 1 --2- 172.21.15.131:0/987436482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1601f54a0 0x7fd160158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd15f7fe640 1 -- 172.21.15.131:0/987436482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd160159140 msgr2=0x7fd1600c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd15f7fe640 1 --2- 172.21.15.131:0/987436482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd160159140 0x7fd1600c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd15f7fe640 1 -- 172.21.15.131:0/987436482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1601f54a0 msgr2=0x7fd160158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd15f7fe640 1 --2- 172.21.15.131:0/987436482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1601f54a0 0x7fd160158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd15f7fe640 1 -- 172.21.15.131:0/987436482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16014f680 con 0x7fd148003c60 2024-05-17T04:09:40.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.680+0000 7fd15effd640 1 --2- 172.21.15.131:0/987436482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1601f54a0 0x7fd160158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:40.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.681+0000 7fd15f7fe640 1 --2- 172.21.15.131:0/987436482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd148003c60 0x7fd16014f140 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd150034040 tx=0x7fd150004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:40.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.681+0000 7fd147fff640 1 -- 172.21.15.131:0/987436482 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150040020 con 0x7fd148003c60 2024-05-17T04:09:40.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.681+0000 7fd147fff640 1 -- 172.21.15.131:0/987436482 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd150003bc0 con 0x7fd148003c60 2024-05-17T04:09:40.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.681+0000 7fd165a64640 1 -- 172.21.15.131:0/987436482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1600c7020 con 0x7fd148003c60 2024-05-17T04:09:40.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.681+0000 7fd147fff640 1 -- 172.21.15.131:0/987436482 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150036040 con 0x7fd148003c60 2024-05-17T04:09:40.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.681+0000 7fd165a64640 1 -- 172.21.15.131:0/987436482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1600c75e0 con 0x7fd148003c60 2024-05-17T04:09:40.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.682+0000 7fd165a64640 1 -- 172.21.15.131:0/987436482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1600b0de0 con 0x7fd148003c60 2024-05-17T04:09:40.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.682+0000 7fd147fff640 1 -- 172.21.15.131:0/987436482 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd150043020 con 0x7fd148003c60 2024-05-17T04:09:40.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.683+0000 7fd147fff640 1 --2- 172.21.15.131:0/987436482 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd14c0762d0 0x7fd14c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:40.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.683+0000 7fd15effd640 1 --2- 172.21.15.131:0/987436482 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd14c0762d0 0x7fd14c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:40.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.683+0000 7fd147fff640 1 -- 172.21.15.131:0/987436482 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd1500b7be0 con 0x7fd148003c60 2024-05-17T04:09:40.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.683+0000 7fd15effd640 1 --2- 172.21.15.131:0/987436482 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd14c0762d0 0x7fd14c0787e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd1600b1730 tx=0x7fd154009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:40.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.687+0000 7fd147fff640 1 -- 172.21.15.131:0/987436482 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd15004a070 con 0x7fd148003c60 2024-05-17T04:09:40.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.881+0000 7fd165a64640 1 -- 172.21.15.131:0/987436482 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd1600b61c0 con 0x7fd148003c60 2024-05-17T04:09:40.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.881+0000 7fd147fff640 1 -- 172.21.15.131:0/987436482 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fd1500044e0 con 0x7fd148003c60 2024-05-17T04:09:40.882 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-05-17T04:09:40.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.883+0000 7fd165a64640 1 -- 172.21.15.131:0/987436482 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd14c0762d0 msgr2=0x7fd14c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.883+0000 7fd165a64640 1 --2- 172.21.15.131:0/987436482 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd14c0762d0 0x7fd14c0787e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd1600b1730 tx=0x7fd154009040 comp rx=0 tx=0).stop 2024-05-17T04:09:40.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.883+0000 7fd165a64640 1 -- 172.21.15.131:0/987436482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd148003c60 msgr2=0x7fd16014f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:40.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.883+0000 7fd165a64640 1 --2- 172.21.15.131:0/987436482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd148003c60 0x7fd16014f140 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd150034040 tx=0x7fd150004730 comp rx=0 tx=0).stop 2024-05-17T04:09:40.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.883+0000 7fd165a64640 1 -- 172.21.15.131:0/987436482 shutdown_connections 2024-05-17T04:09:40.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.883+0000 7fd165a64640 1 --2- 172.21.15.131:0/987436482 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd14c0762d0 0x7fd14c0787e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.883+0000 7fd165a64640 1 --2- 172.21.15.131:0/987436482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd160159140 0x7fd1600c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.883+0000 7fd165a64640 1 --2- 172.21.15.131:0/987436482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1601f54a0 0x7fd160158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.883+0000 7fd165a64640 1 --2- 172.21.15.131:0/987436482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd148003c60 0x7fd16014f140 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:40.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.884+0000 7fd165a64640 1 -- 172.21.15.131:0/987436482 >> 172.21.15.131:0/987436482 conn(0x7fd160073150 msgr2=0x7fd16006d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:40.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.884+0000 7fd165a64640 1 -- 172.21.15.131:0/987436482 shutdown_connections 2024-05-17T04:09:40.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:40.884+0000 7fd165a64640 1 -- 172.21.15.131:0/987436482 wait complete. 2024-05-17T04:09:40.895 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2024-05-17T04:09:40.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:40.895 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-05-17T04:09:40.930 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T04:09:40.931 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-05-17T04:09:40.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:40.931 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-17T04:09:41.008 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:09:41.008 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T04:09:41.024 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:09:41.024 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T04:09:41.080 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-17T04:09:41.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.230+0000 7f408e886640 1 Processor -- start 2024-05-17T04:09:41.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.230+0000 7f408e886640 1 -- start start 2024-05-17T04:09:41.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.232+0000 7f408e886640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f408806d100 0x7f40880cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:41.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.232+0000 7f408e886640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4088073e20 0x7f40880b4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:41.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.232+0000 7f408e886640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f408806d830 con 0x7f4088073300 2024-05-17T04:09:41.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.232+0000 7f408e886640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f40880b4090 con 0x7f4088073e20 2024-05-17T04:09:41.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.232+0000 7f408e886640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f408806db10 con 0x7f408806d100 2024-05-17T04:09:41.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.232+0000 7f408ce23640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4088073e20 0x7f40880b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:41.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.232+0000 7f408ce23640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4088073e20 0x7f40880b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33468/0 (socket says 172.21.15.131:33468) 2024-05-17T04:09:41.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.232+0000 7f408ce23640 1 -- 172.21.15.131:0/1907049216 learned_addr learned my addr 172.21.15.131:0/1907049216 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:41.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.232+0000 7f4087fff640 1 --2- 172.21.15.131:0/1907049216 >> v2:172.21.15.150:3300/0 conn(0x7f408806d100 0x7f40880cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:41.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.232+0000 7f408ce23640 1 -- 172.21.15.131:0/1907049216 >> v2:172.21.15.150:3300/0 conn(0x7f408806d100 msgr2=0x7f40880cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:41.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.232+0000 7f408ce23640 1 --2- 172.21.15.131:0/1907049216 >> v2:172.21.15.150:3300/0 conn(0x7f408806d100 0x7f40880cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.232+0000 7f408ce23640 1 -- 172.21.15.131:0/1907049216 >> v1:172.21.15.150:6789/0 conn(0x7f4088073300 legacy=0x7f4088073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:41.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.232+0000 7f408ce23640 1 -- 172.21.15.131:0/1907049216 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408806ddf0 con 0x7f4088073e20 2024-05-17T04:09:41.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.233+0000 7f408ce23640 1 --2- 172.21.15.131:0/1907049216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4088073e20 0x7f40880b4520 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4088070790 tx=0x7f408002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228862e74609727e server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:41.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.233+0000 7f4086ffd640 1 -- 172.21.15.131:0/1907049216 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080036070 con 0x7f4088073e20 2024-05-17T04:09:41.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.233+0000 7f4086ffd640 1 -- 172.21.15.131:0/1907049216 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4080031600 con 0x7f4088073e20 2024-05-17T04:09:41.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.233+0000 7f4086ffd640 1 -- 172.21.15.131:0/1907049216 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40800319d0 con 0x7f4088073e20 2024-05-17T04:09:41.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.234+0000 7f408e886640 1 -- 172.21.15.131:0/1907049216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4088073e20 msgr2=0x7f40880b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:41.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.234+0000 7f408e886640 1 --2- 172.21.15.131:0/1907049216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4088073e20 0x7f40880b4520 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4088070790 tx=0x7f408002a730 comp rx=0 tx=0).stop 2024-05-17T04:09:41.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.234+0000 7f408e886640 1 -- 172.21.15.131:0/1907049216 shutdown_connections 2024-05-17T04:09:41.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.234+0000 7f408e886640 1 --2- 172.21.15.131:0/1907049216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4088073e20 0x7f40880b4520 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.234+0000 7f408e886640 1 --2- 172.21.15.131:0/1907049216 >> v2:172.21.15.150:3300/0 conn(0x7f408806d100 0x7f40880cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.234+0000 7f408e886640 1 -- 172.21.15.131:0/1907049216 >> 172.21.15.131:0/1907049216 conn(0x7f40880b36d0 msgr2=0x7f40880d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:41.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.234+0000 7f408e886640 1 -- 172.21.15.131:0/1907049216 shutdown_connections 2024-05-17T04:09:41.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.234+0000 7f408e886640 1 -- 172.21.15.131:0/1907049216 wait complete. 2024-05-17T04:09:41.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.236+0000 7f408e886640 1 Processor -- start 2024-05-17T04:09:41.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.236+0000 7f408e886640 1 -- start start 2024-05-17T04:09:41.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.237+0000 7f408e886640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f408806d100 0x7f40881f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:41.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.237+0000 7f408e886640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4088073300 0x7f40881414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:41.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.237+0000 7f408e886640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4088073e20 0x7f4088156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:41.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.237+0000 7f408e886640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f40880d1640 con 0x7f408806d100 2024-05-17T04:09:41.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.237+0000 7f408e886640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f40880d14c0 con 0x7f4088073e20 2024-05-17T04:09:41.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.237+0000 7f408e886640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f40880d17c0 con 0x7f4088073300 2024-05-17T04:09:41.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.237+0000 7f4087fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f408806d100 0x7f40881f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:41.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.237+0000 7f4087fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f408806d100 0x7f40881f1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33474/0 (socket says 172.21.15.131:33474) 2024-05-17T04:09:41.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.237+0000 7f4087fff640 1 -- 172.21.15.131:0/3061999485 learned_addr learned my addr 172.21.15.131:0/3061999485 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:41.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.238+0000 7f408ce23640 1 --2- 172.21.15.131:0/3061999485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4088073e20 0x7f4088156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:41.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.238+0000 7f40877fe640 1 --2- 172.21.15.131:0/3061999485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4088073300 0x7f40881414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:41.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.238+0000 7f4087fff640 1 -- 172.21.15.131:0/3061999485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4088073300 msgr2=0x7f40881414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:41.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.238+0000 7f4087fff640 1 --2- 172.21.15.131:0/3061999485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4088073300 0x7f40881414e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.238+0000 7f4087fff640 1 -- 172.21.15.131:0/3061999485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4088073e20 msgr2=0x7f4088156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:41.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.238+0000 7f4087fff640 1 --2- 172.21.15.131:0/3061999485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4088073e20 0x7f4088156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.238+0000 7f4087fff640 1 -- 172.21.15.131:0/3061999485 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4088141a20 con 0x7f408806d100 2024-05-17T04:09:41.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.238+0000 7f4087fff640 1 --2- 172.21.15.131:0/3061999485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f408806d100 0x7f40881f1440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f407800f980 tx=0x7f407800fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:41.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.238+0000 7f4084ff9640 1 -- 172.21.15.131:0/3061999485 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407800b040 con 0x7f408806d100 2024-05-17T04:09:41.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.238+0000 7f4084ff9640 1 -- 172.21.15.131:0/3061999485 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f407800dbf0 con 0x7f408806d100 2024-05-17T04:09:41.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.238+0000 7f408e886640 1 -- 172.21.15.131:0/3061999485 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4088158e70 con 0x7f408806d100 2024-05-17T04:09:41.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.238+0000 7f4084ff9640 1 -- 172.21.15.131:0/3061999485 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4078012460 con 0x7f408806d100 2024-05-17T04:09:41.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.238+0000 7f408e886640 1 -- 172.21.15.131:0/3061999485 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4088140ce0 con 0x7f408806d100 2024-05-17T04:09:41.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.239+0000 7f408e886640 1 -- 172.21.15.131:0/3061999485 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4088159390 con 0x7f408806d100 2024-05-17T04:09:41.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.240+0000 7f4084ff9640 1 -- 172.21.15.131:0/3061999485 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4078012600 con 0x7f408806d100 2024-05-17T04:09:41.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.240+0000 7f4084ff9640 1 --2- 172.21.15.131:0/3061999485 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f40740762d0 0x7f40740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:41.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.240+0000 7f4084ff9640 1 -- 172.21.15.131:0/3061999485 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4078099070 con 0x7f408806d100 2024-05-17T04:09:41.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.240+0000 7f40877fe640 1 --2- 172.21.15.131:0/3061999485 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f40740762d0 0x7f40740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:41.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.241+0000 7f40877fe640 1 --2- 172.21.15.131:0/3061999485 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f40740762d0 0x7f40740787e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4088155fc0 tx=0x7f407c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:41.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.245+0000 7f4084ff9640 1 -- 172.21.15.131:0/3061999485 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4088159390 con 0x7f408806d100 2024-05-17T04:09:41.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.438+0000 7f408e886640 1 -- 172.21.15.131:0/3061999485 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4088140ae0 con 0x7f408806d100 2024-05-17T04:09:41.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.439+0000 7f4084ff9640 1 -- 172.21.15.131:0/3061999485 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f4078017030 con 0x7f408806d100 2024-05-17T04:09:41.439 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-05-17T04:09:41.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.441+0000 7f408e886640 1 -- 172.21.15.131:0/3061999485 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f40740762d0 msgr2=0x7f40740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:41.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.441+0000 7f408e886640 1 --2- 172.21.15.131:0/3061999485 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f40740762d0 0x7f40740787e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4088155fc0 tx=0x7f407c009040 comp rx=0 tx=0).stop 2024-05-17T04:09:41.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.441+0000 7f408e886640 1 -- 172.21.15.131:0/3061999485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f408806d100 msgr2=0x7f40881f1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:41.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.441+0000 7f408e886640 1 --2- 172.21.15.131:0/3061999485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f408806d100 0x7f40881f1440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f407800f980 tx=0x7f407800fe40 comp rx=0 tx=0).stop 2024-05-17T04:09:41.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.441+0000 7f408e886640 1 -- 172.21.15.131:0/3061999485 shutdown_connections 2024-05-17T04:09:41.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.441+0000 7f408e886640 1 --2- 172.21.15.131:0/3061999485 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f40740762d0 0x7f40740787e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.441+0000 7f408e886640 1 --2- 172.21.15.131:0/3061999485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4088073e20 0x7f4088156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.441+0000 7f408e886640 1 --2- 172.21.15.131:0/3061999485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4088073300 0x7f40881414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.441+0000 7f408e886640 1 --2- 172.21.15.131:0/3061999485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f408806d100 0x7f40881f1440 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.441+0000 7f408e886640 1 -- 172.21.15.131:0/3061999485 >> 172.21.15.131:0/3061999485 conn(0x7f40880b36d0 msgr2=0x7f40880d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:41.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.441+0000 7f408e886640 1 -- 172.21.15.131:0/3061999485 shutdown_connections 2024-05-17T04:09:41.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.441+0000 7f408e886640 1 -- 172.21.15.131:0/3061999485 wait complete. 2024-05-17T04:09:41.452 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:09:41.453 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T04:09:41.470 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-17T04:09:41.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.625+0000 7f9e52697640 1 Processor -- start 2024-05-17T04:09:41.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.625+0000 7f9e52697640 1 -- start start 2024-05-17T04:09:41.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.626+0000 7f9e52697640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9e4c06d100 0x7f9e4c0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:41.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.626+0000 7f9e52697640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e4c073e20 0x7f9e4c0b4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:41.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.627+0000 7f9e52697640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e4c06d830 con 0x7f9e4c073300 2024-05-17T04:09:41.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.627+0000 7f9e52697640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9e4c0b4090 con 0x7f9e4c06d100 2024-05-17T04:09:41.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.627+0000 7f9e52697640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9e4c06db10 con 0x7f9e4c073e20 2024-05-17T04:09:41.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.627+0000 7f9e4bfff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9e4c06d100 0x7f9e4c0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:41.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.627+0000 7f9e4bfff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9e4c06d100 0x7f9e4c0cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33484/0 (socket says 172.21.15.131:33484) 2024-05-17T04:09:41.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.627+0000 7f9e4bfff640 1 -- 172.21.15.131:0/228453239 learned_addr learned my addr 172.21.15.131:0/228453239 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:41.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.627+0000 7f9e50c34640 1 --2- 172.21.15.131:0/228453239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e4c073e20 0x7f9e4c0b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:41.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.627+0000 7f9e4bfff640 1 -- 172.21.15.131:0/228453239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e4c073e20 msgr2=0x7f9e4c0b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:41.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.627+0000 7f9e4bfff640 1 --2- 172.21.15.131:0/228453239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e4c073e20 0x7f9e4c0b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.627+0000 7f9e4bfff640 1 -- 172.21.15.131:0/228453239 >> v1:172.21.15.150:6789/0 conn(0x7f9e4c073300 legacy=0x7f9e4c073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:41.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.627+0000 7f9e4bfff640 1 -- 172.21.15.131:0/228453239 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4c06ddf0 con 0x7f9e4c06d100 2024-05-17T04:09:41.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.627+0000 7f9e50c34640 1 --2- 172.21.15.131:0/228453239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e4c073e20 0x7f9e4c0b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:41.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.628+0000 7f9e4bfff640 1 --2- 172.21.15.131:0/228453239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4c06d100 0x7f9e4c0cd500 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00bb10 tx=0x7f9e3c02c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b511b6d667b1646d server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:41.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.628+0000 7f9e4affd640 1 -- 172.21.15.131:0/228453239 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c032770 con 0x7f9e4c06d100 2024-05-17T04:09:41.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.628+0000 7f9e4affd640 1 -- 172.21.15.131:0/228453239 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e3c038070 con 0x7f9e4c06d100 2024-05-17T04:09:41.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.628+0000 7f9e4affd640 1 -- 172.21.15.131:0/228453239 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c032b30 con 0x7f9e4c06d100 2024-05-17T04:09:41.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.629+0000 7f9e52697640 1 -- 172.21.15.131:0/228453239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4c06d100 msgr2=0x7f9e4c0cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:41.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.629+0000 7f9e52697640 1 --2- 172.21.15.131:0/228453239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4c06d100 0x7f9e4c0cd500 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00bb10 tx=0x7f9e3c02c870 comp rx=0 tx=0).stop 2024-05-17T04:09:41.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.629+0000 7f9e52697640 1 -- 172.21.15.131:0/228453239 shutdown_connections 2024-05-17T04:09:41.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.629+0000 7f9e52697640 1 --2- 172.21.15.131:0/228453239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e4c073e20 0x7f9e4c0b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.629+0000 7f9e52697640 1 --2- 172.21.15.131:0/228453239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4c06d100 0x7f9e4c0cd500 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.629+0000 7f9e52697640 1 -- 172.21.15.131:0/228453239 >> 172.21.15.131:0/228453239 conn(0x7f9e4c0b36d0 msgr2=0x7f9e4c0d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:41.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.629+0000 7f9e52697640 1 -- 172.21.15.131:0/228453239 shutdown_connections 2024-05-17T04:09:41.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.629+0000 7f9e52697640 1 -- 172.21.15.131:0/228453239 wait complete. 2024-05-17T04:09:41.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.630+0000 7f9e52697640 1 Processor -- start 2024-05-17T04:09:41.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.631+0000 7f9e52697640 1 -- start start 2024-05-17T04:09:41.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e52697640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e4c06d100 0x7f9e4c13e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:41.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e52697640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4c073300 0x7f9e4c1f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:41.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e52697640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e4c073e20 0x7f9e4c1f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:41.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e52697640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4c0d1640 con 0x7f9e4c073300 2024-05-17T04:09:41.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e52697640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4c0d14c0 con 0x7f9e4c073e20 2024-05-17T04:09:41.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e52697640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9e4c0d17c0 con 0x7f9e4c06d100 2024-05-17T04:09:41.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e4b7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4c073300 0x7f9e4c1f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:41.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e4b7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4c073300 0x7f9e4c1f4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33494/0 (socket says 172.21.15.131:33494) 2024-05-17T04:09:41.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e4b7fe640 1 -- 172.21.15.131:0/1465914055 learned_addr learned my addr 172.21.15.131:0/1465914055 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:41.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e4bfff640 1 --2- 172.21.15.131:0/1465914055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e4c06d100 0x7f9e4c13e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:41.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e50c34640 1 --2- 172.21.15.131:0/1465914055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e4c073e20 0x7f9e4c1f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:41.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e4b7fe640 1 -- 172.21.15.131:0/1465914055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e4c06d100 msgr2=0x7f9e4c13e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:41.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e4b7fe640 1 --2- 172.21.15.131:0/1465914055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e4c06d100 0x7f9e4c13e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e4b7fe640 1 -- 172.21.15.131:0/1465914055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e4c073e20 msgr2=0x7f9e4c1f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:41.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e4b7fe640 1 --2- 172.21.15.131:0/1465914055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e4c073e20 0x7f9e4c1f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.632+0000 7f9e4b7fe640 1 -- 172.21.15.131:0/1465914055 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4c1542b0 con 0x7f9e4c073300 2024-05-17T04:09:41.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.633+0000 7f9e4b7fe640 1 --2- 172.21.15.131:0/1465914055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4c073300 0x7f9e4c1f4df0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000b3f0 tx=0x7f9e4000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:41.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.633+0000 7f9e48ff9640 1 -- 172.21.15.131:0/1465914055 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40015020 con 0x7f9e4c073300 2024-05-17T04:09:41.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.633+0000 7f9e48ff9640 1 -- 172.21.15.131:0/1465914055 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e40011830 con 0x7f9e4c073300 2024-05-17T04:09:41.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.633+0000 7f9e52697640 1 -- 172.21.15.131:0/1465914055 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e4c154570 con 0x7f9e4c073300 2024-05-17T04:09:41.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.633+0000 7f9e48ff9640 1 -- 172.21.15.131:0/1465914055 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40011c20 con 0x7f9e4c073300 2024-05-17T04:09:41.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.633+0000 7f9e52697640 1 -- 172.21.15.131:0/1465914055 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e4c13f180 con 0x7f9e4c073300 2024-05-17T04:09:41.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.634+0000 7f9e52697640 1 -- 172.21.15.131:0/1465914055 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e4c0cd500 con 0x7f9e4c073300 2024-05-17T04:09:41.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.634+0000 7f9e48ff9640 1 -- 172.21.15.131:0/1465914055 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9e40018020 con 0x7f9e4c073300 2024-05-17T04:09:41.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.635+0000 7f9e48ff9640 1 --2- 172.21.15.131:0/1465914055 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e380762d0 0x7f9e380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:41.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.635+0000 7f9e4bfff640 1 --2- 172.21.15.131:0/1465914055 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e380762d0 0x7f9e380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:41.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.635+0000 7f9e48ff9640 1 -- 172.21.15.131:0/1465914055 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9e40097400 con 0x7f9e4c073300 2024-05-17T04:09:41.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.636+0000 7f9e4bfff640 1 --2- 172.21.15.131:0/1465914055 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e380762d0 0x7f9e380787e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c037000 tx=0x7f9e3c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:41.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.640+0000 7f9e48ff9640 1 -- 172.21.15.131:0/1465914055 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9e4001f030 con 0x7f9e4c073300 2024-05-17T04:09:41.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.835+0000 7f9e52697640 1 -- 172.21.15.131:0/1465914055 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9e4c0b1f60 con 0x7f9e4c073300 2024-05-17T04:09:41.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.836+0000 7f9e48ff9640 1 -- 172.21.15.131:0/1465914055 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f9e400603d0 con 0x7f9e4c073300 2024-05-17T04:09:41.836 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-05-17T04:09:41.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.838+0000 7f9e52697640 1 -- 172.21.15.131:0/1465914055 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e380762d0 msgr2=0x7f9e380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:41.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.838+0000 7f9e52697640 1 --2- 172.21.15.131:0/1465914055 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e380762d0 0x7f9e380787e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c037000 tx=0x7f9e3c032000 comp rx=0 tx=0).stop 2024-05-17T04:09:41.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.838+0000 7f9e52697640 1 -- 172.21.15.131:0/1465914055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4c073300 msgr2=0x7f9e4c1f4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:41.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.838+0000 7f9e52697640 1 --2- 172.21.15.131:0/1465914055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4c073300 0x7f9e4c1f4df0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000b3f0 tx=0x7f9e4000b8b0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.838+0000 7f9e52697640 1 -- 172.21.15.131:0/1465914055 shutdown_connections 2024-05-17T04:09:41.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.838+0000 7f9e52697640 1 --2- 172.21.15.131:0/1465914055 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e380762d0 0x7f9e380787e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.838+0000 7f9e52697640 1 --2- 172.21.15.131:0/1465914055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4c073300 0x7f9e4c1f4df0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.838+0000 7f9e52697640 1 --2- 172.21.15.131:0/1465914055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e4c073e20 0x7f9e4c1f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.838+0000 7f9e52697640 1 --2- 172.21.15.131:0/1465914055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e4c06d100 0x7f9e4c13e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:41.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.838+0000 7f9e52697640 1 -- 172.21.15.131:0/1465914055 >> 172.21.15.131:0/1465914055 conn(0x7f9e4c0b36d0 msgr2=0x7f9e4c0d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:41.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.838+0000 7f9e52697640 1 -- 172.21.15.131:0/1465914055 shutdown_connections 2024-05-17T04:09:41.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:41.838+0000 7f9e52697640 1 -- 172.21.15.131:0/1465914055 wait complete. 2024-05-17T04:09:41.849 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi131.front.sepia.ceph.com... 2024-05-17T04:09:41.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:41.850 DEBUG:teuthology.orchestra.run.smithi131:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-05-17T04:09:41.875 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T04:09:41.876 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-05-17T04:09:41.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:41.876 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-17T04:09:41.932 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:09:41.932 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T04:09:41.952 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:09:41.952 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T04:09:42.013 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-17T04:09:42.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.124+0000 7efd2bb2a640 1 Processor -- start 2024-05-17T04:09:42.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.124+0000 7efd2bb2a640 1 -- start start 2024-05-17T04:09:42.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.125+0000 7efd2bb2a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd2415f7e0 0x7efd240b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.125+0000 7efd2bb2a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd240cf880 con 0x7efd240d3e10 2024-05-17T04:09:42.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.125+0000 7efd2bb2a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd2406d2d0 con 0x7efd2406c6f0 2024-05-17T04:09:42.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.125+0000 7efd2bb2a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7efd240d1830 con 0x7efd2415f7e0 2024-05-17T04:09:42.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.125+0000 7efd290c5640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7efd240d3e10 0x7efd240d4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:58778/0 (socket says 172.21.15.131:58778) 2024-05-17T04:09:42.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.125+0000 7efd290c5640 1 -- 172.21.15.131:0/1866546869 learned_addr learned my addr 172.21.15.131:0/1866546869 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:42.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd298c6640 1 --2- 172.21.15.131:0/1866546869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd2415f7e0 0x7efd240b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd288c4640 1 -- 172.21.15.131:0/1866546869 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1473696791 0 0) 0x7efd240cf880 con 0x7efd240d3e10 2024-05-17T04:09:42.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd288c4640 1 -- 172.21.15.131:0/1866546869 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd10003520 con 0x7efd240d3e10 2024-05-17T04:09:42.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd288c4640 1 -- 172.21.15.131:0/1866546869 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2162137979 0 0) 0x7efd10003520 con 0x7efd240d3e10 2024-05-17T04:09:42.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd288c4640 1 -- 172.21.15.131:0/1866546869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd2415f7e0 msgr2=0x7efd240b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:42.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd288c4640 1 --2- 172.21.15.131:0/1866546869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd2415f7e0 0x7efd240b87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd288c4640 1 -- 172.21.15.131:0/1866546869 >> v1:172.21.15.150:6789/0 conn(0x7efd2406c6f0 legacy=0x7efd2406cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd288c4640 1 -- 172.21.15.131:0/1866546869 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2406d5b0 con 0x7efd240d3e10 2024-05-17T04:09:42.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd288c4640 1 -- 172.21.15.131:0/1866546869 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7efd14001710 con 0x7efd240d3e10 2024-05-17T04:09:42.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd288c4640 1 -- 172.21.15.131:0/1866546869 >> v1:172.21.15.131:6789/0 conn(0x7efd240d3e10 legacy=0x7efd240d4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd288c4640 1 --2- 172.21.15.131:0/1866546869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd10003a30 0x7efd10003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd288c4640 1 --2- 172.21.15.131:0/1866546869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd2415f7e0 0x7efd10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd288c4640 1 --2- 172.21.15.131:0/1866546869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd10004d40 0x7efd100051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd288c4640 1 -- 172.21.15.131:0/1866546869 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efd1000bb50 con 0x7efd10004d40 2024-05-17T04:09:42.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd288c4640 1 -- 172.21.15.131:0/1866546869 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efd1000bd00 con 0x7efd10003a30 2024-05-17T04:09:42.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd288c4640 1 -- 172.21.15.131:0/1866546869 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7efd1000bf00 con 0x7efd2415f7e0 2024-05-17T04:09:42.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd2a0c7640 1 --2- 172.21.15.131:0/1866546869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd10004d40 0x7efd100051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd290c5640 1 --2- 172.21.15.131:0/1866546869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd2415f7e0 0x7efd10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd298c6640 1 --2- 172.21.15.131:0/1866546869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd10003a30 0x7efd10003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd2a0c7640 1 -- 172.21.15.131:0/1866546869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd2415f7e0 msgr2=0x7efd10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:42.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd2a0c7640 1 --2- 172.21.15.131:0/1866546869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd2415f7e0 0x7efd10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd2a0c7640 1 -- 172.21.15.131:0/1866546869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd10003a30 msgr2=0x7efd10003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:42.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd2a0c7640 1 --2- 172.21.15.131:0/1866546869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd10003a30 0x7efd10003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd2a0c7640 1 -- 172.21.15.131:0/1866546869 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd10003520 con 0x7efd10004d40 2024-05-17T04:09:42.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.126+0000 7efd290c5640 1 --2- 172.21.15.131:0/1866546869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd2415f7e0 0x7efd10004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:42.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.127+0000 7efd2a0c7640 1 --2- 172.21.15.131:0/1866546869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd10004d40 0x7efd100051f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efd1c001e30 tx=0x7efd10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8708d83f8f3956e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:42.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.127+0000 7efd288c4640 1 -- 172.21.15.131:0/1866546869 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c001a50 con 0x7efd10004d40 2024-05-17T04:09:42.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.127+0000 7efd288c4640 1 -- 172.21.15.131:0/1866546869 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c02ae40 con 0x7efd10004d40 2024-05-17T04:09:42.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.127+0000 7efd288c4640 1 -- 172.21.15.131:0/1866546869 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c003b70 con 0x7efd10004d40 2024-05-17T04:09:42.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.128+0000 7efd2bb2a640 1 -- 172.21.15.131:0/1866546869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd10004d40 msgr2=0x7efd100051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.128+0000 7efd2bb2a640 1 --2- 172.21.15.131:0/1866546869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd10004d40 0x7efd100051f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efd1c001e30 tx=0x7efd10005830 comp rx=0 tx=0).stop 2024-05-17T04:09:42.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.128+0000 7efd2a0c7640 1 -- 172.21.15.131:0/1866546869 reap_dead start 2024-05-17T04:09:42.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.128+0000 7efd2bb2a640 1 -- 172.21.15.131:0/1866546869 shutdown_connections 2024-05-17T04:09:42.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.128+0000 7efd2bb2a640 1 -- 172.21.15.131:0/1866546869 >> 172.21.15.131:0/1866546869 conn(0x7efd240d5860 msgr2=0x7efd240d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:42.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.128+0000 7efd2bb2a640 1 -- 172.21.15.131:0/1866546869 shutdown_connections 2024-05-17T04:09:42.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.128+0000 7efd2bb2a640 1 -- 172.21.15.131:0/1866546869 wait complete. 2024-05-17T04:09:42.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.130+0000 7efd2bb2a640 1 Processor -- start 2024-05-17T04:09:42.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.130+0000 7efd2bb2a640 1 -- start start 2024-05-17T04:09:42.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.131+0000 7efd2bb2a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd240cc460 0x7efd240cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.131+0000 7efd2bb2a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd241f7000 0x7efd240ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.131+0000 7efd2bb2a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd240cec50 0x7efd240c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.131+0000 7efd2bb2a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efd240b87f0 con 0x7efd240cec50 2024-05-17T04:09:42.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.131+0000 7efd2bb2a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efd240cfe90 con 0x7efd241f7000 2024-05-17T04:09:42.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.131+0000 7efd2bb2a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7efd240b8970 con 0x7efd240cc460 2024-05-17T04:09:42.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.131+0000 7efd2a0c7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd240cec50 0x7efd240c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.131+0000 7efd2a0c7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd240cec50 0x7efd240c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33510/0 (socket says 172.21.15.131:33510) 2024-05-17T04:09:42.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.131+0000 7efd2a0c7640 1 -- 172.21.15.131:0/115187218 learned_addr learned my addr 172.21.15.131:0/115187218 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:42.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.132+0000 7efd290c5640 1 --2- 172.21.15.131:0/115187218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd241f7000 0x7efd240ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.132+0000 7efd298c6640 1 --2- 172.21.15.131:0/115187218 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd240cc460 0x7efd240cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.132+0000 7efd2a0c7640 1 -- 172.21.15.131:0/115187218 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd240cc460 msgr2=0x7efd240cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.132+0000 7efd2a0c7640 1 --2- 172.21.15.131:0/115187218 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd240cc460 0x7efd240cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.132+0000 7efd2a0c7640 1 -- 172.21.15.131:0/115187218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd241f7000 msgr2=0x7efd240ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.132+0000 7efd2a0c7640 1 --2- 172.21.15.131:0/115187218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd241f7000 0x7efd240ce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.132+0000 7efd2a0c7640 1 -- 172.21.15.131:0/115187218 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd240c8eb0 con 0x7efd240cec50 2024-05-17T04:09:42.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.132+0000 7efd298c6640 1 --2- 172.21.15.131:0/115187218 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd240cc460 0x7efd240cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:42.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.132+0000 7efd2a0c7640 1 --2- 172.21.15.131:0/115187218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd240cec50 0x7efd240c9c70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efd1c001f50 tx=0x7efd1c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:42.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.132+0000 7efd1a7fc640 1 -- 172.21.15.131:0/115187218 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14007d90 con 0x7efd240cec50 2024-05-17T04:09:42.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.132+0000 7efd1a7fc640 1 -- 172.21.15.131:0/115187218 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c02ac40 con 0x7efd240cec50 2024-05-17T04:09:42.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.132+0000 7efd2bb2a640 1 -- 172.21.15.131:0/115187218 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd240c9190 con 0x7efd240cec50 2024-05-17T04:09:42.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.132+0000 7efd1a7fc640 1 -- 172.21.15.131:0/115187218 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c001a50 con 0x7efd240cec50 2024-05-17T04:09:42.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.132+0000 7efd2bb2a640 1 -- 172.21.15.131:0/115187218 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd240c9750 con 0x7efd240cec50 2024-05-17T04:09:42.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.133+0000 7efd2bb2a640 1 -- 172.21.15.131:0/115187218 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd240b8d50 con 0x7efd240cec50 2024-05-17T04:09:42.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.134+0000 7efd1a7fc640 1 -- 172.21.15.131:0/115187218 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efd1c043020 con 0x7efd240cec50 2024-05-17T04:09:42.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.134+0000 7efd1a7fc640 1 --2- 172.21.15.131:0/115187218 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7efd080762d0 0x7efd080787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.134+0000 7efd298c6640 1 --2- 172.21.15.131:0/115187218 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7efd080762d0 0x7efd080787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.134+0000 7efd1a7fc640 1 -- 172.21.15.131:0/115187218 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efd1c0b6c00 con 0x7efd240cec50 2024-05-17T04:09:42.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.135+0000 7efd298c6640 1 --2- 172.21.15.131:0/115187218 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7efd080762d0 0x7efd080787e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efd240d2d00 tx=0x7efd20008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:42.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.139+0000 7efd1a7fc640 1 -- 172.21.15.131:0/115187218 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efd1c0bd080 con 0x7efd240cec50 2024-05-17T04:09:42.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.329+0000 7efd2bb2a640 1 -- 172.21.15.131:0/115187218 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efd2406e2e0 con 0x7efd240cec50 2024-05-17T04:09:42.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.329+0000 7efd1a7fc640 1 -- 172.21.15.131:0/115187218 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7efd1c080220 con 0x7efd240cec50 2024-05-17T04:09:42.331 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-05-17T04:09:42.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.331+0000 7efd2bb2a640 1 -- 172.21.15.131:0/115187218 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7efd080762d0 msgr2=0x7efd080787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.331+0000 7efd2bb2a640 1 --2- 172.21.15.131:0/115187218 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7efd080762d0 0x7efd080787e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efd240d2d00 tx=0x7efd20008040 comp rx=0 tx=0).stop 2024-05-17T04:09:42.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.331+0000 7efd2bb2a640 1 -- 172.21.15.131:0/115187218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd240cec50 msgr2=0x7efd240c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.331+0000 7efd2bb2a640 1 --2- 172.21.15.131:0/115187218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd240cec50 0x7efd240c9c70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efd1c001f50 tx=0x7efd1c0014a0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.331+0000 7efd2bb2a640 1 -- 172.21.15.131:0/115187218 shutdown_connections 2024-05-17T04:09:42.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.331+0000 7efd2bb2a640 1 --2- 172.21.15.131:0/115187218 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7efd080762d0 0x7efd080787e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.331+0000 7efd2bb2a640 1 --2- 172.21.15.131:0/115187218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd240cec50 0x7efd240c9c70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.331+0000 7efd2bb2a640 1 --2- 172.21.15.131:0/115187218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd241f7000 0x7efd240ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.331+0000 7efd2bb2a640 1 --2- 172.21.15.131:0/115187218 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd240cc460 0x7efd240cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.331+0000 7efd2bb2a640 1 -- 172.21.15.131:0/115187218 >> 172.21.15.131:0/115187218 conn(0x7efd240d5860 msgr2=0x7efd2406daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:42.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.332+0000 7efd2bb2a640 1 -- 172.21.15.131:0/115187218 shutdown_connections 2024-05-17T04:09:42.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.332+0000 7efd2bb2a640 1 -- 172.21.15.131:0/115187218 wait complete. 2024-05-17T04:09:42.343 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T04:09:42.343 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T04:09:42.362 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-17T04:09:42.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.476+0000 7f6ef44ac640 1 Processor -- start 2024-05-17T04:09:42.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.476+0000 7f6ef44ac640 1 -- start start 2024-05-17T04:09:42.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.477+0000 7f6ef44ac640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec15f770 0x7f6eec0d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.477+0000 7f6ef44ac640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6eec0d3da0 0x7f6eec0d41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.477+0000 7f6ef44ac640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eec0d46f0 con 0x7f6eec0cf880 2024-05-17T04:09:42.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.477+0000 7f6ef44ac640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f6eec0d05b0 con 0x7f6eec0d3da0 2024-05-17T04:09:42.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.477+0000 7f6ef44ac640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6eec0d0890 con 0x7f6eec15f770 2024-05-17T04:09:42.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.478+0000 7f6ef1a47640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6eec0d3da0 0x7f6eec0d41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.478+0000 7f6ef2248640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec15f770 0x7f6eec0d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.478+0000 7f6ef2a49640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f6eec0cf880 0x7f6eec0cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:60126/0 (socket says 172.21.15.131:60126) 2024-05-17T04:09:42.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.478+0000 7f6ef2a49640 1 -- 172.21.15.131:0/796251184 learned_addr learned my addr 172.21.15.131:0/796251184 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:42.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.478+0000 7f6ef2248640 1 -- 172.21.15.131:0/796251184 >> v2:172.21.15.150:3300/0 conn(0x7f6eec0d3da0 msgr2=0x7f6eec0d41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:42.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.478+0000 7f6ef2248640 1 --2- 172.21.15.131:0/796251184 >> v2:172.21.15.150:3300/0 conn(0x7f6eec0d3da0 0x7f6eec0d41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.478+0000 7f6ef2248640 1 -- 172.21.15.131:0/796251184 >> v1:172.21.15.150:6789/0 conn(0x7f6eec0cf880 legacy=0x7f6eec0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.478+0000 7f6ef2248640 1 -- 172.21.15.131:0/796251184 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eec0d0b70 con 0x7f6eec15f770 2024-05-17T04:09:42.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.478+0000 7f6ef1a47640 1 --2- 172.21.15.131:0/796251184 >> v2:172.21.15.150:3300/0 conn(0x7f6eec0d3da0 0x7f6eec0d41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:42.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.479+0000 7f6ef2248640 1 --2- 172.21.15.131:0/796251184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec15f770 0x7f6eec0d1650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009d90 tx=0x7f6ee802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97d700c4698d2d98 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:42.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.479+0000 7f6ef1246640 1 -- 172.21.15.131:0/796251184 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8007740 con 0x7f6eec15f770 2024-05-17T04:09:42.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.479+0000 7f6ef1246640 1 -- 172.21.15.131:0/796251184 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee80078e0 con 0x7f6eec15f770 2024-05-17T04:09:42.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.479+0000 7f6ef1246640 1 -- 172.21.15.131:0/796251184 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8007cb0 con 0x7f6eec15f770 2024-05-17T04:09:42.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.480+0000 7f6ef44ac640 1 -- 172.21.15.131:0/796251184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec15f770 msgr2=0x7f6eec0d1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.480+0000 7f6ef44ac640 1 --2- 172.21.15.131:0/796251184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec15f770 0x7f6eec0d1650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009d90 tx=0x7f6ee802a660 comp rx=0 tx=0).stop 2024-05-17T04:09:42.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.480+0000 7f6ef44ac640 1 -- 172.21.15.131:0/796251184 shutdown_connections 2024-05-17T04:09:42.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.480+0000 7f6ef44ac640 1 --2- 172.21.15.131:0/796251184 >> v2:172.21.15.150:3300/0 conn(0x7f6eec0d3da0 0x7f6eec0d41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.480+0000 7f6ef44ac640 1 --2- 172.21.15.131:0/796251184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec15f770 0x7f6eec0d1650 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.480+0000 7f6ef44ac640 1 -- 172.21.15.131:0/796251184 >> 172.21.15.131:0/796251184 conn(0x7f6eec0d2300 msgr2=0x7f6eec0b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:42.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.480+0000 7f6ef44ac640 1 -- 172.21.15.131:0/796251184 shutdown_connections 2024-05-17T04:09:42.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.480+0000 7f6ef44ac640 1 -- 172.21.15.131:0/796251184 wait complete. 2024-05-17T04:09:42.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.482+0000 7f6ef44ac640 1 Processor -- start 2024-05-17T04:09:42.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.482+0000 7f6ef44ac640 1 -- start start 2024-05-17T04:09:42.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.483+0000 7f6ef44ac640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec0cf880 0x7f6eec0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.483+0000 7f6ef44ac640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eec0d3da0 0x7f6eec150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.483+0000 7f6ef44ac640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6eec15f770 0x7f6eec15b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.483+0000 7f6ef44ac640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec0b87c0 con 0x7f6eec15f770 2024-05-17T04:09:42.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.483+0000 7f6ef44ac640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec0d1130 con 0x7f6eec0d3da0 2024-05-17T04:09:42.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.483+0000 7f6ef44ac640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6eec0b8940 con 0x7f6eec0cf880 2024-05-17T04:09:42.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.483+0000 7f6ef2a49640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6eec15f770 0x7f6eec15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.483+0000 7f6ef2a49640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6eec15f770 0x7f6eec15b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33526/0 (socket says 172.21.15.131:33526) 2024-05-17T04:09:42.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.483+0000 7f6ef2a49640 1 -- 172.21.15.131:0/1361609407 learned_addr learned my addr 172.21.15.131:0/1361609407 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:42.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.483+0000 7f6ef2248640 1 --2- 172.21.15.131:0/1361609407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec0cf880 0x7f6eec0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.483+0000 7f6ef1a47640 1 --2- 172.21.15.131:0/1361609407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eec0d3da0 0x7f6eec150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.483+0000 7f6ef2a49640 1 -- 172.21.15.131:0/1361609407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec0cf880 msgr2=0x7f6eec0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.483+0000 7f6ef2a49640 1 --2- 172.21.15.131:0/1361609407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec0cf880 0x7f6eec0ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.483+0000 7f6ef2a49640 1 -- 172.21.15.131:0/1361609407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eec0d3da0 msgr2=0x7f6eec150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.483+0000 7f6ef2a49640 1 --2- 172.21.15.131:0/1361609407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eec0d3da0 0x7f6eec150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.484+0000 7f6ef2a49640 1 -- 172.21.15.131:0/1361609407 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eec1595e0 con 0x7f6eec15f770 2024-05-17T04:09:42.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.484+0000 7f6ef2a49640 1 --2- 172.21.15.131:0/1361609407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6eec15f770 0x7f6eec15b420 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400c340 tx=0x7f6ee400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:42.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.484+0000 7f6ee2ffd640 1 -- 172.21.15.131:0/1361609407 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4017070 con 0x7f6eec15f770 2024-05-17T04:09:42.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.484+0000 7f6ee2ffd640 1 -- 172.21.15.131:0/1361609407 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee4005ce0 con 0x7f6eec15f770 2024-05-17T04:09:42.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.484+0000 7f6ef44ac640 1 -- 172.21.15.131:0/1361609407 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eec1598c0 con 0x7f6eec15f770 2024-05-17T04:09:42.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.484+0000 7f6ee2ffd640 1 -- 172.21.15.131:0/1361609407 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee40072d0 con 0x7f6eec15f770 2024-05-17T04:09:42.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.484+0000 7f6ef44ac640 1 -- 172.21.15.131:0/1361609407 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eec159e80 con 0x7f6eec15f770 2024-05-17T04:09:42.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.485+0000 7f6ef44ac640 1 -- 172.21.15.131:0/1361609407 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eec0d41b0 con 0x7f6eec15f770 2024-05-17T04:09:42.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.486+0000 7f6ee2ffd640 1 -- 172.21.15.131:0/1361609407 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6ee401a070 con 0x7f6eec15f770 2024-05-17T04:09:42.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.486+0000 7f6ee2ffd640 1 --2- 172.21.15.131:0/1361609407 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6ed00762d0 0x7f6ed00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.486+0000 7f6ef2248640 1 --2- 172.21.15.131:0/1361609407 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6ed00762d0 0x7f6ed00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.486+0000 7f6ee2ffd640 1 -- 172.21.15.131:0/1361609407 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6ee4096b40 con 0x7f6eec15f770 2024-05-17T04:09:42.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.486+0000 7f6ef2248640 1 --2- 172.21.15.131:0/1361609407 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6ed00762d0 0x7f6ed00787e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8034000 tx=0x7f6ee8033040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:42.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.490+0000 7f6ee2ffd640 1 -- 172.21.15.131:0/1361609407 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6eec0d46f0 con 0x7f6eec15f770 2024-05-17T04:09:42.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.685+0000 7f6ef44ac640 1 -- 172.21.15.131:0/1361609407 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6eec0b92e0 con 0x7f6eec15f770 2024-05-17T04:09:42.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.686+0000 7f6ee2ffd640 1 -- 172.21.15.131:0/1361609407 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f6ee405fa80 con 0x7f6eec15f770 2024-05-17T04:09:42.686 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-05-17T04:09:42.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.688+0000 7f6ef44ac640 1 -- 172.21.15.131:0/1361609407 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6ed00762d0 msgr2=0x7f6ed00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.688+0000 7f6ef44ac640 1 --2- 172.21.15.131:0/1361609407 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6ed00762d0 0x7f6ed00787e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8034000 tx=0x7f6ee8033040 comp rx=0 tx=0).stop 2024-05-17T04:09:42.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.688+0000 7f6ef44ac640 1 -- 172.21.15.131:0/1361609407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6eec15f770 msgr2=0x7f6eec15b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.688+0000 7f6ef44ac640 1 --2- 172.21.15.131:0/1361609407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6eec15f770 0x7f6eec15b420 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400c340 tx=0x7f6ee400c800 comp rx=0 tx=0).stop 2024-05-17T04:09:42.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.688+0000 7f6ef44ac640 1 -- 172.21.15.131:0/1361609407 shutdown_connections 2024-05-17T04:09:42.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.688+0000 7f6ef44ac640 1 --2- 172.21.15.131:0/1361609407 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6ed00762d0 0x7f6ed00787e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.688+0000 7f6ef44ac640 1 --2- 172.21.15.131:0/1361609407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6eec15f770 0x7f6eec15b420 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.688+0000 7f6ef44ac640 1 --2- 172.21.15.131:0/1361609407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eec0d3da0 0x7f6eec150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.688+0000 7f6ef44ac640 1 --2- 172.21.15.131:0/1361609407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6eec0cf880 0x7f6eec0ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.688+0000 7f6ef44ac640 1 -- 172.21.15.131:0/1361609407 >> 172.21.15.131:0/1361609407 conn(0x7f6eec0d2300 msgr2=0x7f6eec161bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:42.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.688+0000 7f6ef44ac640 1 -- 172.21.15.131:0/1361609407 shutdown_connections 2024-05-17T04:09:42.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.688+0000 7f6ef44ac640 1 -- 172.21.15.131:0/1361609407 wait complete. 2024-05-17T04:09:42.700 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2024-05-17T04:09:42.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:42.700 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-05-17T04:09:42.731 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T04:09:42.731 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-05-17T04:09:42.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:09:42.732 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-17T04:09:42.789 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-17T04:09:42.790 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T04:09:42.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.900+0000 7fec7f373640 1 Processor -- start 2024-05-17T04:09:42.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.900+0000 7fec7f373640 1 -- start start 2024-05-17T04:09:42.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.901+0000 7fec7f373640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fec78071390 0x7fec780717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.901+0000 7fec7f373640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fec780b74c0 0x7fec780b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.901+0000 7fec7f373640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec78163630 0x7fec78163a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.901+0000 7fec7f373640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fec780d0b90 con 0x7fec78071390 2024-05-17T04:09:42.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.901+0000 7fec7f373640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fec780d1ba0 con 0x7fec780b74c0 2024-05-17T04:09:42.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.901+0000 7fec7f373640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fec78071ce0 con 0x7fec78163630 2024-05-17T04:09:42.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.902+0000 7fec7d10f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fec78071390 0x7fec780717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.902+0000 7fec7d10f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fec78071390 0x7fec780717a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33530/0 (socket says 172.21.15.131:33530) 2024-05-17T04:09:42.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.902+0000 7fec7d10f640 1 -- 172.21.15.131:0/1110124028 learned_addr learned my addr 172.21.15.131:0/1110124028 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:42.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.902+0000 7fec7c90e640 1 --2- 172.21.15.131:0/1110124028 >> v2:172.21.15.150:3300/0 conn(0x7fec780b74c0 0x7fec780b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.902+0000 7fec7d910640 1 --2- 172.21.15.131:0/1110124028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec78163630 0x7fec78163a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.902+0000 7fec7d10f640 1 -- 172.21.15.131:0/1110124028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec78163630 msgr2=0x7fec78163a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:42.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.902+0000 7fec7d10f640 1 --2- 172.21.15.131:0/1110124028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec78163630 0x7fec78163a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.902+0000 7fec7d10f640 1 -- 172.21.15.131:0/1110124028 >> v2:172.21.15.150:3300/0 conn(0x7fec780b74c0 msgr2=0x7fec780b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:42.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.902+0000 7fec7d10f640 1 --2- 172.21.15.131:0/1110124028 >> v2:172.21.15.150:3300/0 conn(0x7fec780b74c0 0x7fec780b78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.902+0000 7fec7d10f640 1 -- 172.21.15.131:0/1110124028 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec780d0de0 con 0x7fec78071390 2024-05-17T04:09:42.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.903+0000 7fec7d10f640 1 --2- 172.21.15.131:0/1110124028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec78071390 0x7fec780717a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fec780745a0 tx=0x7fec7402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6345adad5bf415 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:42.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.903+0000 7fec6ffff640 1 -- 172.21.15.131:0/1110124028 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74037070 con 0x7fec78071390 2024-05-17T04:09:42.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.903+0000 7fec6ffff640 1 -- 172.21.15.131:0/1110124028 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec74032440 con 0x7fec78071390 2024-05-17T04:09:42.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.903+0000 7fec6ffff640 1 -- 172.21.15.131:0/1110124028 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74032810 con 0x7fec78071390 2024-05-17T04:09:42.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.903+0000 7fec7f373640 1 -- 172.21.15.131:0/1110124028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec78071390 msgr2=0x7fec780717a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.903+0000 7fec7f373640 1 --2- 172.21.15.131:0/1110124028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec78071390 0x7fec780717a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fec780745a0 tx=0x7fec7402a140 comp rx=0 tx=0).stop 2024-05-17T04:09:42.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.904+0000 7fec7f373640 1 -- 172.21.15.131:0/1110124028 shutdown_connections 2024-05-17T04:09:42.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.904+0000 7fec7f373640 1 --2- 172.21.15.131:0/1110124028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec78163630 0x7fec78163a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.904+0000 7fec7f373640 1 --2- 172.21.15.131:0/1110124028 >> v2:172.21.15.150:3300/0 conn(0x7fec780b74c0 0x7fec780b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.904+0000 7fec7f373640 1 --2- 172.21.15.131:0/1110124028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec78071390 0x7fec780717a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.904+0000 7fec7f373640 1 -- 172.21.15.131:0/1110124028 >> 172.21.15.131:0/1110124028 conn(0x7fec780735b0 msgr2=0x7fec780739c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:42.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.904+0000 7fec7f373640 1 -- 172.21.15.131:0/1110124028 shutdown_connections 2024-05-17T04:09:42.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.904+0000 7fec7f373640 1 -- 172.21.15.131:0/1110124028 wait complete. 2024-05-17T04:09:42.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.905+0000 7fec7f373640 1 Processor -- start 2024-05-17T04:09:42.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.905+0000 7fec7f373640 1 -- start start 2024-05-17T04:09:42.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7f373640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec78071390 0x7fec781f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7f373640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec780b74c0 0x7fec780c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7f373640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec78163630 0x7fec7815c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7f373640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fec780d1680 con 0x7fec780b74c0 2024-05-17T04:09:42.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7f373640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fec780d1180 con 0x7fec78163630 2024-05-17T04:09:42.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7f373640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fec78142820 con 0x7fec78071390 2024-05-17T04:09:42.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7c90e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec780b74c0 0x7fec780c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7c90e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec780b74c0 0x7fec780c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33542/0 (socket says 172.21.15.131:33542) 2024-05-17T04:09:42.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7c90e640 1 -- 172.21.15.131:0/1211504694 learned_addr learned my addr 172.21.15.131:0/1211504694 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:42.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7d10f640 1 --2- 172.21.15.131:0/1211504694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec78071390 0x7fec781f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7d910640 1 --2- 172.21.15.131:0/1211504694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec78163630 0x7fec7815c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7c90e640 1 -- 172.21.15.131:0/1211504694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec78071390 msgr2=0x7fec781f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7c90e640 1 --2- 172.21.15.131:0/1211504694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec78071390 0x7fec781f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7c90e640 1 -- 172.21.15.131:0/1211504694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec78163630 msgr2=0x7fec7815c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:42.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7c90e640 1 --2- 172.21.15.131:0/1211504694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec78163630 0x7fec7815c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:42.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7c90e640 1 -- 172.21.15.131:0/1211504694 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec781f5c20 con 0x7fec780b74c0 2024-05-17T04:09:42.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec7c90e640 1 --2- 172.21.15.131:0/1211504694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec780b74c0 0x7fec780c88e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fec6800d5c0 tx=0x7fec6800da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:42.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.907+0000 7fec6dffb640 1 -- 172.21.15.131:0/1211504694 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec680125f0 con 0x7fec780b74c0 2024-05-17T04:09:42.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.908+0000 7fec6dffb640 1 -- 172.21.15.131:0/1211504694 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec68019070 con 0x7fec780b74c0 2024-05-17T04:09:42.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.908+0000 7fec7f373640 1 -- 172.21.15.131:0/1211504694 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec781f5f00 con 0x7fec780b74c0 2024-05-17T04:09:42.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.908+0000 7fec6dffb640 1 -- 172.21.15.131:0/1211504694 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec680129d0 con 0x7fec780b74c0 2024-05-17T04:09:42.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.908+0000 7fec7f373640 1 -- 172.21.15.131:0/1211504694 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec781f64c0 con 0x7fec780b74c0 2024-05-17T04:09:42.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.909+0000 7fec7f373640 1 -- 172.21.15.131:0/1211504694 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec781f5990 con 0x7fec780b74c0 2024-05-17T04:09:42.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.909+0000 7fec6dffb640 1 -- 172.21.15.131:0/1211504694 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fec68012b70 con 0x7fec780b74c0 2024-05-17T04:09:42.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.910+0000 7fec6dffb640 1 --2- 172.21.15.131:0/1211504694 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fec5c0762d0 0x7fec5c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:42.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.910+0000 7fec7d10f640 1 --2- 172.21.15.131:0/1211504694 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fec5c0762d0 0x7fec5c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:42.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.910+0000 7fec6dffb640 1 -- 172.21.15.131:0/1211504694 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fec68097bb0 con 0x7fec780b74c0 2024-05-17T04:09:42.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.911+0000 7fec7d10f640 1 --2- 172.21.15.131:0/1211504694 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fec5c0762d0 0x7fec5c0787e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fec74034000 tx=0x7fec7402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:42.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:42.914+0000 7fec6dffb640 1 -- 172.21.15.131:0/1211504694 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fec68060b80 con 0x7fec780b74c0 2024-05-17T04:09:43.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.131+0000 7fec7f373640 1 -- 172.21.15.131:0/1211504694 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec781f6690 con 0x7fec780b74c0 2024-05-17T04:09:43.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.132+0000 7fec6dffb640 1 -- 172.21.15.131:0/1211504694 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5189 (secure 0 0 0) 0x7fec68064e80 con 0x7fec780b74c0 2024-05-17T04:09:43.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:43.132 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2897828294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2897828294},{"type":"v1","addr":"172.21.15.131:6837","nonce":2897828294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/4068751282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4068751282},{"type":"v1","addr":"172.21.15.131:6836","nonce":4068751282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2776700884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2776700884},{"type":"v1","addr":"172.21.15.150:6834","nonce":2776700884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:05.755541+0000","modified":"2024-05-17T04:09:18.813988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2635477484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2635477484},{"type":"v1","addr":"172.21.15.150:6835","nonce":2635477484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-05-17T04:09:43.132 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-05-17T04:09:43.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.134+0000 7fec7f373640 1 -- 172.21.15.131:0/1211504694 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fec5c0762d0 msgr2=0x7fec5c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.134+0000 7fec7f373640 1 --2- 172.21.15.131:0/1211504694 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fec5c0762d0 0x7fec5c0787e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fec74034000 tx=0x7fec7402e000 comp rx=0 tx=0).stop 2024-05-17T04:09:43.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.134+0000 7fec7f373640 1 -- 172.21.15.131:0/1211504694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec780b74c0 msgr2=0x7fec780c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.134+0000 7fec7f373640 1 --2- 172.21.15.131:0/1211504694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec780b74c0 0x7fec780c88e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fec6800d5c0 tx=0x7fec6800da80 comp rx=0 tx=0).stop 2024-05-17T04:09:43.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.134+0000 7fec7f373640 1 -- 172.21.15.131:0/1211504694 shutdown_connections 2024-05-17T04:09:43.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.134+0000 7fec7f373640 1 --2- 172.21.15.131:0/1211504694 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fec5c0762d0 0x7fec5c0787e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.134+0000 7fec7f373640 1 --2- 172.21.15.131:0/1211504694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec780b74c0 0x7fec780c88e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.134+0000 7fec7f373640 1 --2- 172.21.15.131:0/1211504694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec78163630 0x7fec7815c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.134+0000 7fec7f373640 1 --2- 172.21.15.131:0/1211504694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec78071390 0x7fec781f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.134+0000 7fec7f373640 1 -- 172.21.15.131:0/1211504694 >> 172.21.15.131:0/1211504694 conn(0x7fec780735b0 msgr2=0x7fec7815f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:43.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.134+0000 7fec7f373640 1 -- 172.21.15.131:0/1211504694 shutdown_connections 2024-05-17T04:09:43.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.134+0000 7fec7f373640 1 -- 172.21.15.131:0/1211504694 wait complete. 2024-05-17T04:09:43.147 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T04:09:43.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.256+0000 7f07581ba640 1 Processor -- start 2024-05-17T04:09:43.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.257+0000 7f07581ba640 1 -- start start 2024-05-17T04:09:43.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.258+0000 7f07581ba640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f07500d3e10 0x7f07500d4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.258+0000 7f07581ba640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07500d4760 con 0x7f07500b3d20 2024-05-17T04:09:43.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.258+0000 7f07581ba640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07500b4a50 con 0x7f07500b4270 2024-05-17T04:09:43.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.258+0000 7f07581ba640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f07500d19d0 con 0x7f07500d3e10 2024-05-17T04:09:43.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.258+0000 7f0755f56640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f07500b3d20 0x7f075015f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:58786/0 (socket says 172.21.15.131:58786) 2024-05-17T04:09:43.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.258+0000 7f0755f56640 1 -- 172.21.15.131:0/1258772946 learned_addr learned my addr 172.21.15.131:0/1258772946 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:43.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.258+0000 7f0756757640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f07500d3e10 0x7f07500d4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.259+0000 7f0756757640 1 -- 172.21.15.131:0/1258772946 >> v1:172.21.15.150:6789/0 conn(0x7f07500b4270 legacy=0x7f075006dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.259+0000 7f0756757640 1 -- 172.21.15.131:0/1258772946 >> v1:172.21.15.131:6789/0 conn(0x7f07500b3d20 legacy=0x7f075015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.259+0000 7f0754f54640 1 -- 172.21.15.131:0/1258772946 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3922498785 0 0) 0x7f0740001110 con 0x7f07500b3d20 2024-05-17T04:09:43.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.259+0000 7f0756757640 1 -- 172.21.15.131:0/1258772946 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07500d1730 con 0x7f07500d3e10 2024-05-17T04:09:43.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.259+0000 7f0756757640 1 --2- 172.21.15.131:0/1258772946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07500d3e10 0x7f07500d4220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0748009d90 tx=0x7f074802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7be326450c77cc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:43.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.259+0000 7f0754f54640 1 -- 172.21.15.131:0/1258772946 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748007740 con 0x7f07500d3e10 2024-05-17T04:09:43.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.259+0000 7f0754f54640 1 -- 172.21.15.131:0/1258772946 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07480078e0 con 0x7f07500d3e10 2024-05-17T04:09:43.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.259+0000 7f0754f54640 1 -- 172.21.15.131:0/1258772946 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748007cb0 con 0x7f07500d3e10 2024-05-17T04:09:43.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.260+0000 7f07581ba640 1 -- 172.21.15.131:0/1258772946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07500d3e10 msgr2=0x7f07500d4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.260+0000 7f07581ba640 1 --2- 172.21.15.131:0/1258772946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07500d3e10 0x7f07500d4220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0748009d90 tx=0x7f074802a660 comp rx=0 tx=0).stop 2024-05-17T04:09:43.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.260+0000 7f07581ba640 1 -- 172.21.15.131:0/1258772946 shutdown_connections 2024-05-17T04:09:43.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.260+0000 7f07581ba640 1 --2- 172.21.15.131:0/1258772946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07500d3e10 0x7f07500d4220 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.260+0000 7f07581ba640 1 -- 172.21.15.131:0/1258772946 >> 172.21.15.131:0/1258772946 conn(0x7f07500d5860 msgr2=0x7f07500d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:43.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.260+0000 7f07581ba640 1 -- 172.21.15.131:0/1258772946 shutdown_connections 2024-05-17T04:09:43.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.260+0000 7f07581ba640 1 -- 172.21.15.131:0/1258772946 wait complete. 2024-05-17T04:09:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.262+0000 7f07581ba640 1 Processor -- start 2024-05-17T04:09:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.262+0000 7f07581ba640 1 -- start start 2024-05-17T04:09:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.263+0000 7f07581ba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07500b3d20 0x7f07501eb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.263+0000 7f07581ba640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07500b4270 0x7f075015a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.263+0000 7f07581ba640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07500d3e10 0x7f075015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.263+0000 7f07581ba640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f075006e420 con 0x7f07500d3e10 2024-05-17T04:09:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.263+0000 7f07581ba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f075006d880 con 0x7f07500b3d20 2024-05-17T04:09:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.263+0000 7f07581ba640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f075006d510 con 0x7f07500b4270 2024-05-17T04:09:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.263+0000 7f0756757640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07500d3e10 0x7f075015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.263+0000 7f0756757640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07500d3e10 0x7f075015ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33564/0 (socket says 172.21.15.131:33564) 2024-05-17T04:09:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.263+0000 7f0756757640 1 -- 172.21.15.131:0/2258420159 learned_addr learned my addr 172.21.15.131:0/2258420159 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.264+0000 7f0755f56640 1 --2- 172.21.15.131:0/2258420159 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07500b3d20 0x7f07501eb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.264+0000 7f0755755640 1 --2- 172.21.15.131:0/2258420159 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07500b4270 0x7f075015a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.264+0000 7f0756757640 1 -- 172.21.15.131:0/2258420159 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07500b4270 msgr2=0x7f075015a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.264+0000 7f0756757640 1 --2- 172.21.15.131:0/2258420159 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07500b4270 0x7f075015a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.264+0000 7f0756757640 1 -- 172.21.15.131:0/2258420159 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07500b3d20 msgr2=0x7f07501eb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.264+0000 7f0756757640 1 --2- 172.21.15.131:0/2258420159 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07500b3d20 0x7f07501eb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.264+0000 7f0756757640 1 -- 172.21.15.131:0/2258420159 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07501e98c0 con 0x7f07500d3e10 2024-05-17T04:09:43.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.264+0000 7f0755755640 1 --2- 172.21.15.131:0/2258420159 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07500b4270 0x7f075015a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:43.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.264+0000 7f0756757640 1 --2- 172.21.15.131:0/2258420159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07500d3e10 0x7f075015ab50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0748009d90 tx=0x7f0748004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:43.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.264+0000 7f074e7fc640 1 -- 172.21.15.131:0/2258420159 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074803f070 con 0x7f07500d3e10 2024-05-17T04:09:43.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.264+0000 7f074e7fc640 1 -- 172.21.15.131:0/2258420159 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0748031c40 con 0x7f07500d3e10 2024-05-17T04:09:43.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.264+0000 7f07581ba640 1 -- 172.21.15.131:0/2258420159 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07501e9ba0 con 0x7f07500d3e10 2024-05-17T04:09:43.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.264+0000 7f074e7fc640 1 -- 172.21.15.131:0/2258420159 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748003990 con 0x7f07500d3e10 2024-05-17T04:09:43.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.264+0000 7f07581ba640 1 -- 172.21.15.131:0/2258420159 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07501ea160 con 0x7f07500d3e10 2024-05-17T04:09:43.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.265+0000 7f07581ba640 1 -- 172.21.15.131:0/2258420159 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07500d4220 con 0x7f07500d3e10 2024-05-17T04:09:43.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.266+0000 7f074e7fc640 1 -- 172.21.15.131:0/2258420159 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0748003b30 con 0x7f07500d3e10 2024-05-17T04:09:43.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.266+0000 7f074e7fc640 1 --2- 172.21.15.131:0/2258420159 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f073c0762d0 0x7f073c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.266+0000 7f0755f56640 1 --2- 172.21.15.131:0/2258420159 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f073c0762d0 0x7f073c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.266+0000 7f074e7fc640 1 -- 172.21.15.131:0/2258420159 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f07480b8ca0 con 0x7f07500d3e10 2024-05-17T04:09:43.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.267+0000 7f0755f56640 1 --2- 172.21.15.131:0/2258420159 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f073c0762d0 0x7f073c0787e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0740000f60 tx=0x7f0740007d00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:43.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.271+0000 7f074e7fc640 1 -- 172.21.15.131:0/2258420159 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0748082230 con 0x7f07500d3e10 2024-05-17T04:09:43.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.486+0000 7f07581ba640 1 -- 172.21.15.131:0/2258420159 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07500b9ef0 con 0x7f07500d3e10 2024-05-17T04:09:43.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.486+0000 7f074e7fc640 1 -- 172.21.15.131:0/2258420159 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5189 (secure 0 0 0) 0x7f0748081b30 con 0x7f07500d3e10 2024-05-17T04:09:43.486 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:43.487 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2897828294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2897828294},{"type":"v1","addr":"172.21.15.131:6837","nonce":2897828294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/4068751282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4068751282},{"type":"v1","addr":"172.21.15.131:6836","nonce":4068751282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2776700884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2776700884},{"type":"v1","addr":"172.21.15.150:6834","nonce":2776700884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:05.755541+0000","modified":"2024-05-17T04:09:18.813988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2635477484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2635477484},{"type":"v1","addr":"172.21.15.150:6835","nonce":2635477484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-05-17T04:09:43.487 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-05-17T04:09:43.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.488+0000 7f07581ba640 1 -- 172.21.15.131:0/2258420159 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f073c0762d0 msgr2=0x7f073c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.488+0000 7f07581ba640 1 --2- 172.21.15.131:0/2258420159 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f073c0762d0 0x7f073c0787e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0740000f60 tx=0x7f0740007d00 comp rx=0 tx=0).stop 2024-05-17T04:09:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.488+0000 7f07581ba640 1 -- 172.21.15.131:0/2258420159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07500d3e10 msgr2=0x7f075015ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.488+0000 7f07581ba640 1 --2- 172.21.15.131:0/2258420159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07500d3e10 0x7f075015ab50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0748009d90 tx=0x7f0748004a40 comp rx=0 tx=0).stop 2024-05-17T04:09:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.488+0000 7f07581ba640 1 -- 172.21.15.131:0/2258420159 shutdown_connections 2024-05-17T04:09:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.488+0000 7f07581ba640 1 --2- 172.21.15.131:0/2258420159 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f073c0762d0 0x7f073c0787e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.488+0000 7f07581ba640 1 --2- 172.21.15.131:0/2258420159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07500d3e10 0x7f075015ab50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.488+0000 7f07581ba640 1 --2- 172.21.15.131:0/2258420159 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07500b4270 0x7f075015a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.488+0000 7f07581ba640 1 --2- 172.21.15.131:0/2258420159 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07500b3d20 0x7f07501eb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.488+0000 7f07581ba640 1 -- 172.21.15.131:0/2258420159 >> 172.21.15.131:0/2258420159 conn(0x7f07500d5860 msgr2=0x7f07500ba4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.488+0000 7f07581ba640 1 -- 172.21.15.131:0/2258420159 shutdown_connections 2024-05-17T04:09:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.488+0000 7f07581ba640 1 -- 172.21.15.131:0/2258420159 wait complete. 2024-05-17T04:09:43.500 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:09:43.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.610+0000 7f98daace640 1 Processor -- start 2024-05-17T04:09:43.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.610+0000 7f98daace640 1 -- start start 2024-05-17T04:09:43.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.611+0000 7f98daace640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f98d415d3c0 0x7f98d4071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.611+0000 7f98daace640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f98d40d0b90 0x7f98d40d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.611+0000 7f98daace640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98d40d14e0 con 0x7f98d406e090 2024-05-17T04:09:43.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.611+0000 7f98daace640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f98d4070ca0 con 0x7f98d40d0b90 2024-05-17T04:09:43.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.611+0000 7f98daace640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f98d4070370 con 0x7f98d415d3c0 2024-05-17T04:09:43.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.611+0000 7f98d3fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f98d40d0b90 0x7f98d40d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.611+0000 7f98d3fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f98d40d0b90 0x7f98d40d0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33576/0 (socket says 172.21.15.131:33576) 2024-05-17T04:09:43.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.611+0000 7f98d3fff640 1 -- 172.21.15.131:0/712393646 learned_addr learned my addr 172.21.15.131:0/712393646 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:43.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.611+0000 7f98d886a640 1 --2- 172.21.15.131:0/712393646 >> v2:172.21.15.150:3300/0 conn(0x7f98d415d3c0 0x7f98d4071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.612+0000 7f98d3fff640 1 -- 172.21.15.131:0/712393646 >> v2:172.21.15.150:3300/0 conn(0x7f98d415d3c0 msgr2=0x7f98d4071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:43.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.612+0000 7f98d3fff640 1 --2- 172.21.15.131:0/712393646 >> v2:172.21.15.150:3300/0 conn(0x7f98d415d3c0 0x7f98d4071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.612+0000 7f98d3fff640 1 -- 172.21.15.131:0/712393646 >> v1:172.21.15.150:6789/0 conn(0x7f98d406e090 legacy=0x7f98d406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.612+0000 7f98d3fff640 1 -- 172.21.15.131:0/712393646 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d4070650 con 0x7f98d40d0b90 2024-05-17T04:09:43.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.612+0000 7f98d886a640 1 --2- 172.21.15.131:0/712393646 >> v2:172.21.15.150:3300/0 conn(0x7f98d415d3c0 0x7f98d4071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:43.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.612+0000 7f98d3fff640 1 --2- 172.21.15.131:0/712393646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d40d0b90 0x7f98d40d0fa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f98d4074d50 tx=0x7f98c802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a927fa9c5e2a96 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:43.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.612+0000 7f98d37fe640 1 -- 172.21.15.131:0/712393646 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c8036070 con 0x7f98d40d0b90 2024-05-17T04:09:43.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.612+0000 7f98d37fe640 1 -- 172.21.15.131:0/712393646 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c8031600 con 0x7f98d40d0b90 2024-05-17T04:09:43.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.612+0000 7f98d37fe640 1 -- 172.21.15.131:0/712393646 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c80319d0 con 0x7f98d40d0b90 2024-05-17T04:09:43.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.613+0000 7f98daace640 1 -- 172.21.15.131:0/712393646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d40d0b90 msgr2=0x7f98d40d0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.613+0000 7f98daace640 1 --2- 172.21.15.131:0/712393646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d40d0b90 0x7f98d40d0fa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f98d4074d50 tx=0x7f98c802a730 comp rx=0 tx=0).stop 2024-05-17T04:09:43.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.613+0000 7f98daace640 1 -- 172.21.15.131:0/712393646 shutdown_connections 2024-05-17T04:09:43.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.613+0000 7f98daace640 1 --2- 172.21.15.131:0/712393646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d40d0b90 0x7f98d40d0fa0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.613+0000 7f98daace640 1 --2- 172.21.15.131:0/712393646 >> v2:172.21.15.150:3300/0 conn(0x7f98d415d3c0 0x7f98d4071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.613+0000 7f98daace640 1 -- 172.21.15.131:0/712393646 >> 172.21.15.131:0/712393646 conn(0x7f98d40735b0 msgr2=0x7f98d40739c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:43.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.613+0000 7f98daace640 1 -- 172.21.15.131:0/712393646 shutdown_connections 2024-05-17T04:09:43.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.613+0000 7f98daace640 1 -- 172.21.15.131:0/712393646 wait complete. 2024-05-17T04:09:43.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.615+0000 7f98daace640 1 Processor -- start 2024-05-17T04:09:43.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.615+0000 7f98daace640 1 -- start start 2024-05-17T04:09:43.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.616+0000 7f98daace640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d406e090 0x7f98d41f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.616+0000 7f98daace640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d40d0b90 0x7f98d4159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98daace640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98d415d3c0 0x7f98d414d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98daace640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f98d415d7d0 con 0x7f98d40d0b90 2024-05-17T04:09:43.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98daace640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f98d4071670 con 0x7f98d415d3c0 2024-05-17T04:09:43.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98daace640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f98d406ff90 con 0x7f98d406e090 2024-05-17T04:09:43.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d3fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d40d0b90 0x7f98d4159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d3fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d40d0b90 0x7f98d4159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33590/0 (socket says 172.21.15.131:33590) 2024-05-17T04:09:43.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d3fff640 1 -- 172.21.15.131:0/2322384620 learned_addr learned my addr 172.21.15.131:0/2322384620 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:43.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d886a640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d406e090 0x7f98d41f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d906b640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98d415d3c0 0x7f98d414d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d3fff640 1 -- 172.21.15.131:0/2322384620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d406e090 msgr2=0x7f98d41f8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d3fff640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d406e090 0x7f98d41f8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d3fff640 1 -- 172.21.15.131:0/2322384620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98d415d3c0 msgr2=0x7f98d414d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d3fff640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98d415d3c0 0x7f98d414d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d3fff640 1 -- 172.21.15.131:0/2322384620 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d4156ac0 con 0x7f98d40d0b90 2024-05-17T04:09:43.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d886a640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d406e090 0x7f98d41f8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:43.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d906b640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98d415d3c0 0x7f98d414d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:43.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d3fff640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d40d0b90 0x7f98d4159690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f98c8034040 tx=0x7f98c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:43.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d17fa640 1 -- 172.21.15.131:0/2322384620 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c8036050 con 0x7f98d40d0b90 2024-05-17T04:09:43.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d17fa640 1 -- 172.21.15.131:0/2322384620 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c8042070 con 0x7f98d40d0b90 2024-05-17T04:09:43.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98daace640 1 -- 172.21.15.131:0/2322384620 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d41f9b10 con 0x7f98d40d0b90 2024-05-17T04:09:43.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98d17fa640 1 -- 172.21.15.131:0/2322384620 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c8009510 con 0x7f98d40d0b90 2024-05-17T04:09:43.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.617+0000 7f98daace640 1 -- 172.21.15.131:0/2322384620 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d41460c0 con 0x7f98d40d0b90 2024-05-17T04:09:43.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.619+0000 7f98daace640 1 -- 172.21.15.131:0/2322384620 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d40d0fa0 con 0x7f98d40d0b90 2024-05-17T04:09:43.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.619+0000 7f98d17fa640 1 -- 172.21.15.131:0/2322384620 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f98c8007c50 con 0x7f98d40d0b90 2024-05-17T04:09:43.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.620+0000 7f98d17fa640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f98c0076300 0x7f98c0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.620+0000 7f98d17fa640 1 -- 172.21.15.131:0/2322384620 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f98c80b87c0 con 0x7f98d40d0b90 2024-05-17T04:09:43.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.620+0000 7f98d886a640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f98c0076300 0x7f98c0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.620+0000 7f98d886a640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f98c0076300 0x7f98c0078810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f98c4006fd0 tx=0x7f98c4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:43.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.624+0000 7f98d17fa640 1 -- 172.21.15.131:0/2322384620 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f98c8081de0 con 0x7f98d40d0b90 2024-05-17T04:09:43.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.807+0000 7f98daace640 1 -- 172.21.15.131:0/2322384620 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98d40b1900 con 0x7f98d40d0b90 2024-05-17T04:09:43.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.808+0000 7f98d17fa640 1 -- 172.21.15.131:0/2322384620 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f98c80816e0 con 0x7f98d40d0b90 2024-05-17T04:09:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:43.809 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":24,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:09:10.777455+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:03.633460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:04.707669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-17T04:09:08.400498+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:09:43.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.810+0000 7f98daace640 1 -- 172.21.15.131:0/2322384620 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f98c0076300 msgr2=0x7f98c0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.810+0000 7f98daace640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f98c0076300 0x7f98c0078810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f98c4006fd0 tx=0x7f98c4008040 comp rx=0 tx=0).stop 2024-05-17T04:09:43.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.810+0000 7f98daace640 1 -- 172.21.15.131:0/2322384620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d40d0b90 msgr2=0x7f98d4159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.810+0000 7f98daace640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d40d0b90 0x7f98d4159690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f98c8034040 tx=0x7f98c8004a40 comp rx=0 tx=0).stop 2024-05-17T04:09:43.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.811+0000 7f98daace640 1 -- 172.21.15.131:0/2322384620 shutdown_connections 2024-05-17T04:09:43.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.811+0000 7f98daace640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f98c0076300 0x7f98c0078810 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.811+0000 7f98daace640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d40d0b90 0x7f98d4159690 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.811+0000 7f98daace640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98d415d3c0 0x7f98d414d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.811+0000 7f98daace640 1 --2- 172.21.15.131:0/2322384620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98d406e090 0x7f98d41f8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.811+0000 7f98daace640 1 -- 172.21.15.131:0/2322384620 >> 172.21.15.131:0/2322384620 conn(0x7f98d40735b0 msgr2=0x7f98d40cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:43.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.811+0000 7f98daace640 1 -- 172.21.15.131:0/2322384620 shutdown_connections 2024-05-17T04:09:43.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.811+0000 7f98daace640 1 -- 172.21.15.131:0/2322384620 wait complete. 2024-05-17T04:09:43.822 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-17T04:09:43.822 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T04:09:43.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.932+0000 7f9e42fef640 1 Processor -- start 2024-05-17T04:09:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.932+0000 7f9e42fef640 1 -- start start 2024-05-17T04:09:43.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.934+0000 7f9e42fef640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9e3c0d02f0 0x7f9e3c15f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.934+0000 7f9e42fef640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9e3c06e090 0x7f9e3c0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.934+0000 7f9e42fef640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e3c0cd8c0 con 0x7f9e3c0d0ca0 2024-05-17T04:09:43.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.934+0000 7f9e42fef640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9e3c06f0d0 con 0x7f9e3c06e090 2024-05-17T04:09:43.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.934+0000 7f9e42fef640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f9e3c06e830 con 0x7f9e3c0d02f0 2024-05-17T04:09:43.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.934+0000 7f9e4158c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9e3c06e090 0x7f9e3c0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.934+0000 7f9e40d8b640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f9e3c0d0ca0 0x7f9e3c0cfbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:58802/0 (socket says 172.21.15.131:58802) 2024-05-17T04:09:43.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.934+0000 7f9e40d8b640 1 -- 172.21.15.131:0/1781424908 learned_addr learned my addr 172.21.15.131:0/1781424908 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:43.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.934+0000 7f9e3bfff640 1 --2- 172.21.15.131:0/1781424908 >> v2:172.21.15.150:3300/0 conn(0x7f9e3c0d02f0 0x7f9e3c15f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.934+0000 7f9e4158c640 1 -- 172.21.15.131:0/1781424908 >> v2:172.21.15.150:3300/0 conn(0x7f9e3c0d02f0 msgr2=0x7f9e3c15f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:43.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.934+0000 7f9e4158c640 1 --2- 172.21.15.131:0/1781424908 >> v2:172.21.15.150:3300/0 conn(0x7f9e3c0d02f0 0x7f9e3c15f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.934+0000 7f9e4158c640 1 -- 172.21.15.131:0/1781424908 >> v1:172.21.15.131:6789/0 conn(0x7f9e3c0d0ca0 legacy=0x7f9e3c0cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.934+0000 7f9e3b7fe640 1 -- 172.21.15.131:0/1781424908 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 861253532 0 0) 0x7f9e3c0cd8c0 con 0x7f9e3c0d0ca0 2024-05-17T04:09:43.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.934+0000 7f9e4158c640 1 -- 172.21.15.131:0/1781424908 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3c06eb10 con 0x7f9e3c06e090 2024-05-17T04:09:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.935+0000 7f9e4158c640 1 --2- 172.21.15.131:0/1781424908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e3c06e090 0x7f9e3c0cdda0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0cda90 tx=0x7f9e3402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb2e496d6b2cb85 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.935+0000 7f9e3b7fe640 1 -- 172.21.15.131:0/1781424908 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e34037070 con 0x7f9e3c06e090 2024-05-17T04:09:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.935+0000 7f9e3b7fe640 1 -- 172.21.15.131:0/1781424908 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e34032440 con 0x7f9e3c06e090 2024-05-17T04:09:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.935+0000 7f9e3b7fe640 1 -- 172.21.15.131:0/1781424908 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3402ae60 con 0x7f9e3c06e090 2024-05-17T04:09:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.936+0000 7f9e42fef640 1 -- 172.21.15.131:0/1781424908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e3c06e090 msgr2=0x7f9e3c0cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.936+0000 7f9e42fef640 1 --2- 172.21.15.131:0/1781424908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e3c06e090 0x7f9e3c0cdda0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0cda90 tx=0x7f9e3402a110 comp rx=0 tx=0).stop 2024-05-17T04:09:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.936+0000 7f9e42fef640 1 -- 172.21.15.131:0/1781424908 shutdown_connections 2024-05-17T04:09:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.936+0000 7f9e42fef640 1 --2- 172.21.15.131:0/1781424908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e3c06e090 0x7f9e3c0cdda0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.936+0000 7f9e42fef640 1 --2- 172.21.15.131:0/1781424908 >> v2:172.21.15.150:3300/0 conn(0x7f9e3c0d02f0 0x7f9e3c15f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.936+0000 7f9e42fef640 1 -- 172.21.15.131:0/1781424908 >> 172.21.15.131:0/1781424908 conn(0x7f9e3c0b4e40 msgr2=0x7f9e3c0b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:43.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.936+0000 7f9e42fef640 1 -- 172.21.15.131:0/1781424908 shutdown_connections 2024-05-17T04:09:43.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.936+0000 7f9e42fef640 1 -- 172.21.15.131:0/1781424908 wait complete. 2024-05-17T04:09:43.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.938+0000 7f9e42fef640 1 Processor -- start 2024-05-17T04:09:43.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.938+0000 7f9e42fef640 1 -- start start 2024-05-17T04:09:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e42fef640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e3c06e090 0x7f9e3c15b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e42fef640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e3c0d0ca0 0x7f9e3c160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e42fef640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e3c0b8600 0x7f9e3c160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e42fef640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3c0ce2e0 con 0x7f9e3c0b8600 2024-05-17T04:09:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e42fef640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3c06e4a0 con 0x7f9e3c06e090 2024-05-17T04:09:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e42fef640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9e3c0ce460 con 0x7f9e3c0d0ca0 2024-05-17T04:09:43.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e4158c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e3c0b8600 0x7f9e3c160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e4158c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e3c0b8600 0x7f9e3c160fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33616/0 (socket says 172.21.15.131:33616) 2024-05-17T04:09:43.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e4158c640 1 -- 172.21.15.131:0/41970857 learned_addr learned my addr 172.21.15.131:0/41970857 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:43.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e40d8b640 1 --2- 172.21.15.131:0/41970857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e3c06e090 0x7f9e3c15b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e3bfff640 1 --2- 172.21.15.131:0/41970857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e3c0d0ca0 0x7f9e3c160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e4158c640 1 -- 172.21.15.131:0/41970857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e3c0d0ca0 msgr2=0x7f9e3c160a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e4158c640 1 --2- 172.21.15.131:0/41970857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e3c0d0ca0 0x7f9e3c160a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e4158c640 1 -- 172.21.15.131:0/41970857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e3c06e090 msgr2=0x7f9e3c15b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:43.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e4158c640 1 --2- 172.21.15.131:0/41970857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e3c06e090 0x7f9e3c15b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:43.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.939+0000 7f9e4158c640 1 -- 172.21.15.131:0/41970857 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3c0b7b60 con 0x7f9e3c0b8600 2024-05-17T04:09:43.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.940+0000 7f9e4158c640 1 --2- 172.21.15.131:0/41970857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e3c0b8600 0x7f9e3c160fc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e34035040 tx=0x7f9e340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:43.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.940+0000 7f9e397fa640 1 -- 172.21.15.131:0/41970857 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e34037040 con 0x7f9e3c0b8600 2024-05-17T04:09:43.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.940+0000 7f9e397fa640 1 -- 172.21.15.131:0/41970857 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e34042070 con 0x7f9e3c0b8600 2024-05-17T04:09:43.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.940+0000 7f9e42fef640 1 -- 172.21.15.131:0/41970857 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3c0cad00 con 0x7f9e3c0b8600 2024-05-17T04:09:43.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.940+0000 7f9e397fa640 1 -- 172.21.15.131:0/41970857 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e34030b30 con 0x7f9e3c0b8600 2024-05-17T04:09:43.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.940+0000 7f9e42fef640 1 -- 172.21.15.131:0/41970857 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e3c0b7e00 con 0x7f9e3c0b8600 2024-05-17T04:09:43.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.941+0000 7f9e42fef640 1 -- 172.21.15.131:0/41970857 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e3c0cdda0 con 0x7f9e3c0b8600 2024-05-17T04:09:43.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.942+0000 7f9e397fa640 1 -- 172.21.15.131:0/41970857 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9e34030cd0 con 0x7f9e3c0b8600 2024-05-17T04:09:43.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.942+0000 7f9e397fa640 1 --2- 172.21.15.131:0/41970857 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e1c0762d0 0x7f9e1c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:43.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.942+0000 7f9e397fa640 1 -- 172.21.15.131:0/41970857 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9e340b84a0 con 0x7f9e3c0b8600 2024-05-17T04:09:43.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.942+0000 7f9e40d8b640 1 --2- 172.21.15.131:0/41970857 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e1c0762d0 0x7f9e1c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:43.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.943+0000 7f9e40d8b640 1 --2- 172.21.15.131:0/41970857 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e1c0762d0 0x7f9e1c0787e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0012e0 tx=0x7f9e2c001630 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:43.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:43.946+0000 7f9e397fa640 1 -- 172.21.15.131:0/41970857 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9e34032e20 con 0x7f9e3c0b8600 2024-05-17T04:09:44.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.162+0000 7f9e42fef640 1 -- 172.21.15.131:0/41970857 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e3c06f330 con 0x7f9e3c0b8600 2024-05-17T04:09:44.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.162+0000 7f9e397fa640 1 -- 172.21.15.131:0/41970857 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5189 (secure 0 0 0) 0x7f9e340813e0 con 0x7f9e3c0b8600 2024-05-17T04:09:44.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:44.163 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2897828294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2897828294},{"type":"v1","addr":"172.21.15.131:6837","nonce":2897828294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/4068751282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4068751282},{"type":"v1","addr":"172.21.15.131:6836","nonce":4068751282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2776700884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2776700884},{"type":"v1","addr":"172.21.15.150:6834","nonce":2776700884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:05.755541+0000","modified":"2024-05-17T04:09:18.813988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2635477484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2635477484},{"type":"v1","addr":"172.21.15.150:6835","nonce":2635477484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-05-17T04:09:44.163 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-05-17T04:09:44.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.164+0000 7f9e42fef640 1 -- 172.21.15.131:0/41970857 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e1c0762d0 msgr2=0x7f9e1c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:44.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.164+0000 7f9e42fef640 1 --2- 172.21.15.131:0/41970857 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e1c0762d0 0x7f9e1c0787e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0012e0 tx=0x7f9e2c001630 comp rx=0 tx=0).stop 2024-05-17T04:09:44.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.164+0000 7f9e42fef640 1 -- 172.21.15.131:0/41970857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e3c0b8600 msgr2=0x7f9e3c160fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:44.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.164+0000 7f9e42fef640 1 --2- 172.21.15.131:0/41970857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e3c0b8600 0x7f9e3c160fc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e34035040 tx=0x7f9e340046c0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.164+0000 7f9e42fef640 1 -- 172.21.15.131:0/41970857 shutdown_connections 2024-05-17T04:09:44.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.164+0000 7f9e42fef640 1 --2- 172.21.15.131:0/41970857 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9e1c0762d0 0x7f9e1c0787e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.164+0000 7f9e42fef640 1 --2- 172.21.15.131:0/41970857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e3c0b8600 0x7f9e3c160fc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.164+0000 7f9e42fef640 1 --2- 172.21.15.131:0/41970857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e3c0d0ca0 0x7f9e3c160a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.165+0000 7f9e42fef640 1 --2- 172.21.15.131:0/41970857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e3c06e090 0x7f9e3c15b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.165+0000 7f9e42fef640 1 -- 172.21.15.131:0/41970857 >> 172.21.15.131:0/41970857 conn(0x7f9e3c0b4e40 msgr2=0x7f9e3c0702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:44.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.165+0000 7f9e42fef640 1 -- 172.21.15.131:0/41970857 shutdown_connections 2024-05-17T04:09:44.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.165+0000 7f9e42fef640 1 -- 172.21.15.131:0/41970857 wait complete. 2024-05-17T04:09:44.176 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T04:09:44.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.286+0000 7ff9630d6640 1 Processor -- start 2024-05-17T04:09:44.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.286+0000 7ff9630d6640 1 -- start start 2024-05-17T04:09:44.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.288+0000 7ff9630d6640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff95c0afc60 0x7ff95c0b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:44.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.288+0000 7ff9630d6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff95c0b1270 0x7ff95c06c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:44.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.288+0000 7ff9630d6640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff95c0b1680 con 0x7ff95c15f690 2024-05-17T04:09:44.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.288+0000 7ff9630d6640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff95c0b3140 con 0x7ff95c0b1270 2024-05-17T04:09:44.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.288+0000 7ff9630d6640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7ff95c0aebc0 con 0x7ff95c0afc60 2024-05-17T04:09:44.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.288+0000 7ff961673640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff95c0b1270 0x7ff95c06c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:44.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.288+0000 7ff961673640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff95c0b1270 0x7ff95c06c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33620/0 (socket says 172.21.15.131:33620) 2024-05-17T04:09:44.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.288+0000 7ff961673640 1 -- 172.21.15.131:0/3058183614 learned_addr learned my addr 172.21.15.131:0/3058183614 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:44.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.288+0000 7ff953fff640 1 --2- 172.21.15.131:0/3058183614 >> v2:172.21.15.150:3300/0 conn(0x7ff95c0afc60 0x7ff95c0b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:44.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.288+0000 7ff961673640 1 -- 172.21.15.131:0/3058183614 >> v2:172.21.15.150:3300/0 conn(0x7ff95c0afc60 msgr2=0x7ff95c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:44.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.288+0000 7ff961673640 1 --2- 172.21.15.131:0/3058183614 >> v2:172.21.15.150:3300/0 conn(0x7ff95c0afc60 0x7ff95c0b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.288+0000 7ff961673640 1 -- 172.21.15.131:0/3058183614 >> v1:172.21.15.150:6789/0 conn(0x7ff95c15f690 legacy=0x7ff95c0b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:44.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.288+0000 7ff961673640 1 -- 172.21.15.131:0/3058183614 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95c0aeea0 con 0x7ff95c0b1270 2024-05-17T04:09:44.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.289+0000 7ff961673640 1 --2- 172.21.15.131:0/3058183614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff95c0b1270 0x7ff95c06c6f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0b0ad0 tx=0x7ff95402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7956dda686b49c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:44.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.289+0000 7ff9537fe640 1 -- 172.21.15.131:0/3058183614 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954036070 con 0x7ff95c0b1270 2024-05-17T04:09:44.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.289+0000 7ff9537fe640 1 -- 172.21.15.131:0/3058183614 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff954031600 con 0x7ff95c0b1270 2024-05-17T04:09:44.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.289+0000 7ff9537fe640 1 -- 172.21.15.131:0/3058183614 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9540319d0 con 0x7ff95c0b1270 2024-05-17T04:09:44.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.290+0000 7ff9630d6640 1 -- 172.21.15.131:0/3058183614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff95c0b1270 msgr2=0x7ff95c06c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:44.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.290+0000 7ff9630d6640 1 --2- 172.21.15.131:0/3058183614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff95c0b1270 0x7ff95c06c6f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0b0ad0 tx=0x7ff95402a6a0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.290+0000 7ff9630d6640 1 -- 172.21.15.131:0/3058183614 shutdown_connections 2024-05-17T04:09:44.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.290+0000 7ff9630d6640 1 --2- 172.21.15.131:0/3058183614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff95c0b1270 0x7ff95c06c6f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.290+0000 7ff9630d6640 1 --2- 172.21.15.131:0/3058183614 >> v2:172.21.15.150:3300/0 conn(0x7ff95c0afc60 0x7ff95c0b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.290+0000 7ff9630d6640 1 -- 172.21.15.131:0/3058183614 >> 172.21.15.131:0/3058183614 conn(0x7ff95c073150 msgr2=0x7ff95c073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:44.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.290+0000 7ff9630d6640 1 -- 172.21.15.131:0/3058183614 shutdown_connections 2024-05-17T04:09:44.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.290+0000 7ff9630d6640 1 -- 172.21.15.131:0/3058183614 wait complete. 2024-05-17T04:09:44.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.292+0000 7ff9630d6640 1 Processor -- start 2024-05-17T04:09:44.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.292+0000 7ff9630d6640 1 -- start start 2024-05-17T04:09:44.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.293+0000 7ff9630d6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff95c0afc60 0x7ff95c1f8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:44.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.293+0000 7ff9630d6640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff95c0b1270 0x7ff95c154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:44.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.293+0000 7ff9630d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff95c15f690 0x7ff95c1531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:44.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.293+0000 7ff9630d6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c0af740 con 0x7ff95c15f690 2024-05-17T04:09:44.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.293+0000 7ff9630d6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c0af460 con 0x7ff95c0afc60 2024-05-17T04:09:44.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.293+0000 7ff9630d6640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff95c0ae850 con 0x7ff95c0b1270 2024-05-17T04:09:44.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.293+0000 7ff961673640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff95c15f690 0x7ff95c1531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:44.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.293+0000 7ff961673640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff95c15f690 0x7ff95c1531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33632/0 (socket says 172.21.15.131:33632) 2024-05-17T04:09:44.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.293+0000 7ff961673640 1 -- 172.21.15.131:0/2073652815 learned_addr learned my addr 172.21.15.131:0/2073652815 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:44.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.293+0000 7ff953fff640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff95c0b1270 0x7ff95c154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:44.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.294+0000 7ff960e72640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff95c0afc60 0x7ff95c1f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:44.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.294+0000 7ff961673640 1 -- 172.21.15.131:0/2073652815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff95c0b1270 msgr2=0x7ff95c154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:44.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.294+0000 7ff961673640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff95c0b1270 0x7ff95c154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.294+0000 7ff961673640 1 -- 172.21.15.131:0/2073652815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff95c0afc60 msgr2=0x7ff95c1f8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:44.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.294+0000 7ff961673640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff95c0afc60 0x7ff95c1f8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.294+0000 7ff961673640 1 -- 172.21.15.131:0/2073652815 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95c1557c0 con 0x7ff95c15f690 2024-05-17T04:09:44.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.294+0000 7ff953fff640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff95c0b1270 0x7ff95c154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:44.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.294+0000 7ff960e72640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff95c0afc60 0x7ff95c1f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:44.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.294+0000 7ff961673640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff95c15f690 0x7ff95c1531c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff95402ac90 tx=0x7ff954004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:44.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.294+0000 7ff9517fa640 1 -- 172.21.15.131:0/2073652815 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954036050 con 0x7ff95c15f690 2024-05-17T04:09:44.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.294+0000 7ff9517fa640 1 -- 172.21.15.131:0/2073652815 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff954042070 con 0x7ff95c15f690 2024-05-17T04:09:44.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.294+0000 7ff9517fa640 1 -- 172.21.15.131:0/2073652815 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954009510 con 0x7ff95c15f690 2024-05-17T04:09:44.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.294+0000 7ff9630d6640 1 -- 172.21.15.131:0/2073652815 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff95c155aa0 con 0x7ff95c15f690 2024-05-17T04:09:44.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.294+0000 7ff9630d6640 1 -- 172.21.15.131:0/2073652815 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff95c156060 con 0x7ff95c15f690 2024-05-17T04:09:44.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.295+0000 7ff9630d6640 1 -- 172.21.15.131:0/2073652815 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff95c155530 con 0x7ff95c15f690 2024-05-17T04:09:44.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.296+0000 7ff9517fa640 1 -- 172.21.15.131:0/2073652815 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff954007bd0 con 0x7ff95c15f690 2024-05-17T04:09:44.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.296+0000 7ff9517fa640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff9480762d0 0x7ff9480787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:44.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.296+0000 7ff9517fa640 1 -- 172.21.15.131:0/2073652815 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff9540b88c0 con 0x7ff95c15f690 2024-05-17T04:09:44.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.296+0000 7ff960e72640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff9480762d0 0x7ff9480787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:44.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.297+0000 7ff960e72640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff9480762d0 0x7ff9480787e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff95800a830 tx=0x7ff958008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:44.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.301+0000 7ff9517fa640 1 -- 172.21.15.131:0/2073652815 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff95c0b1680 con 0x7ff95c15f690 2024-05-17T04:09:44.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.518+0000 7ff9630d6640 1 -- 172.21.15.131:0/2073652815 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff95c1f59a0 con 0x7ff95c15f690 2024-05-17T04:09:44.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.518+0000 7ff9517fa640 1 -- 172.21.15.131:0/2073652815 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5189 (secure 0 0 0) 0x7ff95c1f59a0 con 0x7ff95c15f690 2024-05-17T04:09:44.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:44.519 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2897828294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2897828294},{"type":"v1","addr":"172.21.15.131:6837","nonce":2897828294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/4068751282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":4068751282},{"type":"v1","addr":"172.21.15.131:6836","nonce":4068751282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2776700884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2776700884},{"type":"v1","addr":"172.21.15.150:6834","nonce":2776700884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:05.755541+0000","modified":"2024-05-17T04:09:18.813988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2635477484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":2635477484},{"type":"v1","addr":"172.21.15.150:6835","nonce":2635477484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-05-17T04:09:44.519 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-05-17T04:09:44.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.520+0000 7ff9630d6640 1 -- 172.21.15.131:0/2073652815 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff9480762d0 msgr2=0x7ff9480787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:44.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.520+0000 7ff9630d6640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff9480762d0 0x7ff9480787e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff95800a830 tx=0x7ff958008040 comp rx=0 tx=0).stop 2024-05-17T04:09:44.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.520+0000 7ff9630d6640 1 -- 172.21.15.131:0/2073652815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff95c15f690 msgr2=0x7ff95c1531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:44.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.520+0000 7ff9630d6640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff95c15f690 0x7ff95c1531c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff95402ac90 tx=0x7ff954004a40 comp rx=0 tx=0).stop 2024-05-17T04:09:44.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.520+0000 7ff9630d6640 1 -- 172.21.15.131:0/2073652815 shutdown_connections 2024-05-17T04:09:44.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.520+0000 7ff9630d6640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff9480762d0 0x7ff9480787e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.520+0000 7ff9630d6640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff95c15f690 0x7ff95c1531c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.520+0000 7ff9630d6640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff95c0b1270 0x7ff95c154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.520+0000 7ff9630d6640 1 --2- 172.21.15.131:0/2073652815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff95c0afc60 0x7ff95c1f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.520+0000 7ff9630d6640 1 -- 172.21.15.131:0/2073652815 >> 172.21.15.131:0/2073652815 conn(0x7ff95c073150 msgr2=0x7ff95c15c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:44.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.520+0000 7ff9630d6640 1 -- 172.21.15.131:0/2073652815 shutdown_connections 2024-05-17T04:09:44.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.521+0000 7ff9630d6640 1 -- 172.21.15.131:0/2073652815 wait complete. 2024-05-17T04:09:44.533 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:09:44.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.644+0000 7f7dd27eb640 1 Processor -- start 2024-05-17T04:09:44.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.644+0000 7f7dd27eb640 1 -- start start 2024-05-17T04:09:44.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.645+0000 7f7dd27eb640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7dcc06fc10 0x7f7dcc0cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:44.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.645+0000 7f7dd27eb640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7dcc0d0000 0x7f7dcc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:44.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.645+0000 7f7dd27eb640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc0d0410 con 0x7f7dcc15d360 2024-05-17T04:09:44.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.645+0000 7f7dd27eb640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7dcc071bd0 con 0x7f7dcc06fc10 2024-05-17T04:09:44.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.645+0000 7f7dd27eb640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f7dcc070020 con 0x7f7dcc0d0000 2024-05-17T04:09:44.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.646+0000 7f7dcb7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7dcc06fc10 0x7f7dcc0cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:44.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.646+0000 7f7dcbfff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f7dcc15d360 0x7f7dcc0714c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38270/0 (socket says 172.21.15.131:38270) 2024-05-17T04:09:44.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.646+0000 7f7dcbfff640 1 -- 172.21.15.131:0/3829588908 learned_addr learned my addr 172.21.15.131:0/3829588908 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:44.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.646+0000 7f7dd0d88640 1 --2- 172.21.15.131:0/3829588908 >> v2:172.21.15.150:3300/0 conn(0x7f7dcc0d0000 0x7f7dcc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:44.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.646+0000 7f7dcb7fe640 1 -- 172.21.15.131:0/3829588908 >> v2:172.21.15.150:3300/0 conn(0x7f7dcc0d0000 msgr2=0x7f7dcc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:44.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.646+0000 7f7dcb7fe640 1 --2- 172.21.15.131:0/3829588908 >> v2:172.21.15.150:3300/0 conn(0x7f7dcc0d0000 0x7f7dcc160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.646+0000 7f7dcaffd640 1 -- 172.21.15.131:0/3829588908 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3181849478 0 0) 0x7f7dbc001110 con 0x7f7dcc15d360 2024-05-17T04:09:44.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.646+0000 7f7dcb7fe640 1 -- 172.21.15.131:0/3829588908 >> v1:172.21.15.131:6789/0 conn(0x7f7dcc15d360 legacy=0x7f7dcc0714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:44.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.646+0000 7f7dcb7fe640 1 -- 172.21.15.131:0/3829588908 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc1635b0 con 0x7f7dcc06fc10 2024-05-17T04:09:44.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.646+0000 7f7dd0d88640 1 --2- 172.21.15.131:0/3829588908 >> v2:172.21.15.150:3300/0 conn(0x7f7dcc0d0000 0x7f7dcc160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:44.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.647+0000 7f7dcb7fe640 1 --2- 172.21.15.131:0/3829588908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc06fc10 0x7f7dcc0cfac0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc072cd0 tx=0x7f7dc002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e3590e924cf58e server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:44.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.647+0000 7f7dcaffd640 1 -- 172.21.15.131:0/3829588908 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0037070 con 0x7f7dcc06fc10 2024-05-17T04:09:44.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.647+0000 7f7dcaffd640 1 -- 172.21.15.131:0/3829588908 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc0032440 con 0x7f7dcc06fc10 2024-05-17T04:09:44.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.647+0000 7f7dcaffd640 1 -- 172.21.15.131:0/3829588908 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc002ae60 con 0x7f7dcc06fc10 2024-05-17T04:09:44.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.647+0000 7f7dd27eb640 1 -- 172.21.15.131:0/3829588908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc06fc10 msgr2=0x7f7dcc0cfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:44.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.647+0000 7f7dd27eb640 1 --2- 172.21.15.131:0/3829588908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc06fc10 0x7f7dcc0cfac0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc072cd0 tx=0x7f7dc002a110 comp rx=0 tx=0).stop 2024-05-17T04:09:44.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.647+0000 7f7dd27eb640 1 -- 172.21.15.131:0/3829588908 shutdown_connections 2024-05-17T04:09:44.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.647+0000 7f7dd27eb640 1 --2- 172.21.15.131:0/3829588908 >> v2:172.21.15.150:3300/0 conn(0x7f7dcc0d0000 0x7f7dcc160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.647+0000 7f7dd27eb640 1 --2- 172.21.15.131:0/3829588908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc06fc10 0x7f7dcc0cfac0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.647+0000 7f7dd27eb640 1 -- 172.21.15.131:0/3829588908 >> 172.21.15.131:0/3829588908 conn(0x7f7dcc0b4c60 msgr2=0x7f7dcc0b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:44.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.648+0000 7f7dd27eb640 1 -- 172.21.15.131:0/3829588908 shutdown_connections 2024-05-17T04:09:44.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.648+0000 7f7dd27eb640 1 -- 172.21.15.131:0/3829588908 wait complete. 2024-05-17T04:09:44.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.649+0000 7f7dd27eb640 1 Processor -- start 2024-05-17T04:09:44.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.650+0000 7f7dd27eb640 1 -- start start 2024-05-17T04:09:44.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dd27eb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc06fc10 0x7f7dcc14b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:44.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dd27eb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dcc0d0000 0x7f7dcc0c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:44.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dd27eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc15d360 0x7f7dcc0b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:44.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dd27eb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc163e50 con 0x7f7dcc15d360 2024-05-17T04:09:44.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dd27eb640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc163b70 con 0x7f7dcc06fc10 2024-05-17T04:09:44.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dd27eb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7dcc072f60 con 0x7f7dcc0d0000 2024-05-17T04:09:44.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dd0d88640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc15d360 0x7f7dcc0b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:44.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dd0d88640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc15d360 0x7f7dcc0b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43346/0 (socket says 172.21.15.131:43346) 2024-05-17T04:09:44.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dd0d88640 1 -- 172.21.15.131:0/794108593 learned_addr learned my addr 172.21.15.131:0/794108593 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:44.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dcbfff640 1 --2- 172.21.15.131:0/794108593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc06fc10 0x7f7dcc14b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:44.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dcb7fe640 1 --2- 172.21.15.131:0/794108593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dcc0d0000 0x7f7dcc0c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:44.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dd0d88640 1 -- 172.21.15.131:0/794108593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dcc0d0000 msgr2=0x7f7dcc0c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:44.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dd0d88640 1 --2- 172.21.15.131:0/794108593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dcc0d0000 0x7f7dcc0c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dd0d88640 1 -- 172.21.15.131:0/794108593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc06fc10 msgr2=0x7f7dcc14b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:44.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dd0d88640 1 --2- 172.21.15.131:0/794108593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc06fc10 0x7f7dcc14b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:44.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dd0d88640 1 -- 172.21.15.131:0/794108593 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc0b7050 con 0x7f7dcc15d360 2024-05-17T04:09:44.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.651+0000 7f7dd0d88640 1 --2- 172.21.15.131:0/794108593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc15d360 0x7f7dcc0b3420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400cd80 tx=0x7f7dc400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:44.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.652+0000 7f7dc8ff9640 1 -- 172.21.15.131:0/794108593 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc400f680 con 0x7f7dcc15d360 2024-05-17T04:09:44.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.652+0000 7f7dc8ff9640 1 -- 172.21.15.131:0/794108593 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc400f840 con 0x7f7dcc15d360 2024-05-17T04:09:44.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.652+0000 7f7dd27eb640 1 -- 172.21.15.131:0/794108593 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc0c85e0 con 0x7f7dcc15d360 2024-05-17T04:09:44.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.652+0000 7f7dc8ff9640 1 -- 172.21.15.131:0/794108593 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc400fc30 con 0x7f7dcc15d360 2024-05-17T04:09:44.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.652+0000 7f7dd27eb640 1 -- 172.21.15.131:0/794108593 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc0b75d0 con 0x7f7dcc15d360 2024-05-17T04:09:44.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.653+0000 7f7dd27eb640 1 -- 172.21.15.131:0/794108593 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dcc1631d0 con 0x7f7dcc15d360 2024-05-17T04:09:44.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.653+0000 7f7dc8ff9640 1 -- 172.21.15.131:0/794108593 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7dc400e3e0 con 0x7f7dcc15d360 2024-05-17T04:09:44.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.654+0000 7f7dc8ff9640 1 --2- 172.21.15.131:0/794108593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7db8076300 0x7f7db8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:44.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.654+0000 7f7dc8ff9640 1 -- 172.21.15.131:0/794108593 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7dc40985b0 con 0x7f7dcc15d360 2024-05-17T04:09:44.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.654+0000 7f7dcbfff640 1 --2- 172.21.15.131:0/794108593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7db8076300 0x7f7db8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:44.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.654+0000 7f7dcbfff640 1 --2- 172.21.15.131:0/794108593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7db8076300 0x7f7db8078810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc000f60 tx=0x7f7dbc007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:44.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.658+0000 7f7dc8ff9640 1 -- 172.21.15.131:0/794108593 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7dc4014030 con 0x7f7dcc15d360 2024-05-17T04:09:44.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.844+0000 7f7dd27eb640 1 -- 172.21.15.131:0/794108593 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7dcc15fb30 con 0x7f7dcc15d360 2024-05-17T04:09:45.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.845+0000 7f7dc8ff9640 1 -- 172.21.15.131:0/794108593 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f7dc4061be0 con 0x7f7dcc15d360 2024-05-17T04:09:45.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:45.081 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":24,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:09:10.777455+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:03.633460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:04.707669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-17T04:09:08.400498+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:09:45.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.847+0000 7f7dd27eb640 1 -- 172.21.15.131:0/794108593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7db8076300 msgr2=0x7f7db8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:45.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.847+0000 7f7dd27eb640 1 --2- 172.21.15.131:0/794108593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7db8076300 0x7f7db8078810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc000f60 tx=0x7f7dbc007c00 comp rx=0 tx=0).stop 2024-05-17T04:09:45.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.847+0000 7f7dd27eb640 1 -- 172.21.15.131:0/794108593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc15d360 msgr2=0x7f7dcc0b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:45.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.847+0000 7f7dd27eb640 1 --2- 172.21.15.131:0/794108593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc15d360 0x7f7dcc0b3420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400cd80 tx=0x7f7dc400a650 comp rx=0 tx=0).stop 2024-05-17T04:09:45.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.847+0000 7f7dd27eb640 1 -- 172.21.15.131:0/794108593 shutdown_connections 2024-05-17T04:09:45.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.847+0000 7f7dd27eb640 1 --2- 172.21.15.131:0/794108593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7db8076300 0x7f7db8078810 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.847+0000 7f7dd27eb640 1 --2- 172.21.15.131:0/794108593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc15d360 0x7f7dcc0b3420 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.847+0000 7f7dd27eb640 1 --2- 172.21.15.131:0/794108593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dcc0d0000 0x7f7dcc0c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.847+0000 7f7dd27eb640 1 --2- 172.21.15.131:0/794108593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc06fc10 0x7f7dcc14b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.847+0000 7f7dd27eb640 1 -- 172.21.15.131:0/794108593 >> 172.21.15.131:0/794108593 conn(0x7f7dcc0b4c60 msgr2=0x7f7dcc0b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:45.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.847+0000 7f7dd27eb640 1 -- 172.21.15.131:0/794108593 shutdown_connections 2024-05-17T04:09:45.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:44.848+0000 7f7dd27eb640 1 -- 172.21.15.131:0/794108593 wait complete. 2024-05-17T04:09:45.085 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-17T04:09:45.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.197+0000 7fce470ac640 1 Processor -- start 2024-05-17T04:09:45.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.197+0000 7fce470ac640 1 -- start start 2024-05-17T04:09:45.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.198+0000 7fce470ac640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fce400b5d70 0x7fce400ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:45.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.198+0000 7fce470ac640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce4006dab0 con 0x7fce4015d300 2024-05-17T04:09:45.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.198+0000 7fce470ac640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce400d0780 con 0x7fce400b48b0 2024-05-17T04:09:45.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.198+0000 7fce470ac640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fce400cd9f0 con 0x7fce400b5d70 2024-05-17T04:09:45.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.198+0000 7fce44e48640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fce4015d300 0x7fce400cd2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38274/0 (socket says 172.21.15.131:38274) 2024-05-17T04:09:45.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.198+0000 7fce44e48640 1 -- 172.21.15.131:0/1740206135 learned_addr learned my addr 172.21.15.131:0/1740206135 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:45.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce45649640 1 --2- 172.21.15.131:0/1740206135 >> v2:172.21.15.150:3300/0 conn(0x7fce400b5d70 0x7fce400ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:45.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce377fe640 1 -- 172.21.15.131:0/1740206135 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3280094537 0 0) 0x7fce4006dab0 con 0x7fce4015d300 2024-05-17T04:09:45.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce377fe640 1 -- 172.21.15.131:0/1740206135 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce28003520 con 0x7fce4015d300 2024-05-17T04:09:45.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce377fe640 1 -- 172.21.15.131:0/1740206135 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 487388392 0 0) 0x7fce28003520 con 0x7fce4015d300 2024-05-17T04:09:45.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce377fe640 1 -- 172.21.15.131:0/1740206135 >> v2:172.21.15.150:3300/0 conn(0x7fce400b5d70 msgr2=0x7fce400ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:45.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce377fe640 1 --2- 172.21.15.131:0/1740206135 >> v2:172.21.15.150:3300/0 conn(0x7fce400b5d70 0x7fce400ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce377fe640 1 -- 172.21.15.131:0/1740206135 >> v1:172.21.15.150:6789/0 conn(0x7fce400b48b0 legacy=0x7fce400b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:45.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce377fe640 1 -- 172.21.15.131:0/1740206135 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce400d0a60 con 0x7fce4015d300 2024-05-17T04:09:45.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce377fe640 1 -- 172.21.15.131:0/1740206135 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7fce3c001710 con 0x7fce4015d300 2024-05-17T04:09:45.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce377fe640 1 -- 172.21.15.131:0/1740206135 >> v1:172.21.15.131:6789/0 conn(0x7fce4015d300 legacy=0x7fce400cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:45.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce377fe640 1 --2- 172.21.15.131:0/1740206135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce28003a50 0x7fce28003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:45.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce377fe640 1 --2- 172.21.15.131:0/1740206135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce28004800 0x7fce28004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:45.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce377fe640 1 --2- 172.21.15.131:0/1740206135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce28005250 0x7fce2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:45.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce377fe640 1 -- 172.21.15.131:0/1740206135 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fce400cd9f0 con 0x7fce28003a50 2024-05-17T04:09:45.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce377fe640 1 -- 172.21.15.131:0/1740206135 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fce2800c1e0 con 0x7fce28004800 2024-05-17T04:09:45.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce377fe640 1 -- 172.21.15.131:0/1740206135 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fce2800c3e0 con 0x7fce28005250 2024-05-17T04:09:45.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce44e48640 1 --2- 172.21.15.131:0/1740206135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce28003a50 0x7fce28003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:45.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce45649640 1 --2- 172.21.15.131:0/1740206135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce28005250 0x7fce2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:45.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce37fff640 1 --2- 172.21.15.131:0/1740206135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce28004800 0x7fce28004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:45.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce44e48640 1 -- 172.21.15.131:0/1740206135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce28005250 msgr2=0x7fce2800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:45.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce44e48640 1 --2- 172.21.15.131:0/1740206135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce28005250 0x7fce2800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce44e48640 1 -- 172.21.15.131:0/1740206135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce28004800 msgr2=0x7fce28004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:45.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce44e48640 1 --2- 172.21.15.131:0/1740206135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce28004800 0x7fce28004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce44e48640 1 -- 172.21.15.131:0/1740206135 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce28003520 con 0x7fce28003a50 2024-05-17T04:09:45.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce45649640 1 --2- 172.21.15.131:0/1740206135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce28005250 0x7fce2800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:45.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.199+0000 7fce45649640 1 -- 172.21.15.131:0/1740206135 reap_dead start 2024-05-17T04:09:45.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.200+0000 7fce44e48640 1 --2- 172.21.15.131:0/1740206135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce28003a50 0x7fce28003ec0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00c210 tx=0x7fce28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74c8c86a80d83d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:45.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.200+0000 7fce377fe640 1 -- 172.21.15.131:0/1740206135 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c007d60 con 0x7fce28003a50 2024-05-17T04:09:45.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.200+0000 7fce377fe640 1 -- 172.21.15.131:0/1740206135 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce3c005ad0 con 0x7fce28003a50 2024-05-17T04:09:45.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.200+0000 7fce377fe640 1 -- 172.21.15.131:0/1740206135 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c007070 con 0x7fce28003a50 2024-05-17T04:09:45.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.201+0000 7fce470ac640 1 -- 172.21.15.131:0/1740206135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce28003a50 msgr2=0x7fce28003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:45.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.201+0000 7fce470ac640 1 --2- 172.21.15.131:0/1740206135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce28003a50 0x7fce28003ec0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00c210 tx=0x7fce28005830 comp rx=0 tx=0).stop 2024-05-17T04:09:45.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.201+0000 7fce470ac640 1 -- 172.21.15.131:0/1740206135 shutdown_connections 2024-05-17T04:09:45.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.201+0000 7fce470ac640 1 --2- 172.21.15.131:0/1740206135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce28003a50 0x7fce28003ec0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.201+0000 7fce470ac640 1 -- 172.21.15.131:0/1740206135 >> 172.21.15.131:0/1740206135 conn(0x7fce400b36d0 msgr2=0x7fce400d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:45.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.201+0000 7fce470ac640 1 -- 172.21.15.131:0/1740206135 shutdown_connections 2024-05-17T04:09:45.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.201+0000 7fce470ac640 1 -- 172.21.15.131:0/1740206135 wait complete. 2024-05-17T04:09:45.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.203+0000 7fce470ac640 1 Processor -- start 2024-05-17T04:09:45.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.203+0000 7fce470ac640 1 -- start start 2024-05-17T04:09:45.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.204+0000 7fce470ac640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce28003a50 0x7fce401436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:45.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.204+0000 7fce470ac640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce40155220 0x7fce401532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:45.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.204+0000 7fce470ac640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce40153800 0x7fce40150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:45.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.204+0000 7fce470ac640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fce4015d710 con 0x7fce40153800 2024-05-17T04:09:45.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.204+0000 7fce470ac640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fce400b4390 con 0x7fce40155220 2024-05-17T04:09:45.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.204+0000 7fce470ac640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fce400d02f0 con 0x7fce28003a50 2024-05-17T04:09:45.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.204+0000 7fce45649640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce40153800 0x7fce40150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:45.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.204+0000 7fce45649640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce40153800 0x7fce40150e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43366/0 (socket says 172.21.15.131:43366) 2024-05-17T04:09:45.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.204+0000 7fce45649640 1 -- 172.21.15.131:0/4269989184 learned_addr learned my addr 172.21.15.131:0/4269989184 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:45.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.205+0000 7fce45649640 1 -- 172.21.15.131:0/4269989184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce28003a50 msgr2=0x7fce401436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:45.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.205+0000 7fce44e48640 1 --2- 172.21.15.131:0/4269989184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce28003a50 0x7fce401436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:45.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.205+0000 7fce37fff640 1 --2- 172.21.15.131:0/4269989184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce40155220 0x7fce401532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:45.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.205+0000 7fce45649640 1 --2- 172.21.15.131:0/4269989184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce28003a50 0x7fce401436c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.205+0000 7fce45649640 1 -- 172.21.15.131:0/4269989184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce40155220 msgr2=0x7fce401532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:45.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.205+0000 7fce45649640 1 --2- 172.21.15.131:0/4269989184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce40155220 0x7fce401532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.205+0000 7fce45649640 1 -- 172.21.15.131:0/4269989184 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce40154460 con 0x7fce40153800 2024-05-17T04:09:45.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.205+0000 7fce45649640 1 --2- 172.21.15.131:0/4269989184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce40153800 0x7fce40150e40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fce400b0a80 tx=0x7fce38010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:45.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.205+0000 7fce357fa640 1 -- 172.21.15.131:0/4269989184 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38003990 con 0x7fce40153800 2024-05-17T04:09:45.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.205+0000 7fce357fa640 1 -- 172.21.15.131:0/4269989184 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce38003b50 con 0x7fce40153800 2024-05-17T04:09:45.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.205+0000 7fce470ac640 1 -- 172.21.15.131:0/4269989184 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce40154740 con 0x7fce40153800 2024-05-17T04:09:45.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.205+0000 7fce357fa640 1 -- 172.21.15.131:0/4269989184 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38004020 con 0x7fce40153800 2024-05-17T04:09:45.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.205+0000 7fce470ac640 1 -- 172.21.15.131:0/4269989184 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce40154d00 con 0x7fce40153800 2024-05-17T04:09:45.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.206+0000 7fce470ac640 1 -- 172.21.15.131:0/4269989184 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce40153d60 con 0x7fce40153800 2024-05-17T04:09:45.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.207+0000 7fce357fa640 1 -- 172.21.15.131:0/4269989184 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fce38005d10 con 0x7fce40153800 2024-05-17T04:09:45.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.207+0000 7fce357fa640 1 --2- 172.21.15.131:0/4269989184 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fce2c0762d0 0x7fce2c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:45.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.207+0000 7fce44e48640 1 --2- 172.21.15.131:0/4269989184 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fce2c0762d0 0x7fce2c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:45.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.208+0000 7fce357fa640 1 -- 172.21.15.131:0/4269989184 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fce380981a0 con 0x7fce40153800 2024-05-17T04:09:45.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.208+0000 7fce44e48640 1 --2- 172.21.15.131:0/4269989184 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fce2c0762d0 0x7fce2c0787e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fce3c032000 tx=0x7fce3c009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:45.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.212+0000 7fce357fa640 1 -- 172.21.15.131:0/4269989184 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fce38025020 con 0x7fce40153800 2024-05-17T04:09:45.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.433+0000 7fce470ac640 1 -- 172.21.15.131:0/4269989184 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fce400b4cc0 con 0x7fce40153800 2024-05-17T04:09:45.433 INFO:tasks.ceph.mon.a.smithi131.stderr:2024-05-17T04:09:45.433+0000 7ff88d74d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-17T04:09:45.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.435+0000 7fce357fa640 1 -- 172.21.15.131:0/4269989184 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fce38061730 con 0x7fce40153800 2024-05-17T04:09:45.435 INFO:teuthology.orchestra.run.smithi131.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-17T04:09:45.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.437+0000 7fce470ac640 1 -- 172.21.15.131:0/4269989184 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fce2c0762d0 msgr2=0x7fce2c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:45.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.437+0000 7fce470ac640 1 --2- 172.21.15.131:0/4269989184 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fce2c0762d0 0x7fce2c0787e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fce3c032000 tx=0x7fce3c009030 comp rx=0 tx=0).stop 2024-05-17T04:09:45.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.437+0000 7fce470ac640 1 -- 172.21.15.131:0/4269989184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce40153800 msgr2=0x7fce40150e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:45.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.437+0000 7fce470ac640 1 --2- 172.21.15.131:0/4269989184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce40153800 0x7fce40150e40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fce400b0a80 tx=0x7fce38010590 comp rx=0 tx=0).stop 2024-05-17T04:09:45.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.438+0000 7fce470ac640 1 -- 172.21.15.131:0/4269989184 shutdown_connections 2024-05-17T04:09:45.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.438+0000 7fce470ac640 1 --2- 172.21.15.131:0/4269989184 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fce2c0762d0 0x7fce2c0787e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.438+0000 7fce470ac640 1 --2- 172.21.15.131:0/4269989184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce40153800 0x7fce40150e40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.438+0000 7fce470ac640 1 --2- 172.21.15.131:0/4269989184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce40155220 0x7fce401532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.438+0000 7fce470ac640 1 --2- 172.21.15.131:0/4269989184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce28003a50 0x7fce401436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.438+0000 7fce470ac640 1 -- 172.21.15.131:0/4269989184 >> 172.21.15.131:0/4269989184 conn(0x7fce400b36d0 msgr2=0x7fce400cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:45.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.438+0000 7fce470ac640 1 -- 172.21.15.131:0/4269989184 shutdown_connections 2024-05-17T04:09:45.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.438+0000 7fce470ac640 1 -- 172.21.15.131:0/4269989184 wait complete. 2024-05-17T04:09:45.441 INFO:tasks.ceph.mds.b.smithi150.stderr: -3083> 2024-05-17T04:09:11.357+0000 7fd62258d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-17T04:09:45.450 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-17T04:09:45.499 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-05-17T04:09:45.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.563+0000 7fbf03b68640 1 Processor -- start 2024-05-17T04:09:45.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.563+0000 7fbf03b68640 1 -- start start 2024-05-17T04:09:45.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.564+0000 7fbf03b68640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbefc15f710 0x7fbefc0d3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:45.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.564+0000 7fbf03b68640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbefc163da0 0x7fbefc06da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:45.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.564+0000 7fbf03b68640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbefc06e360 con 0x7fbefc06df50 2024-05-17T04:09:45.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.564+0000 7fbf03b68640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fbefc0d0250 con 0x7fbefc15f710 2024-05-17T04:09:45.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.564+0000 7fbf03b68640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbefc0d46f0 con 0x7fbefc163da0 2024-05-17T04:09:45.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.564+0000 7fbf01904640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbefc15f710 0x7fbefc0d3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:45.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.564+0000 7fbf02105640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fbefc06df50 0x7fbefc06c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38276/0 (socket says 172.21.15.131:38276) 2024-05-17T04:09:45.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.564+0000 7fbf02105640 1 -- 172.21.15.131:0/1236662565 learned_addr learned my addr 172.21.15.131:0/1236662565 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:45.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.564+0000 7fbf01103640 1 --2- 172.21.15.131:0/1236662565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbefc163da0 0x7fbefc06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:45.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.565+0000 7fbf01904640 1 -- 172.21.15.131:0/1236662565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbefc163da0 msgr2=0x7fbefc06da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:45.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.565+0000 7fbf01904640 1 --2- 172.21.15.131:0/1236662565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbefc163da0 0x7fbefc06da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.565+0000 7fbf01904640 1 -- 172.21.15.131:0/1236662565 >> v1:172.21.15.131:6789/0 conn(0x7fbefc06df50 legacy=0x7fbefc06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:45.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.565+0000 7fbf00902640 1 -- 172.21.15.131:0/1236662565 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3274354668 0 0) 0x7fbef4001110 con 0x7fbefc06df50 2024-05-17T04:09:45.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.565+0000 7fbf01904640 1 -- 172.21.15.131:0/1236662565 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbefc0cf920 con 0x7fbefc15f710 2024-05-17T04:09:45.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.565+0000 7fbf01904640 1 --2- 172.21.15.131:0/1236662565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbefc15f710 0x7fbefc0d3e10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009d90 tx=0x7fbef802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576e52513a04e057 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:45.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.565+0000 7fbf00902640 1 -- 172.21.15.131:0/1236662565 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8007740 con 0x7fbefc15f710 2024-05-17T04:09:45.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.565+0000 7fbf00902640 1 -- 172.21.15.131:0/1236662565 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef80078e0 con 0x7fbefc15f710 2024-05-17T04:09:45.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.566+0000 7fbf00902640 1 -- 172.21.15.131:0/1236662565 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8007cb0 con 0x7fbefc15f710 2024-05-17T04:09:45.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.566+0000 7fbf03b68640 1 -- 172.21.15.131:0/1236662565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbefc15f710 msgr2=0x7fbefc0d3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:45.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.566+0000 7fbf03b68640 1 --2- 172.21.15.131:0/1236662565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbefc15f710 0x7fbefc0d3e10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009d90 tx=0x7fbef802a660 comp rx=0 tx=0).stop 2024-05-17T04:09:45.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.566+0000 7fbf03b68640 1 -- 172.21.15.131:0/1236662565 shutdown_connections 2024-05-17T04:09:45.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.566+0000 7fbf03b68640 1 --2- 172.21.15.131:0/1236662565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbefc163da0 0x7fbefc06da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.566+0000 7fbf03b68640 1 --2- 172.21.15.131:0/1236662565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbefc15f710 0x7fbefc0d3e10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.566+0000 7fbf03b68640 1 -- 172.21.15.131:0/1236662565 >> 172.21.15.131:0/1236662565 conn(0x7fbefc0d5860 msgr2=0x7fbefc0b6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:45.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.566+0000 7fbf03b68640 1 -- 172.21.15.131:0/1236662565 shutdown_connections 2024-05-17T04:09:45.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.566+0000 7fbf03b68640 1 -- 172.21.15.131:0/1236662565 wait complete. 2024-05-17T04:09:45.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.568+0000 7fbf03b68640 1 Processor -- start 2024-05-17T04:09:45.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.568+0000 7fbf03b68640 1 -- start start 2024-05-17T04:09:45.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.569+0000 7fbf03b68640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbefc06df50 0x7fbefc0c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:45.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.569+0000 7fbf03b68640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbefc15f710 0x7fbefc155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:45.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.569+0000 7fbf03b68640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbefc163da0 0x7fbefc1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:45.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.569+0000 7fbf03b68640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbefc0d4350 con 0x7fbefc06df50 2024-05-17T04:09:45.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.569+0000 7fbf03b68640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbefc0cfee0 con 0x7fbefc15f710 2024-05-17T04:09:45.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.569+0000 7fbf03b68640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbefc0d44d0 con 0x7fbefc163da0 2024-05-17T04:09:45.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.569+0000 7fbf01904640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbefc06df50 0x7fbefc0c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:45.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.569+0000 7fbf01904640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbefc06df50 0x7fbefc0c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43372/0 (socket says 172.21.15.131:43372) 2024-05-17T04:09:45.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.569+0000 7fbf01904640 1 -- 172.21.15.131:0/2511468655 learned_addr learned my addr 172.21.15.131:0/2511468655 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:45.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.569+0000 7fbf01103640 1 --2- 172.21.15.131:0/2511468655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbefc15f710 0x7fbefc155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:45.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.570+0000 7fbf02105640 1 --2- 172.21.15.131:0/2511468655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbefc163da0 0x7fbefc1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:45.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.570+0000 7fbf01904640 1 -- 172.21.15.131:0/2511468655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbefc163da0 msgr2=0x7fbefc1561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:45.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.570+0000 7fbf01904640 1 --2- 172.21.15.131:0/2511468655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbefc163da0 0x7fbefc1561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.570+0000 7fbf01904640 1 -- 172.21.15.131:0/2511468655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbefc15f710 msgr2=0x7fbefc155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:45.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.570+0000 7fbf01904640 1 --2- 172.21.15.131:0/2511468655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbefc15f710 0x7fbefc155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:45.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.570+0000 7fbf01904640 1 -- 172.21.15.131:0/2511468655 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbefc156ce0 con 0x7fbefc06df50 2024-05-17T04:09:45.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.570+0000 7fbf01904640 1 --2- 172.21.15.131:0/2511468655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbefc06df50 0x7fbefc0c9b20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009d90 tx=0x7fbef8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:45.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.570+0000 7fbef27fc640 1 -- 172.21.15.131:0/2511468655 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8040070 con 0x7fbefc06df50 2024-05-17T04:09:45.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.570+0000 7fbef27fc640 1 -- 172.21.15.131:0/2511468655 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef8031c40 con 0x7fbefc06df50 2024-05-17T04:09:45.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.570+0000 7fbf03b68640 1 -- 172.21.15.131:0/2511468655 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbefc0ca450 con 0x7fbefc06df50 2024-05-17T04:09:45.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.570+0000 7fbef27fc640 1 -- 172.21.15.131:0/2511468655 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8003990 con 0x7fbefc06df50 2024-05-17T04:09:45.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.570+0000 7fbf03b68640 1 -- 172.21.15.131:0/2511468655 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbefc0caa10 con 0x7fbefc06df50 2024-05-17T04:09:45.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.571+0000 7fbf03b68640 1 -- 172.21.15.131:0/2511468655 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbefc0d40e0 con 0x7fbefc06df50 2024-05-17T04:09:45.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.572+0000 7fbef27fc640 1 -- 172.21.15.131:0/2511468655 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbef8039040 con 0x7fbefc06df50 2024-05-17T04:09:45.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.572+0000 7fbef27fc640 1 --2- 172.21.15.131:0/2511468655 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbee0076300 0x7fbee0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:45.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.573+0000 7fbf01103640 1 --2- 172.21.15.131:0/2511468655 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbee0076300 0x7fbee0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:45.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.573+0000 7fbef27fc640 1 -- 172.21.15.131:0/2511468655 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6618+0+0 (secure 0 0 0) 0x7fbef80b8c10 con 0x7fbefc06df50 2024-05-17T04:09:45.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.573+0000 7fbf01103640 1 --2- 172.21.15.131:0/2511468655 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbee0076300 0x7fbee0078810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbefc15f110 tx=0x7fbeec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:45.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.577+0000 7fbef27fc640 1 -- 172.21.15.131:0/2511468655 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbefc0d40e0 con 0x7fbefc06df50 2024-05-17T04:09:45.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:45.798+0000 7fbf03b68640 1 -- 172.21.15.131:0/2511468655 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fbefc0d1780 con 0x7fbefc06df50 2024-05-17T04:09:46.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.436+0000 7fbef27fc640 1 -- 172.21.15.131:0/2511468655 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fbefc156ce0 con 0x7fbefc06df50 2024-05-17T04:09:46.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.439+0000 7fbf03b68640 1 -- 172.21.15.131:0/2511468655 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbee0076300 msgr2=0x7fbee0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:46.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.439+0000 7fbf03b68640 1 --2- 172.21.15.131:0/2511468655 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbee0076300 0x7fbee0078810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbefc15f110 tx=0x7fbeec008040 comp rx=0 tx=0).stop 2024-05-17T04:09:46.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.439+0000 7fbf03b68640 1 -- 172.21.15.131:0/2511468655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbefc06df50 msgr2=0x7fbefc0c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:46.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.439+0000 7fbf03b68640 1 --2- 172.21.15.131:0/2511468655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbefc06df50 0x7fbefc0c9b20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009d90 tx=0x7fbef8004a40 comp rx=0 tx=0).stop 2024-05-17T04:09:46.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.439+0000 7fbf03b68640 1 -- 172.21.15.131:0/2511468655 shutdown_connections 2024-05-17T04:09:46.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.439+0000 7fbf03b68640 1 --2- 172.21.15.131:0/2511468655 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbee0076300 0x7fbee0078810 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:46.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.439+0000 7fbf03b68640 1 --2- 172.21.15.131:0/2511468655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbefc163da0 0x7fbefc1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:46.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.439+0000 7fbf03b68640 1 --2- 172.21.15.131:0/2511468655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbefc15f710 0x7fbefc155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:46.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.439+0000 7fbf03b68640 1 --2- 172.21.15.131:0/2511468655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbefc06df50 0x7fbefc0c9b20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:46.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.439+0000 7fbf03b68640 1 -- 172.21.15.131:0/2511468655 >> 172.21.15.131:0/2511468655 conn(0x7fbefc0d5860 msgr2=0x7fbefc1579c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:46.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.439+0000 7fbf03b68640 1 -- 172.21.15.131:0/2511468655 shutdown_connections 2024-05-17T04:09:46.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.439+0000 7fbf03b68640 1 -- 172.21.15.131:0/2511468655 wait complete. 2024-05-17T04:09:46.451 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-17T04:09:46.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.568+0000 7fd40edd2640 1 Processor -- start 2024-05-17T04:09:46.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.568+0000 7fd40edd2640 1 -- start start 2024-05-17T04:09:46.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.570+0000 7fd40edd2640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd40806c6f0 0x7fd40815f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:46.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.570+0000 7fd40edd2640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd4080d0860 0x7fd40806dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:46.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.570+0000 7fd40edd2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd40806e200 0x7fd4080d3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:46.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.570+0000 7fd40edd2640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd40815fb20 con 0x7fd40806c6f0 2024-05-17T04:09:46.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.570+0000 7fd40edd2640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd40806cc20 con 0x7fd4080d0860 2024-05-17T04:09:46.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.570+0000 7fd40edd2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd40806cf00 con 0x7fd40806e200 2024-05-17T04:09:46.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.570+0000 7fd40cb6e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd40806c6f0 0x7fd40815f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:46.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.570+0000 7fd40cb6e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd40806c6f0 0x7fd40815f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43376/0 (socket says 172.21.15.131:43376) 2024-05-17T04:09:46.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.570+0000 7fd40cb6e640 1 -- 172.21.15.131:0/1125749138 learned_addr learned my addr 172.21.15.131:0/1125749138 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:46.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.570+0000 7fd40cb6e640 1 -- 172.21.15.131:0/1125749138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd40806e200 msgr2=0x7fd4080d3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:46.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.570+0000 7fd40d36f640 1 --2- 172.21.15.131:0/1125749138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd40806e200 0x7fd4080d3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:46.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.570+0000 7fd40cb6e640 1 --2- 172.21.15.131:0/1125749138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd40806e200 0x7fd4080d3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:46.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.570+0000 7fd40cb6e640 1 -- 172.21.15.131:0/1125749138 >> v2:172.21.15.150:3300/0 conn(0x7fd4080d0860 msgr2=0x7fd40806dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:46.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.570+0000 7fd40cb6e640 1 --2- 172.21.15.131:0/1125749138 >> v2:172.21.15.150:3300/0 conn(0x7fd4080d0860 0x7fd40806dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:46.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.570+0000 7fd40cb6e640 1 -- 172.21.15.131:0/1125749138 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40806d1e0 con 0x7fd40806c6f0 2024-05-17T04:09:46.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.571+0000 7fd40cb6e640 1 --2- 172.21.15.131:0/1125749138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40806c6f0 0x7fd40815f5e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd40806ce30 tx=0x7fd3f802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a49538d1ef5f935 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:46.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.571+0000 7fd4077fe640 1 -- 172.21.15.131:0/1125749138 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8037070 con 0x7fd40806c6f0 2024-05-17T04:09:46.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.571+0000 7fd4077fe640 1 -- 172.21.15.131:0/1125749138 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f8032440 con 0x7fd40806c6f0 2024-05-17T04:09:46.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.571+0000 7fd4077fe640 1 -- 172.21.15.131:0/1125749138 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8032810 con 0x7fd40806c6f0 2024-05-17T04:09:46.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.572+0000 7fd40edd2640 1 -- 172.21.15.131:0/1125749138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40806c6f0 msgr2=0x7fd40815f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:46.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.572+0000 7fd40edd2640 1 --2- 172.21.15.131:0/1125749138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40806c6f0 0x7fd40815f5e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd40806ce30 tx=0x7fd3f802a1c0 comp rx=0 tx=0).stop 2024-05-17T04:09:46.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.572+0000 7fd40edd2640 1 -- 172.21.15.131:0/1125749138 shutdown_connections 2024-05-17T04:09:46.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.572+0000 7fd40edd2640 1 --2- 172.21.15.131:0/1125749138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd40806e200 0x7fd4080d3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:46.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.572+0000 7fd40edd2640 1 --2- 172.21.15.131:0/1125749138 >> v2:172.21.15.150:3300/0 conn(0x7fd4080d0860 0x7fd40806dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:46.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.572+0000 7fd40edd2640 1 --2- 172.21.15.131:0/1125749138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40806c6f0 0x7fd40815f5e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:46.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.572+0000 7fd40edd2640 1 -- 172.21.15.131:0/1125749138 >> 172.21.15.131:0/1125749138 conn(0x7fd4080d59b0 msgr2=0x7fd4080b6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:46.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.572+0000 7fd40edd2640 1 -- 172.21.15.131:0/1125749138 shutdown_connections 2024-05-17T04:09:46.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.572+0000 7fd40edd2640 1 -- 172.21.15.131:0/1125749138 wait complete. 2024-05-17T04:09:46.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.573+0000 7fd40edd2640 1 Processor -- start 2024-05-17T04:09:46.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.574+0000 7fd40edd2640 1 -- start start 2024-05-17T04:09:46.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40edd2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40806c6f0 0x7fd4081516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:46.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40edd2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd40806e200 0x7fd408151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:46.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40edd2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4080d0860 0x7fd408161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:46.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40edd2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd4080d0c70 con 0x7fd40806c6f0 2024-05-17T04:09:46.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40edd2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd40806d7a0 con 0x7fd4080d0860 2024-05-17T04:09:46.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40edd2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd4080d0df0 con 0x7fd40806e200 2024-05-17T04:09:46.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40cb6e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40806c6f0 0x7fd4081516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:46.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40cb6e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40806c6f0 0x7fd4081516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43380/0 (socket says 172.21.15.131:43380) 2024-05-17T04:09:46.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40cb6e640 1 -- 172.21.15.131:0/3378459298 learned_addr learned my addr 172.21.15.131:0/3378459298 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:46.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd407fff640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd40806e200 0x7fd408151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:46.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40d36f640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4080d0860 0x7fd408161ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:46.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40cb6e640 1 -- 172.21.15.131:0/3378459298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd40806e200 msgr2=0x7fd408151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:46.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40cb6e640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd40806e200 0x7fd408151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:46.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40cb6e640 1 -- 172.21.15.131:0/3378459298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4080d0860 msgr2=0x7fd408161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:46.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40cb6e640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4080d0860 0x7fd408161ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:46.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40cb6e640 1 -- 172.21.15.131:0/3378459298 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd408152340 con 0x7fd40806c6f0 2024-05-17T04:09:46.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd407fff640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd40806e200 0x7fd408151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:46.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.575+0000 7fd40d36f640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4080d0860 0x7fd408161ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:46.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.576+0000 7fd40cb6e640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40806c6f0 0x7fd4081516e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8000c00 tx=0x7fd3f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:46.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.576+0000 7fd4057fa640 1 -- 172.21.15.131:0/3378459298 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8041020 con 0x7fd40806c6f0 2024-05-17T04:09:46.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.576+0000 7fd4057fa640 1 -- 172.21.15.131:0/3378459298 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f8030970 con 0x7fd40806c6f0 2024-05-17T04:09:46.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.576+0000 7fd4057fa640 1 -- 172.21.15.131:0/3378459298 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8037040 con 0x7fd40806c6f0 2024-05-17T04:09:46.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.576+0000 7fd40edd2640 1 -- 172.21.15.131:0/3378459298 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd408152620 con 0x7fd40806c6f0 2024-05-17T04:09:46.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.576+0000 7fd40edd2640 1 -- 172.21.15.131:0/3378459298 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd408152be0 con 0x7fd40806c6f0 2024-05-17T04:09:46.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.577+0000 7fd40edd2640 1 -- 172.21.15.131:0/3378459298 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd40815f5e0 con 0x7fd40806c6f0 2024-05-17T04:09:46.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.578+0000 7fd4057fa640 1 -- 172.21.15.131:0/3378459298 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd3f8044020 con 0x7fd40806c6f0 2024-05-17T04:09:46.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.578+0000 7fd4057fa640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd3f4076300 0x7fd3f4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:46.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.578+0000 7fd407fff640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd3f4076300 0x7fd3f4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:46.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.578+0000 7fd4057fa640 1 -- 172.21.15.131:0/3378459298 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6618+0+0 (secure 0 0 0) 0x7fd3f80b8440 con 0x7fd40806c6f0 2024-05-17T04:09:46.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.579+0000 7fd407fff640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd3f4076300 0x7fd3f4078810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd408150020 tx=0x7fd3fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:46.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.583+0000 7fd4057fa640 1 -- 172.21.15.131:0/3378459298 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd3f804b030 con 0x7fd40806c6f0 2024-05-17T04:09:46.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:46.767+0000 7fd40edd2640 1 -- 172.21.15.131:0/3378459298 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd40815d0c0 con 0x7fd40806c6f0 2024-05-17T04:09:47.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.444+0000 7fd4057fa640 1 -- 172.21.15.131:0/3378459298 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) ==== 181+0+0 (secure 0 0 0) 0x7fd3f8081980 con 0x7fd40806c6f0 2024-05-17T04:09:47.444 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_metadata' removed 2024-05-17T04:09:47.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.448+0000 7fd40edd2640 1 -- 172.21.15.131:0/3378459298 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd3f4076300 msgr2=0x7fd3f4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:47.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.448+0000 7fd40edd2640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd3f4076300 0x7fd3f4078810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd408150020 tx=0x7fd3fc008040 comp rx=0 tx=0).stop 2024-05-17T04:09:47.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.448+0000 7fd40edd2640 1 -- 172.21.15.131:0/3378459298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40806c6f0 msgr2=0x7fd4081516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:47.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.448+0000 7fd40edd2640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40806c6f0 0x7fd4081516e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8000c00 tx=0x7fd3f80046c0 comp rx=0 tx=0).stop 2024-05-17T04:09:47.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.449+0000 7fd40edd2640 1 -- 172.21.15.131:0/3378459298 shutdown_connections 2024-05-17T04:09:47.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.449+0000 7fd40edd2640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd3f4076300 0x7fd3f4078810 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:47.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.449+0000 7fd40edd2640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4080d0860 0x7fd408161ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:47.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.449+0000 7fd40edd2640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd40806e200 0x7fd408151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:47.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.449+0000 7fd40edd2640 1 --2- 172.21.15.131:0/3378459298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40806c6f0 0x7fd4081516e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:47.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.449+0000 7fd40edd2640 1 -- 172.21.15.131:0/3378459298 >> 172.21.15.131:0/3378459298 conn(0x7fd4080d59b0 msgr2=0x7fd40815b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:47.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.450+0000 7fd40edd2640 1 -- 172.21.15.131:0/3378459298 shutdown_connections 2024-05-17T04:09:47.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.450+0000 7fd40edd2640 1 -- 172.21.15.131:0/3378459298 wait complete. 2024-05-17T04:09:47.474 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-17T04:09:47.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.590+0000 7f46721f5640 1 Processor -- start 2024-05-17T04:09:47.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.590+0000 7f46721f5640 1 -- start start 2024-05-17T04:09:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.592+0000 7f46721f5640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c0cb500 0x7f466c072f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.592+0000 7f46721f5640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f466c0b3e60 0x7f466c0b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.592+0000 7f46721f5640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f466c0cbd60 con 0x7f466c0cce00 2024-05-17T04:09:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.592+0000 7f46721f5640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f466c0cc040 con 0x7f466c0b3e60 2024-05-17T04:09:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.592+0000 7f46721f5640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f466c0cc320 con 0x7f466c0cb500 2024-05-17T04:09:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.592+0000 7f466affd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f466c0b3e60 0x7f466c0b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.592+0000 7f466affd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f466c0b3e60 0x7f466c0b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43398/0 (socket says 172.21.15.131:43398) 2024-05-17T04:09:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.592+0000 7f466affd640 1 -- 172.21.15.131:0/159958030 learned_addr learned my addr 172.21.15.131:0/159958030 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.592+0000 7f466b7fe640 1 --2- 172.21.15.131:0/159958030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c0cb500 0x7f466c072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.592+0000 7f466affd640 1 -- 172.21.15.131:0/159958030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c0cb500 msgr2=0x7f466c072f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.592+0000 7f466affd640 1 --2- 172.21.15.131:0/159958030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c0cb500 0x7f466c072f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.592+0000 7f466affd640 1 -- 172.21.15.131:0/159958030 >> v1:172.21.15.150:6789/0 conn(0x7f466c0cce00 legacy=0x7f466c06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.592+0000 7f466affd640 1 -- 172.21.15.131:0/159958030 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c0cc600 con 0x7f466c0b3e60 2024-05-17T04:09:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.592+0000 7f466b7fe640 1 --2- 172.21.15.131:0/159958030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c0cb500 0x7f466c072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.593+0000 7f466affd640 1 --2- 172.21.15.131:0/159958030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f466c0b3e60 0x7f466c0b4270 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4660009870 tx=0x7f466002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7080d7c87580fe server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.593+0000 7f466a7fc640 1 -- 172.21.15.131:0/159958030 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660037070 con 0x7f466c0b3e60 2024-05-17T04:09:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.593+0000 7f466a7fc640 1 -- 172.21.15.131:0/159958030 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4660032440 con 0x7f466c0b3e60 2024-05-17T04:09:47.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.593+0000 7f466a7fc640 1 -- 172.21.15.131:0/159958030 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660032810 con 0x7f466c0b3e60 2024-05-17T04:09:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.594+0000 7f46721f5640 1 -- 172.21.15.131:0/159958030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f466c0b3e60 msgr2=0x7f466c0b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.594+0000 7f46721f5640 1 --2- 172.21.15.131:0/159958030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f466c0b3e60 0x7f466c0b4270 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4660009870 tx=0x7f466002a1c0 comp rx=0 tx=0).stop 2024-05-17T04:09:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.594+0000 7f46721f5640 1 -- 172.21.15.131:0/159958030 shutdown_connections 2024-05-17T04:09:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.594+0000 7f46721f5640 1 --2- 172.21.15.131:0/159958030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f466c0b3e60 0x7f466c0b4270 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.594+0000 7f46721f5640 1 --2- 172.21.15.131:0/159958030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c0cb500 0x7f466c072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.594+0000 7f46721f5640 1 -- 172.21.15.131:0/159958030 >> 172.21.15.131:0/159958030 conn(0x7f466c0cd930 msgr2=0x7f466c0cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.594+0000 7f46721f5640 1 -- 172.21.15.131:0/159958030 shutdown_connections 2024-05-17T04:09:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.594+0000 7f46721f5640 1 -- 172.21.15.131:0/159958030 wait complete. 2024-05-17T04:09:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.596+0000 7f46721f5640 1 Processor -- start 2024-05-17T04:09:47.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.596+0000 7f46721f5640 1 -- start start 2024-05-17T04:09:47.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.597+0000 7f46721f5640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c0b3e60 0x7f466c1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:47.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.597+0000 7f46721f5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f466c0cb500 0x7f466c159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.597+0000 7f46721f5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f466c0cce00 0x7f466c159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.597+0000 7f46721f5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f466c0cd390 con 0x7f466c0cce00 2024-05-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.597+0000 7f46721f5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f466c0cd210 con 0x7f466c0cb500 2024-05-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.597+0000 7f46721f5640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f466c0cd510 con 0x7f466c0b3e60 2024-05-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.597+0000 7f466bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f466c0cce00 0x7f466c159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.597+0000 7f466bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f466c0cce00 0x7f466c159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43406/0 (socket says 172.21.15.131:43406) 2024-05-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.597+0000 7f466bfff640 1 -- 172.21.15.131:0/38238490 learned_addr learned my addr 172.21.15.131:0/38238490 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.597+0000 7f466b7fe640 1 --2- 172.21.15.131:0/38238490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c0b3e60 0x7f466c1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.597+0000 7f466affd640 1 --2- 172.21.15.131:0/38238490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f466c0cb500 0x7f466c159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.598+0000 7f466bfff640 1 -- 172.21.15.131:0/38238490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c0b3e60 msgr2=0x7f466c1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.598+0000 7f466bfff640 1 --2- 172.21.15.131:0/38238490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c0b3e60 0x7f466c1592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:47.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.598+0000 7f466bfff640 1 -- 172.21.15.131:0/38238490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f466c0cb500 msgr2=0x7f466c159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:47.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.598+0000 7f466bfff640 1 --2- 172.21.15.131:0/38238490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f466c0cb500 0x7f466c159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:47.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.598+0000 7f466bfff640 1 -- 172.21.15.131:0/38238490 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c0b21e0 con 0x7f466c0cce00 2024-05-17T04:09:47.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.598+0000 7f466bfff640 1 --2- 172.21.15.131:0/38238490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f466c0cce00 0x7f466c159d50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f466400b410 tx=0x7f466400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:47.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.598+0000 7f4653fff640 1 -- 172.21.15.131:0/38238490 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664015030 con 0x7f466c0cce00 2024-05-17T04:09:47.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.598+0000 7f4653fff640 1 -- 172.21.15.131:0/38238490 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4664004020 con 0x7f466c0cce00 2024-05-17T04:09:47.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.598+0000 7f4653fff640 1 -- 172.21.15.131:0/38238490 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664004410 con 0x7f466c0cce00 2024-05-17T04:09:47.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.598+0000 7f46721f5640 1 -- 172.21.15.131:0/38238490 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466c1587f0 con 0x7f466c0cce00 2024-05-17T04:09:47.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.598+0000 7f46721f5640 1 -- 172.21.15.131:0/38238490 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466c158db0 con 0x7f466c0cce00 2024-05-17T04:09:47.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.599+0000 7f46721f5640 1 -- 172.21.15.131:0/38238490 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f466c072f80 con 0x7f466c0cce00 2024-05-17T04:09:47.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.600+0000 7f4653fff640 1 -- 172.21.15.131:0/38238490 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4664018070 con 0x7f466c0cce00 2024-05-17T04:09:47.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.600+0000 7f4653fff640 1 --2- 172.21.15.131:0/38238490 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f46580762d0 0x7f46580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:47.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.600+0000 7f4653fff640 1 -- 172.21.15.131:0/38238490 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6383+0+0 (secure 0 0 0) 0x7f4664097330 con 0x7f466c0cce00 2024-05-17T04:09:47.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.600+0000 7f466b7fe640 1 --2- 172.21.15.131:0/38238490 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f46580762d0 0x7f46580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:47.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.601+0000 7f466b7fe640 1 --2- 172.21.15.131:0/38238490 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f46580762d0 0x7f46580787e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f465c00f500 tx=0x7f465c007770 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:47.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.604+0000 7f4653fff640 1 -- 172.21.15.131:0/38238490 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4664060290 con 0x7f466c0cce00 2024-05-17T04:09:47.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:47.789+0000 7f46721f5640 1 -- 172.21.15.131:0/38238490 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f466c0b1f70 con 0x7f466c0cce00 2024-05-17T04:09:48.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.445+0000 7f4653fff640 1 -- 172.21.15.131:0/38238490 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) ==== 169+0+0 (secure 0 0 0) 0x7f4664064590 con 0x7f466c0cce00 2024-05-17T04:09:48.445 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_data' removed 2024-05-17T04:09:48.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.447+0000 7f46721f5640 1 -- 172.21.15.131:0/38238490 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f46580762d0 msgr2=0x7f46580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:48.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.447+0000 7f46721f5640 1 --2- 172.21.15.131:0/38238490 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f46580762d0 0x7f46580787e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f465c00f500 tx=0x7f465c007770 comp rx=0 tx=0).stop 2024-05-17T04:09:48.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.447+0000 7f46721f5640 1 -- 172.21.15.131:0/38238490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f466c0cce00 msgr2=0x7f466c159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:48.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.447+0000 7f46721f5640 1 --2- 172.21.15.131:0/38238490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f466c0cce00 0x7f466c159d50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f466400b410 tx=0x7f466400b8d0 comp rx=0 tx=0).stop 2024-05-17T04:09:48.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.447+0000 7f46721f5640 1 -- 172.21.15.131:0/38238490 shutdown_connections 2024-05-17T04:09:48.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.447+0000 7f46721f5640 1 --2- 172.21.15.131:0/38238490 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f46580762d0 0x7f46580787e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:48.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.447+0000 7f46721f5640 1 --2- 172.21.15.131:0/38238490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f466c0cce00 0x7f466c159d50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:48.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.447+0000 7f46721f5640 1 --2- 172.21.15.131:0/38238490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f466c0cb500 0x7f466c159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:48.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.447+0000 7f46721f5640 1 --2- 172.21.15.131:0/38238490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c0b3e60 0x7f466c1592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:48.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.447+0000 7f46721f5640 1 -- 172.21.15.131:0/38238490 >> 172.21.15.131:0/38238490 conn(0x7f466c0cd930 msgr2=0x7f466c0b5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:48.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.447+0000 7f46721f5640 1 -- 172.21.15.131:0/38238490 shutdown_connections 2024-05-17T04:09:48.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.447+0000 7f46721f5640 1 -- 172.21.15.131:0/38238490 wait complete. 2024-05-17T04:09:48.469 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-17T04:09:48.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.584+0000 7f2b4b50a640 1 Processor -- start 2024-05-17T04:09:48.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.584+0000 7f2b4b50a640 1 -- start start 2024-05-17T04:09:48.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.585+0000 7f2b4b50a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2b4415d670 0x7f2b440cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:48.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.585+0000 7f2b4b50a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b4415da80 con 0x7f2b440d1e30 2024-05-17T04:09:48.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.585+0000 7f2b4b50a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b440d2640 con 0x7f2b440d07c0 2024-05-17T04:09:48.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.585+0000 7f2b4b50a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f2b440d2920 con 0x7f2b4415d670 2024-05-17T04:09:48.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.585+0000 7f2b492a6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2b4415d670 0x7f2b440cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:48.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.585+0000 7f2b48aa5640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f2b440d1e30 0x7f2b440d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38292/0 (socket says 172.21.15.131:38292) 2024-05-17T04:09:48.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.585+0000 7f2b48aa5640 1 -- 172.21.15.131:0/381457247 learned_addr learned my addr 172.21.15.131:0/381457247 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:48.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.586+0000 7f2b492a6640 1 -- 172.21.15.131:0/381457247 >> v1:172.21.15.150:6789/0 conn(0x7f2b440d07c0 legacy=0x7f2b440b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:48.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.586+0000 7f2b492a6640 1 -- 172.21.15.131:0/381457247 >> v1:172.21.15.131:6789/0 conn(0x7f2b440d1e30 legacy=0x7f2b440d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:48.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.586+0000 7f2b43fff640 1 -- 172.21.15.131:0/381457247 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 524242369 0 0) 0x7f2b4415da80 con 0x7f2b440d1e30 2024-05-17T04:09:48.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.586+0000 7f2b492a6640 1 -- 172.21.15.131:0/381457247 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b440d2c00 con 0x7f2b4415d670 2024-05-17T04:09:48.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.586+0000 7f2b492a6640 1 --2- 172.21.15.131:0/381457247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b4415d670 0x7f2b440cdfe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2b340097a0 tx=0x7f2b3402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d968277d25ae86 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:48.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.586+0000 7f2b43fff640 1 -- 172.21.15.131:0/381457247 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b34037070 con 0x7f2b4415d670 2024-05-17T04:09:48.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.586+0000 7f2b43fff640 1 -- 172.21.15.131:0/381457247 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3402ae50 con 0x7f2b4415d670 2024-05-17T04:09:48.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.586+0000 7f2b43fff640 1 -- 172.21.15.131:0/381457247 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b34032660 con 0x7f2b4415d670 2024-05-17T04:09:48.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.587+0000 7f2b4b50a640 1 -- 172.21.15.131:0/381457247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b4415d670 msgr2=0x7f2b440cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:48.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.587+0000 7f2b4b50a640 1 --2- 172.21.15.131:0/381457247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b4415d670 0x7f2b440cdfe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2b340097a0 tx=0x7f2b3402a100 comp rx=0 tx=0).stop 2024-05-17T04:09:48.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.587+0000 7f2b4b50a640 1 -- 172.21.15.131:0/381457247 shutdown_connections 2024-05-17T04:09:48.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.587+0000 7f2b4b50a640 1 --2- 172.21.15.131:0/381457247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b4415d670 0x7f2b440cdfe0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:48.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.587+0000 7f2b4b50a640 1 -- 172.21.15.131:0/381457247 >> 172.21.15.131:0/381457247 conn(0x7f2b440b5080 msgr2=0x7f2b440b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:48.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.587+0000 7f2b4b50a640 1 -- 172.21.15.131:0/381457247 shutdown_connections 2024-05-17T04:09:48.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.587+0000 7f2b4b50a640 1 -- 172.21.15.131:0/381457247 wait complete. 2024-05-17T04:09:48.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.589+0000 7f2b4b50a640 1 Processor -- start 2024-05-17T04:09:48.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.589+0000 7f2b4b50a640 1 -- start start 2024-05-17T04:09:48.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.590+0000 7f2b4b50a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b440d07c0 0x7f2b441f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:48.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.590+0000 7f2b4b50a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b440d1e30 0x7f2b4415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:48.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.590+0000 7f2b4b50a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b4415d670 0x7f2b4415a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:48.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.590+0000 7f2b4b50a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2b440d23c0 con 0x7f2b4415d670 2024-05-17T04:09:48.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.590+0000 7f2b4b50a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2b440d2240 con 0x7f2b440d07c0 2024-05-17T04:09:48.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.590+0000 7f2b4b50a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2b440b6c70 con 0x7f2b440d1e30 2024-05-17T04:09:48.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.590+0000 7f2b49aa7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b4415d670 0x7f2b4415a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:48.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.590+0000 7f2b49aa7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b4415d670 0x7f2b4415a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43420/0 (socket says 172.21.15.131:43420) 2024-05-17T04:09:48.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.590+0000 7f2b49aa7640 1 -- 172.21.15.131:0/2611984700 learned_addr learned my addr 172.21.15.131:0/2611984700 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:48.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.591+0000 7f2b492a6640 1 --2- 172.21.15.131:0/2611984700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b440d07c0 0x7f2b441f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:48.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.591+0000 7f2b48aa5640 1 --2- 172.21.15.131:0/2611984700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b440d1e30 0x7f2b4415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:48.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.591+0000 7f2b49aa7640 1 -- 172.21.15.131:0/2611984700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b440d1e30 msgr2=0x7f2b4415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:48.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.591+0000 7f2b49aa7640 1 --2- 172.21.15.131:0/2611984700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b440d1e30 0x7f2b4415a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:48.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.591+0000 7f2b49aa7640 1 -- 172.21.15.131:0/2611984700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b440d07c0 msgr2=0x7f2b441f4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:48.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.591+0000 7f2b49aa7640 1 --2- 172.21.15.131:0/2611984700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b440d07c0 0x7f2b441f4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:48.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.591+0000 7f2b49aa7640 1 -- 172.21.15.131:0/2611984700 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b44157d40 con 0x7f2b4415d670 2024-05-17T04:09:48.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.591+0000 7f2b492a6640 1 --2- 172.21.15.131:0/2611984700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b440d07c0 0x7f2b441f4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:48.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.591+0000 7f2b49aa7640 1 --2- 172.21.15.131:0/2611984700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b4415d670 0x7f2b4415a9d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00b990 tx=0x7f2b3c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:48.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.591+0000 7f2b41ffb640 1 -- 172.21.15.131:0/2611984700 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c019070 con 0x7f2b4415d670 2024-05-17T04:09:48.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.591+0000 7f2b41ffb640 1 -- 172.21.15.131:0/2611984700 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3c00cb40 con 0x7f2b4415d670 2024-05-17T04:09:48.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.591+0000 7f2b4b50a640 1 -- 172.21.15.131:0/2611984700 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b44158020 con 0x7f2b4415d670 2024-05-17T04:09:48.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.591+0000 7f2b41ffb640 1 -- 172.21.15.131:0/2611984700 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c014440 con 0x7f2b4415d670 2024-05-17T04:09:48.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.591+0000 7f2b4b50a640 1 -- 172.21.15.131:0/2611984700 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b44155710 con 0x7f2b4415d670 2024-05-17T04:09:48.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.593+0000 7f2b4b50a640 1 -- 172.21.15.131:0/2611984700 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b440cdfe0 con 0x7f2b4415d670 2024-05-17T04:09:48.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.593+0000 7f2b41ffb640 1 -- 172.21.15.131:0/2611984700 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2b3c01c070 con 0x7f2b4415d670 2024-05-17T04:09:48.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.594+0000 7f2b41ffb640 1 --2- 172.21.15.131:0/2611984700 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b300762d0 0x7f2b300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:48.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.594+0000 7f2b41ffb640 1 -- 172.21.15.131:0/2611984700 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5853+0+0 (secure 0 0 0) 0x7f2b3c097490 con 0x7f2b4415d670 2024-05-17T04:09:48.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.594+0000 7f2b492a6640 1 --2- 172.21.15.131:0/2611984700 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b300762d0 0x7f2b300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:48.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.594+0000 7f2b492a6640 1 --2- 172.21.15.131:0/2611984700 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b300762d0 0x7f2b300787e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2b34034000 tx=0x7f2b3402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:48.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.598+0000 7f2b41ffb640 1 -- 172.21.15.131:0/2611984700 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2b3c060cd0 con 0x7f2b4415d670 2024-05-17T04:09:48.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:48.777+0000 7f2b4b50a640 1 -- 172.21.15.131:0/2611984700 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2b44159200 con 0x7f2b4415d670 2024-05-17T04:09:49.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.770+0000 7f2b41ffb640 1 -- 172.21.15.131:0/2611984700 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v28) ==== 178+0+0 (secure 0 0 0) 0x7f2b3c0605d0 con 0x7f2b4415d670 2024-05-17T04:09:49.771 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_data_ec' removed 2024-05-17T04:09:49.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.774+0000 7f2b4b50a640 1 -- 172.21.15.131:0/2611984700 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b300762d0 msgr2=0x7f2b300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:49.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.774+0000 7f2b4b50a640 1 --2- 172.21.15.131:0/2611984700 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b300762d0 0x7f2b300787e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2b34034000 tx=0x7f2b3402e000 comp rx=0 tx=0).stop 2024-05-17T04:09:49.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.774+0000 7f2b4b50a640 1 -- 172.21.15.131:0/2611984700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b4415d670 msgr2=0x7f2b4415a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:49.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.774+0000 7f2b4b50a640 1 --2- 172.21.15.131:0/2611984700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b4415d670 0x7f2b4415a9d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00b990 tx=0x7f2b3c00be50 comp rx=0 tx=0).stop 2024-05-17T04:09:49.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.775+0000 7f2b4b50a640 1 -- 172.21.15.131:0/2611984700 shutdown_connections 2024-05-17T04:09:49.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.775+0000 7f2b4b50a640 1 --2- 172.21.15.131:0/2611984700 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2b300762d0 0x7f2b300787e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:49.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.775+0000 7f2b4b50a640 1 --2- 172.21.15.131:0/2611984700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b4415d670 0x7f2b4415a9d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:49.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.775+0000 7f2b4b50a640 1 --2- 172.21.15.131:0/2611984700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b440d1e30 0x7f2b4415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:49.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.775+0000 7f2b4b50a640 1 --2- 172.21.15.131:0/2611984700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b440d07c0 0x7f2b441f4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:49.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.775+0000 7f2b4b50a640 1 -- 172.21.15.131:0/2611984700 >> 172.21.15.131:0/2611984700 conn(0x7f2b440b5080 msgr2=0x7f2b440b81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:49.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.775+0000 7f2b4b50a640 1 -- 172.21.15.131:0/2611984700 shutdown_connections 2024-05-17T04:09:49.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.775+0000 7f2b4b50a640 1 -- 172.21.15.131:0/2611984700 wait complete. 2024-05-17T04:09:49.790 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-17T04:09:49.791 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-17T04:09:49.791 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-17T04:09:49.791 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T04:09:49.791 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-17T04:09:49.791 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-17T04:09:49.791 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-17T04:09:49.791 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T04:09:49.792 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-17T04:09:49.792 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-17T04:09:49.792 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-17T04:09:49.792 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T04:09:49.792 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-17T04:09:49.792 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-17T04:09:49.793 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-17T04:09:49.793 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T04:09:49.804 INFO:tasks.ceph.mds.c:Stopped 2024-05-17T04:09:49.804 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-17T04:09:49.805 INFO:tasks.ceph.mds.d:Stopped 2024-05-17T04:09:49.805 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-17T04:09:49.806 INFO:tasks.ceph.mds.b:Stopped 2024-05-17T04:09:49.807 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-17T04:09:49.808 INFO:tasks.ceph.mds.a:Stopped 2024-05-17T04:09:49.808 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-17T04:09:49.848 INFO:tasks.ceph.mds.d:Started 2024-05-17T04:09:49.849 DEBUG:teuthology.parallel:result is None 2024-05-17T04:09:49.850 INFO:tasks.ceph.mds.c:Started 2024-05-17T04:09:49.850 DEBUG:teuthology.parallel:result is None 2024-05-17T04:09:49.850 INFO:tasks.ceph.mds.b:Started 2024-05-17T04:09:49.851 DEBUG:teuthology.parallel:result is None 2024-05-17T04:09:49.851 INFO:tasks.ceph.mds.a:Started 2024-05-17T04:09:49.851 DEBUG:teuthology.parallel:result is None 2024-05-17T04:09:49.852 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-17T04:09:49.942 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-05-17T04:09:49.943 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2024-05-17T04:09:49.943 INFO:tasks.ceph.mds.a.smithi131.stdout:starting mds.a at 2024-05-17T04:09:49.944 INFO:tasks.ceph.mds.c.smithi131.stdout:starting mds.c at 2024-05-17T04:09:49.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.977+0000 7f59862e7640 1 Processor -- start 2024-05-17T04:09:49.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.977+0000 7f59862e7640 1 -- start start 2024-05-17T04:09:49.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.978+0000 7f59862e7640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f59800d44b0 0x7f59800d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:49.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.978+0000 7f59862e7640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59800d05b0 con 0x7f598015f770 2024-05-17T04:09:49.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.978+0000 7f59862e7640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59800d0890 con 0x7f59800cf880 2024-05-17T04:09:49.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.978+0000 7f59862e7640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f59800d0b70 con 0x7f59800d44b0 2024-05-17T04:09:49.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.978+0000 7f597ffff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f598015f770 0x7f59800d3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38330/0 (socket says 172.21.15.131:38330) 2024-05-17T04:09:49.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.978+0000 7f597ffff640 1 -- 172.21.15.131:0/324731185 learned_addr learned my addr 172.21.15.131:0/324731185 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:49.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.978+0000 7f597f7fe640 1 --2- 172.21.15.131:0/324731185 >> v2:172.21.15.150:3300/0 conn(0x7f59800d44b0 0x7f59800d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:49.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.978+0000 7f597effd640 1 -- 172.21.15.131:0/324731185 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 123932842 0 0) 0x7f59800d05b0 con 0x7f598015f770 2024-05-17T04:09:49.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.978+0000 7f597effd640 1 -- 172.21.15.131:0/324731185 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5968003520 con 0x7f598015f770 2024-05-17T04:09:49.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.979+0000 7f597effd640 1 -- 172.21.15.131:0/324731185 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3361538453 0 0) 0x7f59800d0890 con 0x7f59800cf880 2024-05-17T04:09:49.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.979+0000 7f597effd640 1 -- 172.21.15.131:0/324731185 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59800d05b0 con 0x7f59800cf880 2024-05-17T04:09:49.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.979+0000 7f597effd640 1 -- 172.21.15.131:0/324731185 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 979392289 0 0) 0x7f5968003520 con 0x7f598015f770 2024-05-17T04:09:49.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.979+0000 7f597f7fe640 1 -- 172.21.15.131:0/324731185 >> v1:172.21.15.150:6789/0 conn(0x7f59800cf880 legacy=0x7f59800cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:49.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.979+0000 7f597f7fe640 1 -- 172.21.15.131:0/324731185 >> v1:172.21.15.131:6789/0 conn(0x7f598015f770 legacy=0x7f59800d3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:49.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.979+0000 7f597f7fe640 1 -- 172.21.15.131:0/324731185 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59800d0e50 con 0x7f59800d44b0 2024-05-17T04:09:49.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.979+0000 7f597f7fe640 1 --2- 172.21.15.131:0/324731185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59800d44b0 0x7f59800d1650 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f59740097a0 tx=0x7f597402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7de13d9aa5dc958 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:49.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.980+0000 7f597effd640 1 -- 172.21.15.131:0/324731185 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5974037070 con 0x7f59800d44b0 2024-05-17T04:09:49.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.980+0000 7f597effd640 1 -- 172.21.15.131:0/324731185 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597402ac50 con 0x7f59800d44b0 2024-05-17T04:09:49.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.980+0000 7f597effd640 1 -- 172.21.15.131:0/324731185 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59700016f0 con 0x7f59800d44b0 2024-05-17T04:09:49.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.980+0000 7f59862e7640 1 -- 172.21.15.131:0/324731185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59800d44b0 msgr2=0x7f59800d1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:49.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.980+0000 7f59862e7640 1 --2- 172.21.15.131:0/324731185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59800d44b0 0x7f59800d1650 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f59740097a0 tx=0x7f597402a1c0 comp rx=0 tx=0).stop 2024-05-17T04:09:49.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.980+0000 7f59862e7640 1 -- 172.21.15.131:0/324731185 shutdown_connections 2024-05-17T04:09:49.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.980+0000 7f59862e7640 1 --2- 172.21.15.131:0/324731185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59800d44b0 0x7f59800d1650 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:49.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.980+0000 7f59862e7640 1 -- 172.21.15.131:0/324731185 >> 172.21.15.131:0/324731185 conn(0x7f59800d2300 msgr2=0x7f59800b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:49.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.980+0000 7f59862e7640 1 -- 172.21.15.131:0/324731185 shutdown_connections 2024-05-17T04:09:49.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.980+0000 7f59862e7640 1 -- 172.21.15.131:0/324731185 wait complete. 2024-05-17T04:09:49.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.982+0000 7f59862e7640 1 Processor -- start 2024-05-17T04:09:49.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.982+0000 7f59862e7640 1 -- start start 2024-05-17T04:09:49.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f59862e7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59800cf880 0x7f59801f8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:49.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f59862e7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f598015f770 0x7f5980159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:49.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f59862e7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f598015a4b0 0x7f59800b9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:49.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f59862e7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f59800b8940 con 0x7f59800cf880 2024-05-17T04:09:49.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f59862e7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f59800b87c0 con 0x7f598015f770 2024-05-17T04:09:49.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f59862e7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f59800b8ac0 con 0x7f598015a4b0 2024-05-17T04:09:49.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f597ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59800cf880 0x7f59801f8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:49.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f597ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59800cf880 0x7f59801f8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43448/0 (socket says 172.21.15.131:43448) 2024-05-17T04:09:49.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f597ffff640 1 -- 172.21.15.131:0/1157761938 learned_addr learned my addr 172.21.15.131:0/1157761938 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:49.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f597f7fe640 1 --2- 172.21.15.131:0/1157761938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f598015f770 0x7f5980159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:49.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f597ffff640 1 -- 172.21.15.131:0/1157761938 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f598015a4b0 msgr2=0x7f59800b9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:49.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f597ffff640 1 --2- 172.21.15.131:0/1157761938 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f598015a4b0 0x7f59800b9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:49.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f597ffff640 1 -- 172.21.15.131:0/1157761938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f598015f770 msgr2=0x7f5980159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:49.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f597ffff640 1 --2- 172.21.15.131:0/1157761938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f598015f770 0x7f5980159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:49.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f597ffff640 1 -- 172.21.15.131:0/1157761938 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f598015a8c0 con 0x7f59800cf880 2024-05-17T04:09:49.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f597f7fe640 1 --2- 172.21.15.131:0/1157761938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f598015f770 0x7f5980159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:49.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f597ffff640 1 --2- 172.21.15.131:0/1157761938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59800cf880 0x7f59801f8430 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f597000c500 tx=0x7f597000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:49.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f597cff9640 1 -- 172.21.15.131:0/1157761938 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970017070 con 0x7f59800cf880 2024-05-17T04:09:49.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f597cff9640 1 -- 172.21.15.131:0/1157761938 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5970005ce0 con 0x7f59800cf880 2024-05-17T04:09:49.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f597cff9640 1 -- 172.21.15.131:0/1157761938 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970007310 con 0x7f59800cf880 2024-05-17T04:09:49.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.984+0000 7f59862e7640 1 -- 172.21.15.131:0/1157761938 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f598015ad10 con 0x7f59800cf880 2024-05-17T04:09:49.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.985+0000 7f59862e7640 1 -- 172.21.15.131:0/1157761938 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f598015b2d0 con 0x7f59800cf880 2024-05-17T04:09:49.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.986+0000 7f59862e7640 1 -- 172.21.15.131:0/1157761938 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59801f5500 con 0x7f59800cf880 2024-05-17T04:09:49.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.986+0000 7f597cff9640 1 -- 172.21.15.131:0/1157761938 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f597001a070 con 0x7f59800cf880 2024-05-17T04:09:49.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.987+0000 7f597cff9640 1 --2- 172.21.15.131:0/1157761938 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f596c076300 0x7f596c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:49.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.987+0000 7f597f7fe640 1 --2- 172.21.15.131:0/1157761938 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f596c076300 0x7f596c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:49.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.987+0000 7f597cff9640 1 -- 172.21.15.131:0/1157761938 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5335+0+0 (secure 0 0 0) 0x7f59700969a0 con 0x7f59800cf880 2024-05-17T04:09:49.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.987+0000 7f597f7fe640 1 --2- 172.21.15.131:0/1157761938 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f596c076300 0x7f596c078810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5974034000 tx=0x7f597402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:49.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:49.991+0000 7f597cff9640 1 -- 172.21.15.131:0/1157761938 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f598015a8c0 con 0x7f59800cf880 2024-05-17T04:09:50.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.184+0000 7f59862e7640 1 -- 172.21.15.131:0/1157761938 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f59800d1650 con 0x7f59800cf880 2024-05-17T04:09:50.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.780+0000 7f597cff9640 1 -- 172.21.15.131:0/1157761938 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) ==== 97+0+0 (secure 0 0 0) 0x7f59700603f0 con 0x7f59800cf880 2024-05-17T04:09:50.781 INFO:teuthology.orchestra.run.smithi131.stderr: removed all blocklist entries 2024-05-17T04:09:50.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.783+0000 7f59862e7640 1 -- 172.21.15.131:0/1157761938 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f596c076300 msgr2=0x7f596c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:50.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.783+0000 7f59862e7640 1 --2- 172.21.15.131:0/1157761938 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f596c076300 0x7f596c078810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5974034000 tx=0x7f597402e000 comp rx=0 tx=0).stop 2024-05-17T04:09:50.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.783+0000 7f59862e7640 1 -- 172.21.15.131:0/1157761938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59800cf880 msgr2=0x7f59801f8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:50.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.783+0000 7f59862e7640 1 --2- 172.21.15.131:0/1157761938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59800cf880 0x7f59801f8430 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f597000c500 tx=0x7f597000c9c0 comp rx=0 tx=0).stop 2024-05-17T04:09:50.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.783+0000 7f59862e7640 1 -- 172.21.15.131:0/1157761938 shutdown_connections 2024-05-17T04:09:50.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.783+0000 7f59862e7640 1 --2- 172.21.15.131:0/1157761938 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f596c076300 0x7f596c078810 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:50.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.783+0000 7f59862e7640 1 --2- 172.21.15.131:0/1157761938 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f598015a4b0 0x7f59800b9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:50.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.783+0000 7f59862e7640 1 --2- 172.21.15.131:0/1157761938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f598015f770 0x7f5980159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:50.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.783+0000 7f59862e7640 1 --2- 172.21.15.131:0/1157761938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59800cf880 0x7f59801f8430 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:50.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.783+0000 7f59862e7640 1 -- 172.21.15.131:0/1157761938 >> 172.21.15.131:0/1157761938 conn(0x7f59800d2300 msgr2=0x7f5980068970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:50.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.783+0000 7f59862e7640 1 -- 172.21.15.131:0/1157761938 shutdown_connections 2024-05-17T04:09:50.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.783+0000 7f59862e7640 1 -- 172.21.15.131:0/1157761938 wait complete. 2024-05-17T04:09:50.797 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-17T04:09:50.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.906+0000 7fc417b35640 1 Processor -- start 2024-05-17T04:09:50.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.907+0000 7fc417b35640 1 -- start start 2024-05-17T04:09:50.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.908+0000 7fc417b35640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc41006d100 0x7fc4100cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:50.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.908+0000 7fc417b35640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc410073300 0x7fc410073710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:50.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.908+0000 7fc417b35640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc41006d830 con 0x7fc410073c50 2024-05-17T04:09:50.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.908+0000 7fc417b35640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc4100b4090 con 0x7fc41006d100 2024-05-17T04:09:50.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.908+0000 7fc417b35640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc41006db10 con 0x7fc410073300 2024-05-17T04:09:50.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.908+0000 7fc4158d1640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc41006d100 0x7fc4100cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:50.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.908+0000 7fc4160d2640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fc410073c50 0x7fc41015f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38344/0 (socket says 172.21.15.131:38344) 2024-05-17T04:09:50.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.908+0000 7fc4160d2640 1 -- 172.21.15.131:0/3938807948 learned_addr learned my addr 172.21.15.131:0/3938807948 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:50.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.908+0000 7fc4150d0640 1 --2- 172.21.15.131:0/3938807948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc410073300 0x7fc410073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:50.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.908+0000 7fc4158d1640 1 -- 172.21.15.131:0/3938807948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc410073300 msgr2=0x7fc410073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:50.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.908+0000 7fc4158d1640 1 --2- 172.21.15.131:0/3938807948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc410073300 0x7fc410073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:50.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.908+0000 7fc4158d1640 1 -- 172.21.15.131:0/3938807948 >> v1:172.21.15.131:6789/0 conn(0x7fc410073c50 legacy=0x7fc41015f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:50.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.908+0000 7fc4158d1640 1 -- 172.21.15.131:0/3938807948 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41006ddf0 con 0x7fc41006d100 2024-05-17T04:09:50.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.908+0000 7fc4148cf640 1 -- 172.21.15.131:0/3938807948 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2335192590 0 0) 0x7fc41006d830 con 0x7fc410073c50 2024-05-17T04:09:50.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.909+0000 7fc4150d0640 1 --2- 172.21.15.131:0/3938807948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc410073300 0x7fc410073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:50.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.909+0000 7fc4158d1640 1 --2- 172.21.15.131:0/3938807948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc41006d100 0x7fc4100cd500 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc400009d90 tx=0x7fc40002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb027f55f5e53196 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:50.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.909+0000 7fc4148cf640 1 -- 172.21.15.131:0/3938807948 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400007740 con 0x7fc41006d100 2024-05-17T04:09:50.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.909+0000 7fc4148cf640 1 -- 172.21.15.131:0/3938807948 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4000078e0 con 0x7fc41006d100 2024-05-17T04:09:50.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.909+0000 7fc4148cf640 1 -- 172.21.15.131:0/3938807948 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400007cb0 con 0x7fc41006d100 2024-05-17T04:09:50.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.910+0000 7fc417b35640 1 -- 172.21.15.131:0/3938807948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc41006d100 msgr2=0x7fc4100cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:50.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.910+0000 7fc417b35640 1 --2- 172.21.15.131:0/3938807948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc41006d100 0x7fc4100cd500 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc400009d90 tx=0x7fc40002a660 comp rx=0 tx=0).stop 2024-05-17T04:09:50.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.910+0000 7fc417b35640 1 -- 172.21.15.131:0/3938807948 shutdown_connections 2024-05-17T04:09:50.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.910+0000 7fc417b35640 1 --2- 172.21.15.131:0/3938807948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc410073300 0x7fc410073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:50.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.910+0000 7fc417b35640 1 --2- 172.21.15.131:0/3938807948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc41006d100 0x7fc4100cd500 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:50.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.910+0000 7fc417b35640 1 -- 172.21.15.131:0/3938807948 >> 172.21.15.131:0/3938807948 conn(0x7fc4100b36d0 msgr2=0x7fc4100d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:50.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.910+0000 7fc417b35640 1 -- 172.21.15.131:0/3938807948 shutdown_connections 2024-05-17T04:09:50.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.910+0000 7fc417b35640 1 -- 172.21.15.131:0/3938807948 wait complete. 2024-05-17T04:09:50.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.912+0000 7fc417b35640 1 Processor -- start 2024-05-17T04:09:50.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.912+0000 7fc417b35640 1 -- start start 2024-05-17T04:09:50.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.913+0000 7fc417b35640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc41006d100 0x7fc41013e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:50.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.913+0000 7fc417b35640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc410073300 0x7fc410143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:50.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.913+0000 7fc417b35640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc410073c50 0x7fc410158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:50.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.913+0000 7fc417b35640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc4100b5530 con 0x7fc410073300 2024-05-17T04:09:50.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.913+0000 7fc417b35640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc410074060 con 0x7fc41006d100 2024-05-17T04:09:50.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.913+0000 7fc417b35640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc4100b56b0 con 0x7fc410073c50 2024-05-17T04:09:50.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.913+0000 7fc4150d0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc410073300 0x7fc410143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:50.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.913+0000 7fc4150d0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc410073300 0x7fc410143380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43476/0 (socket says 172.21.15.131:43476) 2024-05-17T04:09:50.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.913+0000 7fc4150d0640 1 -- 172.21.15.131:0/2890688485 learned_addr learned my addr 172.21.15.131:0/2890688485 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:50.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.914+0000 7fc4160d2640 1 --2- 172.21.15.131:0/2890688485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc410073c50 0x7fc410158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:50.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.914+0000 7fc4158d1640 1 --2- 172.21.15.131:0/2890688485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc41006d100 0x7fc41013e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:50.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.914+0000 7fc4150d0640 1 -- 172.21.15.131:0/2890688485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc410073c50 msgr2=0x7fc410158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:50.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.914+0000 7fc4150d0640 1 --2- 172.21.15.131:0/2890688485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc410073c50 0x7fc410158440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:50.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.914+0000 7fc4150d0640 1 -- 172.21.15.131:0/2890688485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc41006d100 msgr2=0x7fc41013e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:50.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.914+0000 7fc4150d0640 1 --2- 172.21.15.131:0/2890688485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc41006d100 0x7fc41013e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:50.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.914+0000 7fc4150d0640 1 -- 172.21.15.131:0/2890688485 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4100af740 con 0x7fc410073300 2024-05-17T04:09:50.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.914+0000 7fc4150d0640 1 --2- 172.21.15.131:0/2890688485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc410073300 0x7fc410143380 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc40400c820 tx=0x7fc40400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:50.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.914+0000 7fc40e7fc640 1 -- 172.21.15.131:0/2890688485 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404015070 con 0x7fc410073300 2024-05-17T04:09:50.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.914+0000 7fc40e7fc640 1 -- 172.21.15.131:0/2890688485 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc404007a30 con 0x7fc410073300 2024-05-17T04:09:50.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.914+0000 7fc417b35640 1 -- 172.21.15.131:0/2890688485 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4100afa20 con 0x7fc410073300 2024-05-17T04:09:50.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.914+0000 7fc40e7fc640 1 -- 172.21.15.131:0/2890688485 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404007de0 con 0x7fc410073300 2024-05-17T04:09:50.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.914+0000 7fc417b35640 1 -- 172.21.15.131:0/2890688485 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4100affe0 con 0x7fc410073300 2024-05-17T04:09:50.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.915+0000 7fc417b35640 1 -- 172.21.15.131:0/2890688485 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc41006d830 con 0x7fc410073300 2024-05-17T04:09:50.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.916+0000 7fc40e7fc640 1 -- 172.21.15.131:0/2890688485 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc404018070 con 0x7fc410073300 2024-05-17T04:09:50.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.916+0000 7fc40e7fc640 1 --2- 172.21.15.131:0/2890688485 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc3fc0762d0 0x7fc3fc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:50.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.916+0000 7fc40e7fc640 1 -- 172.21.15.131:0/2890688485 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7fc404097310 con 0x7fc410073300 2024-05-17T04:09:50.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.916+0000 7fc4158d1640 1 --2- 172.21.15.131:0/2890688485 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc3fc0762d0 0x7fc3fc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:50.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.917+0000 7fc4158d1640 1 --2- 172.21.15.131:0/2890688485 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc3fc0762d0 0x7fc3fc0787e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc400034000 tx=0x7fc40002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:50.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:50.921+0000 7fc40e7fc640 1 -- 172.21.15.131:0/2890688485 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc404060e30 con 0x7fc410073300 2024-05-17T04:09:51.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.170+0000 7fc417b35640 1 -- 172.21.15.131:0/2890688485 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fc41015d030 con 0x7fc410073300 2024-05-17T04:09:51.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.171+0000 7fc40e7fc640 1 -- 172.21.15.131:0/2890688485 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7fc404095e20 con 0x7fc410073300 2024-05-17T04:09:51.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:51.172 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T04:09:51.172 INFO:teuthology.orchestra.run.smithi131.stdout: "auth_dump": [ 2024-05-17T04:09:51.172 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.172 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mds.a", 2024-05-17T04:09:51.172 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAo2EZmPfihFxAA2kg5+fAicFy/rzEq6Z1Zzw==", 2024-05-17T04:09:51.172 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.172 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-05-17T04:09:51.172 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow *", 2024-05-17T04:09:51.172 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow *", 2024-05-17T04:09:51.173 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-05-17T04:09:51.173 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.173 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.173 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.173 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mds.b", 2024-05-17T04:09:51.173 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAo2EZmI2CdJBAAP+AuWB4Y9Ruxx7YPFF+INw==", 2024-05-17T04:09:51.173 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.173 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-05-17T04:09:51.173 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow *", 2024-05-17T04:09:51.173 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow *", 2024-05-17T04:09:51.173 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-05-17T04:09:51.173 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.173 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.173 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.174 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mds.c", 2024-05-17T04:09:51.174 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAo2EZmFEFWHxAAcVFOLk4BIgfPddmYDX4bvw==", 2024-05-17T04:09:51.174 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.174 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-05-17T04:09:51.174 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow *", 2024-05-17T04:09:51.174 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow *", 2024-05-17T04:09:51.174 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-05-17T04:09:51.174 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.174 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mds.d", 2024-05-17T04:09:51.174 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAo2EZmLys7LBAAWYz6TNvnK3jjmkdehCAUew==", 2024-05-17T04:09:51.174 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.175 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-05-17T04:09:51.175 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow *", 2024-05-17T04:09:51.175 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow *", 2024-05-17T04:09:51.175 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-05-17T04:09:51.175 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.175 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.0", 2024-05-17T04:09:51.175 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAs2EZmbGMrDxAAXyD+J/3el16d/DqixYFocA==", 2024-05-17T04:09:51.175 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.175 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-05-17T04:09:51.175 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-05-17T04:09:51.175 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-05-17T04:09:51.175 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.176 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.1", 2024-05-17T04:09:51.176 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAv2EZmPdxODhAAYtAoZ+kAxN5f12GsQprdvw==", 2024-05-17T04:09:51.176 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.176 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-05-17T04:09:51.176 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-05-17T04:09:51.176 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-05-17T04:09:51.176 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.176 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.2", 2024-05-17T04:09:51.176 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAy2EZmchhVDRAAy33imJlj9IZD8pEAq7DG1w==", 2024-05-17T04:09:51.177 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.177 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-05-17T04:09:51.177 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-05-17T04:09:51.177 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-05-17T04:09:51.177 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.177 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.3", 2024-05-17T04:09:51.177 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQA12EZmpYYZDBAAdSY711ZardICQkehwT9ToA==", 2024-05-17T04:09:51.177 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.177 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-05-17T04:09:51.177 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-05-17T04:09:51.177 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-05-17T04:09:51.177 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.178 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.4", 2024-05-17T04:09:51.178 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQA72EZmyRF0FBAAptR7qdMV+KD+B1Fd4D9mJA==", 2024-05-17T04:09:51.178 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.178 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-05-17T04:09:51.178 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-05-17T04:09:51.178 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-05-17T04:09:51.178 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.178 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.5", 2024-05-17T04:09:51.178 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQA+2EZmGlDqEhAAkFqHiBqkwiK6xrJEE/7ztg==", 2024-05-17T04:09:51.179 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.179 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-05-17T04:09:51.179 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-05-17T04:09:51.179 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-05-17T04:09:51.179 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.179 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.6", 2024-05-17T04:09:51.179 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBB2EZmQV3/EhAAuD5k0P441rbiEkmprCflhw==", 2024-05-17T04:09:51.179 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.179 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-05-17T04:09:51.179 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-05-17T04:09:51.179 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-05-17T04:09:51.179 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.180 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "osd.7", 2024-05-17T04:09:51.180 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBE2EZmVTeSERAAbVrh1aPseyWnb75xGqNHzQ==", 2024-05-17T04:09:51.180 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.180 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow profile osd", 2024-05-17T04:09:51.180 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile osd", 2024-05-17T04:09:51.180 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-05-17T04:09:51.180 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.180 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.0", 2024-05-17T04:09:51.180 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAo2EZm18HoMBAALbZPYs0ajHhO8BUkz1amdw==", 2024-05-17T04:09:51.180 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.181 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-05-17T04:09:51.181 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow r", 2024-05-17T04:09:51.181 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow rw", 2024-05-17T04:09:51.181 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow rwx" 2024-05-17T04:09:51.181 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.181 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.1", 2024-05-17T04:09:51.181 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAo2EZmUQGAOBAAt7329zcgCmdCConfCDgjpg==", 2024-05-17T04:09:51.181 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.181 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-05-17T04:09:51.181 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow r", 2024-05-17T04:09:51.181 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow rw", 2024-05-17T04:09:51.182 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow rwx" 2024-05-17T04:09:51.182 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.182 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.182 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.2", 2024-05-17T04:09:51.182 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAo2EZm6bGmNBAAlhJcLWnOzTRep1u5X5sXQA==", 2024-05-17T04:09:51.182 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.182 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-05-17T04:09:51.182 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow r", 2024-05-17T04:09:51.182 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow rw", 2024-05-17T04:09:51.182 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow rwx" 2024-05-17T04:09:51.182 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.182 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.183 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.3", 2024-05-17T04:09:51.183 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAp2EZm0rakABAAUYqMoamKTlxtOFaCmCG3Wg==", 2024-05-17T04:09:51.183 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.183 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow", 2024-05-17T04:09:51.183 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow r", 2024-05-17T04:09:51.183 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow rw", 2024-05-17T04:09:51.183 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow rwx" 2024-05-17T04:09:51.183 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.183 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.183 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.183 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.admin", 2024-05-17T04:09:51.183 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAn2EZmvfO5NRAAocsT8xp7O+U89lf5zNmKtw==", 2024-05-17T04:09:51.184 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.184 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow *", 2024-05-17T04:09:51.184 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": "allow *", 2024-05-17T04:09:51.184 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow *", 2024-05-17T04:09:51.184 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-05-17T04:09:51.184 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.184 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.bootstrap-mds", 2024-05-17T04:09:51.184 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBK2EZmesPXExAAihcx+t4Qv1gSy1ZfXE71sw==", 2024-05-17T04:09:51.184 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.184 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile bootstrap-mds" 2024-05-17T04:09:51.184 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.185 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.bootstrap-mgr", 2024-05-17T04:09:51.185 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBK2EZmo8vXExAA2CJoEJ/XX3ykiXImXpy9Og==", 2024-05-17T04:09:51.185 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.185 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-17T04:09:51.185 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.185 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.bootstrap-osd", 2024-05-17T04:09:51.185 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBK2EZmMtLXExAAGiCJuwpD+wtRS9nd/lBqAQ==", 2024-05-17T04:09:51.185 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.185 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile bootstrap-osd" 2024-05-17T04:09:51.185 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.186 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.bootstrap-rbd", 2024-05-17T04:09:51.186 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBK2EZmwtjXExAAx7nr7cst9jF5sBzZXAPoTw==", 2024-05-17T04:09:51.186 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.186 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-17T04:09:51.186 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.186 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-17T04:09:51.186 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBK2EZmn9/XExAAng/cBpc6DNq5pnDq4IqiQQ==", 2024-05-17T04:09:51.186 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.186 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-17T04:09:51.187 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.187 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.187 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.187 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "client.bootstrap-rgw", 2024-05-17T04:09:51.187 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQBK2EZmmObXExAAmqb+PPCTU7bLVJ5YtHDR0Q==", 2024-05-17T04:09:51.187 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.187 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-17T04:09:51.187 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.187 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.187 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.187 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mgr.x", 2024-05-17T04:09:51.187 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAo2EZmPtPRExAAJ5ag2LAxwzUZUAQz0jCNbw==", 2024-05-17T04:09:51.187 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.187 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow *", 2024-05-17T04:09:51.188 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile mgr", 2024-05-17T04:09:51.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-05-17T04:09:51.188 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.188 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:09:51.188 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:51.188 INFO:teuthology.orchestra.run.smithi131.stdout: "entity": "mgr.y", 2024-05-17T04:09:51.188 INFO:teuthology.orchestra.run.smithi131.stdout: "key": "AQAo2EZmpXVwDxAA480Fd1pQXWmbKRKQLQ/peA==", 2024-05-17T04:09:51.188 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": { 2024-05-17T04:09:51.188 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": "allow *", 2024-05-17T04:09:51.188 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": "allow profile mgr", 2024-05-17T04:09:51.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": "allow *" 2024-05-17T04:09:51.188 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.189 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:51.189 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-05-17T04:09:51.189 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T04:09:51.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.173+0000 7fc417b35640 1 -- 172.21.15.131:0/2890688485 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc3fc0762d0 msgr2=0x7fc3fc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:51.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.173+0000 7fc417b35640 1 --2- 172.21.15.131:0/2890688485 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc3fc0762d0 0x7fc3fc0787e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc400034000 tx=0x7fc40002f000 comp rx=0 tx=0).stop 2024-05-17T04:09:51.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.173+0000 7fc417b35640 1 -- 172.21.15.131:0/2890688485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc410073300 msgr2=0x7fc410143380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:51.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.173+0000 7fc417b35640 1 --2- 172.21.15.131:0/2890688485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc410073300 0x7fc410143380 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc40400c820 tx=0x7fc40400cce0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.173+0000 7fc417b35640 1 -- 172.21.15.131:0/2890688485 shutdown_connections 2024-05-17T04:09:51.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.173+0000 7fc417b35640 1 --2- 172.21.15.131:0/2890688485 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc3fc0762d0 0x7fc3fc0787e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.173+0000 7fc417b35640 1 --2- 172.21.15.131:0/2890688485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc410073300 0x7fc410143380 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.173+0000 7fc417b35640 1 --2- 172.21.15.131:0/2890688485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc410073c50 0x7fc410158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.173+0000 7fc417b35640 1 --2- 172.21.15.131:0/2890688485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc41006d100 0x7fc41013e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.173+0000 7fc417b35640 1 -- 172.21.15.131:0/2890688485 >> 172.21.15.131:0/2890688485 conn(0x7fc4100b36d0 msgr2=0x7fc4100d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:51.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.173+0000 7fc417b35640 1 -- 172.21.15.131:0/2890688485 shutdown_connections 2024-05-17T04:09:51.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.173+0000 7fc417b35640 1 -- 172.21.15.131:0/2890688485 wait complete. 2024-05-17T04:09:51.192 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-17T04:09:51.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.302+0000 7fb328ba0640 1 Processor -- start 2024-05-17T04:09:51.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.302+0000 7fb328ba0640 1 -- start start 2024-05-17T04:09:51.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.303+0000 7fb328ba0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3240cf0e0 0x7fb32415f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:51.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.303+0000 7fb328ba0640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb32406e170 0x7fb32406e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:51.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.303+0000 7fb328ba0640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3240ce080 con 0x7fb3240cf870 2024-05-17T04:09:51.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.304+0000 7fb328ba0640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fb3240cec50 con 0x7fb32406e170 2024-05-17T04:09:51.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.304+0000 7fb328ba0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb32415fab0 con 0x7fb3240cf0e0 2024-05-17T04:09:51.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.304+0000 7fb323fff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb32406e170 0x7fb32406e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:51.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.304+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3240cf0e0 0x7fb32415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:51.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.304+0000 7fb322ffd640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb3240cf870 0x7fb3240cfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:43870/0 (socket says 172.21.15.131:43870) 2024-05-17T04:09:51.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.304+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3240cf0e0 0x7fb32415f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:57680/0 (socket says 172.21.15.131:57680) 2024-05-17T04:09:51.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.304+0000 7fb323fff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb32406e170 0x7fb32406e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:46742/0 (socket says 172.21.15.131:46742) 2024-05-17T04:09:51.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.304+0000 7fb322ffd640 1 -- 172.21.15.131:0/2654727874 learned_addr learned my addr 172.21.15.131:0/2654727874 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:51.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.304+0000 7fb3237fe640 1 -- 172.21.15.131:0/2654727874 >> v2:172.21.15.150:3300/0 conn(0x7fb32406e170 msgr2=0x7fb32406e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:51.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.304+0000 7fb3237fe640 1 --2- 172.21.15.131:0/2654727874 >> v2:172.21.15.150:3300/0 conn(0x7fb32406e170 0x7fb32406e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.304+0000 7fb3237fe640 1 -- 172.21.15.131:0/2654727874 >> v1:172.21.15.150:6789/0 conn(0x7fb3240cf870 legacy=0x7fb3240cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:51.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.304+0000 7fb3237fe640 1 -- 172.21.15.131:0/2654727874 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3240ce320 con 0x7fb3240cf0e0 2024-05-17T04:09:51.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.304+0000 7fb323fff640 1 --2- 172.21.15.131:0/2654727874 >> v2:172.21.15.150:3300/0 conn(0x7fb32406e170 0x7fb32406e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:51.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.305+0000 7fb3237fe640 1 --2- 172.21.15.131:0/2654727874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3240cf0e0 0x7fb32415f570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb3140097a0 tx=0x7fb31402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=216685e81e29129f server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:51.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.305+0000 7fb3227fc640 1 -- 172.21.15.131:0/2654727874 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314037070 con 0x7fb3240cf0e0 2024-05-17T04:09:51.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.305+0000 7fb3227fc640 1 -- 172.21.15.131:0/2654727874 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31402ae50 con 0x7fb3240cf0e0 2024-05-17T04:09:51.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.305+0000 7fb3227fc640 1 -- 172.21.15.131:0/2654727874 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314032660 con 0x7fb3240cf0e0 2024-05-17T04:09:51.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.306+0000 7fb328ba0640 1 -- 172.21.15.131:0/2654727874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3240cf0e0 msgr2=0x7fb32415f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:51.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.306+0000 7fb328ba0640 1 --2- 172.21.15.131:0/2654727874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3240cf0e0 0x7fb32415f570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb3140097a0 tx=0x7fb31402a100 comp rx=0 tx=0).stop 2024-05-17T04:09:51.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.306+0000 7fb328ba0640 1 -- 172.21.15.131:0/2654727874 shutdown_connections 2024-05-17T04:09:51.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.306+0000 7fb328ba0640 1 --2- 172.21.15.131:0/2654727874 >> v2:172.21.15.150:3300/0 conn(0x7fb32406e170 0x7fb32406e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.306+0000 7fb328ba0640 1 --2- 172.21.15.131:0/2654727874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3240cf0e0 0x7fb32415f570 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.306+0000 7fb328ba0640 1 -- 172.21.15.131:0/2654727874 >> 172.21.15.131:0/2654727874 conn(0x7fb3240b4a70 msgr2=0x7fb3240b4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:51.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.306+0000 7fb328ba0640 1 -- 172.21.15.131:0/2654727874 shutdown_connections 2024-05-17T04:09:51.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.306+0000 7fb328ba0640 1 -- 172.21.15.131:0/2654727874 wait complete. 2024-05-17T04:09:51.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.308+0000 7fb328ba0640 1 Processor -- start 2024-05-17T04:09:51.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.308+0000 7fb328ba0640 1 -- start start 2024-05-17T04:09:51.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.309+0000 7fb328ba0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32406e170 0x7fb32415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:51.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.309+0000 7fb328ba0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3240cf0e0 0x7fb3240b8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:51.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.309+0000 7fb328ba0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3240cf870 0x7fb3240b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:51.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.309+0000 7fb328ba0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb3240cf4f0 con 0x7fb32406e170 2024-05-17T04:09:51.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.309+0000 7fb328ba0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb3240ce8e0 con 0x7fb3240cf870 2024-05-17T04:09:51.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.309+0000 7fb328ba0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb32406eac0 con 0x7fb3240cf0e0 2024-05-17T04:09:51.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.309+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32406e170 0x7fb32415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:51.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.309+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32406e170 0x7fb32415b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43490/0 (socket says 172.21.15.131:43490) 2024-05-17T04:09:51.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.309+0000 7fb3237fe640 1 -- 172.21.15.131:0/2137671941 learned_addr learned my addr 172.21.15.131:0/2137671941 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:51.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.309+0000 7fb322ffd640 1 --2- 172.21.15.131:0/2137671941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3240cf0e0 0x7fb3240b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:51.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.309+0000 7fb323fff640 1 --2- 172.21.15.131:0/2137671941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3240cf870 0x7fb3240b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:51.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.310+0000 7fb3237fe640 1 -- 172.21.15.131:0/2137671941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3240cf0e0 msgr2=0x7fb3240b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:51.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.310+0000 7fb3237fe640 1 --2- 172.21.15.131:0/2137671941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3240cf0e0 0x7fb3240b8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.310+0000 7fb3237fe640 1 -- 172.21.15.131:0/2137671941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3240cf870 msgr2=0x7fb3240b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:51.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.310+0000 7fb3237fe640 1 --2- 172.21.15.131:0/2137671941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3240cf870 0x7fb3240b87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.310+0000 7fb3237fe640 1 -- 172.21.15.131:0/2137671941 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3241f5810 con 0x7fb32406e170 2024-05-17T04:09:51.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.310+0000 7fb3237fe640 1 --2- 172.21.15.131:0/2137671941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32406e170 0x7fb32415b510 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb31402a140 tx=0x7fb3140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:51.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.310+0000 7fb30bfff640 1 -- 172.21.15.131:0/2137671941 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314041070 con 0x7fb32406e170 2024-05-17T04:09:51.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.310+0000 7fb30bfff640 1 -- 172.21.15.131:0/2137671941 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31403c670 con 0x7fb32406e170 2024-05-17T04:09:51.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.310+0000 7fb328ba0640 1 -- 172.21.15.131:0/2137671941 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3240b2ab0 con 0x7fb32406e170 2024-05-17T04:09:51.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.310+0000 7fb30bfff640 1 -- 172.21.15.131:0/2137671941 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314037040 con 0x7fb32406e170 2024-05-17T04:09:51.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.310+0000 7fb328ba0640 1 -- 172.21.15.131:0/2137671941 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3240b3070 con 0x7fb32406e170 2024-05-17T04:09:51.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.311+0000 7fb328ba0640 1 -- 172.21.15.131:0/2137671941 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb32406e580 con 0x7fb32406e170 2024-05-17T04:09:51.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.312+0000 7fb30bfff640 1 -- 172.21.15.131:0/2137671941 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb314044070 con 0x7fb32406e170 2024-05-17T04:09:51.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.312+0000 7fb30bfff640 1 --2- 172.21.15.131:0/2137671941 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb310076300 0x7fb310078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:51.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.312+0000 7fb30bfff640 1 -- 172.21.15.131:0/2137671941 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7fb3140b79e0 con 0x7fb32406e170 2024-05-17T04:09:51.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.312+0000 7fb322ffd640 1 --2- 172.21.15.131:0/2137671941 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb310076300 0x7fb310078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:51.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.313+0000 7fb322ffd640 1 --2- 172.21.15.131:0/2137671941 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb310076300 0x7fb310078810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb3241f8ce0 tx=0x7fb3180019f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:51.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.317+0000 7fb30bfff640 1 -- 172.21.15.131:0/2137671941 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb314080e20 con 0x7fb32406e170 2024-05-17T04:09:51.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.566+0000 7fb328ba0640 1 -- 172.21.15.131:0/2137671941 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fb324068ae0 con 0x7fb32406e170 2024-05-17T04:09:51.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.568+0000 7fb30bfff640 1 -- 172.21.15.131:0/2137671941 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7fb314085120 con 0x7fb32406e170 2024-05-17T04:09:51.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.570+0000 7fb328ba0640 1 -- 172.21.15.131:0/2137671941 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb310076300 msgr2=0x7fb310078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:51.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.570+0000 7fb328ba0640 1 --2- 172.21.15.131:0/2137671941 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb310076300 0x7fb310078810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb3241f8ce0 tx=0x7fb3180019f0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.571+0000 7fb328ba0640 1 -- 172.21.15.131:0/2137671941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32406e170 msgr2=0x7fb32415b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:51.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.571+0000 7fb328ba0640 1 --2- 172.21.15.131:0/2137671941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32406e170 0x7fb32415b510 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb31402a140 tx=0x7fb3140046c0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.571+0000 7fb328ba0640 1 -- 172.21.15.131:0/2137671941 shutdown_connections 2024-05-17T04:09:51.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.571+0000 7fb328ba0640 1 --2- 172.21.15.131:0/2137671941 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb310076300 0x7fb310078810 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.571+0000 7fb328ba0640 1 --2- 172.21.15.131:0/2137671941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3240cf870 0x7fb3240b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.571+0000 7fb328ba0640 1 --2- 172.21.15.131:0/2137671941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3240cf0e0 0x7fb3240b8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.571+0000 7fb328ba0640 1 --2- 172.21.15.131:0/2137671941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32406e170 0x7fb32415b510 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.571+0000 7fb328ba0640 1 -- 172.21.15.131:0/2137671941 >> 172.21.15.131:0/2137671941 conn(0x7fb3240b4a70 msgr2=0x7fb324160a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:51.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.571+0000 7fb328ba0640 1 -- 172.21.15.131:0/2137671941 shutdown_connections 2024-05-17T04:09:51.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.571+0000 7fb328ba0640 1 -- 172.21.15.131:0/2137671941 wait complete. 2024-05-17T04:09:51.584 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-17T04:09:51.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.695+0000 7f75955ef640 1 Processor -- start 2024-05-17T04:09:51.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.695+0000 7f75955ef640 1 -- start start 2024-05-17T04:09:51.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.697+0000 7f75955ef640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75900d44b0 0x7f75900d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:51.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.697+0000 7f75955ef640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75900d05b0 con 0x7f75900cf880 2024-05-17T04:09:51.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.697+0000 7f75955ef640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75900d0890 con 0x7f759015f770 2024-05-17T04:09:51.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.697+0000 7f75955ef640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f75900d0b70 con 0x7f75900d44b0 2024-05-17T04:09:51.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.697+0000 7f758f7fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f75900cf880 0x7f75900cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38350/0 (socket says 172.21.15.131:38350) 2024-05-17T04:09:51.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.697+0000 7f758f7fe640 1 -- 172.21.15.131:0/666166215 learned_addr learned my addr 172.21.15.131:0/666166215 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:51.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.697+0000 7f758e7fc640 1 --2- 172.21.15.131:0/666166215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75900d44b0 0x7f75900d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:51.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.697+0000 7f758dffb640 1 -- 172.21.15.131:0/666166215 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897209347 0 0) 0x7f75900d05b0 con 0x7f75900cf880 2024-05-17T04:09:51.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.697+0000 7f758dffb640 1 -- 172.21.15.131:0/666166215 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f757c003520 con 0x7f75900cf880 2024-05-17T04:09:51.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.697+0000 7f758dffb640 1 -- 172.21.15.131:0/666166215 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 654377610 0 0) 0x7f75900d0890 con 0x7f759015f770 2024-05-17T04:09:51.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.697+0000 7f758dffb640 1 -- 172.21.15.131:0/666166215 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75900d05b0 con 0x7f759015f770 2024-05-17T04:09:51.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.697+0000 7f758dffb640 1 -- 172.21.15.131:0/666166215 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3678369317 0 0) 0x7f757c003520 con 0x7f75900cf880 2024-05-17T04:09:51.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.697+0000 7f758e7fc640 1 -- 172.21.15.131:0/666166215 >> v1:172.21.15.150:6789/0 conn(0x7f759015f770 legacy=0x7f75900d3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:51.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.697+0000 7f758e7fc640 1 -- 172.21.15.131:0/666166215 >> v1:172.21.15.131:6789/0 conn(0x7f75900cf880 legacy=0x7f75900cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:51.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.697+0000 7f758e7fc640 1 -- 172.21.15.131:0/666166215 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75900d0e50 con 0x7f75900d44b0 2024-05-17T04:09:51.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.698+0000 7f758e7fc640 1 --2- 172.21.15.131:0/666166215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75900d44b0 0x7f75900d1650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f75780097d0 tx=0x7f757802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0521725f995e509 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:51.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.698+0000 7f758dffb640 1 -- 172.21.15.131:0/666166215 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7578037070 con 0x7f75900d44b0 2024-05-17T04:09:51.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.698+0000 7f758dffb640 1 -- 172.21.15.131:0/666166215 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f757802ac30 con 0x7f75900d44b0 2024-05-17T04:09:51.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.698+0000 7f758dffb640 1 -- 172.21.15.131:0/666166215 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75880016f0 con 0x7f75900d44b0 2024-05-17T04:09:51.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.699+0000 7f75955ef640 1 -- 172.21.15.131:0/666166215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75900d44b0 msgr2=0x7f75900d1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:51.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.699+0000 7f75955ef640 1 --2- 172.21.15.131:0/666166215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75900d44b0 0x7f75900d1650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f75780097d0 tx=0x7f757802a1a0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.699+0000 7f75955ef640 1 -- 172.21.15.131:0/666166215 shutdown_connections 2024-05-17T04:09:51.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.699+0000 7f75955ef640 1 --2- 172.21.15.131:0/666166215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75900d44b0 0x7f75900d1650 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.699+0000 7f75955ef640 1 -- 172.21.15.131:0/666166215 >> 172.21.15.131:0/666166215 conn(0x7f75900d2300 msgr2=0x7f75900b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:51.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.699+0000 7f75955ef640 1 -- 172.21.15.131:0/666166215 shutdown_connections 2024-05-17T04:09:51.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.699+0000 7f75955ef640 1 -- 172.21.15.131:0/666166215 wait complete. 2024-05-17T04:09:51.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.701+0000 7f75955ef640 1 Processor -- start 2024-05-17T04:09:51.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.701+0000 7f75955ef640 1 -- start start 2024-05-17T04:09:51.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.702+0000 7f75955ef640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75900cf880 0x7f759015b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:51.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.702+0000 7f75955ef640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f759015f770 0x7f759015c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:51.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.702+0000 7f75955ef640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7590162550 0x7f7590162960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:51.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.702+0000 7f75955ef640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f75900b8940 con 0x7f7590162550 2024-05-17T04:09:51.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.702+0000 7f75955ef640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f75900b87c0 con 0x7f75900cf880 2024-05-17T04:09:51.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.702+0000 7f75955ef640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f75900b8ac0 con 0x7f759015f770 2024-05-17T04:09:51.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.702+0000 7f758f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7590162550 0x7f7590162960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:51.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.702+0000 7f758f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7590162550 0x7f7590162960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43496/0 (socket says 172.21.15.131:43496) 2024-05-17T04:09:51.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.703+0000 7f758f7fe640 1 -- 172.21.15.131:0/1642643435 learned_addr learned my addr 172.21.15.131:0/1642643435 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:51.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.703+0000 7f758e7fc640 1 --2- 172.21.15.131:0/1642643435 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f759015f770 0x7f759015c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:51.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.703+0000 7f758effd640 1 --2- 172.21.15.131:0/1642643435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75900cf880 0x7f759015b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:51.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.703+0000 7f758f7fe640 1 -- 172.21.15.131:0/1642643435 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f759015f770 msgr2=0x7f759015c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:51.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.703+0000 7f758f7fe640 1 --2- 172.21.15.131:0/1642643435 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f759015f770 0x7f759015c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.703+0000 7f758f7fe640 1 -- 172.21.15.131:0/1642643435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75900cf880 msgr2=0x7f759015b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.703+0000 7f758f7fe640 1 --2- 172.21.15.131:0/1642643435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75900cf880 0x7f759015b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.703+0000 7f758f7fe640 1 -- 172.21.15.131:0/1642643435 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75901f6000 con 0x7f7590162550 2024-05-17T04:09:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.703+0000 7f758effd640 1 --2- 172.21.15.131:0/1642643435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75900cf880 0x7f759015b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.703+0000 7f758f7fe640 1 --2- 172.21.15.131:0/1642643435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7590162550 0x7f7590162960 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7588001eb0 tx=0x7f758800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.703+0000 7f75877fe640 1 -- 172.21.15.131:0/1642643435 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588005ce0 con 0x7f7590162550 2024-05-17T04:09:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.703+0000 7f75877fe640 1 -- 172.21.15.131:0/1642643435 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7588007070 con 0x7f7590162550 2024-05-17T04:09:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.703+0000 7f75955ef640 1 -- 172.21.15.131:0/1642643435 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7590161a70 con 0x7f7590162550 2024-05-17T04:09:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.703+0000 7f75877fe640 1 -- 172.21.15.131:0/1642643435 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588007420 con 0x7f7590162550 2024-05-17T04:09:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.703+0000 7f75955ef640 1 -- 172.21.15.131:0/1642643435 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f759015bbd0 con 0x7f7590162550 2024-05-17T04:09:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.704+0000 7f75955ef640 1 -- 172.21.15.131:0/1642643435 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75901f5d70 con 0x7f7590162550 2024-05-17T04:09:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.705+0000 7f75877fe640 1 -- 172.21.15.131:0/1642643435 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75880075c0 con 0x7f7590162550 2024-05-17T04:09:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.705+0000 7f75877fe640 1 --2- 172.21.15.131:0/1642643435 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f75700762d0 0x7f75700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.705+0000 7f758effd640 1 --2- 172.21.15.131:0/1642643435 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f75700762d0 0x7f75700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.705+0000 7f75877fe640 1 -- 172.21.15.131:0/1642643435 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7f75880971c0 con 0x7f7590162550 2024-05-17T04:09:51.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.706+0000 7f758effd640 1 --2- 172.21.15.131:0/1642643435 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f75700762d0 0x7f75700787e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7580007fd0 tx=0x7f7580009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:51.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.710+0000 7f75877fe640 1 -- 172.21.15.131:0/1642643435 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7588060c50 con 0x7f7590162550 2024-05-17T04:09:51.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.963+0000 7f75955ef640 1 -- 172.21.15.131:0/1642643435 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f75900d1650 con 0x7f7590162550 2024-05-17T04:09:51.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.966+0000 7f75877fe640 1 -- 172.21.15.131:0/1642643435 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7f7588060550 con 0x7f7590162550 2024-05-17T04:09:51.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.968+0000 7f75955ef640 1 -- 172.21.15.131:0/1642643435 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f75700762d0 msgr2=0x7f75700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:51.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.968+0000 7f75955ef640 1 --2- 172.21.15.131:0/1642643435 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f75700762d0 0x7f75700787e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7580007fd0 tx=0x7f7580009040 comp rx=0 tx=0).stop 2024-05-17T04:09:51.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.968+0000 7f75955ef640 1 -- 172.21.15.131:0/1642643435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7590162550 msgr2=0x7f7590162960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:51.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.968+0000 7f75955ef640 1 --2- 172.21.15.131:0/1642643435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7590162550 0x7f7590162960 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7588001eb0 tx=0x7f758800c960 comp rx=0 tx=0).stop 2024-05-17T04:09:51.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.968+0000 7f75955ef640 1 -- 172.21.15.131:0/1642643435 shutdown_connections 2024-05-17T04:09:51.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.968+0000 7f75955ef640 1 --2- 172.21.15.131:0/1642643435 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f75700762d0 0x7f75700787e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.968+0000 7f75955ef640 1 --2- 172.21.15.131:0/1642643435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7590162550 0x7f7590162960 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.968+0000 7f75955ef640 1 --2- 172.21.15.131:0/1642643435 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f759015f770 0x7f759015c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.968+0000 7f75955ef640 1 --2- 172.21.15.131:0/1642643435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75900cf880 0x7f759015b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:51.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.968+0000 7f75955ef640 1 -- 172.21.15.131:0/1642643435 >> 172.21.15.131:0/1642643435 conn(0x7f75900d2300 msgr2=0x7f75900b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:51.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.968+0000 7f75955ef640 1 -- 172.21.15.131:0/1642643435 shutdown_connections 2024-05-17T04:09:51.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:51.968+0000 7f75955ef640 1 -- 172.21.15.131:0/1642643435 wait complete. 2024-05-17T04:09:51.981 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-17T04:09:52.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.091+0000 7f64965f5640 1 Processor -- start 2024-05-17T04:09:52.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.091+0000 7f64965f5640 1 -- start start 2024-05-17T04:09:52.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.093+0000 7f64965f5640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f64900b4970 0x7f64900b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.093+0000 7f64965f5640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f64900b4d80 0x7f64900b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.093+0000 7f64965f5640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64900b3f00 con 0x7f64900d02f0 2024-05-17T04:09:52.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.093+0000 7f64965f5640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f64900d0820 con 0x7f64900b4970 2024-05-17T04:09:52.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.093+0000 7f64965f5640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f64900b4170 con 0x7f64900b4d80 2024-05-17T04:09:52.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.093+0000 7f648f7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f64900b4970 0x7f64900b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.093+0000 7f648f7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f64900b4970 0x7f64900b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43510/0 (socket says 172.21.15.131:43510) 2024-05-17T04:09:52.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.093+0000 7f648f7fe640 1 -- 172.21.15.131:0/2001540894 learned_addr learned my addr 172.21.15.131:0/2001540894 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:52.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.093+0000 7f648f7fe640 1 -- 172.21.15.131:0/2001540894 >> v2:172.21.15.150:3300/0 conn(0x7f64900b4d80 msgr2=0x7f64900b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:52.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.093+0000 7f6494b92640 1 --2- 172.21.15.131:0/2001540894 >> v2:172.21.15.150:3300/0 conn(0x7f64900b4d80 0x7f64900b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.093+0000 7f648f7fe640 1 --2- 172.21.15.131:0/2001540894 >> v2:172.21.15.150:3300/0 conn(0x7f64900b4d80 0x7f64900b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.093+0000 7f648f7fe640 1 -- 172.21.15.131:0/2001540894 >> v1:172.21.15.150:6789/0 conn(0x7f64900d02f0 legacy=0x7f649015d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:52.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.093+0000 7f648f7fe640 1 -- 172.21.15.131:0/2001540894 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64900b4450 con 0x7f64900b4970 2024-05-17T04:09:52.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.093+0000 7f6494b92640 1 --2- 172.21.15.131:0/2001540894 >> v2:172.21.15.150:3300/0 conn(0x7f64900b4d80 0x7f64900b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:52.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.094+0000 7f648f7fe640 1 --2- 172.21.15.131:0/2001540894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64900b4970 0x7f64900b56f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f649006ded0 tx=0x7f648402c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500dbab42a836cbe server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:52.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.094+0000 7f648effd640 1 -- 172.21.15.131:0/2001540894 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6484032700 con 0x7f64900b4970 2024-05-17T04:09:52.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.094+0000 7f648effd640 1 -- 172.21.15.131:0/2001540894 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64840328a0 con 0x7f64900b4970 2024-05-17T04:09:52.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.094+0000 7f648effd640 1 -- 172.21.15.131:0/2001540894 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6484032c70 con 0x7f64900b4970 2024-05-17T04:09:52.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.095+0000 7f64965f5640 1 -- 172.21.15.131:0/2001540894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64900b4970 msgr2=0x7f64900b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:52.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.095+0000 7f64965f5640 1 --2- 172.21.15.131:0/2001540894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64900b4970 0x7f64900b56f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f649006ded0 tx=0x7f648402c800 comp rx=0 tx=0).stop 2024-05-17T04:09:52.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.095+0000 7f64965f5640 1 -- 172.21.15.131:0/2001540894 shutdown_connections 2024-05-17T04:09:52.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.095+0000 7f64965f5640 1 --2- 172.21.15.131:0/2001540894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64900b4970 0x7f64900b56f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.095+0000 7f64965f5640 1 --2- 172.21.15.131:0/2001540894 >> v2:172.21.15.150:3300/0 conn(0x7f64900b4d80 0x7f64900b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.095+0000 7f64965f5640 1 -- 172.21.15.131:0/2001540894 >> 172.21.15.131:0/2001540894 conn(0x7f64900b36d0 msgr2=0x7f64900d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:52.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.095+0000 7f64965f5640 1 -- 172.21.15.131:0/2001540894 shutdown_connections 2024-05-17T04:09:52.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.095+0000 7f64965f5640 1 -- 172.21.15.131:0/2001540894 wait complete. 2024-05-17T04:09:52.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.097+0000 7f64965f5640 1 Processor -- start 2024-05-17T04:09:52.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.097+0000 7f64965f5640 1 -- start start 2024-05-17T04:09:52.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.098+0000 7f64965f5640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64900b4970 0x7f64900b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.098+0000 7f64965f5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64900d02f0 0x7f64901f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.098+0000 7f64965f5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64901f5510 0x7f649015e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.098+0000 7f64965f5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f64900cd940 con 0x7f64901f5510 2024-05-17T04:09:52.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.098+0000 7f64965f5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f64900cd7c0 con 0x7f64900d02f0 2024-05-17T04:09:52.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.098+0000 7f64965f5640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f64900ceb10 con 0x7f64900b4970 2024-05-17T04:09:52.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.098+0000 7f6494b92640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64901f5510 0x7f649015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.098+0000 7f6494b92640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64901f5510 0x7f649015e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43526/0 (socket says 172.21.15.131:43526) 2024-05-17T04:09:52.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.098+0000 7f6494b92640 1 -- 172.21.15.131:0/4109342593 learned_addr learned my addr 172.21.15.131:0/4109342593 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:52.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.099+0000 7f648f7fe640 1 --2- 172.21.15.131:0/4109342593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64900d02f0 0x7f64901f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.099+0000 7f648ffff640 1 --2- 172.21.15.131:0/4109342593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64900b4970 0x7f64900b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.099+0000 7f6494b92640 1 -- 172.21.15.131:0/4109342593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64900b4970 msgr2=0x7f64900b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:52.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.099+0000 7f6494b92640 1 --2- 172.21.15.131:0/4109342593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64900b4970 0x7f64900b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.099+0000 7f6494b92640 1 -- 172.21.15.131:0/4109342593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64900d02f0 msgr2=0x7f64901f4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:52.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.099+0000 7f6494b92640 1 --2- 172.21.15.131:0/4109342593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64900d02f0 0x7f64901f4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.099+0000 7f6494b92640 1 -- 172.21.15.131:0/4109342593 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64900b1ae0 con 0x7f64901f5510 2024-05-17T04:09:52.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.099+0000 7f6494b92640 1 --2- 172.21.15.131:0/4109342593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64901f5510 0x7f649015e790 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f648800cd80 tx=0x7f648800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:52.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.099+0000 7f648cff9640 1 -- 172.21.15.131:0/4109342593 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648800f680 con 0x7f64901f5510 2024-05-17T04:09:52.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.099+0000 7f648cff9640 1 -- 172.21.15.131:0/4109342593 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648800f840 con 0x7f64901f5510 2024-05-17T04:09:52.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.099+0000 7f64965f5640 1 -- 172.21.15.131:0/4109342593 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64900b1dc0 con 0x7f64901f5510 2024-05-17T04:09:52.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.099+0000 7f648cff9640 1 -- 172.21.15.131:0/4109342593 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648800fc30 con 0x7f64901f5510 2024-05-17T04:09:52.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.099+0000 7f64965f5640 1 -- 172.21.15.131:0/4109342593 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f649014cd70 con 0x7f64901f5510 2024-05-17T04:09:52.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.100+0000 7f64965f5640 1 -- 172.21.15.131:0/4109342593 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64901f59e0 con 0x7f64901f5510 2024-05-17T04:09:52.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.101+0000 7f648cff9640 1 -- 172.21.15.131:0/4109342593 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f64880213f0 con 0x7f64901f5510 2024-05-17T04:09:52.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.101+0000 7f648cff9640 1 --2- 172.21.15.131:0/4109342593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f647c076300 0x7f647c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.101+0000 7f648cff9640 1 -- 172.21.15.131:0/4109342593 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7f6488098230 con 0x7f64901f5510 2024-05-17T04:09:52.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.101+0000 7f648ffff640 1 --2- 172.21.15.131:0/4109342593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f647c076300 0x7f647c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.102+0000 7f648ffff640 1 --2- 172.21.15.131:0/4109342593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f647c076300 0x7f647c078810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6480006fd0 tx=0x7f6480008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:52.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.106+0000 7f648cff9640 1 -- 172.21.15.131:0/4109342593 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6488014030 con 0x7f64901f5510 2024-05-17T04:09:52.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.355+0000 7f64965f5640 1 -- 172.21.15.131:0/4109342593 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f64900b4d80 con 0x7f64901f5510 2024-05-17T04:09:52.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.357+0000 7f648cff9640 1 -- 172.21.15.131:0/4109342593 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f6488061cc0 con 0x7f64901f5510 2024-05-17T04:09:52.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.360+0000 7f64965f5640 1 -- 172.21.15.131:0/4109342593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f647c076300 msgr2=0x7f647c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:52.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.360+0000 7f64965f5640 1 --2- 172.21.15.131:0/4109342593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f647c076300 0x7f647c078810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6480006fd0 tx=0x7f6480008040 comp rx=0 tx=0).stop 2024-05-17T04:09:52.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.360+0000 7f64965f5640 1 -- 172.21.15.131:0/4109342593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64901f5510 msgr2=0x7f649015e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:52.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.360+0000 7f64965f5640 1 --2- 172.21.15.131:0/4109342593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64901f5510 0x7f649015e790 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f648800cd80 tx=0x7f648800a650 comp rx=0 tx=0).stop 2024-05-17T04:09:52.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.360+0000 7f64965f5640 1 -- 172.21.15.131:0/4109342593 shutdown_connections 2024-05-17T04:09:52.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.360+0000 7f64965f5640 1 --2- 172.21.15.131:0/4109342593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f647c076300 0x7f647c078810 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.360+0000 7f64965f5640 1 --2- 172.21.15.131:0/4109342593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64901f5510 0x7f649015e790 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.360+0000 7f64965f5640 1 --2- 172.21.15.131:0/4109342593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64900d02f0 0x7f64901f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.360+0000 7f64965f5640 1 --2- 172.21.15.131:0/4109342593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64900b4970 0x7f64900b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.360+0000 7f64965f5640 1 -- 172.21.15.131:0/4109342593 >> 172.21.15.131:0/4109342593 conn(0x7f64900b36d0 msgr2=0x7f64900731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:52.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.360+0000 7f64965f5640 1 -- 172.21.15.131:0/4109342593 shutdown_connections 2024-05-17T04:09:52.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.360+0000 7f64965f5640 1 -- 172.21.15.131:0/4109342593 wait complete. 2024-05-17T04:09:52.373 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-17T04:09:52.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.482+0000 7fe3ded35640 1 Processor -- start 2024-05-17T04:09:52.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.483+0000 7fe3ded35640 1 -- start start 2024-05-17T04:09:52.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.484+0000 7fe3ded35640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe3d815f690 0x7fe3d80afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.484+0000 7fe3ded35640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe3d80b1440 0x7fe3d806c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.484+0000 7fe3ded35640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3d80aebc0 con 0x7fe3d80b3d30 2024-05-17T04:09:52.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.484+0000 7fe3ded35640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d80b3140 con 0x7fe3d815f690 2024-05-17T04:09:52.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.484+0000 7fe3ded35640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d80b01a0 con 0x7fe3d80b1440 2024-05-17T04:09:52.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.484+0000 7fe3dcad1640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe3d815f690 0x7fe3d80afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.484+0000 7fe3d7fff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe3d80b3d30 0x7fe3d80b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38364/0 (socket says 172.21.15.131:38364) 2024-05-17T04:09:52.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.484+0000 7fe3d7fff640 1 -- 172.21.15.131:0/1267364360 learned_addr learned my addr 172.21.15.131:0/1267364360 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:52.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.484+0000 7fe3dcad1640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe3d815f690 0x7fe3d80afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43536/0 (socket says 172.21.15.131:43536) 2024-05-17T04:09:52.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.484+0000 7fe3dcad1640 1 -- 172.21.15.131:0/1267364360 >> v2:172.21.15.150:3300/0 conn(0x7fe3d80b1440 msgr2=0x7fe3d806c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:52.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.484+0000 7fe3dcad1640 1 --2- 172.21.15.131:0/1267364360 >> v2:172.21.15.150:3300/0 conn(0x7fe3d80b1440 0x7fe3d806c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.484+0000 7fe3dcad1640 1 -- 172.21.15.131:0/1267364360 >> v1:172.21.15.131:6789/0 conn(0x7fe3d80b3d30 legacy=0x7fe3d80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:52.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.484+0000 7fe3d77fe640 1 -- 172.21.15.131:0/1267364360 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2577233100 0 0) 0x7fe3d80aebc0 con 0x7fe3d80b3d30 2024-05-17T04:09:52.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.484+0000 7fe3dcad1640 1 -- 172.21.15.131:0/1267364360 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d80aeea0 con 0x7fe3d815f690 2024-05-17T04:09:52.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.485+0000 7fe3dcad1640 1 --2- 172.21.15.131:0/1267364360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3d815f690 0x7fe3d80afc60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8072b50 tx=0x7fe3c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1a0c41f1ce04b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:52.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.485+0000 7fe3d77fe640 1 -- 172.21.15.131:0/1267364360 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8037070 con 0x7fe3d815f690 2024-05-17T04:09:52.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.485+0000 7fe3d77fe640 1 -- 172.21.15.131:0/1267364360 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c8032440 con 0x7fe3d815f690 2024-05-17T04:09:52.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.485+0000 7fe3d77fe640 1 -- 172.21.15.131:0/1267364360 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8032810 con 0x7fe3d815f690 2024-05-17T04:09:52.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.486+0000 7fe3ded35640 1 -- 172.21.15.131:0/1267364360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3d815f690 msgr2=0x7fe3d80afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:52.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.486+0000 7fe3ded35640 1 --2- 172.21.15.131:0/1267364360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3d815f690 0x7fe3d80afc60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8072b50 tx=0x7fe3c802a1a0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.486+0000 7fe3ded35640 1 -- 172.21.15.131:0/1267364360 shutdown_connections 2024-05-17T04:09:52.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.486+0000 7fe3ded35640 1 --2- 172.21.15.131:0/1267364360 >> v2:172.21.15.150:3300/0 conn(0x7fe3d80b1440 0x7fe3d806c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.486+0000 7fe3ded35640 1 --2- 172.21.15.131:0/1267364360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3d815f690 0x7fe3d80afc60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.486+0000 7fe3ded35640 1 -- 172.21.15.131:0/1267364360 >> 172.21.15.131:0/1267364360 conn(0x7fe3d8073150 msgr2=0x7fe3d8073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:52.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.486+0000 7fe3ded35640 1 -- 172.21.15.131:0/1267364360 shutdown_connections 2024-05-17T04:09:52.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.486+0000 7fe3ded35640 1 -- 172.21.15.131:0/1267364360 wait complete. 2024-05-17T04:09:52.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.488+0000 7fe3ded35640 1 Processor -- start 2024-05-17T04:09:52.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.488+0000 7fe3ded35640 1 -- start start 2024-05-17T04:09:52.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.489+0000 7fe3ded35640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3d80b3d30 0x7fe3d8150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.489+0000 7fe3ded35640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3d815f690 0x7fe3d81f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.489+0000 7fe3ded35640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3d8152480 0x7fe3d8153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.489+0000 7fe3ded35640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d80af740 con 0x7fe3d815f690 2024-05-17T04:09:52.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.489+0000 7fe3ded35640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d80af460 con 0x7fe3d80b3d30 2024-05-17T04:09:52.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.489+0000 7fe3ded35640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d80ae850 con 0x7fe3d8152480 2024-05-17T04:09:52.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.489+0000 7fe3d7fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3d815f690 0x7fe3d81f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.489+0000 7fe3d7fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3d815f690 0x7fe3d81f6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43544/0 (socket says 172.21.15.131:43544) 2024-05-17T04:09:52.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.489+0000 7fe3d7fff640 1 -- 172.21.15.131:0/3879015670 learned_addr learned my addr 172.21.15.131:0/3879015670 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:52.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.490+0000 7fe3dcad1640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3d80b3d30 0x7fe3d8150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.490+0000 7fe3d7fff640 1 -- 172.21.15.131:0/3879015670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3d8152480 msgr2=0x7fe3d8153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:52.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.490+0000 7fe3dd2d2640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3d8152480 0x7fe3d8153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.490+0000 7fe3d7fff640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3d8152480 0x7fe3d8153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.490+0000 7fe3d7fff640 1 -- 172.21.15.131:0/3879015670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3d80b3d30 msgr2=0x7fe3d8150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:52.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.490+0000 7fe3d7fff640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3d80b3d30 0x7fe3d8150270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.490+0000 7fe3d7fff640 1 -- 172.21.15.131:0/3879015670 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d81f6720 con 0x7fe3d815f690 2024-05-17T04:09:52.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.490+0000 7fe3dcad1640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3d80b3d30 0x7fe3d8150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:52.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.490+0000 7fe3dd2d2640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3d8152480 0x7fe3d8153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:52.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.490+0000 7fe3d7fff640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3d815f690 0x7fe3d81f6920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c3f0 tx=0x7fe3cc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:52.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.490+0000 7fe3d57fa640 1 -- 172.21.15.131:0/3879015670 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0074e0 con 0x7fe3d815f690 2024-05-17T04:09:52.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.490+0000 7fe3d57fa640 1 -- 172.21.15.131:0/3879015670 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3cc0047e0 con 0x7fe3d815f690 2024-05-17T04:09:52.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.490+0000 7fe3ded35640 1 -- 172.21.15.131:0/3879015670 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d81513e0 con 0x7fe3d815f690 2024-05-17T04:09:52.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.490+0000 7fe3d57fa640 1 -- 172.21.15.131:0/3879015670 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc004bd0 con 0x7fe3d815f690 2024-05-17T04:09:52.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.490+0000 7fe3ded35640 1 -- 172.21.15.131:0/3879015670 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d81519a0 con 0x7fe3d815f690 2024-05-17T04:09:52.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.491+0000 7fe3ded35640 1 -- 172.21.15.131:0/3879015670 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d81507b0 con 0x7fe3d815f690 2024-05-17T04:09:52.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.492+0000 7fe3d57fa640 1 -- 172.21.15.131:0/3879015670 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe3cc011070 con 0x7fe3d815f690 2024-05-17T04:09:52.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.492+0000 7fe3d57fa640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe3c40762d0 0x7fe3c40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.493+0000 7fe3dcad1640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe3c40762d0 0x7fe3c40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.493+0000 7fe3d57fa640 1 -- 172.21.15.131:0/3879015670 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7fe3cc097040 con 0x7fe3d815f690 2024-05-17T04:09:52.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.493+0000 7fe3dcad1640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe3c40762d0 0x7fe3c40787e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8034000 tx=0x7fe3c802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:52.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.497+0000 7fe3d57fa640 1 -- 172.21.15.131:0/3879015670 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe3d81507b0 con 0x7fe3d815f690 2024-05-17T04:09:52.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.747+0000 7fe3ded35640 1 -- 172.21.15.131:0/3879015670 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fe3d8151170 con 0x7fe3d815f690 2024-05-17T04:09:52.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.750+0000 7fe3d57fa640 1 -- 172.21.15.131:0/3879015670 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fe3d81f6720 con 0x7fe3d815f690 2024-05-17T04:09:52.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.752+0000 7fe3ded35640 1 -- 172.21.15.131:0/3879015670 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe3c40762d0 msgr2=0x7fe3c40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:52.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.752+0000 7fe3ded35640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe3c40762d0 0x7fe3c40787e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8034000 tx=0x7fe3c802e000 comp rx=0 tx=0).stop 2024-05-17T04:09:52.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.752+0000 7fe3ded35640 1 -- 172.21.15.131:0/3879015670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3d815f690 msgr2=0x7fe3d81f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:52.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.752+0000 7fe3ded35640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3d815f690 0x7fe3d81f6920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c3f0 tx=0x7fe3cc00c8b0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.752+0000 7fe3ded35640 1 -- 172.21.15.131:0/3879015670 shutdown_connections 2024-05-17T04:09:52.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.752+0000 7fe3ded35640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe3c40762d0 0x7fe3c40787e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.752+0000 7fe3ded35640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3d815f690 0x7fe3d81f6920 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.752+0000 7fe3ded35640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3d8152480 0x7fe3d8153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.752+0000 7fe3ded35640 1 --2- 172.21.15.131:0/3879015670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3d80b3d30 0x7fe3d8150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.752+0000 7fe3ded35640 1 -- 172.21.15.131:0/3879015670 >> 172.21.15.131:0/3879015670 conn(0x7fe3d8073150 msgr2=0x7fe3d80b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:52.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.752+0000 7fe3ded35640 1 -- 172.21.15.131:0/3879015670 shutdown_connections 2024-05-17T04:09:52.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.752+0000 7fe3ded35640 1 -- 172.21.15.131:0/3879015670 wait complete. 2024-05-17T04:09:52.765 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-17T04:09:52.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.877+0000 7fce24d9a640 1 Processor -- start 2024-05-17T04:09:52.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.877+0000 7fce24d9a640 1 -- start start 2024-05-17T04:09:52.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.879+0000 7fce24d9a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fce2015f690 0x7fce200afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.879+0000 7fce24d9a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce200b1440 0x7fce2006c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.879+0000 7fce24d9a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce200aebc0 con 0x7fce200b3d30 2024-05-17T04:09:52.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.879+0000 7fce24d9a640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fce200b3140 con 0x7fce2015f690 2024-05-17T04:09:52.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.879+0000 7fce24d9a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fce200b01a0 con 0x7fce200b1440 2024-05-17T04:09:52.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.879+0000 7fce1e59c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fce2015f690 0x7fce200afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.879+0000 7fce1ed9d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce200b1440 0x7fce2006c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.879+0000 7fce1e59c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fce2015f690 0x7fce200afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:46792/0 (socket says 172.21.15.131:46792) 2024-05-17T04:09:52.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.879+0000 7fce1e59c640 1 -- 172.21.15.131:0/1034995924 learned_addr learned my addr 172.21.15.131:0/1034995924 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:52.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.879+0000 7fce1dd9b640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fce200b3d30 0x7fce200b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:43904/0 (socket says 172.21.15.131:43904) 2024-05-17T04:09:52.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.879+0000 7fce1ed9d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce200b1440 0x7fce2006c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:57730/0 (socket says 172.21.15.131:57730) 2024-05-17T04:09:52.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.880+0000 7fce1ed9d640 1 -- 172.21.15.131:0/1034995924 >> v2:172.21.15.150:3300/0 conn(0x7fce2015f690 msgr2=0x7fce200afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:52.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.880+0000 7fce1ed9d640 1 --2- 172.21.15.131:0/1034995924 >> v2:172.21.15.150:3300/0 conn(0x7fce2015f690 0x7fce200afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.880+0000 7fce1ed9d640 1 -- 172.21.15.131:0/1034995924 >> v1:172.21.15.150:6789/0 conn(0x7fce200b3d30 legacy=0x7fce200b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:52.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.880+0000 7fce1ed9d640 1 -- 172.21.15.131:0/1034995924 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce200aeea0 con 0x7fce200b1440 2024-05-17T04:09:52.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.880+0000 7fce1e59c640 1 --2- 172.21.15.131:0/1034995924 >> v2:172.21.15.150:3300/0 conn(0x7fce2015f690 0x7fce200afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:52.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.880+0000 7fce1ed9d640 1 --2- 172.21.15.131:0/1034995924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce200b1440 0x7fce2006c6f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fce180097a0 tx=0x7fce1802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=362746e9c0a4f87d server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:52.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.881+0000 7fce1d59a640 1 -- 172.21.15.131:0/1034995924 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18037070 con 0x7fce200b1440 2024-05-17T04:09:52.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.881+0000 7fce1d59a640 1 -- 172.21.15.131:0/1034995924 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce18032440 con 0x7fce200b1440 2024-05-17T04:09:52.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.881+0000 7fce1d59a640 1 -- 172.21.15.131:0/1034995924 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18032810 con 0x7fce200b1440 2024-05-17T04:09:52.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.881+0000 7fce24d9a640 1 -- 172.21.15.131:0/1034995924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce200b1440 msgr2=0x7fce2006c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:52.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.881+0000 7fce24d9a640 1 --2- 172.21.15.131:0/1034995924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce200b1440 0x7fce2006c6f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fce180097a0 tx=0x7fce1802a180 comp rx=0 tx=0).stop 2024-05-17T04:09:52.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.881+0000 7fce24d9a640 1 -- 172.21.15.131:0/1034995924 shutdown_connections 2024-05-17T04:09:52.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.881+0000 7fce24d9a640 1 --2- 172.21.15.131:0/1034995924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce200b1440 0x7fce2006c6f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.881+0000 7fce24d9a640 1 --2- 172.21.15.131:0/1034995924 >> v2:172.21.15.150:3300/0 conn(0x7fce2015f690 0x7fce200afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.881+0000 7fce24d9a640 1 -- 172.21.15.131:0/1034995924 >> 172.21.15.131:0/1034995924 conn(0x7fce20073150 msgr2=0x7fce20073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:52.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.881+0000 7fce24d9a640 1 -- 172.21.15.131:0/1034995924 shutdown_connections 2024-05-17T04:09:52.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.881+0000 7fce24d9a640 1 -- 172.21.15.131:0/1034995924 wait complete. 2024-05-17T04:09:52.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.883+0000 7fce24d9a640 1 Processor -- start 2024-05-17T04:09:52.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.883+0000 7fce24d9a640 1 -- start start 2024-05-17T04:09:52.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce24d9a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce200b3d30 0x7fce200caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce24d9a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce2015f690 0x7fce20162ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce24d9a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce20163430 0x7fce201f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce24d9a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fce200af740 con 0x7fce200b3d30 2024-05-17T04:09:52.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce24d9a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fce200af460 con 0x7fce2015f690 2024-05-17T04:09:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce24d9a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fce200ae850 con 0x7fce20163430 2024-05-17T04:09:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce1e59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce200b3d30 0x7fce200caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce1e59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce200b3d30 0x7fce200caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43546/0 (socket says 172.21.15.131:43546) 2024-05-17T04:09:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce1e59c640 1 -- 172.21.15.131:0/3939908964 learned_addr learned my addr 172.21.15.131:0/3939908964 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce1dd9b640 1 --2- 172.21.15.131:0/3939908964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce2015f690 0x7fce20162ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce1ed9d640 1 --2- 172.21.15.131:0/3939908964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce20163430 0x7fce201f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce1e59c640 1 -- 172.21.15.131:0/3939908964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce20163430 msgr2=0x7fce201f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce1e59c640 1 --2- 172.21.15.131:0/3939908964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce20163430 0x7fce201f5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce1e59c640 1 -- 172.21.15.131:0/3939908964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce2015f690 msgr2=0x7fce20162ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce1e59c640 1 --2- 172.21.15.131:0/3939908964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce2015f690 0x7fce20162ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce1e59c640 1 -- 172.21.15.131:0/3939908964 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce201f90e0 con 0x7fce200b3d30 2024-05-17T04:09:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce1dd9b640 1 --2- 172.21.15.131:0/3939908964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce2015f690 0x7fce20162ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce1e59c640 1 --2- 172.21.15.131:0/3939908964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce200b3d30 0x7fce200caea0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fce1000efc0 tx=0x7fce1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:52.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.885+0000 7fce16ffd640 1 -- 172.21.15.131:0/3939908964 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1000ce60 con 0x7fce200b3d30 2024-05-17T04:09:52.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.886+0000 7fce24d9a640 1 -- 172.21.15.131:0/3939908964 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce201f93c0 con 0x7fce200b3d30 2024-05-17T04:09:52.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.886+0000 7fce16ffd640 1 -- 172.21.15.131:0/3939908964 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce10019070 con 0x7fce200b3d30 2024-05-17T04:09:52.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.886+0000 7fce16ffd640 1 -- 172.21.15.131:0/3939908964 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce10014680 con 0x7fce200b3d30 2024-05-17T04:09:52.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.886+0000 7fce24d9a640 1 -- 172.21.15.131:0/3939908964 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce201f9980 con 0x7fce200b3d30 2024-05-17T04:09:52.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.887+0000 7fce24d9a640 1 -- 172.21.15.131:0/3939908964 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce200b2330 con 0x7fce200b3d30 2024-05-17T04:09:52.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.887+0000 7fce16ffd640 1 -- 172.21.15.131:0/3939908964 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fce10005d10 con 0x7fce200b3d30 2024-05-17T04:09:52.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.888+0000 7fce16ffd640 1 --2- 172.21.15.131:0/3939908964 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fce00076300 0x7fce00078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:52.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.888+0000 7fce16ffd640 1 -- 172.21.15.131:0/3939908964 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7fce10097a60 con 0x7fce200b3d30 2024-05-17T04:09:52.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.888+0000 7fce1dd9b640 1 --2- 172.21.15.131:0/3939908964 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fce00076300 0x7fce00078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:52.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.888+0000 7fce1dd9b640 1 --2- 172.21.15.131:0/3939908964 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fce00076300 0x7fce00078810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce08000f60 tx=0x7fce08009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:52.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:52.892+0000 7fce16ffd640 1 -- 172.21.15.131:0/3939908964 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fce200b2330 con 0x7fce200b3d30 2024-05-17T04:09:53.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.144+0000 7fce24d9a640 1 -- 172.21.15.131:0/3939908964 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fce200b4140 con 0x7fce200b3d30 2024-05-17T04:09:53.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.147+0000 7fce16ffd640 1 -- 172.21.15.131:0/3939908964 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7fce10023020 con 0x7fce200b3d30 2024-05-17T04:09:53.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.149+0000 7fce24d9a640 1 -- 172.21.15.131:0/3939908964 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fce00076300 msgr2=0x7fce00078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:53.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.149+0000 7fce24d9a640 1 --2- 172.21.15.131:0/3939908964 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fce00076300 0x7fce00078810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce08000f60 tx=0x7fce08009040 comp rx=0 tx=0).stop 2024-05-17T04:09:53.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.149+0000 7fce24d9a640 1 -- 172.21.15.131:0/3939908964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce200b3d30 msgr2=0x7fce200caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:53.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.149+0000 7fce24d9a640 1 --2- 172.21.15.131:0/3939908964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce200b3d30 0x7fce200caea0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fce1000efc0 tx=0x7fce1000c490 comp rx=0 tx=0).stop 2024-05-17T04:09:53.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.149+0000 7fce24d9a640 1 -- 172.21.15.131:0/3939908964 shutdown_connections 2024-05-17T04:09:53.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.149+0000 7fce24d9a640 1 --2- 172.21.15.131:0/3939908964 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fce00076300 0x7fce00078810 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.149+0000 7fce24d9a640 1 --2- 172.21.15.131:0/3939908964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce20163430 0x7fce201f5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.149+0000 7fce24d9a640 1 --2- 172.21.15.131:0/3939908964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce2015f690 0x7fce20162ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.149+0000 7fce24d9a640 1 --2- 172.21.15.131:0/3939908964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce200b3d30 0x7fce200caea0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.149+0000 7fce24d9a640 1 -- 172.21.15.131:0/3939908964 >> 172.21.15.131:0/3939908964 conn(0x7fce20073150 msgr2=0x7fce2015b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:53.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.149+0000 7fce24d9a640 1 -- 172.21.15.131:0/3939908964 shutdown_connections 2024-05-17T04:09:53.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.149+0000 7fce24d9a640 1 -- 172.21.15.131:0/3939908964 wait complete. 2024-05-17T04:09:53.161 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-17T04:09:53.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.271+0000 7fa28057a640 1 Processor -- start 2024-05-17T04:09:53.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.271+0000 7fa28057a640 1 -- start start 2024-05-17T04:09:53.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.273+0000 7fa28057a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2780d0ca0 0x7fa27815f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:53.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.273+0000 7fa28057a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2780cd8c0 con 0x7fa27806e090 2024-05-17T04:09:53.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.273+0000 7fa28057a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa27806e830 con 0x7fa2780d02f0 2024-05-17T04:09:53.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.273+0000 7fa28057a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa27806f0d0 con 0x7fa2780d0ca0 2024-05-17T04:09:53.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.273+0000 7fa27db15640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa27806e090 0x7fa2780cfbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38378/0 (socket says 172.21.15.131:38378) 2024-05-17T04:09:53.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.273+0000 7fa27db15640 1 -- 172.21.15.131:0/3701202094 learned_addr learned my addr 172.21.15.131:0/3701202094 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:53.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.273+0000 7fa27e316640 1 --2- 172.21.15.131:0/3701202094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2780d0ca0 0x7fa27815f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:53.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.273+0000 7fa27d314640 1 -- 172.21.15.131:0/3701202094 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2159859272 0 0) 0x7fa2780cd8c0 con 0x7fa27806e090 2024-05-17T04:09:53.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.273+0000 7fa27d314640 1 -- 172.21.15.131:0/3701202094 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa260003520 con 0x7fa27806e090 2024-05-17T04:09:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27d314640 1 -- 172.21.15.131:0/3701202094 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3064717781 0 0) 0x7fa260003520 con 0x7fa27806e090 2024-05-17T04:09:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27d314640 1 -- 172.21.15.131:0/3701202094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2780d0ca0 msgr2=0x7fa27815f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27d314640 1 --2- 172.21.15.131:0/3701202094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2780d0ca0 0x7fa27815f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27d314640 1 -- 172.21.15.131:0/3701202094 >> v1:172.21.15.150:6789/0 conn(0x7fa2780d02f0 legacy=0x7fa2780cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27d314640 1 -- 172.21.15.131:0/3701202094 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27806eb10 con 0x7fa27806e090 2024-05-17T04:09:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27d314640 1 -- 172.21.15.131:0/3701202094 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7fa26c0016f0 con 0x7fa27806e090 2024-05-17T04:09:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27d314640 1 -- 172.21.15.131:0/3701202094 >> v1:172.21.15.131:6789/0 conn(0x7fa27806e090 legacy=0x7fa2780cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27d314640 1 --2- 172.21.15.131:0/3701202094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2600039e0 0x7fa260003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27d314640 1 --2- 172.21.15.131:0/3701202094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2780d0ca0 0x7fa260004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:53.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27d314640 1 --2- 172.21.15.131:0/3701202094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa260004d40 0x7fa260005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27d314640 1 -- 172.21.15.131:0/3701202094 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa27806f0d0 con 0x7fa2600039e0 2024-05-17T04:09:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27d314640 1 -- 172.21.15.131:0/3701202094 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa26000bba0 con 0x7fa260004d40 2024-05-17T04:09:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27d314640 1 -- 172.21.15.131:0/3701202094 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa26000bda0 con 0x7fa2780d0ca0 2024-05-17T04:09:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27e316640 1 --2- 172.21.15.131:0/3701202094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2600039e0 0x7fa260003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27db15640 1 --2- 172.21.15.131:0/3701202094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2780d0ca0 0x7fa260004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27eb17640 1 --2- 172.21.15.131:0/3701202094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa260004d40 0x7fa260005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27e316640 1 -- 172.21.15.131:0/3701202094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2780d0ca0 msgr2=0x7fa260004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27e316640 1 --2- 172.21.15.131:0/3701202094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2780d0ca0 0x7fa260004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27e316640 1 -- 172.21.15.131:0/3701202094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa260004d40 msgr2=0x7fa260005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27e316640 1 --2- 172.21.15.131:0/3701202094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa260004d40 0x7fa260005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.274+0000 7fa27e316640 1 -- 172.21.15.131:0/3701202094 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa260003520 con 0x7fa2600039e0 2024-05-17T04:09:53.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.275+0000 7fa27e316640 1 --2- 172.21.15.131:0/3701202094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2600039e0 0x7fa260003e10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa268009fc0 tx=0x7fa260005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27e06f3b5fff4e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:53.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.275+0000 7fa27d314640 1 -- 172.21.15.131:0/3701202094 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa268034020 con 0x7fa2600039e0 2024-05-17T04:09:53.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.275+0000 7fa27d314640 1 -- 172.21.15.131:0/3701202094 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2680305f0 con 0x7fa2600039e0 2024-05-17T04:09:53.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.275+0000 7fa27d314640 1 -- 172.21.15.131:0/3701202094 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa268009c10 con 0x7fa2600039e0 2024-05-17T04:09:53.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.276+0000 7fa28057a640 1 -- 172.21.15.131:0/3701202094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2600039e0 msgr2=0x7fa260003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:53.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.276+0000 7fa28057a640 1 --2- 172.21.15.131:0/3701202094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2600039e0 0x7fa260003e10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa268009fc0 tx=0x7fa260005830 comp rx=0 tx=0).stop 2024-05-17T04:09:53.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.276+0000 7fa27eb17640 1 -- 172.21.15.131:0/3701202094 reap_dead start 2024-05-17T04:09:53.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.276+0000 7fa28057a640 1 -- 172.21.15.131:0/3701202094 shutdown_connections 2024-05-17T04:09:53.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.276+0000 7fa28057a640 1 -- 172.21.15.131:0/3701202094 >> 172.21.15.131:0/3701202094 conn(0x7fa2780b4e40 msgr2=0x7fa2780b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:53.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.276+0000 7fa28057a640 1 -- 172.21.15.131:0/3701202094 shutdown_connections 2024-05-17T04:09:53.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.276+0000 7fa28057a640 1 -- 172.21.15.131:0/3701202094 wait complete. 2024-05-17T04:09:53.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.278+0000 7fa28057a640 1 Processor -- start 2024-05-17T04:09:53.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.278+0000 7fa28057a640 1 -- start start 2024-05-17T04:09:53.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa28057a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2600039e0 0x7fa278153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:53.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa28057a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2780b5f60 0x7fa278161b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:53.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa28057a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2780c9e60 0x7fa278162050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:53.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa28057a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa27815f7c0 con 0x7fa2780b5f60 2024-05-17T04:09:53.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa28057a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa27806e4a0 con 0x7fa2780c9e60 2024-05-17T04:09:53.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa28057a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa27815f940 con 0x7fa2600039e0 2024-05-17T04:09:53.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa27db15640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2780b5f60 0x7fa278161b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:53.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa27db15640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2780b5f60 0x7fa278161b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43562/0 (socket says 172.21.15.131:43562) 2024-05-17T04:09:53.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa27db15640 1 -- 172.21.15.131:0/1553447526 learned_addr learned my addr 172.21.15.131:0/1553447526 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:53.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa27e316640 1 --2- 172.21.15.131:0/1553447526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2600039e0 0x7fa278153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:53.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa27eb17640 1 --2- 172.21.15.131:0/1553447526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2780c9e60 0x7fa278162050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:53.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa27db15640 1 -- 172.21.15.131:0/1553447526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2600039e0 msgr2=0x7fa278153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:53.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa27db15640 1 --2- 172.21.15.131:0/1553447526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2600039e0 0x7fa278153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa27db15640 1 -- 172.21.15.131:0/1553447526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2780c9e60 msgr2=0x7fa278162050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa27db15640 1 --2- 172.21.15.131:0/1553447526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2780c9e60 0x7fa278162050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa27db15640 1 -- 172.21.15.131:0/1553447526 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2781f5090 con 0x7fa2780b5f60 2024-05-17T04:09:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.279+0000 7fa27eb17640 1 --2- 172.21.15.131:0/1553447526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2780c9e60 0x7fa278162050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.280+0000 7fa27db15640 1 --2- 172.21.15.131:0/1553447526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2780b5f60 0x7fa278161b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa2780b47f0 tx=0x7fa26c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.280+0000 7fa276ffd640 1 -- 172.21.15.131:0/1553447526 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00f6a0 con 0x7fa2780b5f60 2024-05-17T04:09:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.280+0000 7fa276ffd640 1 -- 172.21.15.131:0/1553447526 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa26c018070 con 0x7fa2780b5f60 2024-05-17T04:09:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.280+0000 7fa276ffd640 1 -- 172.21.15.131:0/1553447526 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00fa40 con 0x7fa2780b5f60 2024-05-17T04:09:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.280+0000 7fa28057a640 1 -- 172.21.15.131:0/1553447526 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa278153a90 con 0x7fa2780b5f60 2024-05-17T04:09:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.280+0000 7fa28057a640 1 -- 172.21.15.131:0/1553447526 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2780b69b0 con 0x7fa2780b5f60 2024-05-17T04:09:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.281+0000 7fa28057a640 1 -- 172.21.15.131:0/1553447526 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2780cfbe0 con 0x7fa2780b5f60 2024-05-17T04:09:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.281+0000 7fa276ffd640 1 -- 172.21.15.131:0/1553447526 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa26c00fbe0 con 0x7fa2780b5f60 2024-05-17T04:09:53.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.282+0000 7fa276ffd640 1 --2- 172.21.15.131:0/1553447526 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa264076300 0x7fa264078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:53.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.282+0000 7fa27e316640 1 --2- 172.21.15.131:0/1553447526 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa264076300 0x7fa264078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:53.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.282+0000 7fa276ffd640 1 -- 172.21.15.131:0/1553447526 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7fa26c097280 con 0x7fa2780b5f60 2024-05-17T04:09:53.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.283+0000 7fa27e316640 1 --2- 172.21.15.131:0/1553447526 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa264076300 0x7fa264078810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa268035000 tx=0x7fa26802f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:53.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.287+0000 7fa276ffd640 1 -- 172.21.15.131:0/1553447526 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa26c060d10 con 0x7fa2780b5f60 2024-05-17T04:09:53.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.540+0000 7fa28057a640 1 -- 172.21.15.131:0/1553447526 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fa2780b63f0 con 0x7fa2780b5f60 2024-05-17T04:09:53.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.542+0000 7fa276ffd640 1 -- 172.21.15.131:0/1553447526 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fa26c060610 con 0x7fa2780b5f60 2024-05-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.544+0000 7fa28057a640 1 -- 172.21.15.131:0/1553447526 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa264076300 msgr2=0x7fa264078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.544+0000 7fa28057a640 1 --2- 172.21.15.131:0/1553447526 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa264076300 0x7fa264078810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa268035000 tx=0x7fa26802f000 comp rx=0 tx=0).stop 2024-05-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.544+0000 7fa28057a640 1 -- 172.21.15.131:0/1553447526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2780b5f60 msgr2=0x7fa278161b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.544+0000 7fa28057a640 1 --2- 172.21.15.131:0/1553447526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2780b5f60 0x7fa278161b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa2780b47f0 tx=0x7fa26c007430 comp rx=0 tx=0).stop 2024-05-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.545+0000 7fa28057a640 1 -- 172.21.15.131:0/1553447526 shutdown_connections 2024-05-17T04:09:53.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.545+0000 7fa28057a640 1 --2- 172.21.15.131:0/1553447526 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa264076300 0x7fa264078810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.545+0000 7fa28057a640 1 --2- 172.21.15.131:0/1553447526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2780b5f60 0x7fa278161b10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.545+0000 7fa28057a640 1 --2- 172.21.15.131:0/1553447526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2780c9e60 0x7fa278162050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.545+0000 7fa28057a640 1 --2- 172.21.15.131:0/1553447526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2600039e0 0x7fa278153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.545+0000 7fa28057a640 1 -- 172.21.15.131:0/1553447526 >> 172.21.15.131:0/1553447526 conn(0x7fa2780b4e40 msgr2=0x7fa27815ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:53.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.545+0000 7fa28057a640 1 -- 172.21.15.131:0/1553447526 shutdown_connections 2024-05-17T04:09:53.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.545+0000 7fa28057a640 1 -- 172.21.15.131:0/1553447526 wait complete. 2024-05-17T04:09:53.558 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-17T04:09:53.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.668+0000 7fb1167e0640 1 Processor -- start 2024-05-17T04:09:53.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.668+0000 7fb1167e0640 1 -- start start 2024-05-17T04:09:53.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.670+0000 7fb1167e0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1100b74c0 0x7fb1100b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:53.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.670+0000 7fb1167e0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb110163630 0x7fb110163a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:53.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.670+0000 7fb1167e0640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1100d0de0 con 0x7fb110071390 2024-05-17T04:09:53.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.670+0000 7fb1167e0640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb1100d0b90 con 0x7fb110163630 2024-05-17T04:09:53.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.670+0000 7fb1167e0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb1100d1ba0 con 0x7fb1100b74c0 2024-05-17T04:09:53.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.670+0000 7fb114d7d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb110163630 0x7fb110163a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:53.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.670+0000 7fb10ffff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb110071390 0x7fb1100717a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38384/0 (socket says 172.21.15.131:38384) 2024-05-17T04:09:53.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.670+0000 7fb10ffff640 1 -- 172.21.15.131:0/3826719038 learned_addr learned my addr 172.21.15.131:0/3826719038 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:53.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.670+0000 7fb10f7fe640 1 --2- 172.21.15.131:0/3826719038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1100b74c0 0x7fb1100b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:53.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.670+0000 7fb114d7d640 1 -- 172.21.15.131:0/3826719038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1100b74c0 msgr2=0x7fb1100b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:53.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.670+0000 7fb114d7d640 1 --2- 172.21.15.131:0/3826719038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1100b74c0 0x7fb1100b78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.670+0000 7fb114d7d640 1 -- 172.21.15.131:0/3826719038 >> v1:172.21.15.131:6789/0 conn(0x7fb110071390 legacy=0x7fb1100717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:53.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.670+0000 7fb114d7d640 1 -- 172.21.15.131:0/3826719038 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1100d10c0 con 0x7fb110163630 2024-05-17T04:09:53.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.671+0000 7fb114d7d640 1 --2- 172.21.15.131:0/3826719038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb110163630 0x7fb110163a40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb108009d90 tx=0x7fb10802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc9668897b1235a server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:53.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.671+0000 7fb10effd640 1 -- 172.21.15.131:0/3826719038 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108031600 con 0x7fb110163630 2024-05-17T04:09:53.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.671+0000 7fb10effd640 1 -- 172.21.15.131:0/3826719038 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1080317a0 con 0x7fb110163630 2024-05-17T04:09:53.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.671+0000 7fb10effd640 1 -- 172.21.15.131:0/3826719038 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108031b70 con 0x7fb110163630 2024-05-17T04:09:53.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.672+0000 7fb1167e0640 1 -- 172.21.15.131:0/3826719038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb110163630 msgr2=0x7fb110163a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:53.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.672+0000 7fb1167e0640 1 --2- 172.21.15.131:0/3826719038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb110163630 0x7fb110163a40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb108009d90 tx=0x7fb10802a5d0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.672+0000 7fb1167e0640 1 -- 172.21.15.131:0/3826719038 shutdown_connections 2024-05-17T04:09:53.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.672+0000 7fb1167e0640 1 --2- 172.21.15.131:0/3826719038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb110163630 0x7fb110163a40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.672+0000 7fb1167e0640 1 --2- 172.21.15.131:0/3826719038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1100b74c0 0x7fb1100b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.672+0000 7fb1167e0640 1 -- 172.21.15.131:0/3826719038 >> 172.21.15.131:0/3826719038 conn(0x7fb1100735b0 msgr2=0x7fb1100739c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:53.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.672+0000 7fb1167e0640 1 -- 172.21.15.131:0/3826719038 shutdown_connections 2024-05-17T04:09:53.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.672+0000 7fb1167e0640 1 -- 172.21.15.131:0/3826719038 wait complete. 2024-05-17T04:09:53.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.674+0000 7fb1167e0640 1 Processor -- start 2024-05-17T04:09:53.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.674+0000 7fb1167e0640 1 -- start start 2024-05-17T04:09:53.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb1167e0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb110071390 0x7fb1101f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:53.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb1167e0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1100b74c0 0x7fb11015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:53.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb1167e0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb110163630 0x7fb11015c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:53.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb1167e0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb1100b7e10 con 0x7fb110071390 2024-05-17T04:09:53.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb1167e0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb110142820 con 0x7fb110163630 2024-05-17T04:09:53.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb1167e0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb110163f80 con 0x7fb1100b74c0 2024-05-17T04:09:53.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb10ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb110071390 0x7fb1101f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:53.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb10ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb110071390 0x7fb1101f8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43578/0 (socket says 172.21.15.131:43578) 2024-05-17T04:09:53.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb10ffff640 1 -- 172.21.15.131:0/1651570596 learned_addr learned my addr 172.21.15.131:0/1651570596 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:53.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb10f7fe640 1 --2- 172.21.15.131:0/1651570596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1100b74c0 0x7fb11015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:53.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb114d7d640 1 --2- 172.21.15.131:0/1651570596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb110163630 0x7fb11015c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:53.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb10ffff640 1 -- 172.21.15.131:0/1651570596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1100b74c0 msgr2=0x7fb11015c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:53.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb10ffff640 1 --2- 172.21.15.131:0/1651570596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1100b74c0 0x7fb11015c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb10ffff640 1 -- 172.21.15.131:0/1651570596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb110163630 msgr2=0x7fb11015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:53.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb10ffff640 1 --2- 172.21.15.131:0/1651570596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb110163630 0x7fb11015c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb10ffff640 1 -- 172.21.15.131:0/1651570596 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb110142ad0 con 0x7fb110071390 2024-05-17T04:09:53.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.675+0000 7fb10f7fe640 1 --2- 172.21.15.131:0/1651570596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1100b74c0 0x7fb11015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:53.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.676+0000 7fb10ffff640 1 --2- 172.21.15.131:0/1651570596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb110071390 0x7fb1101f8d90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb10000c400 tx=0x7fb10000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:53.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.676+0000 7fb10cff9640 1 -- 172.21.15.131:0/1651570596 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100017070 con 0x7fb110071390 2024-05-17T04:09:53.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.676+0000 7fb10cff9640 1 -- 172.21.15.131:0/1651570596 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb100005d00 con 0x7fb110071390 2024-05-17T04:09:53.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.676+0000 7fb1167e0640 1 -- 172.21.15.131:0/1651570596 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb110142db0 con 0x7fb110071390 2024-05-17T04:09:53.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.676+0000 7fb10cff9640 1 -- 172.21.15.131:0/1651570596 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100007310 con 0x7fb110071390 2024-05-17T04:09:53.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.676+0000 7fb1167e0640 1 -- 172.21.15.131:0/1651570596 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb110143370 con 0x7fb110071390 2024-05-17T04:09:53.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.677+0000 7fb1167e0640 1 -- 172.21.15.131:0/1651570596 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1100b78d0 con 0x7fb110071390 2024-05-17T04:09:53.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.678+0000 7fb10cff9640 1 -- 172.21.15.131:0/1651570596 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb10001a070 con 0x7fb110071390 2024-05-17T04:09:53.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.678+0000 7fb10cff9640 1 --2- 172.21.15.131:0/1651570596 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb0fc076300 0x7fb0fc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:53.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.678+0000 7fb10cff9640 1 -- 172.21.15.131:0/1651570596 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7fb100096820 con 0x7fb110071390 2024-05-17T04:09:53.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.678+0000 7fb10f7fe640 1 --2- 172.21.15.131:0/1651570596 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb0fc076300 0x7fb0fc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:53.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.679+0000 7fb10f7fe640 1 --2- 172.21.15.131:0/1651570596 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb0fc076300 0x7fb0fc078810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb110145440 tx=0x7fb104008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:53.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.683+0000 7fb10cff9640 1 -- 172.21.15.131:0/1651570596 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb1000602c0 con 0x7fb110071390 2024-05-17T04:09:53.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.867+0000 7fb1167e0640 1 -- 172.21.15.131:0/1651570596 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb1100ce810 con 0x7fb110071390 2024-05-17T04:09:53.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.867+0000 7fb10cff9640 1 -- 172.21.15.131:0/1651570596 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) ==== 84+0+65 (secure 0 0 0) 0x7fb10005fbc0 con 0x7fb110071390 2024-05-17T04:09:53.868 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:53.869 INFO:teuthology.orchestra.run.smithi131.stdout:[ 2024-05-17T04:09:53.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-05-17T04:09:53.869 INFO:teuthology.orchestra.run.smithi131.stdout: "poolnum": 1, 2024-05-17T04:09:53.869 INFO:teuthology.orchestra.run.smithi131.stdout: "poolname": ".mgr" 2024-05-17T04:09:53.869 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:09:53.869 INFO:teuthology.orchestra.run.smithi131.stdout:] 2024-05-17T04:09:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.869+0000 7fb1167e0640 1 -- 172.21.15.131:0/1651570596 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb0fc076300 msgr2=0x7fb0fc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.869+0000 7fb1167e0640 1 --2- 172.21.15.131:0/1651570596 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb0fc076300 0x7fb0fc078810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb110145440 tx=0x7fb104008040 comp rx=0 tx=0).stop 2024-05-17T04:09:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.869+0000 7fb1167e0640 1 -- 172.21.15.131:0/1651570596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb110071390 msgr2=0x7fb1101f8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.869+0000 7fb1167e0640 1 --2- 172.21.15.131:0/1651570596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb110071390 0x7fb1101f8d90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb10000c400 tx=0x7fb10000c8c0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.870+0000 7fb1167e0640 1 -- 172.21.15.131:0/1651570596 shutdown_connections 2024-05-17T04:09:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.870+0000 7fb1167e0640 1 --2- 172.21.15.131:0/1651570596 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb0fc076300 0x7fb0fc078810 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.870+0000 7fb1167e0640 1 --2- 172.21.15.131:0/1651570596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb110163630 0x7fb11015c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.870+0000 7fb1167e0640 1 --2- 172.21.15.131:0/1651570596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1100b74c0 0x7fb11015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.870+0000 7fb1167e0640 1 --2- 172.21.15.131:0/1651570596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb110071390 0x7fb1101f8d90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:53.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.870+0000 7fb1167e0640 1 -- 172.21.15.131:0/1651570596 >> 172.21.15.131:0/1651570596 conn(0x7fb1100735b0 msgr2=0x7fb110141950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:53.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.870+0000 7fb1167e0640 1 -- 172.21.15.131:0/1651570596 shutdown_connections 2024-05-17T04:09:53.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.870+0000 7fb1167e0640 1 -- 172.21.15.131:0/1651570596 wait complete. 2024-05-17T04:09:53.882 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-17T04:09:53.882 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-17T04:09:53.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.997+0000 7f2bc78ba640 1 Processor -- start 2024-05-17T04:09:53.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.997+0000 7f2bc78ba640 1 -- start start 2024-05-17T04:09:53.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.998+0000 7f2bc78ba640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2bc01606a0 0x7f2bc016a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:53.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.998+0000 7f2bc78ba640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc00d08e0 con 0x7f2bc015f6a0 2024-05-17T04:09:53.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.998+0000 7f2bc78ba640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc006c820 con 0x7f2bc00d4570 2024-05-17T04:09:53.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.998+0000 7f2bc78ba640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f2bc0160d00 con 0x7f2bc01606a0 2024-05-17T04:09:54.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.998+0000 7f2bc5656640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f2bc015f6a0 0x7f2bc00d3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38388/0 (socket says 172.21.15.131:38388) 2024-05-17T04:09:54.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.998+0000 7f2bc5656640 1 -- 172.21.15.131:0/2054514022 learned_addr learned my addr 172.21.15.131:0/2054514022 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:54.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.998+0000 7f2bc5e57640 1 --2- 172.21.15.131:0/2054514022 >> v2:172.21.15.131:3300/0 conn(0x7f2bc01606a0 0x7f2bc016a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:54.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.999+0000 7f2bb7fff640 1 -- 172.21.15.131:0/2054514022 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2781812552 0 0) 0x7f2bc00d08e0 con 0x7f2bc015f6a0 2024-05-17T04:09:54.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.999+0000 7f2bb7fff640 1 -- 172.21.15.131:0/2054514022 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bac003520 con 0x7f2bc015f6a0 2024-05-17T04:09:54.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.999+0000 7f2bc5e57640 1 -- 172.21.15.131:0/2054514022 >> v1:172.21.15.150:6789/0 conn(0x7f2bc00d4570 legacy=0x7f2bc015ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:54.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.999+0000 7f2bc5e57640 1 -- 172.21.15.131:0/2054514022 >> v1:172.21.15.131:6789/0 conn(0x7f2bc015f6a0 legacy=0x7f2bc00d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:54.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.999+0000 7f2bc5e57640 1 -- 172.21.15.131:0/2054514022 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc006cb00 con 0x7f2bc01606a0 2024-05-17T04:09:54.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:53.999+0000 7f2bc5e57640 1 --2- 172.21.15.131:0/2054514022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bc01606a0 0x7f2bc016a4b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0160e80 tx=0x7f2bb802a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc19ed4a63ef294b server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:54.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.000+0000 7f2bb7fff640 1 -- 172.21.15.131:0/2054514022 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8007740 con 0x7f2bc01606a0 2024-05-17T04:09:54.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.000+0000 7f2bb7fff640 1 -- 172.21.15.131:0/2054514022 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb80078e0 con 0x7f2bc01606a0 2024-05-17T04:09:54.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.000+0000 7f2bb7fff640 1 -- 172.21.15.131:0/2054514022 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8007c90 con 0x7f2bc01606a0 2024-05-17T04:09:54.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.000+0000 7f2bc78ba640 1 -- 172.21.15.131:0/2054514022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bc01606a0 msgr2=0x7f2bc016a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:54.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.000+0000 7f2bc78ba640 1 --2- 172.21.15.131:0/2054514022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bc01606a0 0x7f2bc016a4b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0160e80 tx=0x7f2bb802a530 comp rx=0 tx=0).stop 2024-05-17T04:09:54.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.000+0000 7f2bc78ba640 1 -- 172.21.15.131:0/2054514022 shutdown_connections 2024-05-17T04:09:54.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.000+0000 7f2bc78ba640 1 --2- 172.21.15.131:0/2054514022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bc01606a0 0x7f2bc016a4b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:54.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.000+0000 7f2bc78ba640 1 -- 172.21.15.131:0/2054514022 >> 172.21.15.131:0/2054514022 conn(0x7f2bc00d58b0 msgr2=0x7f2bc00b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:54.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.000+0000 7f2bc78ba640 1 -- 172.21.15.131:0/2054514022 shutdown_connections 2024-05-17T04:09:54.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.000+0000 7f2bc78ba640 1 -- 172.21.15.131:0/2054514022 wait complete. 2024-05-17T04:09:54.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.002+0000 7f2bc78ba640 1 Processor -- start 2024-05-17T04:09:54.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.002+0000 7f2bc78ba640 1 -- start start 2024-05-17T04:09:54.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.003+0000 7f2bc78ba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bc015f6a0 0x7f2bc01f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:54.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.003+0000 7f2bc78ba640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bc01606a0 0x7f2bc0158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:54.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.003+0000 7f2bc78ba640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bc01593b0 0x7f2bc00ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:54.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.003+0000 7f2bc78ba640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc006d5e0 con 0x7f2bc01593b0 2024-05-17T04:09:54.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.003+0000 7f2bc78ba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc0160ab0 con 0x7f2bc015f6a0 2024-05-17T04:09:54.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.003+0000 7f2bc78ba640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2bc015fab0 con 0x7f2bc01606a0 2024-05-17T04:09:54.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bc5e57640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bc01593b0 0x7f2bc00ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:54.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bc5e57640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bc01593b0 0x7f2bc00ac6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:43596/0 (socket says 172.21.15.131:43596) 2024-05-17T04:09:54.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bc5e57640 1 -- 172.21.15.131:0/2177315750 learned_addr learned my addr 172.21.15.131:0/2177315750 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:54.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bc5656640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bc015f6a0 0x7f2bc01f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:54.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bc4e55640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bc01606a0 0x7f2bc0158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:54.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bc5e57640 1 -- 172.21.15.131:0/2177315750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bc01606a0 msgr2=0x7f2bc0158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:54.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bc5e57640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bc01606a0 0x7f2bc0158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:54.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bc5e57640 1 -- 172.21.15.131:0/2177315750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bc015f6a0 msgr2=0x7f2bc01f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:54.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bc5e57640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bc015f6a0 0x7f2bc01f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:54.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bc5e57640 1 -- 172.21.15.131:0/2177315750 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc01f6450 con 0x7f2bc01593b0 2024-05-17T04:09:54.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bc5656640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bc015f6a0 0x7f2bc01f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:54.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bc4e55640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bc01606a0 0x7f2bc0158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:54.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bc5e57640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bc01593b0 0x7f2bc00ac6f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2bb802ab20 tx=0x7f2bb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:54.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bb5ffb640 1 -- 172.21.15.131:0/2177315750 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8040070 con 0x7f2bc01593b0 2024-05-17T04:09:54.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bb5ffb640 1 -- 172.21.15.131:0/2177315750 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb8031c40 con 0x7f2bc01593b0 2024-05-17T04:09:54.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bc78ba640 1 -- 172.21.15.131:0/2177315750 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc01f69f0 con 0x7f2bc01593b0 2024-05-17T04:09:54.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.004+0000 7f2bb5ffb640 1 -- 172.21.15.131:0/2177315750 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8009450 con 0x7f2bc01593b0 2024-05-17T04:09:54.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.005+0000 7f2bc78ba640 1 -- 172.21.15.131:0/2177315750 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc01f6fb0 con 0x7f2bc01593b0 2024-05-17T04:09:54.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.006+0000 7f2bc78ba640 1 -- 172.21.15.131:0/2177315750 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bc01619c0 con 0x7f2bc01593b0 2024-05-17T04:09:54.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.006+0000 7f2bb5ffb640 1 -- 172.21.15.131:0/2177315750 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2bb8039040 con 0x7f2bc01593b0 2024-05-17T04:09:54.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.007+0000 7f2bb5ffb640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2ba4076300 0x7f2ba4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:54.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.007+0000 7f2bb5ffb640 1 -- 172.21.15.131:0/2177315750 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7f2bb80b8190 con 0x7f2bc01593b0 2024-05-17T04:09:54.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.007+0000 7f2bc5656640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2ba4076300 0x7f2ba4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:54.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.007+0000 7f2bc5656640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2ba4076300 0x7f2ba4078810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc001220 tx=0x7f2bbc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:54.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.011+0000 7f2bb5ffb640 1 -- 172.21.15.131:0/2177315750 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2bc01619c0 con 0x7f2bc01593b0 2024-05-17T04:09:54.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.196+0000 7f2bc78ba640 1 -- 172.21.15.131:0/2177315750 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2bc015ff90 con 0x7f2bc01593b0 2024-05-17T04:09:54.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.790+0000 7f2bb5ffb640 1 -- 172.21.15.131:0/2177315750 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) ==== 138+0+0 (secure 0 0 0) 0x7f2bc01f6450 con 0x7f2bc01593b0 2024-05-17T04:09:54.791 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_metadata' created 2024-05-17T04:09:54.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.793+0000 7f2bc78ba640 1 -- 172.21.15.131:0/2177315750 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2ba4076300 msgr2=0x7f2ba4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:54.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.793+0000 7f2bc78ba640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2ba4076300 0x7f2ba4078810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc001220 tx=0x7f2bbc009040 comp rx=0 tx=0).stop 2024-05-17T04:09:54.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.793+0000 7f2bc78ba640 1 -- 172.21.15.131:0/2177315750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bc01593b0 msgr2=0x7f2bc00ac6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:54.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.793+0000 7f2bc78ba640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bc01593b0 0x7f2bc00ac6f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2bb802ab20 tx=0x7f2bb8004a40 comp rx=0 tx=0).stop 2024-05-17T04:09:54.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.794+0000 7f2bc78ba640 1 -- 172.21.15.131:0/2177315750 shutdown_connections 2024-05-17T04:09:54.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.794+0000 7f2bc78ba640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2ba4076300 0x7f2ba4078810 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:54.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.794+0000 7f2bc78ba640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bc01593b0 0x7f2bc00ac6f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:54.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.794+0000 7f2bc78ba640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bc01606a0 0x7f2bc0158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:54.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.794+0000 7f2bc78ba640 1 --2- 172.21.15.131:0/2177315750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bc015f6a0 0x7f2bc01f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:54.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.794+0000 7f2bc78ba640 1 -- 172.21.15.131:0/2177315750 >> 172.21.15.131:0/2177315750 conn(0x7f2bc00d58b0 msgr2=0x7f2bc00cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:54.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.794+0000 7f2bc78ba640 1 -- 172.21.15.131:0/2177315750 shutdown_connections 2024-05-17T04:09:54.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.794+0000 7f2bc78ba640 1 -- 172.21.15.131:0/2177315750 wait complete. 2024-05-17T04:09:54.811 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-17T04:09:54.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.930+0000 7ff828bb2640 1 Processor -- start 2024-05-17T04:09:54.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.930+0000 7ff828bb2640 1 -- start start 2024-05-17T04:09:54.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.932+0000 7ff828bb2640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff82415f760 0x7ff8240cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:54.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.932+0000 7ff828bb2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff82406f180 0x7ff82406f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:54.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.932+0000 7ff828bb2640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff82406fad0 con 0x7ff8240cdc90 2024-05-17T04:09:54.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.932+0000 7ff828bb2640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7ff82406e730 con 0x7ff82415f760 2024-05-17T04:09:54.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.932+0000 7ff828bb2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff82406ecf0 con 0x7ff82406f180 2024-05-17T04:09:54.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.932+0000 7ff819d9b640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff8240cdc90 0x7ff824163360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46486/0 (socket says 172.21.15.131:46486) 2024-05-17T04:09:54.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.932+0000 7ff819d9b640 1 -- 172.21.15.131:0/1654054181 learned_addr learned my addr 172.21.15.131:0/1654054181 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:54.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.932+0000 7ff82259c640 1 --2- 172.21.15.131:0/1654054181 >> v2:172.21.15.150:3300/0 conn(0x7ff82415f760 0x7ff8240cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:54.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.932+0000 7ff821d9b640 1 -- 172.21.15.131:0/1654054181 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 210333662 0 0) 0x7ff82406fad0 con 0x7ff8240cdc90 2024-05-17T04:09:54.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.932+0000 7ff822d9d640 1 --2- 172.21.15.131:0/1654054181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff82406f180 0x7ff82406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:54.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.932+0000 7ff821d9b640 1 -- 172.21.15.131:0/1654054181 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff810003520 con 0x7ff8240cdc90 2024-05-17T04:09:54.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.932+0000 7ff821d9b640 1 -- 172.21.15.131:0/1654054181 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2406909194 0 0) 0x7ff810003520 con 0x7ff8240cdc90 2024-05-17T04:09:54.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.932+0000 7ff821d9b640 1 -- 172.21.15.131:0/1654054181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff82406f180 msgr2=0x7ff82406f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:54.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff821d9b640 1 --2- 172.21.15.131:0/1654054181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff82406f180 0x7ff82406f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:54.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff821d9b640 1 -- 172.21.15.131:0/1654054181 >> v2:172.21.15.150:3300/0 conn(0x7ff82415f760 msgr2=0x7ff8240cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:54.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff821d9b640 1 --2- 172.21.15.131:0/1654054181 >> v2:172.21.15.150:3300/0 conn(0x7ff82415f760 0x7ff8240cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:54.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff821d9b640 1 -- 172.21.15.131:0/1654054181 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff824163de0 con 0x7ff8240cdc90 2024-05-17T04:09:54.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff821d9b640 1 -- 172.21.15.131:0/1654054181 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7ff80c0016f0 con 0x7ff8240cdc90 2024-05-17T04:09:54.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff821d9b640 1 -- 172.21.15.131:0/1654054181 >> v1:172.21.15.131:6789/0 conn(0x7ff8240cdc90 legacy=0x7ff824163360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:54.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff821d9b640 1 --2- 172.21.15.131:0/1654054181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff810003a50 0x7ff810003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:54.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff821d9b640 1 --2- 172.21.15.131:0/1654054181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff82406f180 0x7ff810004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:54.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff821d9b640 1 --2- 172.21.15.131:0/1654054181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff810004d40 0x7ff810005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:54.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff821d9b640 1 -- 172.21.15.131:0/1654054181 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff82406e730 con 0x7ff810004d40 2024-05-17T04:09:54.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff821d9b640 1 -- 172.21.15.131:0/1654054181 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff82406ecf0 con 0x7ff810003a50 2024-05-17T04:09:54.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff821d9b640 1 -- 172.21.15.131:0/1654054181 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff81000baa0 con 0x7ff82406f180 2024-05-17T04:09:54.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff822d9d640 1 --2- 172.21.15.131:0/1654054181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff810004d40 0x7ff810005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:54.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff82259c640 1 --2- 172.21.15.131:0/1654054181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff810003a50 0x7ff810003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:54.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff819d9b640 1 --2- 172.21.15.131:0/1654054181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff82406f180 0x7ff810004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:54.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff822d9d640 1 -- 172.21.15.131:0/1654054181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff82406f180 msgr2=0x7ff810004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:54.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff822d9d640 1 --2- 172.21.15.131:0/1654054181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff82406f180 0x7ff810004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:54.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff822d9d640 1 -- 172.21.15.131:0/1654054181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff810003a50 msgr2=0x7ff810003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:54.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff822d9d640 1 --2- 172.21.15.131:0/1654054181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff810003a50 0x7ff810003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:54.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.933+0000 7ff822d9d640 1 -- 172.21.15.131:0/1654054181 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff810003520 con 0x7ff810004d40 2024-05-17T04:09:54.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.934+0000 7ff822d9d640 1 --2- 172.21.15.131:0/1654054181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff810004d40 0x7ff810005150 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff8240b5bf0 tx=0x7ff810005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e4c458249d97cc server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:54.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.934+0000 7ff821d9b640 1 -- 172.21.15.131:0/1654054181 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c037070 con 0x7ff810004d40 2024-05-17T04:09:54.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.934+0000 7ff821d9b640 1 -- 172.21.15.131:0/1654054181 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff81c032620 con 0x7ff810004d40 2024-05-17T04:09:54.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.934+0000 7ff821d9b640 1 -- 172.21.15.131:0/1654054181 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c009c10 con 0x7ff810004d40 2024-05-17T04:09:54.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.935+0000 7ff828bb2640 1 -- 172.21.15.131:0/1654054181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff810004d40 msgr2=0x7ff810005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:54.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.935+0000 7ff828bb2640 1 --2- 172.21.15.131:0/1654054181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff810004d40 0x7ff810005150 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff8240b5bf0 tx=0x7ff810005830 comp rx=0 tx=0).stop 2024-05-17T04:09:54.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.935+0000 7ff822d9d640 1 -- 172.21.15.131:0/1654054181 reap_dead start 2024-05-17T04:09:54.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.935+0000 7ff828bb2640 1 -- 172.21.15.131:0/1654054181 shutdown_connections 2024-05-17T04:09:54.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.935+0000 7ff828bb2640 1 -- 172.21.15.131:0/1654054181 >> 172.21.15.131:0/1654054181 conn(0x7ff8240cffa0 msgr2=0x7ff8240d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:54.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.935+0000 7ff828bb2640 1 -- 172.21.15.131:0/1654054181 shutdown_connections 2024-05-17T04:09:54.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.935+0000 7ff828bb2640 1 -- 172.21.15.131:0/1654054181 wait complete. 2024-05-17T04:09:54.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.937+0000 7ff828bb2640 1 Processor -- start 2024-05-17T04:09:54.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.937+0000 7ff828bb2640 1 -- start start 2024-05-17T04:09:54.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.938+0000 7ff828bb2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff810004d40 0x7ff8240b8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:54.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.938+0000 7ff828bb2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff824158460 0x7ff8240b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:54.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.938+0000 7ff828bb2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8240b74c0 0x7ff824149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:54.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.938+0000 7ff828bb2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff82415fb70 con 0x7ff824158460 2024-05-17T04:09:54.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.938+0000 7ff828bb2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff82406e980 con 0x7ff810004d40 2024-05-17T04:09:54.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.938+0000 7ff828bb2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff824163a70 con 0x7ff8240b74c0 2024-05-17T04:09:54.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.938+0000 7ff819d9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff824158460 0x7ff8240b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:54.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.938+0000 7ff819d9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff824158460 0x7ff8240b6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46342/0 (socket says 172.21.15.131:46342) 2024-05-17T04:09:54.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.938+0000 7ff819d9b640 1 -- 172.21.15.131:0/1303396915 learned_addr learned my addr 172.21.15.131:0/1303396915 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:54.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.939+0000 7ff82259c640 1 --2- 172.21.15.131:0/1303396915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff810004d40 0x7ff8240b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:54.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.939+0000 7ff822d9d640 1 --2- 172.21.15.131:0/1303396915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8240b74c0 0x7ff824149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:54.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.939+0000 7ff819d9b640 1 -- 172.21.15.131:0/1303396915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8240b74c0 msgr2=0x7ff824149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:54.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.939+0000 7ff819d9b640 1 --2- 172.21.15.131:0/1303396915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8240b74c0 0x7ff824149620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:54.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.939+0000 7ff819d9b640 1 -- 172.21.15.131:0/1303396915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff810004d40 msgr2=0x7ff8240b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:54.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.939+0000 7ff819d9b640 1 --2- 172.21.15.131:0/1303396915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff810004d40 0x7ff8240b8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:54.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.939+0000 7ff819d9b640 1 -- 172.21.15.131:0/1303396915 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8240b78d0 con 0x7ff824158460 2024-05-17T04:09:54.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.939+0000 7ff82259c640 1 --2- 172.21.15.131:0/1303396915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff810004d40 0x7ff8240b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:09:54.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.939+0000 7ff819d9b640 1 --2- 172.21.15.131:0/1303396915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff824158460 0x7ff8240b6f80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff80c007310 tx=0x7ff80c0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:54.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.939+0000 7ff81b7fe640 1 -- 172.21.15.131:0/1303396915 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c00f9a0 con 0x7ff824158460 2024-05-17T04:09:54.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.939+0000 7ff81b7fe640 1 -- 172.21.15.131:0/1303396915 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80c018070 con 0x7ff824158460 2024-05-17T04:09:54.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.939+0000 7ff81b7fe640 1 -- 172.21.15.131:0/1303396915 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c00fd80 con 0x7ff824158460 2024-05-17T04:09:54.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.939+0000 7ff828bb2640 1 -- 172.21.15.131:0/1303396915 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff824159f70 con 0x7ff824158460 2024-05-17T04:09:54.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.939+0000 7ff828bb2640 1 -- 172.21.15.131:0/1303396915 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff82415a6c0 con 0x7ff824158460 2024-05-17T04:09:54.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.940+0000 7ff828bb2640 1 -- 172.21.15.131:0/1303396915 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff82415a140 con 0x7ff824158460 2024-05-17T04:09:54.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.941+0000 7ff81b7fe640 1 -- 172.21.15.131:0/1303396915 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff80c01d460 con 0x7ff824158460 2024-05-17T04:09:54.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.941+0000 7ff81b7fe640 1 --2- 172.21.15.131:0/1303396915 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff8040762d0 0x7ff8040787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:54.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.942+0000 7ff81b7fe640 1 -- 172.21.15.131:0/1303396915 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5619+0+0 (secure 0 0 0) 0x7ff80c098160 con 0x7ff824158460 2024-05-17T04:09:54.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.942+0000 7ff82259c640 1 --2- 172.21.15.131:0/1303396915 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff8040762d0 0x7ff8040787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:54.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.942+0000 7ff82259c640 1 --2- 172.21.15.131:0/1303396915 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff8040762d0 0x7ff8040787e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff814009ab0 tx=0x7ff814008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:54.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:54.945+0000 7ff81b7fe640 1 -- 172.21.15.131:0/1303396915 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff82415a140 con 0x7ff824158460 2024-05-17T04:09:55.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.126+0000 7ff828bb2640 1 -- 172.21.15.131:0/1303396915 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff8240b9080 con 0x7ff824158460 2024-05-17T04:09:55.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.793+0000 7ff81b7fe640 1 -- 172.21.15.131:0/1303396915 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) ==== 170+0+0 (secure 0 0 0) 0x7ff8240b78d0 con 0x7ff824158460 2024-05-17T04:09:55.794 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_data' created 2024-05-17T04:09:55.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.796+0000 7ff828bb2640 1 -- 172.21.15.131:0/1303396915 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff8040762d0 msgr2=0x7ff8040787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:55.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.796+0000 7ff828bb2640 1 --2- 172.21.15.131:0/1303396915 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff8040762d0 0x7ff8040787e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff814009ab0 tx=0x7ff814008040 comp rx=0 tx=0).stop 2024-05-17T04:09:55.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.796+0000 7ff828bb2640 1 -- 172.21.15.131:0/1303396915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff824158460 msgr2=0x7ff8240b6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:55.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.796+0000 7ff828bb2640 1 --2- 172.21.15.131:0/1303396915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff824158460 0x7ff8240b6f80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff80c007310 tx=0x7ff80c0077d0 comp rx=0 tx=0).stop 2024-05-17T04:09:55.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.796+0000 7ff828bb2640 1 -- 172.21.15.131:0/1303396915 shutdown_connections 2024-05-17T04:09:55.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.796+0000 7ff828bb2640 1 --2- 172.21.15.131:0/1303396915 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7ff8040762d0 0x7ff8040787e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:55.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.796+0000 7ff828bb2640 1 --2- 172.21.15.131:0/1303396915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff824158460 0x7ff8240b6f80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:55.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.796+0000 7ff828bb2640 1 --2- 172.21.15.131:0/1303396915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8240b74c0 0x7ff824149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:55.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.796+0000 7ff828bb2640 1 --2- 172.21.15.131:0/1303396915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff810004d40 0x7ff8240b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:55.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.796+0000 7ff828bb2640 1 -- 172.21.15.131:0/1303396915 >> 172.21.15.131:0/1303396915 conn(0x7ff8240cffa0 msgr2=0x7ff82415e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:55.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.796+0000 7ff828bb2640 1 -- 172.21.15.131:0/1303396915 shutdown_connections 2024-05-17T04:09:55.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.796+0000 7ff828bb2640 1 -- 172.21.15.131:0/1303396915 wait complete. 2024-05-17T04:09:55.819 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-17T04:09:55.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.936+0000 7f80cd143640 1 Processor -- start 2024-05-17T04:09:55.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.936+0000 7f80cd143640 1 -- start start 2024-05-17T04:09:55.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.937+0000 7f80cd143640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f80c80d02c0 0x7f80c81605a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:55.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.937+0000 7f80cd143640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80c80cc800 con 0x7f80c80b0240 2024-05-17T04:09:55.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.937+0000 7f80cd143640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80c8160d00 con 0x7f80c8160190 2024-05-17T04:09:55.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.937+0000 7f80cd143640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f80c8160ae0 con 0x7f80c80d02c0 2024-05-17T04:09:55.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.937+0000 7f80c759e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f80c80d02c0 0x7f80c81605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:55.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.937+0000 7f80c6d9d640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f80c80b0240 0x7f80c8074230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46490/0 (socket says 172.21.15.131:46490) 2024-05-17T04:09:55.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.937+0000 7f80c759e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f80c80d02c0 0x7f80c81605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46344/0 (socket says 172.21.15.131:46344) 2024-05-17T04:09:55.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.937+0000 7f80c6d9d640 1 -- 172.21.15.131:0/2569409782 learned_addr learned my addr 172.21.15.131:0/2569409782 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:55.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.938+0000 7f80c759e640 1 -- 172.21.15.131:0/2569409782 >> v1:172.21.15.150:6789/0 conn(0x7f80c8160190 legacy=0x7f80c80cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:55.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.938+0000 7f80c759e640 1 -- 172.21.15.131:0/2569409782 >> v1:172.21.15.131:6789/0 conn(0x7f80c80b0240 legacy=0x7f80c8074230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:55.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.938+0000 7f80c759e640 1 -- 172.21.15.131:0/2569409782 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c8073750 con 0x7f80c80d02c0 2024-05-17T04:09:55.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.938+0000 7f80c659c640 1 -- 172.21.15.131:0/2569409782 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320395160 0 0) 0x7f80c80cc800 con 0x7f80c80b0240 2024-05-17T04:09:55.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.938+0000 7f80c759e640 1 --2- 172.21.15.131:0/2569409782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c80d02c0 0x7f80c81605a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009d90 tx=0x7f80c002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599cde522d1dddde server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:55.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.939+0000 7f80c659c640 1 -- 172.21.15.131:0/2569409782 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c0007740 con 0x7f80c80d02c0 2024-05-17T04:09:55.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.939+0000 7f80c659c640 1 -- 172.21.15.131:0/2569409782 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c00078e0 con 0x7f80c80d02c0 2024-05-17T04:09:55.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.939+0000 7f80c659c640 1 -- 172.21.15.131:0/2569409782 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c0007cb0 con 0x7f80c80d02c0 2024-05-17T04:09:55.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.939+0000 7f80cd143640 1 -- 172.21.15.131:0/2569409782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c80d02c0 msgr2=0x7f80c81605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:55.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.939+0000 7f80cd143640 1 --2- 172.21.15.131:0/2569409782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c80d02c0 0x7f80c81605a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009d90 tx=0x7f80c002a660 comp rx=0 tx=0).stop 2024-05-17T04:09:55.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.939+0000 7f80cd143640 1 -- 172.21.15.131:0/2569409782 shutdown_connections 2024-05-17T04:09:55.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.939+0000 7f80cd143640 1 --2- 172.21.15.131:0/2569409782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c80d02c0 0x7f80c81605a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:55.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.939+0000 7f80cd143640 1 -- 172.21.15.131:0/2569409782 >> 172.21.15.131:0/2569409782 conn(0x7f80c80cdb30 msgr2=0x7f80c80cdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:55.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.939+0000 7f80cd143640 1 -- 172.21.15.131:0/2569409782 shutdown_connections 2024-05-17T04:09:55.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.939+0000 7f80cd143640 1 -- 172.21.15.131:0/2569409782 wait complete. 2024-05-17T04:09:55.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.941+0000 7f80cd143640 1 Processor -- start 2024-05-17T04:09:55.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.941+0000 7f80cd143640 1 -- start start 2024-05-17T04:09:55.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80cd143640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80c80b0240 0x7f80c80c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:55.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80cd143640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80c8160190 0x7f80c815a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:55.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80cd143640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c80c3cd0 0x7f80c809d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:55.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80cd143640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f80c8074940 con 0x7f80c80c3cd0 2024-05-17T04:09:55.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80cd143640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f80c8073d10 con 0x7f80c8160190 2024-05-17T04:09:55.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80cd143640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f80c8160fe0 con 0x7f80c80b0240 2024-05-17T04:09:55.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80c759e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c80c3cd0 0x7f80c809d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:55.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80c759e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c80c3cd0 0x7f80c809d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46346/0 (socket says 172.21.15.131:46346) 2024-05-17T04:09:55.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80c759e640 1 -- 172.21.15.131:0/2339672554 learned_addr learned my addr 172.21.15.131:0/2339672554 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:55.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80c6d9d640 1 --2- 172.21.15.131:0/2339672554 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80c80b0240 0x7f80c80c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:55.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80bffff640 1 --2- 172.21.15.131:0/2339672554 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80c8160190 0x7f80c815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:55.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80c759e640 1 -- 172.21.15.131:0/2339672554 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80c80b0240 msgr2=0x7f80c80c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:55.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80c759e640 1 --2- 172.21.15.131:0/2339672554 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80c80b0240 0x7f80c80c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:55.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80c759e640 1 -- 172.21.15.131:0/2339672554 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80c8160190 msgr2=0x7f80c815a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:55.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80c759e640 1 --2- 172.21.15.131:0/2339672554 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80c8160190 0x7f80c815a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:55.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80c759e640 1 -- 172.21.15.131:0/2339672554 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c80c6d90 con 0x7f80c80c3cd0 2024-05-17T04:09:55.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80c759e640 1 --2- 172.21.15.131:0/2339672554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c80c3cd0 0x7f80c809d2e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009d90 tx=0x7f80c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:55.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80bf7fe640 1 -- 172.21.15.131:0/2339672554 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c0040070 con 0x7f80c80c3cd0 2024-05-17T04:09:55.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80bf7fe640 1 -- 172.21.15.131:0/2339672554 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c0031c90 con 0x7f80c80c3cd0 2024-05-17T04:09:55.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80cd143640 1 -- 172.21.15.131:0/2339672554 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c809c520 con 0x7f80c80c3cd0 2024-05-17T04:09:55.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80bf7fe640 1 -- 172.21.15.131:0/2339672554 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c003c640 con 0x7f80c80c3cd0 2024-05-17T04:09:55.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.943+0000 7f80cd143640 1 -- 172.21.15.131:0/2339672554 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c809cae0 con 0x7f80c80c3cd0 2024-05-17T04:09:55.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.945+0000 7f80cd143640 1 -- 172.21.15.131:0/2339672554 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c80b0650 con 0x7f80c80c3cd0 2024-05-17T04:09:55.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.945+0000 7f80bf7fe640 1 -- 172.21.15.131:0/2339672554 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f80c0039040 con 0x7f80c80c3cd0 2024-05-17T04:09:55.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.946+0000 7f80bf7fe640 1 --2- 172.21.15.131:0/2339672554 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f80a80762d0 0x7f80a80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:55.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.946+0000 7f80c6d9d640 1 --2- 172.21.15.131:0/2339672554 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f80a80762d0 0x7f80a80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:55.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.946+0000 7f80bf7fe640 1 -- 172.21.15.131:0/2339672554 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6001+0+0 (secure 0 0 0) 0x7f80c00b8ca0 con 0x7f80c80c3cd0 2024-05-17T04:09:55.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.947+0000 7f80c6d9d640 1 --2- 172.21.15.131:0/2339672554 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f80a80762d0 0x7f80a80787e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f80b8000f60 tx=0x7f80b8007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:55.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:55.951+0000 7f80bf7fe640 1 -- 172.21.15.131:0/2339672554 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f80c0082620 con 0x7f80c80c3cd0 2024-05-17T04:09:56.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.171+0000 7f80cd143640 1 -- 172.21.15.131:0/2339672554 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f80c80c6b20 con 0x7f80c80c3cd0 2024-05-17T04:09:56.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.825+0000 7f80bf7fe640 1 -- 172.21.15.131:0/2339672554 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7f80c0081f20 con 0x7f80c80c3cd0 2024-05-17T04:09:56.830 INFO:teuthology.orchestra.run.smithi131.stderr:new fs with metadata pool 5 and data pool 6 2024-05-17T04:09:56.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.833+0000 7f80cd143640 1 -- 172.21.15.131:0/2339672554 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f80a80762d0 msgr2=0x7f80a80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:56.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.833+0000 7f80cd143640 1 --2- 172.21.15.131:0/2339672554 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f80a80762d0 0x7f80a80787e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f80b8000f60 tx=0x7f80b8007c00 comp rx=0 tx=0).stop 2024-05-17T04:09:56.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.833+0000 7f80cd143640 1 -- 172.21.15.131:0/2339672554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c80c3cd0 msgr2=0x7f80c809d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:56.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.833+0000 7f80cd143640 1 --2- 172.21.15.131:0/2339672554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c80c3cd0 0x7f80c809d2e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009d90 tx=0x7f80c0004a40 comp rx=0 tx=0).stop 2024-05-17T04:09:56.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.835+0000 7f80cd143640 1 -- 172.21.15.131:0/2339672554 shutdown_connections 2024-05-17T04:09:56.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.835+0000 7f80cd143640 1 --2- 172.21.15.131:0/2339672554 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f80a80762d0 0x7f80a80787e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:56.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.835+0000 7f80cd143640 1 --2- 172.21.15.131:0/2339672554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c80c3cd0 0x7f80c809d2e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:56.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.835+0000 7f80cd143640 1 --2- 172.21.15.131:0/2339672554 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80c8160190 0x7f80c815a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:56.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.835+0000 7f80cd143640 1 --2- 172.21.15.131:0/2339672554 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80c80b0240 0x7f80c80c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:56.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.835+0000 7f80cd143640 1 -- 172.21.15.131:0/2339672554 >> 172.21.15.131:0/2339672554 conn(0x7f80c80cdb30 msgr2=0x7f80c80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:56.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.835+0000 7f80cd143640 1 -- 172.21.15.131:0/2339672554 shutdown_connections 2024-05-17T04:09:56.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.836+0000 7f80cd143640 1 -- 172.21.15.131:0/2339672554 wait complete. 2024-05-17T04:09:56.855 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:09:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.966+0000 7f66b4ce4640 1 Processor -- start 2024-05-17T04:09:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.966+0000 7f66b4ce4640 1 -- start start 2024-05-17T04:09:56.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.967+0000 7f66b4ce4640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f66b015f770 0x7f66b00d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.967+0000 7f66b4ce4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66b00cf880 0x7f66b00cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.967+0000 7f66b4ce4640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66b00d05b0 con 0x7f66b00d3da0 2024-05-17T04:09:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.967+0000 7f66b4ce4640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f66b00d0890 con 0x7f66b015f770 2024-05-17T04:09:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.967+0000 7f66b4ce4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f66b00d0b70 con 0x7f66b00cf880 2024-05-17T04:09:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.967+0000 7f66ae59c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f66b015f770 0x7f66b00d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.967+0000 7f66ae59c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f66b015f770 0x7f66b00d1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46348/0 (socket says 172.21.15.131:46348) 2024-05-17T04:09:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.967+0000 7f66ae59c640 1 -- 172.21.15.131:0/441898929 learned_addr learned my addr 172.21.15.131:0/441898929 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.968+0000 7f66ae59c640 1 -- 172.21.15.131:0/441898929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66b00cf880 msgr2=0x7f66b00cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.968+0000 7f66ae59c640 1 --2- 172.21.15.131:0/441898929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66b00cf880 0x7f66b00cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.968+0000 7f66ae59c640 1 -- 172.21.15.131:0/441898929 >> v1:172.21.15.150:6789/0 conn(0x7f66b00d3da0 legacy=0x7f66b00d41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.968+0000 7f66ae59c640 1 -- 172.21.15.131:0/441898929 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b00d0e50 con 0x7f66b015f770 2024-05-17T04:09:56.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.968+0000 7f66ae59c640 1 --2- 172.21.15.131:0/441898929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66b015f770 0x7f66b00d1650 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f66b00d4960 tx=0x7f66a002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63392a3a6f2390c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:56.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.968+0000 7f66add9b640 1 -- 172.21.15.131:0/441898929 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a0037070 con 0x7f66b015f770 2024-05-17T04:09:56.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.968+0000 7f66add9b640 1 -- 172.21.15.131:0/441898929 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66a0032440 con 0x7f66b015f770 2024-05-17T04:09:56.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.968+0000 7f66add9b640 1 -- 172.21.15.131:0/441898929 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a0032810 con 0x7f66b015f770 2024-05-17T04:09:56.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.969+0000 7f66b4ce4640 1 -- 172.21.15.131:0/441898929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66b015f770 msgr2=0x7f66b00d1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:56.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.969+0000 7f66b4ce4640 1 --2- 172.21.15.131:0/441898929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66b015f770 0x7f66b00d1650 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f66b00d4960 tx=0x7f66a002a1c0 comp rx=0 tx=0).stop 2024-05-17T04:09:56.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.969+0000 7f66b4ce4640 1 -- 172.21.15.131:0/441898929 shutdown_connections 2024-05-17T04:09:56.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.969+0000 7f66b4ce4640 1 --2- 172.21.15.131:0/441898929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66b00cf880 0x7f66b00cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:56.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.969+0000 7f66b4ce4640 1 --2- 172.21.15.131:0/441898929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66b015f770 0x7f66b00d1650 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:56.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.969+0000 7f66b4ce4640 1 -- 172.21.15.131:0/441898929 >> 172.21.15.131:0/441898929 conn(0x7f66b00d2300 msgr2=0x7f66b00b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.969+0000 7f66b4ce4640 1 -- 172.21.15.131:0/441898929 shutdown_connections 2024-05-17T04:09:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.969+0000 7f66b4ce4640 1 -- 172.21.15.131:0/441898929 wait complete. 2024-05-17T04:09:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.971+0000 7f66b4ce4640 1 Processor -- start 2024-05-17T04:09:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.971+0000 7f66b4ce4640 1 -- start start 2024-05-17T04:09:56.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66b4ce4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66b00cf880 0x7f66b0154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:56.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66b4ce4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66b00d3da0 0x7f66b00cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:56.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66b4ce4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66b015f770 0x7f66b0161d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:56.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66b4ce4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f66b00d0350 con 0x7f66b015f770 2024-05-17T04:09:56.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66b4ce4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f66b00d01d0 con 0x7f66b00d3da0 2024-05-17T04:09:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66b4ce4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f66b00b87c0 con 0x7f66b00cf880 2024-05-17T04:09:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66aed9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66b015f770 0x7f66b0161d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66aed9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66b015f770 0x7f66b0161d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46360/0 (socket says 172.21.15.131:46360) 2024-05-17T04:09:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66aed9d640 1 -- 172.21.15.131:0/2246720168 learned_addr learned my addr 172.21.15.131:0/2246720168 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66a5d9b640 1 --2- 172.21.15.131:0/2246720168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66b00d3da0 0x7f66b00cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66ae59c640 1 --2- 172.21.15.131:0/2246720168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66b00cf880 0x7f66b0154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66aed9d640 1 -- 172.21.15.131:0/2246720168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66b00cf880 msgr2=0x7f66b0154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66aed9d640 1 --2- 172.21.15.131:0/2246720168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66b00cf880 0x7f66b0154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66aed9d640 1 -- 172.21.15.131:0/2246720168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66b00d3da0 msgr2=0x7f66b00cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66aed9d640 1 --2- 172.21.15.131:0/2246720168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66b00d3da0 0x7f66b00cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66aed9d640 1 -- 172.21.15.131:0/2246720168 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b01e9b10 con 0x7f66b015f770 2024-05-17T04:09:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66aed9d640 1 --2- 172.21.15.131:0/2246720168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66b015f770 0x7f66b0161d60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f66a800ba10 tx=0x7f66a800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66a77fe640 1 -- 172.21.15.131:0/2246720168 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8019070 con 0x7f66b015f770 2024-05-17T04:09:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66a77fe640 1 -- 172.21.15.131:0/2246720168 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66a800cae0 con 0x7f66b015f770 2024-05-17T04:09:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.973+0000 7f66b4ce4640 1 -- 172.21.15.131:0/2246720168 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b01e9df0 con 0x7f66b015f770 2024-05-17T04:09:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.974+0000 7f66a77fe640 1 -- 172.21.15.131:0/2246720168 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8014440 con 0x7f66b015f770 2024-05-17T04:09:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.974+0000 7f66b4ce4640 1 -- 172.21.15.131:0/2246720168 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b01ea3b0 con 0x7f66b015f770 2024-05-17T04:09:56.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.975+0000 7f66b4ce4640 1 -- 172.21.15.131:0/2246720168 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66b00cfc90 con 0x7f66b015f770 2024-05-17T04:09:56.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.975+0000 7f66a77fe640 1 -- 172.21.15.131:0/2246720168 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f66a801c070 con 0x7f66b015f770 2024-05-17T04:09:56.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.976+0000 7f66a77fe640 1 --2- 172.21.15.131:0/2246720168 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f66900762d0 0x7f66900787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:56.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.976+0000 7f66a77fe640 1 -- 172.21.15.131:0/2246720168 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6101+0+0 (secure 0 0 0) 0x7f66a80974c0 con 0x7f66b015f770 2024-05-17T04:09:56.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.976+0000 7f66ae59c640 1 --2- 172.21.15.131:0/2246720168 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f66900762d0 0x7f66900787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:56.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.976+0000 7f66ae59c640 1 --2- 172.21.15.131:0/2246720168 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f66900762d0 0x7f66900787e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f66a0034000 tx=0x7f66a002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:56.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:56.981+0000 7f66a77fe640 1 -- 172.21.15.131:0/2246720168 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f66a8060c00 con 0x7f66b015f770 2024-05-17T04:09:57.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.164+0000 7f66b4ce4640 1 -- 172.21.15.131:0/2246720168 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66b01e9880 con 0x7f66b015f770 2024-05-17T04:09:57.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.165+0000 7f66a77fe640 1 -- 172.21.15.131:0/2246720168 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16979 (secure 0 0 0) 0x7f66a8060500 con 0x7f66b015f770 2024-05-17T04:09:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:57.167 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":35,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:09:56.173566+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:54.201745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:55.131426+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:09:57.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.168+0000 7f66b4ce4640 1 -- 172.21.15.131:0/2246720168 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f66900762d0 msgr2=0x7f66900787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:57.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.168+0000 7f66b4ce4640 1 --2- 172.21.15.131:0/2246720168 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f66900762d0 0x7f66900787e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f66a0034000 tx=0x7f66a002e000 comp rx=0 tx=0).stop 2024-05-17T04:09:57.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.168+0000 7f66b4ce4640 1 -- 172.21.15.131:0/2246720168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66b015f770 msgr2=0x7f66b0161d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:57.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.168+0000 7f66b4ce4640 1 --2- 172.21.15.131:0/2246720168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66b015f770 0x7f66b0161d60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f66a800ba10 tx=0x7f66a800bed0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.168+0000 7f66b4ce4640 1 -- 172.21.15.131:0/2246720168 shutdown_connections 2024-05-17T04:09:57.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.168+0000 7f66b4ce4640 1 --2- 172.21.15.131:0/2246720168 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f66900762d0 0x7f66900787e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.168+0000 7f66b4ce4640 1 --2- 172.21.15.131:0/2246720168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66b015f770 0x7f66b0161d60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.168+0000 7f66b4ce4640 1 --2- 172.21.15.131:0/2246720168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66b00d3da0 0x7f66b00cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.168+0000 7f66b4ce4640 1 --2- 172.21.15.131:0/2246720168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66b00cf880 0x7f66b0154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.168+0000 7f66b4ce4640 1 -- 172.21.15.131:0/2246720168 >> 172.21.15.131:0/2246720168 conn(0x7f66b00d2300 msgr2=0x7f66b00d41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:57.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.168+0000 7f66b4ce4640 1 -- 172.21.15.131:0/2246720168 shutdown_connections 2024-05-17T04:09:57.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.168+0000 7f66b4ce4640 1 -- 172.21.15.131:0/2246720168 wait complete. 2024-05-17T04:09:57.181 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:09:57.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.290+0000 7fe9aebe0640 1 Processor -- start 2024-05-17T04:09:57.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.290+0000 7fe9aebe0640 1 -- start start 2024-05-17T04:09:57.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.291+0000 7fe9aebe0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a80d44b0 0x7fe9a80d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:57.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.291+0000 7fe9aebe0640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe9a80cf880 0x7fe9a80cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:57.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.291+0000 7fe9aebe0640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9a80d05b0 con 0x7fe9a815f770 2024-05-17T04:09:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.291+0000 7fe9aebe0640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe9a80d0890 con 0x7fe9a80cf880 2024-05-17T04:09:57.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.291+0000 7fe9aebe0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a80d0b70 con 0x7fe9a80d44b0 2024-05-17T04:09:57.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.292+0000 7fe9ad17d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe9a80cf880 0x7fe9a80cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:57.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.292+0000 7fe99ffff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a80d44b0 0x7fe9a80d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:57.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.292+0000 7fe9ad17d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe9a80cf880 0x7fe9a80cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:35012/0 (socket says 172.21.15.131:35012) 2024-05-17T04:09:57.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.292+0000 7fe9ad17d640 1 -- 172.21.15.131:0/2437635599 learned_addr learned my addr 172.21.15.131:0/2437635599 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:57.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.292+0000 7fe99ffff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a80d44b0 0x7fe9a80d1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:49940/0 (socket says 172.21.15.131:49940) 2024-05-17T04:09:57.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.292+0000 7fe99ffff640 1 -- 172.21.15.131:0/2437635599 >> v2:172.21.15.150:3300/0 conn(0x7fe9a80cf880 msgr2=0x7fe9a80cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:57.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.292+0000 7fe99ffff640 1 --2- 172.21.15.131:0/2437635599 >> v2:172.21.15.150:3300/0 conn(0x7fe9a80cf880 0x7fe9a80cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.292+0000 7fe99ffff640 1 -- 172.21.15.131:0/2437635599 >> v1:172.21.15.150:6789/0 conn(0x7fe9a815f770 legacy=0x7fe9a80d3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:57.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.292+0000 7fe99ffff640 1 -- 172.21.15.131:0/2437635599 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a80d0e50 con 0x7fe9a80d44b0 2024-05-17T04:09:57.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.292+0000 7fe99f7fe640 1 -- 172.21.15.131:0/2437635599 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3867540298 0 0) 0x7fe9a80d05b0 con 0x7fe9a815f770 2024-05-17T04:09:57.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.292+0000 7fe9ad17d640 1 --2- 172.21.15.131:0/2437635599 >> v2:172.21.15.150:3300/0 conn(0x7fe9a80cf880 0x7fe9a80cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:57.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.293+0000 7fe99ffff640 1 --2- 172.21.15.131:0/2437635599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a80d44b0 0x7fe9a80d1650 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe9980097a0 tx=0x7fe99802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0e1cacb6c0e2813 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:57.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.293+0000 7fe99f7fe640 1 -- 172.21.15.131:0/2437635599 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe998037070 con 0x7fe9a80d44b0 2024-05-17T04:09:57.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.293+0000 7fe99f7fe640 1 -- 172.21.15.131:0/2437635599 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe998032440 con 0x7fe9a80d44b0 2024-05-17T04:09:57.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.293+0000 7fe99f7fe640 1 -- 172.21.15.131:0/2437635599 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe998032810 con 0x7fe9a80d44b0 2024-05-17T04:09:57.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.294+0000 7fe9aebe0640 1 -- 172.21.15.131:0/2437635599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a80d44b0 msgr2=0x7fe9a80d1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:57.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.294+0000 7fe9aebe0640 1 --2- 172.21.15.131:0/2437635599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a80d44b0 0x7fe9a80d1650 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe9980097a0 tx=0x7fe99802a180 comp rx=0 tx=0).stop 2024-05-17T04:09:57.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.294+0000 7fe9aebe0640 1 -- 172.21.15.131:0/2437635599 shutdown_connections 2024-05-17T04:09:57.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.294+0000 7fe9aebe0640 1 --2- 172.21.15.131:0/2437635599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a80d44b0 0x7fe9a80d1650 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.294+0000 7fe9aebe0640 1 --2- 172.21.15.131:0/2437635599 >> v2:172.21.15.150:3300/0 conn(0x7fe9a80cf880 0x7fe9a80cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.294+0000 7fe9aebe0640 1 -- 172.21.15.131:0/2437635599 >> 172.21.15.131:0/2437635599 conn(0x7fe9a80d2300 msgr2=0x7fe9a80b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:57.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.294+0000 7fe9aebe0640 1 -- 172.21.15.131:0/2437635599 shutdown_connections 2024-05-17T04:09:57.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.294+0000 7fe9aebe0640 1 -- 172.21.15.131:0/2437635599 wait complete. 2024-05-17T04:09:57.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.296+0000 7fe9aebe0640 1 Processor -- start 2024-05-17T04:09:57.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.296+0000 7fe9aebe0640 1 -- start start 2024-05-17T04:09:57.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.297+0000 7fe9aebe0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9a80cf880 0x7fe9a815b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:57.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.297+0000 7fe9aebe0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9a815f770 0x7fe9a81e8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:57.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.297+0000 7fe9aebe0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a81e8e70 0x7fe9a80ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:57.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.297+0000 7fe9aebe0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a80d0350 con 0x7fe9a80cf880 2024-05-17T04:09:57.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.297+0000 7fe9aebe0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a80d01d0 con 0x7fe9a815f770 2024-05-17T04:09:57.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.297+0000 7fe9aebe0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a80b87c0 con 0x7fe9a81e8e70 2024-05-17T04:09:57.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.297+0000 7fe9ac97c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9a80cf880 0x7fe9a815b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:57.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.297+0000 7fe9ac97c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9a80cf880 0x7fe9a815b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46366/0 (socket says 172.21.15.131:46366) 2024-05-17T04:09:57.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.298+0000 7fe9ac97c640 1 -- 172.21.15.131:0/1428650384 learned_addr learned my addr 172.21.15.131:0/1428650384 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:57.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.298+0000 7fe99ffff640 1 --2- 172.21.15.131:0/1428650384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9a815f770 0x7fe9a81e8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:57.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.298+0000 7fe9ad17d640 1 --2- 172.21.15.131:0/1428650384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a81e8e70 0x7fe9a80ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:57.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.298+0000 7fe9ac97c640 1 -- 172.21.15.131:0/1428650384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a81e8e70 msgr2=0x7fe9a80ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:57.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.298+0000 7fe9ac97c640 1 --2- 172.21.15.131:0/1428650384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a81e8e70 0x7fe9a80ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.298+0000 7fe9ac97c640 1 -- 172.21.15.131:0/1428650384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9a815f770 msgr2=0x7fe9a81e8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:57.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.298+0000 7fe9ac97c640 1 --2- 172.21.15.131:0/1428650384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9a815f770 0x7fe9a81e8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.298+0000 7fe9ac97c640 1 -- 172.21.15.131:0/1428650384 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a815bb90 con 0x7fe9a80cf880 2024-05-17T04:09:57.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.298+0000 7fe99ffff640 1 --2- 172.21.15.131:0/1428650384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9a815f770 0x7fe9a81e8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:57.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.298+0000 7fe9ac97c640 1 --2- 172.21.15.131:0/1428650384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9a80cf880 0x7fe9a815b650 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400c3f0 tx=0x7fe9a400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:57.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.298+0000 7fe99d7fa640 1 -- 172.21.15.131:0/1428650384 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4017070 con 0x7fe9a80cf880 2024-05-17T04:09:57.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.298+0000 7fe99d7fa640 1 -- 172.21.15.131:0/1428650384 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a40035f0 con 0x7fe9a80cf880 2024-05-17T04:09:57.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.298+0000 7fe9aebe0640 1 -- 172.21.15.131:0/1428650384 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a80ce4c0 con 0x7fe9a80cf880 2024-05-17T04:09:57.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.298+0000 7fe99d7fa640 1 -- 172.21.15.131:0/1428650384 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a40039e0 con 0x7fe9a80cf880 2024-05-17T04:09:57.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.298+0000 7fe9aebe0640 1 -- 172.21.15.131:0/1428650384 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a80cea80 con 0x7fe9a80cf880 2024-05-17T04:09:57.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.299+0000 7fe9aebe0640 1 -- 172.21.15.131:0/1428650384 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a80cfc90 con 0x7fe9a80cf880 2024-05-17T04:09:57.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.300+0000 7fe99d7fa640 1 -- 172.21.15.131:0/1428650384 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe9a401a070 con 0x7fe9a80cf880 2024-05-17T04:09:57.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.301+0000 7fe99d7fa640 1 --2- 172.21.15.131:0/1428650384 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe9940762d0 0x7fe9940787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:57.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.301+0000 7fe99d7fa640 1 -- 172.21.15.131:0/1428650384 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6101+0+0 (secure 0 0 0) 0x7fe9a4096bb0 con 0x7fe9a80cf880 2024-05-17T04:09:57.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.301+0000 7fe99ffff640 1 --2- 172.21.15.131:0/1428650384 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe9940762d0 0x7fe9940787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:57.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.301+0000 7fe99ffff640 1 --2- 172.21.15.131:0/1428650384 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe9940762d0 0x7fe9940787e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe998034000 tx=0x7fe99802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:57.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.305+0000 7fe99d7fa640 1 -- 172.21.15.131:0/1428650384 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe9a815bb90 con 0x7fe9a80cf880 2024-05-17T04:09:57.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.485+0000 7fe9aebe0640 1 -- 172.21.15.131:0/1428650384 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9a806de60 con 0x7fe9a80cf880 2024-05-17T04:09:57.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.486+0000 7fe99d7fa640 1 -- 172.21.15.131:0/1428650384 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16979 (secure 0 0 0) 0x7fe9a40602f0 con 0x7fe9a80cf880 2024-05-17T04:09:57.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:09:57.488 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":35,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:09:56.173566+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:54.201745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:55.131426+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:09:57.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.488+0000 7fe9aebe0640 1 -- 172.21.15.131:0/1428650384 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe9940762d0 msgr2=0x7fe9940787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:57.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.488+0000 7fe9aebe0640 1 --2- 172.21.15.131:0/1428650384 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe9940762d0 0x7fe9940787e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe998034000 tx=0x7fe99802e000 comp rx=0 tx=0).stop 2024-05-17T04:09:57.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.488+0000 7fe9aebe0640 1 -- 172.21.15.131:0/1428650384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9a80cf880 msgr2=0x7fe9a815b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:57.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.488+0000 7fe9aebe0640 1 --2- 172.21.15.131:0/1428650384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9a80cf880 0x7fe9a815b650 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400c3f0 tx=0x7fe9a400c8b0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.488+0000 7fe9aebe0640 1 -- 172.21.15.131:0/1428650384 shutdown_connections 2024-05-17T04:09:57.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.488+0000 7fe9aebe0640 1 --2- 172.21.15.131:0/1428650384 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe9940762d0 0x7fe9940787e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.488+0000 7fe9aebe0640 1 --2- 172.21.15.131:0/1428650384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a81e8e70 0x7fe9a80ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.488+0000 7fe9aebe0640 1 --2- 172.21.15.131:0/1428650384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9a815f770 0x7fe9a81e8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.488+0000 7fe9aebe0640 1 --2- 172.21.15.131:0/1428650384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9a80cf880 0x7fe9a815b650 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.488+0000 7fe9aebe0640 1 -- 172.21.15.131:0/1428650384 >> 172.21.15.131:0/1428650384 conn(0x7fe9a80d2300 msgr2=0x7fe9a8161b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:57.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.489+0000 7fe9aebe0640 1 -- 172.21.15.131:0/1428650384 shutdown_connections 2024-05-17T04:09:57.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.489+0000 7fe9aebe0640 1 -- 172.21.15.131:0/1428650384 wait complete. 2024-05-17T04:09:57.502 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-17T04:09:57.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.614+0000 7f5d75ace640 1 Processor -- start 2024-05-17T04:09:57.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.614+0000 7f5d75ace640 1 -- start start 2024-05-17T04:09:57.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d75ace640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d700b0240 0x7f5d70074230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:57.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d75ace640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5d70074770 0x7f5d70160190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:57.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d75ace640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d700cc800 con 0x7f5d701606d0 2024-05-17T04:09:57.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d75ace640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f5d70160ae0 con 0x7f5d70074770 2024-05-17T04:09:57.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d75ace640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5d70160d00 con 0x7f5d700b0240 2024-05-17T04:09:57.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d6ffff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f5d701606d0 0x7f5d700cfbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46496/0 (socket says 172.21.15.131:46496) 2024-05-17T04:09:57.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d6ffff640 1 -- 172.21.15.131:0/4133947370 learned_addr learned my addr 172.21.15.131:0/4133947370 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:57.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d6f7fe640 1 --2- 172.21.15.131:0/4133947370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d700b0240 0x7f5d70074230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:57.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d6effd640 1 --2- 172.21.15.131:0/4133947370 >> v2:172.21.15.150:3300/0 conn(0x7f5d70074770 0x7f5d70160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:57.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d6e7fc640 1 -- 172.21.15.131:0/4133947370 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 530311537 0 0) 0x7f5d700cc800 con 0x7f5d701606d0 2024-05-17T04:09:57.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d6e7fc640 1 -- 172.21.15.131:0/4133947370 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d58003520 con 0x7f5d701606d0 2024-05-17T04:09:57.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d6f7fe640 1 -- 172.21.15.131:0/4133947370 >> v2:172.21.15.150:3300/0 conn(0x7f5d70074770 msgr2=0x7f5d70160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:57.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d6f7fe640 1 --2- 172.21.15.131:0/4133947370 >> v2:172.21.15.150:3300/0 conn(0x7f5d70074770 0x7f5d70160190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d6f7fe640 1 -- 172.21.15.131:0/4133947370 >> v1:172.21.15.131:6789/0 conn(0x7f5d701606d0 legacy=0x7f5d700cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:57.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d6f7fe640 1 -- 172.21.15.131:0/4133947370 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d70073750 con 0x7f5d700b0240 2024-05-17T04:09:57.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.616+0000 7f5d6effd640 1 --2- 172.21.15.131:0/4133947370 >> v2:172.21.15.150:3300/0 conn(0x7f5d70074770 0x7f5d70160190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T04:09:57.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.617+0000 7f5d6f7fe640 1 --2- 172.21.15.131:0/4133947370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d700b0240 0x7f5d70074230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d60009d90 tx=0x7f5d6002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb4700b6d7e79d5f server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:57.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.617+0000 7f5d6e7fc640 1 -- 172.21.15.131:0/4133947370 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d60007740 con 0x7f5d700b0240 2024-05-17T04:09:57.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.617+0000 7f5d6e7fc640 1 -- 172.21.15.131:0/4133947370 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d600078e0 con 0x7f5d700b0240 2024-05-17T04:09:57.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.617+0000 7f5d6e7fc640 1 -- 172.21.15.131:0/4133947370 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d60007cb0 con 0x7f5d700b0240 2024-05-17T04:09:57.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.618+0000 7f5d75ace640 1 -- 172.21.15.131:0/4133947370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d700b0240 msgr2=0x7f5d70074230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:57.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.618+0000 7f5d75ace640 1 --2- 172.21.15.131:0/4133947370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d700b0240 0x7f5d70074230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d60009d90 tx=0x7f5d6002a660 comp rx=0 tx=0).stop 2024-05-17T04:09:57.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.618+0000 7f5d75ace640 1 -- 172.21.15.131:0/4133947370 shutdown_connections 2024-05-17T04:09:57.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.618+0000 7f5d75ace640 1 --2- 172.21.15.131:0/4133947370 >> v2:172.21.15.150:3300/0 conn(0x7f5d70074770 0x7f5d70160190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.618+0000 7f5d75ace640 1 --2- 172.21.15.131:0/4133947370 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d700b0240 0x7f5d70074230 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.618+0000 7f5d75ace640 1 -- 172.21.15.131:0/4133947370 >> 172.21.15.131:0/4133947370 conn(0x7f5d700cdb30 msgr2=0x7f5d700cdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:57.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.618+0000 7f5d75ace640 1 -- 172.21.15.131:0/4133947370 shutdown_connections 2024-05-17T04:09:57.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.618+0000 7f5d75ace640 1 -- 172.21.15.131:0/4133947370 wait complete. 2024-05-17T04:09:57.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.620+0000 7f5d75ace640 1 Processor -- start 2024-05-17T04:09:57.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.620+0000 7f5d75ace640 1 -- start start 2024-05-17T04:09:57.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.621+0000 7f5d75ace640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d70074770 0x7f5d7015f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:57.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.621+0000 7f5d75ace640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d700b0240 0x7f5d700c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:57.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.621+0000 7f5d75ace640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d701606d0 0x7f5d7015be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:57.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.621+0000 7f5d75ace640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5d70160fe0 con 0x7f5d700b0240 2024-05-17T04:09:57.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.621+0000 7f5d75ace640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5d70073d10 con 0x7f5d70074770 2024-05-17T04:09:57.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.621+0000 7f5d75ace640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5d700b0650 con 0x7f5d701606d0 2024-05-17T04:09:57.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.621+0000 7f5d6effd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d700b0240 0x7f5d700c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:57.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.621+0000 7f5d6effd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d700b0240 0x7f5d700c4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46376/0 (socket says 172.21.15.131:46376) 2024-05-17T04:09:57.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.621+0000 7f5d6effd640 1 -- 172.21.15.131:0/854541213 learned_addr learned my addr 172.21.15.131:0/854541213 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:57.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.622+0000 7f5d6ffff640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d701606d0 0x7f5d7015be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:57.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.622+0000 7f5d6f7fe640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d70074770 0x7f5d7015f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:57.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.622+0000 7f5d6effd640 1 -- 172.21.15.131:0/854541213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d701606d0 msgr2=0x7f5d7015be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:57.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.622+0000 7f5d6effd640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d701606d0 0x7f5d7015be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.622+0000 7f5d6effd640 1 -- 172.21.15.131:0/854541213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d70074770 msgr2=0x7f5d7015f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:57.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.622+0000 7f5d6effd640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d70074770 0x7f5d7015f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:57.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.622+0000 7f5d6effd640 1 -- 172.21.15.131:0/854541213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7015dcc0 con 0x7f5d700b0240 2024-05-17T04:09:57.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.622+0000 7f5d6ffff640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d701606d0 0x7f5d7015be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:57.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.622+0000 7f5d6f7fe640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d70074770 0x7f5d7015f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:57.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.622+0000 7f5d6effd640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d700b0240 0x7f5d700c4830 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400e960 tx=0x7f5d6400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:57.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.622+0000 7f5d57fff640 1 -- 172.21.15.131:0/854541213 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64017070 con 0x7f5d700b0240 2024-05-17T04:09:57.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.622+0000 7f5d57fff640 1 -- 172.21.15.131:0/854541213 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d6400ca00 con 0x7f5d700b0240 2024-05-17T04:09:57.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.622+0000 7f5d75ace640 1 -- 172.21.15.131:0/854541213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d7015dfa0 con 0x7f5d700b0240 2024-05-17T04:09:57.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.622+0000 7f5d57fff640 1 -- 172.21.15.131:0/854541213 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6400cdd0 con 0x7f5d700b0240 2024-05-17T04:09:57.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.622+0000 7f5d75ace640 1 -- 172.21.15.131:0/854541213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d7015e560 con 0x7f5d700b0240 2024-05-17T04:09:57.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.623+0000 7f5d75ace640 1 -- 172.21.15.131:0/854541213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d70160190 con 0x7f5d700b0240 2024-05-17T04:09:57.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.624+0000 7f5d57fff640 1 -- 172.21.15.131:0/854541213 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5d6401a070 con 0x7f5d700b0240 2024-05-17T04:09:57.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.624+0000 7f5d57fff640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5d5c0762d0 0x7f5d5c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:57.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.624+0000 7f5d57fff640 1 -- 172.21.15.131:0/854541213 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6101+0+0 (secure 0 0 0) 0x7f5d64097a40 con 0x7f5d700b0240 2024-05-17T04:09:57.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.624+0000 7f5d6f7fe640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5d5c0762d0 0x7f5d5c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:57.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.625+0000 7f5d6f7fe640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5d5c0762d0 0x7f5d5c0787e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5d60034000 tx=0x7f5d60033040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:57.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.629+0000 7f5d57fff640 1 -- 172.21.15.131:0/854541213 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5d64061210 con 0x7f5d700b0240 2024-05-17T04:09:57.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:57.848+0000 7f5d75ace640 1 -- 172.21.15.131:0/854541213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5d70069dc0 con 0x7f5d700b0240 2024-05-17T04:09:58.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.845+0000 7f5d57fff640 1 -- 172.21.15.131:0/854541213 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f5d64069030 con 0x7f5d700b0240 2024-05-17T04:09:58.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.848+0000 7f5d75ace640 1 -- 172.21.15.131:0/854541213 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5d5c0762d0 msgr2=0x7f5d5c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:58.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.848+0000 7f5d75ace640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5d5c0762d0 0x7f5d5c0787e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5d60034000 tx=0x7f5d60033040 comp rx=0 tx=0).stop 2024-05-17T04:09:58.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.848+0000 7f5d75ace640 1 -- 172.21.15.131:0/854541213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d700b0240 msgr2=0x7f5d700c4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:58.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.848+0000 7f5d75ace640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d700b0240 0x7f5d700c4830 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400e960 tx=0x7f5d6400ee20 comp rx=0 tx=0).stop 2024-05-17T04:09:58.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.848+0000 7f5d75ace640 1 -- 172.21.15.131:0/854541213 shutdown_connections 2024-05-17T04:09:58.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.848+0000 7f5d75ace640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5d5c0762d0 0x7f5d5c0787e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:58.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.848+0000 7f5d75ace640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d700b0240 0x7f5d700c4830 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:58.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.848+0000 7f5d75ace640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d701606d0 0x7f5d7015be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:58.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.848+0000 7f5d75ace640 1 --2- 172.21.15.131:0/854541213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d70074770 0x7f5d7015f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:58.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.848+0000 7f5d75ace640 1 -- 172.21.15.131:0/854541213 >> 172.21.15.131:0/854541213 conn(0x7f5d700cdb30 msgr2=0x7f5d700cdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:58.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.848+0000 7f5d75ace640 1 -- 172.21.15.131:0/854541213 shutdown_connections 2024-05-17T04:09:58.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.848+0000 7f5d75ace640 1 -- 172.21.15.131:0/854541213 wait complete. 2024-05-17T04:09:58.863 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-17T04:09:58.864 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-17T04:09:58.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.981+0000 7f0b043c2640 1 Processor -- start 2024-05-17T04:09:58.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.981+0000 7f0b043c2640 1 -- start start 2024-05-17T04:09:58.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b043c2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0afc168450 0x7f0afc16a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:58.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b043c2640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0afc145e70 con 0x7f0afc073eb0 2024-05-17T04:09:58.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b043c2640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0afc0d0c30 con 0x7f0afc145a60 2024-05-17T04:09:58.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b043c2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0afc0d1840 con 0x7f0afc168450 2024-05-17T04:09:58.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b0195d640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f0afc073eb0 0x7f0afc0742c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46500/0 (socket says 172.21.15.131:46500) 2024-05-17T04:09:58.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b0195d640 1 -- 172.21.15.131:0/1943827619 learned_addr learned my addr 172.21.15.131:0/1943827619 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:58.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b0115c640 1 -- 172.21.15.131:0/1943827619 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640650703 0 0) 0x7f0afc145e70 con 0x7f0afc073eb0 2024-05-17T04:09:58.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b0115c640 1 -- 172.21.15.131:0/1943827619 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae8003520 con 0x7f0afc073eb0 2024-05-17T04:09:58.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b0295f640 1 --2- 172.21.15.131:0/1943827619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0afc168450 0x7f0afc16a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:58.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b0115c640 1 -- 172.21.15.131:0/1943827619 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2013488302 0 0) 0x7f0ae8003520 con 0x7f0afc073eb0 2024-05-17T04:09:58.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b0115c640 1 -- 172.21.15.131:0/1943827619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0afc168450 msgr2=0x7f0afc16a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:58.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b0115c640 1 --2- 172.21.15.131:0/1943827619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0afc168450 0x7f0afc16a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:58.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b0115c640 1 -- 172.21.15.131:0/1943827619 >> v1:172.21.15.150:6789/0 conn(0x7f0afc145a60 legacy=0x7f0afc163cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:58.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b0115c640 1 -- 172.21.15.131:0/1943827619 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0afc0d0f10 con 0x7f0afc073eb0 2024-05-17T04:09:58.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b0115c640 1 -- 172.21.15.131:0/1943827619 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7f0aec0016f0 con 0x7f0afc073eb0 2024-05-17T04:09:58.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b0115c640 1 -- 172.21.15.131:0/1943827619 >> v1:172.21.15.131:6789/0 conn(0x7f0afc073eb0 legacy=0x7f0afc0742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:58.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b0115c640 1 --2- 172.21.15.131:0/1943827619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0afc168450 0x7f0ae80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b0115c640 1 --2- 172.21.15.131:0/1943827619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ae8003f90 0x7f0ae8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.983+0000 7f0b0115c640 1 --2- 172.21.15.131:0/1943827619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ae8004d40 0x7f0ae8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.984+0000 7f0b0115c640 1 -- 172.21.15.131:0/1943827619 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc0d1840 con 0x7f0ae8004d40 2024-05-17T04:09:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.984+0000 7f0b0115c640 1 -- 172.21.15.131:0/1943827619 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae800bb80 con 0x7f0ae8003f90 2024-05-17T04:09:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.984+0000 7f0b0115c640 1 -- 172.21.15.131:0/1943827619 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae800bd80 con 0x7f0afc168450 2024-05-17T04:09:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.984+0000 7f0b0295f640 1 --2- 172.21.15.131:0/1943827619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ae8004d40 0x7f0ae8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.984+0000 7f0b0195d640 1 --2- 172.21.15.131:0/1943827619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ae8003f90 0x7f0ae8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.984+0000 7f0b0215e640 1 --2- 172.21.15.131:0/1943827619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0afc168450 0x7f0ae80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.984+0000 7f0b0295f640 1 -- 172.21.15.131:0/1943827619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0afc168450 msgr2=0x7f0ae80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.984+0000 7f0b0295f640 1 --2- 172.21.15.131:0/1943827619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0afc168450 0x7f0ae80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.984+0000 7f0b0295f640 1 -- 172.21.15.131:0/1943827619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ae8003f90 msgr2=0x7f0ae8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.984+0000 7f0b0295f640 1 --2- 172.21.15.131:0/1943827619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ae8003f90 0x7f0ae8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.984+0000 7f0b0295f640 1 -- 172.21.15.131:0/1943827619 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae8003520 con 0x7f0ae8004d40 2024-05-17T04:09:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.985+0000 7f0b0295f640 1 --2- 172.21.15.131:0/1943827619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ae8004d40 0x7f0ae8005190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009fc0 tx=0x7f0ae8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb9164dd7ee33f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.985+0000 7f0b0115c640 1 -- 172.21.15.131:0/1943827619 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4034020 con 0x7f0ae8004d40 2024-05-17T04:09:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.985+0000 7f0b0115c640 1 -- 172.21.15.131:0/1943827619 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af40305f0 con 0x7f0ae8004d40 2024-05-17T04:09:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.985+0000 7f0b0115c640 1 -- 172.21.15.131:0/1943827619 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4009c10 con 0x7f0ae8004d40 2024-05-17T04:09:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.985+0000 7f0b043c2640 1 -- 172.21.15.131:0/1943827619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ae8004d40 msgr2=0x7f0ae8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.985+0000 7f0b043c2640 1 --2- 172.21.15.131:0/1943827619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ae8004d40 0x7f0ae8005190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009fc0 tx=0x7f0ae8005830 comp rx=0 tx=0).stop 2024-05-17T04:09:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.985+0000 7f0b0295f640 1 -- 172.21.15.131:0/1943827619 reap_dead start 2024-05-17T04:09:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.986+0000 7f0b043c2640 1 -- 172.21.15.131:0/1943827619 shutdown_connections 2024-05-17T04:09:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.986+0000 7f0b043c2640 1 -- 172.21.15.131:0/1943827619 >> 172.21.15.131:0/1943827619 conn(0x7f0afc0b4450 msgr2=0x7f0afc0737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.986+0000 7f0b043c2640 1 -- 172.21.15.131:0/1943827619 shutdown_connections 2024-05-17T04:09:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.986+0000 7f0b043c2640 1 -- 172.21.15.131:0/1943827619 wait complete. 2024-05-17T04:09:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.987+0000 7f0b043c2640 1 Processor -- start 2024-05-17T04:09:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.987+0000 7f0b043c2640 1 -- start start 2024-05-17T04:09:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b043c2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ae8004d40 0x7f0afc15ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b043c2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0afc13efc0 0x7f0afc13f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b043c2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0afc0b1fd0 0x7f0afc0b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b043c2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc0d14d0 con 0x7f0ae8004d40 2024-05-17T04:09:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b043c2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc0b0aa0 con 0x7f0afc13efc0 2024-05-17T04:09:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b043c2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0afc1490c0 con 0x7f0afc0b1fd0 2024-05-17T04:09:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b0215e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ae8004d40 0x7f0afc15ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b0215e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ae8004d40 0x7f0afc15ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46394/0 (socket says 172.21.15.131:46394) 2024-05-17T04:09:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b0215e640 1 -- 172.21.15.131:0/3692952489 learned_addr learned my addr 172.21.15.131:0/3692952489 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b0195d640 1 --2- 172.21.15.131:0/3692952489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0afc13efc0 0x7f0afc13f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b0295f640 1 --2- 172.21.15.131:0/3692952489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0afc0b1fd0 0x7f0afc0b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b0215e640 1 -- 172.21.15.131:0/3692952489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0afc0b1fd0 msgr2=0x7f0afc0b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b0215e640 1 --2- 172.21.15.131:0/3692952489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0afc0b1fd0 0x7f0afc0b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b0215e640 1 -- 172.21.15.131:0/3692952489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0afc13efc0 msgr2=0x7f0afc13f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b0215e640 1 --2- 172.21.15.131:0/3692952489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0afc13efc0 0x7f0afc13f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b0215e640 1 -- 172.21.15.131:0/3692952489 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0afc15fe00 con 0x7f0ae8004d40 2024-05-17T04:09:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b0295f640 1 --2- 172.21.15.131:0/3692952489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0afc0b1fd0 0x7f0afc0b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b0215e640 1 --2- 172.21.15.131:0/3692952489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ae8004d40 0x7f0afc15ed90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0af800f7a0 tx=0x7f0af800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0af2ffd640 1 -- 172.21.15.131:0/3692952489 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af80052e0 con 0x7f0ae8004d40 2024-05-17T04:09:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0af2ffd640 1 -- 172.21.15.131:0/3692952489 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af8018070 con 0x7f0ae8004d40 2024-05-17T04:09:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0b043c2640 1 -- 172.21.15.131:0/3692952489 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0afc0b2920 con 0x7f0ae8004d40 2024-05-17T04:09:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.989+0000 7f0af2ffd640 1 -- 172.21.15.131:0/3692952489 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af800d970 con 0x7f0ae8004d40 2024-05-17T04:09:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.990+0000 7f0b043c2640 1 -- 172.21.15.131:0/3692952489 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0afc160070 con 0x7f0ae8004d40 2024-05-17T04:09:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.991+0000 7f0b043c2640 1 -- 172.21.15.131:0/3692952489 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0afc160a70 con 0x7f0ae8004d40 2024-05-17T04:09:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.991+0000 7f0af2ffd640 1 -- 172.21.15.131:0/3692952489 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0af800db10 con 0x7f0ae8004d40 2024-05-17T04:09:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.992+0000 7f0af2ffd640 1 --2- 172.21.15.131:0/3692952489 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0ae00762d0 0x7f0ae00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.992+0000 7f0b0195d640 1 --2- 172.21.15.131:0/3692952489 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0ae00762d0 0x7f0ae00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.992+0000 7f0af2ffd640 1 -- 172.21.15.131:0/3692952489 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f0af8097700 con 0x7f0ae8004d40 2024-05-17T04:09:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.992+0000 7f0b0195d640 1 --2- 172.21.15.131:0/3692952489 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0ae00762d0 0x7f0ae00787e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0aec001010 tx=0x7f0aec007970 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:58.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:58.996+0000 7f0af2ffd640 1 -- 172.21.15.131:0/3692952489 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0afc0b2920 con 0x7f0ae8004d40 2024-05-17T04:09:59.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.214+0000 7f0b043c2640 1 -- 172.21.15.131:0/3692952489 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0afc0d1cd0 con 0x7f0ae8004d40 2024-05-17T04:09:59.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.846+0000 7f0af2ffd640 1 -- 172.21.15.131:0/3692952489 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f0af8060e40 con 0x7f0ae8004d40 2024-05-17T04:09:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.849+0000 7f0b043c2640 1 -- 172.21.15.131:0/3692952489 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0ae00762d0 msgr2=0x7f0ae00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.849+0000 7f0b043c2640 1 --2- 172.21.15.131:0/3692952489 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0ae00762d0 0x7f0ae00787e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0aec001010 tx=0x7f0aec007970 comp rx=0 tx=0).stop 2024-05-17T04:09:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.849+0000 7f0b043c2640 1 -- 172.21.15.131:0/3692952489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ae8004d40 msgr2=0x7f0afc15ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.849+0000 7f0b043c2640 1 --2- 172.21.15.131:0/3692952489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ae8004d40 0x7f0afc15ed90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0af800f7a0 tx=0x7f0af800fc60 comp rx=0 tx=0).stop 2024-05-17T04:09:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.849+0000 7f0b043c2640 1 -- 172.21.15.131:0/3692952489 shutdown_connections 2024-05-17T04:09:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.849+0000 7f0b043c2640 1 --2- 172.21.15.131:0/3692952489 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0ae00762d0 0x7f0ae00787e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.849+0000 7f0b043c2640 1 --2- 172.21.15.131:0/3692952489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0afc0b1fd0 0x7f0afc0b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.849+0000 7f0b043c2640 1 --2- 172.21.15.131:0/3692952489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0afc13efc0 0x7f0afc13f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.849+0000 7f0b043c2640 1 --2- 172.21.15.131:0/3692952489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ae8004d40 0x7f0afc15ed90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.849+0000 7f0b043c2640 1 -- 172.21.15.131:0/3692952489 >> 172.21.15.131:0/3692952489 conn(0x7f0afc0b4450 msgr2=0x7f0afc1441d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.849+0000 7f0b043c2640 1 -- 172.21.15.131:0/3692952489 shutdown_connections 2024-05-17T04:09:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.849+0000 7f0b043c2640 1 -- 172.21.15.131:0/3692952489 wait complete. 2024-05-17T04:09:59.863 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-17T04:09:59.864 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T04:09:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.978+0000 7f0e2449e640 1 Processor -- start 2024-05-17T04:09:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.978+0000 7f0e2449e640 1 -- start start 2024-05-17T04:09:59.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.980+0000 7f0e2449e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0e1c0b36d0 0x7f0e1c0b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:59.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.980+0000 7f0e2449e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e1c0ce140 0x7f0e1c0ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:59.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.980+0000 7f0e2449e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1c0b4020 con 0x7f0e1c06dad0 2024-05-17T04:09:59.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.980+0000 7f0e2449e640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f0e1c06c6f0 con 0x7f0e1c0b36d0 2024-05-17T04:09:59.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.980+0000 7f0e2449e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1c06c9d0 con 0x7f0e1c0ce140 2024-05-17T04:09:59.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.980+0000 7f0e21a39640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0e1c0b36d0 0x7f0e1c0b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:59.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.980+0000 7f0e2223a640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f0e1c06dad0 0x7f0e1c15d4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46508/0 (socket says 172.21.15.131:46508) 2024-05-17T04:09:59.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.980+0000 7f0e2223a640 1 -- 172.21.15.131:0/4110766424 learned_addr learned my addr 172.21.15.131:0/4110766424 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:09:59.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.980+0000 7f0e22a3b640 1 --2- 172.21.15.131:0/4110766424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e1c0ce140 0x7f0e1c0ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:59.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.980+0000 7f0e21a39640 1 -- 172.21.15.131:0/4110766424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e1c0ce140 msgr2=0x7f0e1c0ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:09:59.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.980+0000 7f0e21a39640 1 --2- 172.21.15.131:0/4110766424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e1c0ce140 0x7f0e1c0ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:59.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.980+0000 7f0e21a39640 1 -- 172.21.15.131:0/4110766424 >> v1:172.21.15.131:6789/0 conn(0x7f0e1c06dad0 legacy=0x7f0e1c15d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:59.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.980+0000 7f0e21a39640 1 -- 172.21.15.131:0/4110766424 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c06ccb0 con 0x7f0e1c0b36d0 2024-05-17T04:09:59.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.981+0000 7f0e21a39640 1 --2- 172.21.15.131:0/4110766424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e1c0b36d0 0x7f0e1c0b3ae0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0097a0 tx=0x7f0e0c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3833cac43fbbe740 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:59.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.981+0000 7f0e21238640 1 -- 172.21.15.131:0/4110766424 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c037070 con 0x7f0e1c0b36d0 2024-05-17T04:09:59.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.981+0000 7f0e21238640 1 -- 172.21.15.131:0/4110766424 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e0c032440 con 0x7f0e1c0b36d0 2024-05-17T04:09:59.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.981+0000 7f0e21238640 1 -- 172.21.15.131:0/4110766424 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c032810 con 0x7f0e1c0b36d0 2024-05-17T04:09:59.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.982+0000 7f0e2449e640 1 -- 172.21.15.131:0/4110766424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e1c0b36d0 msgr2=0x7f0e1c0b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:59.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.982+0000 7f0e2449e640 1 --2- 172.21.15.131:0/4110766424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e1c0b36d0 0x7f0e1c0b3ae0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0097a0 tx=0x7f0e0c02a210 comp rx=0 tx=0).stop 2024-05-17T04:09:59.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.982+0000 7f0e2449e640 1 -- 172.21.15.131:0/4110766424 shutdown_connections 2024-05-17T04:09:59.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.982+0000 7f0e2449e640 1 --2- 172.21.15.131:0/4110766424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e1c0ce140 0x7f0e1c0ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:59.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.982+0000 7f0e2449e640 1 --2- 172.21.15.131:0/4110766424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e1c0b36d0 0x7f0e1c0b3ae0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:59.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.982+0000 7f0e2449e640 1 -- 172.21.15.131:0/4110766424 >> 172.21.15.131:0/4110766424 conn(0x7f0e1c073150 msgr2=0x7f0e1c073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:09:59.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.982+0000 7f0e2449e640 1 -- 172.21.15.131:0/4110766424 shutdown_connections 2024-05-17T04:09:59.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.982+0000 7f0e2449e640 1 -- 172.21.15.131:0/4110766424 wait complete. 2024-05-17T04:09:59.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.984+0000 7f0e2449e640 1 Processor -- start 2024-05-17T04:09:59.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.984+0000 7f0e2449e640 1 -- start start 2024-05-17T04:09:59.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e2449e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e1c06dad0 0x7f0e1c148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:59.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e2449e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e1c0b36d0 0x7f0e1c14d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:59.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e2449e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e1c0ce140 0x7f0e1c14df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:59.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e2449e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c06d550 con 0x7f0e1c0ce140 2024-05-17T04:09:59.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e2449e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c06d270 con 0x7f0e1c0b36d0 2024-05-17T04:09:59.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e2449e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1c06dee0 con 0x7f0e1c06dad0 2024-05-17T04:09:59.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e22a3b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e1c0ce140 0x7f0e1c14df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:59.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e22a3b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e1c0ce140 0x7f0e1c14df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46404/0 (socket says 172.21.15.131:46404) 2024-05-17T04:09:59.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e22a3b640 1 -- 172.21.15.131:0/2078710559 learned_addr learned my addr 172.21.15.131:0/2078710559 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:09:59.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e21a39640 1 --2- 172.21.15.131:0/2078710559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e1c0b36d0 0x7f0e1c14d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:59.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e2223a640 1 --2- 172.21.15.131:0/2078710559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e1c06dad0 0x7f0e1c148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:59.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e22a3b640 1 -- 172.21.15.131:0/2078710559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e1c06dad0 msgr2=0x7f0e1c148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:59.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e22a3b640 1 --2- 172.21.15.131:0/2078710559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e1c06dad0 0x7f0e1c148fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:59.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e22a3b640 1 -- 172.21.15.131:0/2078710559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e1c0b36d0 msgr2=0x7f0e1c14d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:09:59.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e22a3b640 1 --2- 172.21.15.131:0/2078710559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e1c0b36d0 0x7f0e1c14d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:09:59.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e22a3b640 1 -- 172.21.15.131:0/2078710559 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c156b70 con 0x7f0e1c0ce140 2024-05-17T04:09:59.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e2223a640 1 --2- 172.21.15.131:0/2078710559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e1c06dad0 0x7f0e1c148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:09:59.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.985+0000 7f0e22a3b640 1 --2- 172.21.15.131:0/2078710559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e1c0ce140 0x7f0e1c14df30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0e14007e60 tx=0x7f0e1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:59.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.986+0000 7f0e12ffd640 1 -- 172.21.15.131:0/2078710559 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14014420 con 0x7f0e1c0ce140 2024-05-17T04:09:59.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.986+0000 7f0e12ffd640 1 -- 172.21.15.131:0/2078710559 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e14019070 con 0x7f0e1c0ce140 2024-05-17T04:09:59.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.986+0000 7f0e12ffd640 1 -- 172.21.15.131:0/2078710559 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14014820 con 0x7f0e1c0ce140 2024-05-17T04:09:59.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.986+0000 7f0e2449e640 1 -- 172.21.15.131:0/2078710559 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1c155ff0 con 0x7f0e1c0ce140 2024-05-17T04:09:59.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.986+0000 7f0e2449e640 1 -- 172.21.15.131:0/2078710559 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e1c1565b0 con 0x7f0e1c0ce140 2024-05-17T04:09:59.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.987+0000 7f0e2449e640 1 -- 172.21.15.131:0/2078710559 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1c155d40 con 0x7f0e1c0ce140 2024-05-17T04:09:59.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.987+0000 7f0e12ffd640 1 -- 172.21.15.131:0/2078710559 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0e140149c0 con 0x7f0e1c0ce140 2024-05-17T04:09:59.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.988+0000 7f0e12ffd640 1 --2- 172.21.15.131:0/2078710559 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0e00076300 0x7f0e00078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:09:59.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.988+0000 7f0e2223a640 1 --2- 172.21.15.131:0/2078710559 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0e00076300 0x7f0e00078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:09:59.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.988+0000 7f0e12ffd640 1 -- 172.21.15.131:0/2078710559 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f0e14097f10 con 0x7f0e1c0ce140 2024-05-17T04:09:59.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.989+0000 7f0e2223a640 1 --2- 172.21.15.131:0/2078710559 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0e00076300 0x7f0e00078810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0e18000f60 tx=0x7f0e18009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:09:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:09:59.993+0000 7f0e12ffd640 1 -- 172.21.15.131:0/2078710559 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0e140616e0 con 0x7f0e1c0ce140 2024-05-17T04:10:00.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.211+0000 7f0e2449e640 1 -- 172.21.15.131:0/2078710559 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e1c0cf520 con 0x7f0e1c0ce140 2024-05-17T04:10:00.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.212+0000 7f0e12ffd640 1 -- 172.21.15.131:0/2078710559 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5187 (secure 0 0 0) 0x7f0e14060fe0 con 0x7f0e1c0ce140 2024-05-17T04:10:00.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:10:00.213 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/569182744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":569182744},{"type":"v1","addr":"172.21.15.150:6835","nonce":569182744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1749773301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1749773301},{"type":"v1","addr":"172.21.15.150:6834","nonce":1749773301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3795031678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3795031678},{"type":"v1","addr":"172.21.15.131:6837","nonce":3795031678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:56.173520+0000","modified":"2024-05-17T04:09:59.216262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4923":{"gid":4923,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/119325169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":119325169},{"type":"v1","addr":"172.21.15.131:6836","nonce":119325169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4923,"qdb_cluster":[4923]},"id":2}]} 2024-05-17T04:10:00.213 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 16 2024-05-17T04:10:00.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.214+0000 7f0e2449e640 1 -- 172.21.15.131:0/2078710559 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0e00076300 msgr2=0x7f0e00078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:00.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.214+0000 7f0e2449e640 1 --2- 172.21.15.131:0/2078710559 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0e00076300 0x7f0e00078810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0e18000f60 tx=0x7f0e18009040 comp rx=0 tx=0).stop 2024-05-17T04:10:00.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.214+0000 7f0e2449e640 1 -- 172.21.15.131:0/2078710559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e1c0ce140 msgr2=0x7f0e1c14df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:00.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.214+0000 7f0e2449e640 1 --2- 172.21.15.131:0/2078710559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e1c0ce140 0x7f0e1c14df30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0e14007e60 tx=0x7f0e1400e4b0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.214+0000 7f0e2449e640 1 -- 172.21.15.131:0/2078710559 shutdown_connections 2024-05-17T04:10:00.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.214+0000 7f0e2449e640 1 --2- 172.21.15.131:0/2078710559 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f0e00076300 0x7f0e00078810 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.214+0000 7f0e2449e640 1 --2- 172.21.15.131:0/2078710559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e1c0ce140 0x7f0e1c14df30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.214+0000 7f0e2449e640 1 --2- 172.21.15.131:0/2078710559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e1c0b36d0 0x7f0e1c14d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.214+0000 7f0e2449e640 1 --2- 172.21.15.131:0/2078710559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e1c06dad0 0x7f0e1c148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.214+0000 7f0e2449e640 1 -- 172.21.15.131:0/2078710559 >> 172.21.15.131:0/2078710559 conn(0x7f0e1c073150 msgr2=0x7f0e1c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:00.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.214+0000 7f0e2449e640 1 -- 172.21.15.131:0/2078710559 shutdown_connections 2024-05-17T04:10:00.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.214+0000 7f0e2449e640 1 -- 172.21.15.131:0/2078710559 wait complete. 2024-05-17T04:10:00.227 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T04:10:00.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.338+0000 7fb4f98a7640 1 Processor -- start 2024-05-17T04:10:00.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.339+0000 7fb4f98a7640 1 -- start start 2024-05-17T04:10:00.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.340+0000 7fb4f98a7640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb4f406d910 0x7fb4f415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:00.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.340+0000 7fb4f98a7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4f40b45c0 0x7fb4f40d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:00.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.340+0000 7fb4f98a7640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4f40d06f0 con 0x7fb4f40d3da0 2024-05-17T04:10:00.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.340+0000 7fb4f98a7640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fb4f40d0ff0 con 0x7fb4f406d910 2024-05-17T04:10:00.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.340+0000 7fb4f98a7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f40d0ac0 con 0x7fb4f40b45c0 2024-05-17T04:10:00.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.340+0000 7fb4f2ffd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb4f406d910 0x7fb4f415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:00.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.340+0000 7fb4f2ffd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb4f406d910 0x7fb4f415f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:35086/0 (socket says 172.21.15.131:35086) 2024-05-17T04:10:00.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.340+0000 7fb4f2ffd640 1 -- 172.21.15.131:0/1151196443 learned_addr learned my addr 172.21.15.131:0/1151196443 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:10:00.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.340+0000 7fb4f37fe640 1 --1- 172.21.15.131:0/1151196443 >> v1:172.21.15.150:6789/0 conn(0x7fb4f40d3da0 0x7fb4f40d41b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:57272/0 (socket says 172.21.15.131:57272) 2024-05-17T04:10:00.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.340+0000 7fb4ebfff640 1 --2- 172.21.15.131:0/1151196443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4f40b45c0 0x7fb4f40d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:00.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.341+0000 7fb4f2ffd640 1 -- 172.21.15.131:0/1151196443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4f40b45c0 msgr2=0x7fb4f40d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:00.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.341+0000 7fb4f2ffd640 1 --2- 172.21.15.131:0/1151196443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4f40b45c0 0x7fb4f40d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.341+0000 7fb4f2ffd640 1 -- 172.21.15.131:0/1151196443 >> v1:172.21.15.150:6789/0 conn(0x7fb4f40d3da0 legacy=0x7fb4f40d41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:00.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.341+0000 7fb4f2ffd640 1 -- 172.21.15.131:0/1151196443 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f40b49d0 con 0x7fb4f406d910 2024-05-17T04:10:00.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.341+0000 7fb4f2ffd640 1 --2- 172.21.15.131:0/1151196443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f406d910 0x7fb4f415f7f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009870 tx=0x7fb4e402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a3911c8089a416d server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:00.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.341+0000 7fb4f27fc640 1 -- 172.21.15.131:0/1151196443 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4037070 con 0x7fb4f406d910 2024-05-17T04:10:00.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.341+0000 7fb4f27fc640 1 -- 172.21.15.131:0/1151196443 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e4032440 con 0x7fb4f406d910 2024-05-17T04:10:00.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.341+0000 7fb4f27fc640 1 -- 172.21.15.131:0/1151196443 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4032810 con 0x7fb4f406d910 2024-05-17T04:10:00.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.342+0000 7fb4f98a7640 1 -- 172.21.15.131:0/1151196443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f406d910 msgr2=0x7fb4f415f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:00.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.342+0000 7fb4f98a7640 1 --2- 172.21.15.131:0/1151196443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f406d910 0x7fb4f415f7f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009870 tx=0x7fb4e402a1c0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.342+0000 7fb4f98a7640 1 -- 172.21.15.131:0/1151196443 shutdown_connections 2024-05-17T04:10:00.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.342+0000 7fb4f98a7640 1 --2- 172.21.15.131:0/1151196443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4f40b45c0 0x7fb4f40d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.342+0000 7fb4f98a7640 1 --2- 172.21.15.131:0/1151196443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f406d910 0x7fb4f415f7f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.342+0000 7fb4f98a7640 1 -- 172.21.15.131:0/1151196443 >> 172.21.15.131:0/1151196443 conn(0x7fb4f40b6cb0 msgr2=0x7fb4f40b70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:00.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.342+0000 7fb4f98a7640 1 -- 172.21.15.131:0/1151196443 shutdown_connections 2024-05-17T04:10:00.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.342+0000 7fb4f98a7640 1 -- 172.21.15.131:0/1151196443 wait complete. 2024-05-17T04:10:00.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.344+0000 7fb4f98a7640 1 Processor -- start 2024-05-17T04:10:00.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.344+0000 7fb4f98a7640 1 -- start start 2024-05-17T04:10:00.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.345+0000 7fb4f98a7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4f406d910 0x7fb4f40ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:00.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.345+0000 7fb4f98a7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4f40b45c0 0x7fb4f40b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:00.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.345+0000 7fb4f98a7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f40d3da0 0x7fb4f40b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:00.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.345+0000 7fb4f98a7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f40cf9b0 con 0x7fb4f406d910 2024-05-17T04:10:00.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.345+0000 7fb4f98a7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f40b43c0 con 0x7fb4f40d3da0 2024-05-17T04:10:00.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.345+0000 7fb4f98a7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f40cfc90 con 0x7fb4f40b45c0 2024-05-17T04:10:00.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.345+0000 7fb4f2ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4f406d910 0x7fb4f40ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:00.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.345+0000 7fb4f2ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4f406d910 0x7fb4f40ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46420/0 (socket says 172.21.15.131:46420) 2024-05-17T04:10:00.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.345+0000 7fb4f2ffd640 1 -- 172.21.15.131:0/3627441925 learned_addr learned my addr 172.21.15.131:0/3627441925 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:10:00.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.346+0000 7fb4ebfff640 1 --2- 172.21.15.131:0/3627441925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4f40b45c0 0x7fb4f40b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:00.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.346+0000 7fb4f37fe640 1 --2- 172.21.15.131:0/3627441925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f40d3da0 0x7fb4f40b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:00.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.346+0000 7fb4f2ffd640 1 -- 172.21.15.131:0/3627441925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4f40b45c0 msgr2=0x7fb4f40b86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:00.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.346+0000 7fb4f2ffd640 1 --2- 172.21.15.131:0/3627441925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4f40b45c0 0x7fb4f40b86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.346+0000 7fb4f2ffd640 1 -- 172.21.15.131:0/3627441925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f40d3da0 msgr2=0x7fb4f40b8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:00.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.346+0000 7fb4f2ffd640 1 --2- 172.21.15.131:0/3627441925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f40d3da0 0x7fb4f40b8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.346+0000 7fb4f2ffd640 1 -- 172.21.15.131:0/3627441925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f40b9170 con 0x7fb4f406d910 2024-05-17T04:10:00.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.346+0000 7fb4f37fe640 1 --2- 172.21.15.131:0/3627441925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f40d3da0 0x7fb4f40b8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:10:00.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.346+0000 7fb4f2ffd640 1 --2- 172.21.15.131:0/3627441925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4f406d910 0x7fb4f40ce5e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4000c00 tx=0x7fb4e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:00.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.346+0000 7fb4f0ff9640 1 -- 172.21.15.131:0/3627441925 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4037040 con 0x7fb4f406d910 2024-05-17T04:10:00.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.346+0000 7fb4f0ff9640 1 -- 172.21.15.131:0/3627441925 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e4042070 con 0x7fb4f406d910 2024-05-17T04:10:00.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.346+0000 7fb4f98a7640 1 -- 172.21.15.131:0/3627441925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f40cc810 con 0x7fb4f406d910 2024-05-17T04:10:00.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.346+0000 7fb4f0ff9640 1 -- 172.21.15.131:0/3627441925 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4030880 con 0x7fb4f406d910 2024-05-17T04:10:00.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.346+0000 7fb4f98a7640 1 -- 172.21.15.131:0/3627441925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f40ccdd0 con 0x7fb4f406d910 2024-05-17T04:10:00.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.347+0000 7fb4f98a7640 1 -- 172.21.15.131:0/3627441925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f415f7f0 con 0x7fb4f406d910 2024-05-17T04:10:00.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.348+0000 7fb4f0ff9640 1 -- 172.21.15.131:0/3627441925 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb4e402ad10 con 0x7fb4f406d910 2024-05-17T04:10:00.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.348+0000 7fb4f0ff9640 1 --2- 172.21.15.131:0/3627441925 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb4d40762d0 0x7fb4d40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:00.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.348+0000 7fb4f0ff9640 1 -- 172.21.15.131:0/3627441925 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fb4e40b7e00 con 0x7fb4f406d910 2024-05-17T04:10:00.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.348+0000 7fb4ebfff640 1 --2- 172.21.15.131:0/3627441925 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb4d40762d0 0x7fb4d40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:00.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.349+0000 7fb4ebfff640 1 --2- 172.21.15.131:0/3627441925 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb4d40762d0 0x7fb4d40787e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40cc050 tx=0x7fb4dc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:00.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.353+0000 7fb4f0ff9640 1 -- 172.21.15.131:0/3627441925 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb4e4081540 con 0x7fb4f406d910 2024-05-17T04:10:00.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.532+0000 7fb4f98a7640 1 -- 172.21.15.131:0/3627441925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4f406e120 con 0x7fb4f406d910 2024-05-17T04:10:00.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.533+0000 7fb4f0ff9640 1 -- 172.21.15.131:0/3627441925 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16966 (secure 0 0 0) 0x7fb4e4080e40 con 0x7fb4f406d910 2024-05-17T04:10:00.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:10:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":36,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:09:57.820389+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:54.201745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:55.131426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T04:10:00.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.535+0000 7fb4f98a7640 1 -- 172.21.15.131:0/3627441925 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb4d40762d0 msgr2=0x7fb4d40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:00.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.535+0000 7fb4f98a7640 1 --2- 172.21.15.131:0/3627441925 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb4d40762d0 0x7fb4d40787e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40cc050 tx=0x7fb4dc008040 comp rx=0 tx=0).stop 2024-05-17T04:10:00.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.535+0000 7fb4f98a7640 1 -- 172.21.15.131:0/3627441925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4f406d910 msgr2=0x7fb4f40ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:00.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.535+0000 7fb4f98a7640 1 --2- 172.21.15.131:0/3627441925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4f406d910 0x7fb4f40ce5e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4000c00 tx=0x7fb4e40046c0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.535+0000 7fb4f98a7640 1 -- 172.21.15.131:0/3627441925 shutdown_connections 2024-05-17T04:10:00.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.535+0000 7fb4f98a7640 1 --2- 172.21.15.131:0/3627441925 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fb4d40762d0 0x7fb4d40787e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.535+0000 7fb4f98a7640 1 --2- 172.21.15.131:0/3627441925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f40d3da0 0x7fb4f40b8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.535+0000 7fb4f98a7640 1 --2- 172.21.15.131:0/3627441925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb4f40b45c0 0x7fb4f40b86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.535+0000 7fb4f98a7640 1 --2- 172.21.15.131:0/3627441925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4f406d910 0x7fb4f40ce5e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.535+0000 7fb4f98a7640 1 -- 172.21.15.131:0/3627441925 >> 172.21.15.131:0/3627441925 conn(0x7fb4f40b6cb0 msgr2=0x7fb4f40b5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:00.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.535+0000 7fb4f98a7640 1 -- 172.21.15.131:0/3627441925 shutdown_connections 2024-05-17T04:10:00.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.535+0000 7fb4f98a7640 1 -- 172.21.15.131:0/3627441925 wait complete. 2024-05-17T04:10:00.549 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-17T04:10:00.549 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-17T04:10:00.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.663+0000 7f18fab31640 1 Processor -- start 2024-05-17T04:10:00.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.663+0000 7f18fab31640 1 -- start start 2024-05-17T04:10:00.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.665+0000 7f18fab31640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f18f406cf80 0x7f18f406d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:00.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.665+0000 7f18fab31640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f406d8d0 con 0x7f18f4156030 2024-05-17T04:10:00.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.665+0000 7f18fab31640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f415c110 con 0x7f18f40b3df0 2024-05-17T04:10:00.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.665+0000 7f18fab31640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f18f415c3d0 con 0x7f18f406cf80 2024-05-17T04:10:00.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.665+0000 7f18ebfff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f18f406cf80 0x7f18f406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:00.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.665+0000 7f18f88cd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f18f4156030 0x7f18f40737e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46522/0 (socket says 172.21.15.131:46522) 2024-05-17T04:10:00.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.665+0000 7f18f88cd640 1 -- 172.21.15.131:0/3000154455 learned_addr learned my addr 172.21.15.131:0/3000154455 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:10:00.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.665+0000 7f18ebfff640 1 -- 172.21.15.131:0/3000154455 >> v1:172.21.15.150:6789/0 conn(0x7f18f40b3df0 legacy=0x7f18f40b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:00.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.665+0000 7f18ebfff640 1 -- 172.21.15.131:0/3000154455 >> v1:172.21.15.131:6789/0 conn(0x7f18f4156030 legacy=0x7f18f40737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:00.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.665+0000 7f18ebfff640 1 -- 172.21.15.131:0/3000154455 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f415c6b0 con 0x7f18f406cf80 2024-05-17T04:10:00.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.665+0000 7f18eb7fe640 1 -- 172.21.15.131:0/3000154455 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3240393514 0 0) 0x7f18f0001110 con 0x7f18f4156030 2024-05-17T04:10:00.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.666+0000 7f18ebfff640 1 --2- 172.21.15.131:0/3000154455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f406cf80 0x7f18f406d390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f18e40097d0 tx=0x7f18e402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d4c76ffb91560a server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:00.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.666+0000 7f18eb7fe640 1 -- 172.21.15.131:0/3000154455 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4037070 con 0x7f18f406cf80 2024-05-17T04:10:00.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.666+0000 7f18eb7fe640 1 -- 172.21.15.131:0/3000154455 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e402ae40 con 0x7f18f406cf80 2024-05-17T04:10:00.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.666+0000 7f18eb7fe640 1 -- 172.21.15.131:0/3000154455 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4032660 con 0x7f18f406cf80 2024-05-17T04:10:00.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.667+0000 7f18fab31640 1 -- 172.21.15.131:0/3000154455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f406cf80 msgr2=0x7f18f406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:00.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.667+0000 7f18fab31640 1 --2- 172.21.15.131:0/3000154455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f406cf80 0x7f18f406d390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f18e40097d0 tx=0x7f18e402a130 comp rx=0 tx=0).stop 2024-05-17T04:10:00.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.667+0000 7f18fab31640 1 -- 172.21.15.131:0/3000154455 shutdown_connections 2024-05-17T04:10:00.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.667+0000 7f18fab31640 1 --2- 172.21.15.131:0/3000154455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f406cf80 0x7f18f406d390 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.667+0000 7f18fab31640 1 -- 172.21.15.131:0/3000154455 >> 172.21.15.131:0/3000154455 conn(0x7f18f40d0dc0 msgr2=0x7f18f40d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:00.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.667+0000 7f18fab31640 1 -- 172.21.15.131:0/3000154455 shutdown_connections 2024-05-17T04:10:00.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.667+0000 7f18fab31640 1 -- 172.21.15.131:0/3000154455 wait complete. 2024-05-17T04:10:00.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.669+0000 7f18fab31640 1 Processor -- start 2024-05-17T04:10:00.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.669+0000 7f18fab31640 1 -- start start 2024-05-17T04:10:00.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18fab31640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f406cf80 0x7f18f4144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:00.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18fab31640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f40b3df0 0x7f18f4152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:00.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18fab31640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f4156030 0x7f18f40cf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:00.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18fab31640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f18f4160520 con 0x7f18f40b3df0 2024-05-17T04:10:00.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18fab31640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f18f415cc70 con 0x7f18f4156030 2024-05-17T04:10:00.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18fab31640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f18f4157a40 con 0x7f18f406cf80 2024-05-17T04:10:00.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18ebfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f40b3df0 0x7f18f4152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:00.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18ebfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f40b3df0 0x7f18f4152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46446/0 (socket says 172.21.15.131:46446) 2024-05-17T04:10:00.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18ebfff640 1 -- 172.21.15.131:0/1736570382 learned_addr learned my addr 172.21.15.131:0/1736570382 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18f88cd640 1 --2- 172.21.15.131:0/1736570382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f406cf80 0x7f18f4144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18ebfff640 1 -- 172.21.15.131:0/1736570382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f406cf80 msgr2=0x7f18f4144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18ebfff640 1 --2- 172.21.15.131:0/1736570382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f406cf80 0x7f18f4144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18ebfff640 1 -- 172.21.15.131:0/1736570382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f4156030 msgr2=0x7f18f40cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18f90ce640 1 --2- 172.21.15.131:0/1736570382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f4156030 0x7f18f40cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18ebfff640 1 --2- 172.21.15.131:0/1736570382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f4156030 0x7f18f40cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.670+0000 7f18ebfff640 1 -- 172.21.15.131:0/1736570382 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f4152780 con 0x7f18f40b3df0 2024-05-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.671+0000 7f18f88cd640 1 --2- 172.21.15.131:0/1736570382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f406cf80 0x7f18f4144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.671+0000 7f18ebfff640 1 --2- 172.21.15.131:0/1736570382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f40b3df0 0x7f18f4152240 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f18e40097d0 tx=0x7f18e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.671+0000 7f18e97fa640 1 -- 172.21.15.131:0/1736570382 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4037040 con 0x7f18f40b3df0 2024-05-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.671+0000 7f18e97fa640 1 -- 172.21.15.131:0/1736570382 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e4004030 con 0x7f18f40b3df0 2024-05-17T04:10:00.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.671+0000 7f18e97fa640 1 -- 172.21.15.131:0/1736570382 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4006e10 con 0x7f18f40b3df0 2024-05-17T04:10:00.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.671+0000 7f18fab31640 1 -- 172.21.15.131:0/1736570382 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f415ab70 con 0x7f18f40b3df0 2024-05-17T04:10:00.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.671+0000 7f18fab31640 1 -- 172.21.15.131:0/1736570382 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f415b130 con 0x7f18f40b3df0 2024-05-17T04:10:00.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.672+0000 7f18fab31640 1 -- 172.21.15.131:0/1736570382 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18f415a890 con 0x7f18f40b3df0 2024-05-17T04:10:00.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.673+0000 7f18e97fa640 1 -- 172.21.15.131:0/1736570382 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f18e403d650 con 0x7f18f40b3df0 2024-05-17T04:10:00.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.673+0000 7f18e97fa640 1 --2- 172.21.15.131:0/1736570382 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f18e0076300 0x7f18e0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:00.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.673+0000 7f18e97fa640 1 -- 172.21.15.131:0/1736570382 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f18e40b7fd0 con 0x7f18f40b3df0 2024-05-17T04:10:00.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.673+0000 7f18f88cd640 1 --2- 172.21.15.131:0/1736570382 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f18e0076300 0x7f18e0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:00.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.674+0000 7f18f88cd640 1 --2- 172.21.15.131:0/1736570382 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f18e0076300 0x7f18e0078810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f18f0000f60 tx=0x7f18f0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:00.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.678+0000 7f18e97fa640 1 -- 172.21.15.131:0/1736570382 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f18e4042020 con 0x7f18f40b3df0 2024-05-17T04:10:00.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.857+0000 7f18fab31640 1 -- 172.21.15.131:0/1736570382 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f18f406c940 con 0x7f18e0076300 2024-05-17T04:10:00.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.862+0000 7f18e97fa640 1 -- 172.21.15.131:0/1736570382 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251945 (secure 0 0 0) 0x7f18f406c940 con 0x7f18e0076300 2024-05-17T04:10:00.864 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:10:00.873 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-05-17T04:10:00.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.865+0000 7f18fab31640 1 -- 172.21.15.131:0/1736570382 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f18e0076300 msgr2=0x7f18e0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:00.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.865+0000 7f18fab31640 1 --2- 172.21.15.131:0/1736570382 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f18e0076300 0x7f18e0078810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f18f0000f60 tx=0x7f18f0009040 comp rx=0 tx=0).stop 2024-05-17T04:10:00.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.865+0000 7f18fab31640 1 -- 172.21.15.131:0/1736570382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f40b3df0 msgr2=0x7f18f4152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:00.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.865+0000 7f18fab31640 1 --2- 172.21.15.131:0/1736570382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f40b3df0 0x7f18f4152240 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f18e40097d0 tx=0x7f18e40046c0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.865+0000 7f18fab31640 1 -- 172.21.15.131:0/1736570382 shutdown_connections 2024-05-17T04:10:00.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.865+0000 7f18fab31640 1 --2- 172.21.15.131:0/1736570382 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f18e0076300 0x7f18e0078810 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.865+0000 7f18fab31640 1 --2- 172.21.15.131:0/1736570382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18f40b3df0 0x7f18f4152240 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.865+0000 7f18fab31640 1 --2- 172.21.15.131:0/1736570382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f4156030 0x7f18f40cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.865+0000 7f18fab31640 1 --2- 172.21.15.131:0/1736570382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f406cf80 0x7f18f4144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:00.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.865+0000 7f18fab31640 1 -- 172.21.15.131:0/1736570382 >> 172.21.15.131:0/1736570382 conn(0x7f18f40d0dc0 msgr2=0x7f18f4073990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:00.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.866+0000 7f18fab31640 1 -- 172.21.15.131:0/1736570382 shutdown_connections 2024-05-17T04:10:00.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:00.866+0000 7f18fab31640 1 -- 172.21.15.131:0/1736570382 wait complete. 2024-05-17T04:10:00.879 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-05-17T04:10:00.720064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220680,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754040,"statfs":{"total":773094113280,"available":772868136960,"internally_reserved":0,"allocated":4562944,"data_stored":2593324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.927740"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978708+0000","last_change":"2024-05-17T04:09:56.827214+0000","last_active":"2024-05-17T04:09:57.978708+0000","last_peered":"2024-05-17T04:09:57.978708+0000","last_clean":"2024-05-17T04:09:57.978708+0000","last_became_active":"2024-05-17T04:09:56.826487+0000","last_became_peered":"2024-05-17T04:09:56.826487+0000","last_unstale":"2024-05-17T04:09:57.978708+0000","last_undegraded":"2024-05-17T04:09:57.978708+0000","last_fullsized":"2024-05-17T04:09:57.978708+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:47:11.150860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978005+0000","last_change":"2024-05-17T04:09:56.829415+0000","last_active":"2024-05-17T04:09:57.978005+0000","last_peered":"2024-05-17T04:09:57.978005+0000","last_clean":"2024-05-17T04:09:57.978005+0000","last_became_active":"2024-05-17T04:09:56.828902+0000","last_became_peered":"2024-05-17T04:09:56.828902+0000","last_unstale":"2024-05-17T04:09:57.978005+0000","last_undegraded":"2024-05-17T04:09:57.978005+0000","last_fullsized":"2024-05-17T04:09:57.978005+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:20:04.060791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977374+0000","last_change":"2024-05-17T04:09:56.839790+0000","last_active":"2024-05-17T04:09:57.977374+0000","last_peered":"2024-05-17T04:09:57.977374+0000","last_clean":"2024-05-17T04:09:57.977374+0000","last_became_active":"2024-05-17T04:09:56.839486+0000","last_became_peered":"2024-05-17T04:09:56.839486+0000","last_unstale":"2024-05-17T04:09:57.977374+0000","last_undegraded":"2024-05-17T04:09:57.977374+0000","last_fullsized":"2024-05-17T04:09:57.977374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:05:56.736360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830734+0000","last_change":"2024-05-17T04:09:56.825989+0000","last_active":"2024-05-17T04:09:57.830734+0000","last_peered":"2024-05-17T04:09:57.830734+0000","last_clean":"2024-05-17T04:09:57.830734+0000","last_became_active":"2024-05-17T04:09:56.825603+0000","last_became_peered":"2024-05-17T04:09:56.825603+0000","last_unstale":"2024-05-17T04:09:57.830734+0000","last_undegraded":"2024-05-17T04:09:57.830734+0000","last_fullsized":"2024-05-17T04:09:57.830734+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:07:15.712823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830586+0000","last_change":"2024-05-17T04:09:56.821526+0000","last_active":"2024-05-17T04:09:57.830586+0000","last_peered":"2024-05-17T04:09:57.830586+0000","last_clean":"2024-05-17T04:09:57.830586+0000","last_became_active":"2024-05-17T04:09:56.821174+0000","last_became_peered":"2024-05-17T04:09:56.821174+0000","last_unstale":"2024-05-17T04:09:57.830586+0000","last_undegraded":"2024-05-17T04:09:57.830586+0000","last_fullsized":"2024-05-17T04:09:57.830586+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:28:27.612300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977345+0000","last_change":"2024-05-17T04:09:56.841371+0000","last_active":"2024-05-17T04:09:57.977345+0000","last_peered":"2024-05-17T04:09:57.977345+0000","last_clean":"2024-05-17T04:09:57.977345+0000","last_became_active":"2024-05-17T04:09:56.839665+0000","last_became_peered":"2024-05-17T04:09:56.839665+0000","last_unstale":"2024-05-17T04:09:57.977345+0000","last_undegraded":"2024-05-17T04:09:57.977345+0000","last_fullsized":"2024-05-17T04:09:57.977345+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:27:11.379666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978146+0000","last_change":"2024-05-17T04:09:56.831598+0000","last_active":"2024-05-17T04:09:57.978146+0000","last_peered":"2024-05-17T04:09:57.978146+0000","last_clean":"2024-05-17T04:09:57.978146+0000","last_became_active":"2024-05-17T04:09:56.831236+0000","last_became_peered":"2024-05-17T04:09:56.831236+0000","last_unstale":"2024-05-17T04:09:57.978146+0000","last_undegraded":"2024-05-17T04:09:57.978146+0000","last_fullsized":"2024-05-17T04:09:57.978146+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:38:40.807197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977646+0000","last_change":"2024-05-17T04:09:56.825511+0000","last_active":"2024-05-17T04:09:57.977646+0000","last_peered":"2024-05-17T04:09:57.977646+0000","last_clean":"2024-05-17T04:09:57.977646+0000","last_became_active":"2024-05-17T04:09:56.825187+0000","last_became_peered":"2024-05-17T04:09:56.825187+0000","last_unstale":"2024-05-17T04:09:57.977646+0000","last_undegraded":"2024-05-17T04:09:57.977646+0000","last_fullsized":"2024-05-17T04:09:57.977646+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:07:03.374460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977839+0000","last_change":"2024-05-17T04:09:56.824645+0000","last_active":"2024-05-17T04:09:57.977839+0000","last_peered":"2024-05-17T04:09:57.977839+0000","last_clean":"2024-05-17T04:09:57.977839+0000","last_became_active":"2024-05-17T04:09:56.824337+0000","last_became_peered":"2024-05-17T04:09:56.824337+0000","last_unstale":"2024-05-17T04:09:57.977839+0000","last_undegraded":"2024-05-17T04:09:57.977839+0000","last_fullsized":"2024-05-17T04:09:57.977839+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:29:03.731516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979253+0000","last_change":"2024-05-17T04:09:56.833198+0000","last_active":"2024-05-17T04:09:57.979253+0000","last_peered":"2024-05-17T04:09:57.979253+0000","last_clean":"2024-05-17T04:09:57.979253+0000","last_became_active":"2024-05-17T04:09:56.832883+0000","last_became_peered":"2024-05-17T04:09:56.832883+0000","last_unstale":"2024-05-17T04:09:57.979253+0000","last_undegraded":"2024-05-17T04:09:57.979253+0000","last_fullsized":"2024-05-17T04:09:57.979253+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:50:36.421863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979063+0000","last_change":"2024-05-17T04:09:56.825380+0000","last_active":"2024-05-17T04:09:57.979063+0000","last_peered":"2024-05-17T04:09:57.979063+0000","last_clean":"2024-05-17T04:09:57.979063+0000","last_became_active":"2024-05-17T04:09:56.825032+0000","last_became_peered":"2024-05-17T04:09:56.825032+0000","last_unstale":"2024-05-17T04:09:57.979063+0000","last_undegraded":"2024-05-17T04:09:57.979063+0000","last_fullsized":"2024-05-17T04:09:57.979063+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:01:18.400546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977647+0000","last_change":"2024-05-17T04:09:56.826804+0000","last_active":"2024-05-17T04:09:57.977647+0000","last_peered":"2024-05-17T04:09:57.977647+0000","last_clean":"2024-05-17T04:09:57.977647+0000","last_became_active":"2024-05-17T04:09:56.826477+0000","last_became_peered":"2024-05-17T04:09:56.826477+0000","last_unstale":"2024-05-17T04:09:57.977647+0000","last_undegraded":"2024-05-17T04:09:57.977647+0000","last_fullsized":"2024-05-17T04:09:57.977647+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T15:55:45.396403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978803+0000","last_change":"2024-05-17T04:09:56.833279+0000","last_active":"2024-05-17T04:09:57.978803+0000","last_peered":"2024-05-17T04:09:57.978803+0000","last_clean":"2024-05-17T04:09:57.978803+0000","last_became_active":"2024-05-17T04:09:56.832947+0000","last_became_peered":"2024-05-17T04:09:56.832947+0000","last_unstale":"2024-05-17T04:09:57.978803+0000","last_undegraded":"2024-05-17T04:09:57.978803+0000","last_fullsized":"2024-05-17T04:09:57.978803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:46.641376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.827902+0000","last_change":"2024-05-17T04:09:56.830066+0000","last_active":"2024-05-17T04:09:57.827902+0000","last_peered":"2024-05-17T04:09:57.827902+0000","last_clean":"2024-05-17T04:09:57.827902+0000","last_became_active":"2024-05-17T04:09:56.829732+0000","last_became_peered":"2024-05-17T04:09:56.829732+0000","last_unstale":"2024-05-17T04:09:57.827902+0000","last_undegraded":"2024-05-17T04:09:57.827902+0000","last_fullsized":"2024-05-17T04:09:57.827902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:27:11.379666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978207+0000","last_change":"2024-05-17T04:09:56.830275+0000","last_active":"2024-05-17T04:09:57.978207+0000","last_peered":"2024-05-17T04:09:57.978207+0000","last_clean":"2024-05-17T04:09:57.978207+0000","last_became_active":"2024-05-17T04:09:56.829515+0000","last_became_peered":"2024-05-17T04:09:56.829515+0000","last_unstale":"2024-05-17T04:09:57.978207+0000","last_undegraded":"2024-05-17T04:09:57.978207+0000","last_fullsized":"2024-05-17T04:09:57.978207+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:07:03.374460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978066+0000","last_change":"2024-05-17T04:09:56.835764+0000","last_active":"2024-05-17T04:09:57.978066+0000","last_peered":"2024-05-17T04:09:57.978066+0000","last_clean":"2024-05-17T04:09:57.978066+0000","last_became_active":"2024-05-17T04:09:56.835081+0000","last_became_peered":"2024-05-17T04:09:56.835081+0000","last_unstale":"2024-05-17T04:09:57.978066+0000","last_undegraded":"2024-05-17T04:09:57.978066+0000","last_fullsized":"2024-05-17T04:09:57.978066+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:09:24.677580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978724+0000","last_change":"2024-05-17T04:09:56.842209+0000","last_active":"2024-05-17T04:09:57.978724+0000","last_peered":"2024-05-17T04:09:57.978724+0000","last_clean":"2024-05-17T04:09:57.978724+0000","last_became_active":"2024-05-17T04:09:56.841876+0000","last_became_peered":"2024-05-17T04:09:56.841876+0000","last_unstale":"2024-05-17T04:09:57.978724+0000","last_undegraded":"2024-05-17T04:09:57.978724+0000","last_fullsized":"2024-05-17T04:09:57.978724+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:38:40.807197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.827951+0000","last_change":"2024-05-17T04:09:56.833456+0000","last_active":"2024-05-17T04:09:57.827951+0000","last_peered":"2024-05-17T04:09:57.827951+0000","last_clean":"2024-05-17T04:09:57.827951+0000","last_became_active":"2024-05-17T04:09:56.832947+0000","last_became_peered":"2024-05-17T04:09:56.832947+0000","last_unstale":"2024-05-17T04:09:57.827951+0000","last_undegraded":"2024-05-17T04:09:57.827951+0000","last_fullsized":"2024-05-17T04:09:57.827951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:23:42.611545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830911+0000","last_change":"2024-05-17T04:09:56.843492+0000","last_active":"2024-05-17T04:09:57.830911+0000","last_peered":"2024-05-17T04:09:57.830911+0000","last_clean":"2024-05-17T04:09:57.830911+0000","last_became_active":"2024-05-17T04:09:56.843149+0000","last_became_peered":"2024-05-17T04:09:56.843149+0000","last_unstale":"2024-05-17T04:09:57.830911+0000","last_undegraded":"2024-05-17T04:09:57.830911+0000","last_fullsized":"2024-05-17T04:09:57.830911+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:26:48.819432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828141+0000","last_change":"2024-05-17T04:09:56.832063+0000","last_active":"2024-05-17T04:09:57.828141+0000","last_peered":"2024-05-17T04:09:57.828141+0000","last_clean":"2024-05-17T04:09:57.828141+0000","last_became_active":"2024-05-17T04:09:56.831756+0000","last_became_peered":"2024-05-17T04:09:56.831756+0000","last_unstale":"2024-05-17T04:09:57.828141+0000","last_undegraded":"2024-05-17T04:09:57.828141+0000","last_fullsized":"2024-05-17T04:09:57.828141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:04:06.160726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978994+0000","last_change":"2024-05-17T04:09:56.838628+0000","last_active":"2024-05-17T04:09:57.978994+0000","last_peered":"2024-05-17T04:09:57.978994+0000","last_clean":"2024-05-17T04:09:57.978994+0000","last_became_active":"2024-05-17T04:09:56.838308+0000","last_became_peered":"2024-05-17T04:09:56.838308+0000","last_unstale":"2024-05-17T04:09:57.978994+0000","last_undegraded":"2024-05-17T04:09:57.978994+0000","last_fullsized":"2024-05-17T04:09:57.978994+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:46:26.786323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828347+0000","last_change":"2024-05-17T04:09:56.831614+0000","last_active":"2024-05-17T04:09:57.828347+0000","last_peered":"2024-05-17T04:09:57.828347+0000","last_clean":"2024-05-17T04:09:57.828347+0000","last_became_active":"2024-05-17T04:09:56.830404+0000","last_became_peered":"2024-05-17T04:09:56.830404+0000","last_unstale":"2024-05-17T04:09:57.828347+0000","last_undegraded":"2024-05-17T04:09:57.828347+0000","last_fullsized":"2024-05-17T04:09:57.828347+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:22:46.067823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978993+0000","last_change":"2024-05-17T04:09:56.835964+0000","last_active":"2024-05-17T04:09:57.978993+0000","last_peered":"2024-05-17T04:09:57.978993+0000","last_clean":"2024-05-17T04:09:57.978993+0000","last_became_active":"2024-05-17T04:09:56.835213+0000","last_became_peered":"2024-05-17T04:09:56.835213+0000","last_unstale":"2024-05-17T04:09:57.978993+0000","last_undegraded":"2024-05-17T04:09:57.978993+0000","last_fullsized":"2024-05-17T04:09:57.978993+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:07:03.374460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830767+0000","last_change":"2024-05-17T04:09:56.840796+0000","last_active":"2024-05-17T04:09:57.830767+0000","last_peered":"2024-05-17T04:09:57.830767+0000","last_clean":"2024-05-17T04:09:57.830767+0000","last_became_active":"2024-05-17T04:09:56.840243+0000","last_became_peered":"2024-05-17T04:09:56.840243+0000","last_unstale":"2024-05-17T04:09:57.830767+0000","last_undegraded":"2024-05-17T04:09:57.830767+0000","last_fullsized":"2024-05-17T04:09:57.830767+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:12:39.058727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828529+0000","last_change":"2024-05-17T04:09:56.827955+0000","last_active":"2024-05-17T04:09:57.828529+0000","last_peered":"2024-05-17T04:09:57.828529+0000","last_clean":"2024-05-17T04:09:57.828529+0000","last_became_active":"2024-05-17T04:09:56.827614+0000","last_became_peered":"2024-05-17T04:09:56.827614+0000","last_unstale":"2024-05-17T04:09:57.828529+0000","last_undegraded":"2024-05-17T04:09:57.828529+0000","last_fullsized":"2024-05-17T04:09:57.828529+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:27:11.379666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978424+0000","last_change":"2024-05-17T04:09:56.843755+0000","last_active":"2024-05-17T04:09:57.978424+0000","last_peered":"2024-05-17T04:09:57.978424+0000","last_clean":"2024-05-17T04:09:57.978424+0000","last_became_active":"2024-05-17T04:09:56.843458+0000","last_became_peered":"2024-05-17T04:09:56.843458+0000","last_unstale":"2024-05-17T04:09:57.978424+0000","last_undegraded":"2024-05-17T04:09:57.978424+0000","last_fullsized":"2024-05-17T04:09:57.978424+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:05:56.736360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828240+0000","last_change":"2024-05-17T04:09:56.836273+0000","last_active":"2024-05-17T04:09:57.828240+0000","last_peered":"2024-05-17T04:09:57.828240+0000","last_clean":"2024-05-17T04:09:57.828240+0000","last_became_active":"2024-05-17T04:09:56.835937+0000","last_became_peered":"2024-05-17T04:09:56.835937+0000","last_unstale":"2024-05-17T04:09:57.828240+0000","last_undegraded":"2024-05-17T04:09:57.828240+0000","last_fullsized":"2024-05-17T04:09:57.828240+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:59:52.445933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979236+0000","last_change":"2024-05-17T04:09:56.832537+0000","last_active":"2024-05-17T04:09:57.979236+0000","last_peered":"2024-05-17T04:09:57.979236+0000","last_clean":"2024-05-17T04:09:57.979236+0000","last_became_active":"2024-05-17T04:09:56.832043+0000","last_became_peered":"2024-05-17T04:09:56.832043+0000","last_unstale":"2024-05-17T04:09:57.979236+0000","last_undegraded":"2024-05-17T04:09:57.979236+0000","last_fullsized":"2024-05-17T04:09:57.979236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:01:33.323140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828047+0000","last_change":"2024-05-17T04:09:56.842305+0000","last_active":"2024-05-17T04:09:57.828047+0000","last_peered":"2024-05-17T04:09:57.828047+0000","last_clean":"2024-05-17T04:09:57.828047+0000","last_became_active":"2024-05-17T04:09:56.841368+0000","last_became_peered":"2024-05-17T04:09:56.841368+0000","last_unstale":"2024-05-17T04:09:57.828047+0000","last_undegraded":"2024-05-17T04:09:57.828047+0000","last_fullsized":"2024-05-17T04:09:57.828047+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:04:00.178469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828182+0000","last_change":"2024-05-17T04:09:56.835421+0000","last_active":"2024-05-17T04:09:57.828182+0000","last_peered":"2024-05-17T04:09:57.828182+0000","last_clean":"2024-05-17T04:09:57.828182+0000","last_became_active":"2024-05-17T04:09:56.835091+0000","last_became_peered":"2024-05-17T04:09:56.835091+0000","last_unstale":"2024-05-17T04:09:57.828182+0000","last_undegraded":"2024-05-17T04:09:57.828182+0000","last_fullsized":"2024-05-17T04:09:57.828182+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:19:17.078008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978517+0000","last_change":"2024-05-17T04:09:56.836391+0000","last_active":"2024-05-17T04:09:57.978517+0000","last_peered":"2024-05-17T04:09:57.978517+0000","last_clean":"2024-05-17T04:09:57.978517+0000","last_became_active":"2024-05-17T04:09:56.835618+0000","last_became_peered":"2024-05-17T04:09:56.835618+0000","last_unstale":"2024-05-17T04:09:57.978517+0000","last_undegraded":"2024-05-17T04:09:57.978517+0000","last_fullsized":"2024-05-17T04:09:57.978517+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:48:31.553971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977640+0000","last_change":"2024-05-17T04:09:56.835457+0000","last_active":"2024-05-17T04:09:57.977640+0000","last_peered":"2024-05-17T04:09:57.977640+0000","last_clean":"2024-05-17T04:09:57.977640+0000","last_became_active":"2024-05-17T04:09:56.835144+0000","last_became_peered":"2024-05-17T04:09:56.835144+0000","last_unstale":"2024-05-17T04:09:57.977640+0000","last_undegraded":"2024-05-17T04:09:57.977640+0000","last_fullsized":"2024-05-17T04:09:57.977640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:38:36.051847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978342+0000","last_change":"2024-05-17T04:09:56.838638+0000","last_active":"2024-05-17T04:09:57.978342+0000","last_peered":"2024-05-17T04:09:57.978342+0000","last_clean":"2024-05-17T04:09:57.978342+0000","last_became_active":"2024-05-17T04:09:56.838318+0000","last_became_peered":"2024-05-17T04:09:56.838318+0000","last_unstale":"2024-05-17T04:09:57.978342+0000","last_undegraded":"2024-05-17T04:09:57.978342+0000","last_fullsized":"2024-05-17T04:09:57.978342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:21:59.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828673+0000","last_change":"2024-05-17T04:09:55.818935+0000","last_active":"2024-05-17T04:09:57.828673+0000","last_peered":"2024-05-17T04:09:57.828673+0000","last_clean":"2024-05-17T04:09:57.828673+0000","last_became_active":"2024-05-17T04:09:55.818624+0000","last_became_peered":"2024-05-17T04:09:55.818624+0000","last_unstale":"2024-05-17T04:09:57.828673+0000","last_undegraded":"2024-05-17T04:09:57.828673+0000","last_fullsized":"2024-05-17T04:09:57.828673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:26:47.814637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978150+0000","last_change":"2024-05-17T04:09:56.848583+0000","last_active":"2024-05-17T04:09:57.978150+0000","last_peered":"2024-05-17T04:09:57.978150+0000","last_clean":"2024-05-17T04:09:57.978150+0000","last_became_active":"2024-05-17T04:09:56.848314+0000","last_became_peered":"2024-05-17T04:09:56.848314+0000","last_unstale":"2024-05-17T04:09:57.978150+0000","last_undegraded":"2024-05-17T04:09:57.978150+0000","last_fullsized":"2024-05-17T04:09:57.978150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:22:46.067823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977953+0000","last_change":"2024-05-17T04:09:55.821047+0000","last_active":"2024-05-17T04:09:57.977953+0000","last_peered":"2024-05-17T04:09:57.977953+0000","last_clean":"2024-05-17T04:09:57.977953+0000","last_became_active":"2024-05-17T04:09:55.820759+0000","last_became_peered":"2024-05-17T04:09:55.820759+0000","last_unstale":"2024-05-17T04:09:57.977953+0000","last_undegraded":"2024-05-17T04:09:57.977953+0000","last_fullsized":"2024-05-17T04:09:57.977953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:29:44.829522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.829362+0000","last_change":"2024-05-17T04:09:56.828152+0000","last_active":"2024-05-17T04:09:57.829362+0000","last_peered":"2024-05-17T04:09:57.829362+0000","last_clean":"2024-05-17T04:09:57.829362+0000","last_became_active":"2024-05-17T04:09:56.827843+0000","last_became_peered":"2024-05-17T04:09:56.827843+0000","last_unstale":"2024-05-17T04:09:57.829362+0000","last_undegraded":"2024-05-17T04:09:57.829362+0000","last_fullsized":"2024-05-17T04:09:57.829362+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:09:24.677580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978514+0000","last_change":"2024-05-17T04:09:55.820006+0000","last_active":"2024-05-17T04:09:57.978514+0000","last_peered":"2024-05-17T04:09:57.978514+0000","last_clean":"2024-05-17T04:09:57.978514+0000","last_became_active":"2024-05-17T04:09:55.819684+0000","last_became_peered":"2024-05-17T04:09:55.819684+0000","last_unstale":"2024-05-17T04:09:57.978514+0000","last_undegraded":"2024-05-17T04:09:57.978514+0000","last_fullsized":"2024-05-17T04:09:57.978514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:55:32.614756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978632+0000","last_change":"2024-05-17T04:09:56.827539+0000","last_active":"2024-05-17T04:09:57.978632+0000","last_peered":"2024-05-17T04:09:57.978632+0000","last_clean":"2024-05-17T04:09:57.978632+0000","last_became_active":"2024-05-17T04:09:56.826878+0000","last_became_peered":"2024-05-17T04:09:56.826878+0000","last_unstale":"2024-05-17T04:09:57.978632+0000","last_undegraded":"2024-05-17T04:09:57.978632+0000","last_fullsized":"2024-05-17T04:09:57.978632+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:50:36.421863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.829169+0000","last_change":"2024-05-17T04:09:55.803088+0000","last_active":"2024-05-17T04:09:57.829169+0000","last_peered":"2024-05-17T04:09:57.829169+0000","last_clean":"2024-05-17T04:09:57.829169+0000","last_became_active":"2024-05-17T04:09:55.802751+0000","last_became_peered":"2024-05-17T04:09:55.802751+0000","last_unstale":"2024-05-17T04:09:57.829169+0000","last_undegraded":"2024-05-17T04:09:57.829169+0000","last_fullsized":"2024-05-17T04:09:57.829169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:59:12.808353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977185+0000","last_change":"2024-05-17T04:09:56.825507+0000","last_active":"2024-05-17T04:09:57.977185+0000","last_peered":"2024-05-17T04:09:57.977185+0000","last_clean":"2024-05-17T04:09:57.977185+0000","last_became_active":"2024-05-17T04:09:56.825175+0000","last_became_peered":"2024-05-17T04:09:56.825175+0000","last_unstale":"2024-05-17T04:09:57.977185+0000","last_undegraded":"2024-05-17T04:09:57.977185+0000","last_fullsized":"2024-05-17T04:09:57.977185+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:22:46.067823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978959+0000","last_change":"2024-05-17T04:09:55.819632+0000","last_active":"2024-05-17T04:09:57.978959+0000","last_peered":"2024-05-17T04:09:57.978959+0000","last_clean":"2024-05-17T04:09:57.978959+0000","last_became_active":"2024-05-17T04:09:55.819271+0000","last_became_peered":"2024-05-17T04:09:55.819271+0000","last_unstale":"2024-05-17T04:09:57.978959+0000","last_undegraded":"2024-05-17T04:09:57.978959+0000","last_fullsized":"2024-05-17T04:09:57.978959+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:59:51.441138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978328+0000","last_change":"2024-05-17T04:09:56.843043+0000","last_active":"2024-05-17T04:09:57.978328+0000","last_peered":"2024-05-17T04:09:57.978328+0000","last_clean":"2024-05-17T04:09:57.978328+0000","last_became_active":"2024-05-17T04:09:56.842622+0000","last_became_peered":"2024-05-17T04:09:56.842622+0000","last_unstale":"2024-05-17T04:09:57.978328+0000","last_undegraded":"2024-05-17T04:09:57.978328+0000","last_fullsized":"2024-05-17T04:09:57.978328+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:29:33.758722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978085+0000","last_change":"2024-05-17T04:09:55.815834+0000","last_active":"2024-05-17T04:09:57.978085+0000","last_peered":"2024-05-17T04:09:57.978085+0000","last_clean":"2024-05-17T04:09:57.978085+0000","last_became_active":"2024-05-17T04:09:55.814885+0000","last_became_peered":"2024-05-17T04:09:55.814885+0000","last_unstale":"2024-05-17T04:09:57.978085+0000","last_undegraded":"2024-05-17T04:09:57.978085+0000","last_fullsized":"2024-05-17T04:09:57.978085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:29:44.829522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828310+0000","last_change":"2024-05-17T04:09:56.825054+0000","last_active":"2024-05-17T04:09:57.828310+0000","last_peered":"2024-05-17T04:09:57.828310+0000","last_clean":"2024-05-17T04:09:57.828310+0000","last_became_active":"2024-05-17T04:09:56.824266+0000","last_became_peered":"2024-05-17T04:09:56.824266+0000","last_unstale":"2024-05-17T04:09:57.828310+0000","last_undegraded":"2024-05-17T04:09:57.828310+0000","last_fullsized":"2024-05-17T04:09:57.828310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:43:51.560581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978291+0000","last_change":"2024-05-17T04:09:55.820732+0000","last_active":"2024-05-17T04:09:57.978291+0000","last_peered":"2024-05-17T04:09:57.978291+0000","last_clean":"2024-05-17T04:09:57.978291+0000","last_became_active":"2024-05-17T04:09:55.820445+0000","last_became_peered":"2024-05-17T04:09:55.820445+0000","last_unstale":"2024-05-17T04:09:57.978291+0000","last_undegraded":"2024-05-17T04:09:57.978291+0000","last_fullsized":"2024-05-17T04:09:57.978291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:01:41.468780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978201+0000","last_change":"2024-05-17T04:09:56.835846+0000","last_active":"2024-05-17T04:09:57.978201+0000","last_peered":"2024-05-17T04:09:57.978201+0000","last_clean":"2024-05-17T04:09:57.978201+0000","last_became_active":"2024-05-17T04:09:56.835477+0000","last_became_peered":"2024-05-17T04:09:56.835477+0000","last_unstale":"2024-05-17T04:09:57.978201+0000","last_undegraded":"2024-05-17T04:09:57.978201+0000","last_fullsized":"2024-05-17T04:09:57.978201+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:01:18.400546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.827717+0000","last_change":"2024-05-17T04:09:55.810472+0000","last_active":"2024-05-17T04:09:57.827717+0000","last_peered":"2024-05-17T04:09:57.827717+0000","last_clean":"2024-05-17T04:09:57.827717+0000","last_became_active":"2024-05-17T04:09:55.810163+0000","last_became_peered":"2024-05-17T04:09:55.810163+0000","last_unstale":"2024-05-17T04:09:57.827717+0000","last_undegraded":"2024-05-17T04:09:57.827717+0000","last_fullsized":"2024-05-17T04:09:57.827717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:51:09.126771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830738+0000","last_change":"2024-05-17T04:09:56.822558+0000","last_active":"2024-05-17T04:09:57.830738+0000","last_peered":"2024-05-17T04:09:57.830738+0000","last_clean":"2024-05-17T04:09:57.830738+0000","last_became_active":"2024-05-17T04:09:56.822225+0000","last_became_peered":"2024-05-17T04:09:56.822225+0000","last_unstale":"2024-05-17T04:09:57.830738+0000","last_undegraded":"2024-05-17T04:09:57.830738+0000","last_fullsized":"2024-05-17T04:09:57.830738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:51:19.045405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978750+0000","last_change":"2024-05-17T04:09:55.816188+0000","last_active":"2024-05-17T04:09:57.978750+0000","last_peered":"2024-05-17T04:09:57.978750+0000","last_clean":"2024-05-17T04:09:57.978750+0000","last_became_active":"2024-05-17T04:09:55.815864+0000","last_became_peered":"2024-05-17T04:09:55.815864+0000","last_unstale":"2024-05-17T04:09:57.978750+0000","last_undegraded":"2024-05-17T04:09:57.978750+0000","last_fullsized":"2024-05-17T04:09:57.978750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:32:09.495723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978308+0000","last_change":"2024-05-17T04:09:56.830612+0000","last_active":"2024-05-17T04:09:57.978308+0000","last_peered":"2024-05-17T04:09:57.978308+0000","last_clean":"2024-05-17T04:09:57.978308+0000","last_became_active":"2024-05-17T04:09:56.830260+0000","last_became_peered":"2024-05-17T04:09:56.830260+0000","last_unstale":"2024-05-17T04:09:57.978308+0000","last_undegraded":"2024-05-17T04:09:57.978308+0000","last_fullsized":"2024-05-17T04:09:57.978308+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:29:03.731516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979390+0000","last_change":"2024-05-17T04:09:55.813554+0000","last_active":"2024-05-17T04:09:57.979390+0000","last_peered":"2024-05-17T04:09:57.979390+0000","last_clean":"2024-05-17T04:09:57.979390+0000","last_became_active":"2024-05-17T04:09:55.813157+0000","last_became_peered":"2024-05-17T04:09:55.813157+0000","last_unstale":"2024-05-17T04:09:57.979390+0000","last_undegraded":"2024-05-17T04:09:57.979390+0000","last_fullsized":"2024-05-17T04:09:57.979390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:27:10.374871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977840+0000","last_change":"2024-05-17T04:09:56.834168+0000","last_active":"2024-05-17T04:09:57.977840+0000","last_peered":"2024-05-17T04:09:57.977840+0000","last_clean":"2024-05-17T04:09:57.977840+0000","last_became_active":"2024-05-17T04:09:56.833861+0000","last_became_peered":"2024-05-17T04:09:56.833861+0000","last_unstale":"2024-05-17T04:09:57.977840+0000","last_undegraded":"2024-05-17T04:09:57.977840+0000","last_fullsized":"2024-05-17T04:09:57.977840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:21:59.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979202+0000","last_change":"2024-05-17T04:09:55.819860+0000","last_active":"2024-05-17T04:09:57.979202+0000","last_peered":"2024-05-17T04:09:57.979202+0000","last_clean":"2024-05-17T04:09:57.979202+0000","last_became_active":"2024-05-17T04:09:55.819443+0000","last_became_peered":"2024-05-17T04:09:55.819443+0000","last_unstale":"2024-05-17T04:09:57.979202+0000","last_undegraded":"2024-05-17T04:09:57.979202+0000","last_fullsized":"2024-05-17T04:09:57.979202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:19:16.073212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.829287+0000","last_change":"2024-05-17T04:09:56.828134+0000","last_active":"2024-05-17T04:09:57.829287+0000","last_peered":"2024-05-17T04:09:57.829287+0000","last_clean":"2024-05-17T04:09:57.829287+0000","last_became_active":"2024-05-17T04:09:56.827447+0000","last_became_peered":"2024-05-17T04:09:56.827447+0000","last_unstale":"2024-05-17T04:09:57.829287+0000","last_undegraded":"2024-05-17T04:09:57.829287+0000","last_fullsized":"2024-05-17T04:09:57.829287+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:05:56.736360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977848+0000","last_change":"2024-05-17T04:09:55.809191+0000","last_active":"2024-05-17T04:09:57.977848+0000","last_peered":"2024-05-17T04:09:57.977848+0000","last_clean":"2024-05-17T04:09:57.977848+0000","last_became_active":"2024-05-17T04:09:55.808844+0000","last_became_peered":"2024-05-17T04:09:55.808844+0000","last_unstale":"2024-05-17T04:09:57.977848+0000","last_undegraded":"2024-05-17T04:09:57.977848+0000","last_fullsized":"2024-05-17T04:09:57.977848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:22:45.063028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977183+0000","last_change":"2024-05-17T04:09:56.838875+0000","last_active":"2024-05-17T04:09:57.977183+0000","last_peered":"2024-05-17T04:09:57.977183+0000","last_clean":"2024-05-17T04:09:57.977183+0000","last_became_active":"2024-05-17T04:09:56.838541+0000","last_became_peered":"2024-05-17T04:09:56.838541+0000","last_unstale":"2024-05-17T04:09:57.977183+0000","last_undegraded":"2024-05-17T04:09:57.977183+0000","last_fullsized":"2024-05-17T04:09:57.977183+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:43:51.560581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978499+0000","last_change":"2024-05-17T04:09:55.813738+0000","last_active":"2024-05-17T04:09:57.978499+0000","last_peered":"2024-05-17T04:09:57.978499+0000","last_clean":"2024-05-17T04:09:57.978499+0000","last_became_active":"2024-05-17T04:09:55.813395+0000","last_became_peered":"2024-05-17T04:09:55.813395+0000","last_unstale":"2024-05-17T04:09:57.978499+0000","last_undegraded":"2024-05-17T04:09:57.978499+0000","last_fullsized":"2024-05-17T04:09:57.978499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:43:50.555786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978166+0000","last_change":"2024-05-17T04:09:56.823839+0000","last_active":"2024-05-17T04:09:57.978166+0000","last_peered":"2024-05-17T04:09:57.978166+0000","last_clean":"2024-05-17T04:09:57.978166+0000","last_became_active":"2024-05-17T04:09:56.823497+0000","last_became_peered":"2024-05-17T04:09:56.823497+0000","last_unstale":"2024-05-17T04:09:57.978166+0000","last_undegraded":"2024-05-17T04:09:57.978166+0000","last_fullsized":"2024-05-17T04:09:57.978166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:46.641376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977380+0000","last_change":"2024-05-17T04:09:55.819468+0000","last_active":"2024-05-17T04:09:57.977380+0000","last_peered":"2024-05-17T04:09:57.977380+0000","last_clean":"2024-05-17T04:09:57.977380+0000","last_became_active":"2024-05-17T04:09:55.819137+0000","last_became_peered":"2024-05-17T04:09:55.819137+0000","last_unstale":"2024-05-17T04:09:57.977380+0000","last_undegraded":"2024-05-17T04:09:57.977380+0000","last_fullsized":"2024-05-17T04:09:57.977380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:29:44.829522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978228+0000","last_change":"2024-05-17T04:09:56.838101+0000","last_active":"2024-05-17T04:09:57.978228+0000","last_peered":"2024-05-17T04:09:57.978228+0000","last_clean":"2024-05-17T04:09:57.978228+0000","last_became_active":"2024-05-17T04:09:56.834695+0000","last_became_peered":"2024-05-17T04:09:56.834695+0000","last_unstale":"2024-05-17T04:09:57.978228+0000","last_undegraded":"2024-05-17T04:09:57.978228+0000","last_fullsized":"2024-05-17T04:09:57.978228+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T15:55:45.396403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.827828+0000","last_change":"2024-05-17T04:09:55.816322+0000","last_active":"2024-05-17T04:09:57.827828+0000","last_peered":"2024-05-17T04:09:57.827828+0000","last_clean":"2024-05-17T04:09:57.827828+0000","last_became_active":"2024-05-17T04:09:55.814342+0000","last_became_peered":"2024-05-17T04:09:55.814342+0000","last_unstale":"2024-05-17T04:09:57.827828+0000","last_undegraded":"2024-05-17T04:09:57.827828+0000","last_fullsized":"2024-05-17T04:09:57.827828+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:51:18.040610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978376+0000","last_change":"2024-05-17T04:09:56.828470+0000","last_active":"2024-05-17T04:09:57.978376+0000","last_peered":"2024-05-17T04:09:57.978376+0000","last_clean":"2024-05-17T04:09:57.978376+0000","last_became_active":"2024-05-17T04:09:56.828098+0000","last_became_peered":"2024-05-17T04:09:56.828098+0000","last_unstale":"2024-05-17T04:09:57.978376+0000","last_undegraded":"2024-05-17T04:09:57.978376+0000","last_fullsized":"2024-05-17T04:09:57.978376+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:01:33.323140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978418+0000","last_change":"2024-05-17T04:09:55.818372+0000","last_active":"2024-05-17T04:09:57.978418+0000","last_peered":"2024-05-17T04:09:57.978418+0000","last_clean":"2024-05-17T04:09:57.978418+0000","last_became_active":"2024-05-17T04:09:55.818044+0000","last_became_peered":"2024-05-17T04:09:55.818044+0000","last_unstale":"2024-05-17T04:09:57.978418+0000","last_undegraded":"2024-05-17T04:09:57.978418+0000","last_fullsized":"2024-05-17T04:09:57.978418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:08:21.444990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977661+0000","last_change":"2024-05-17T04:09:56.828516+0000","last_active":"2024-05-17T04:09:57.977661+0000","last_peered":"2024-05-17T04:09:57.977661+0000","last_clean":"2024-05-17T04:09:57.977661+0000","last_became_active":"2024-05-17T04:09:56.828173+0000","last_became_peered":"2024-05-17T04:09:56.828173+0000","last_unstale":"2024-05-17T04:09:57.977661+0000","last_undegraded":"2024-05-17T04:09:57.977661+0000","last_fullsized":"2024-05-17T04:09:57.977661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:29:33.758722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979370+0000","last_change":"2024-05-17T04:09:55.820473+0000","last_active":"2024-05-17T04:09:57.979370+0000","last_peered":"2024-05-17T04:09:57.979370+0000","last_clean":"2024-05-17T04:09:57.979370+0000","last_became_active":"2024-05-17T04:09:55.819912+0000","last_became_peered":"2024-05-17T04:09:55.819912+0000","last_unstale":"2024-05-17T04:09:57.979370+0000","last_undegraded":"2024-05-17T04:09:57.979370+0000","last_fullsized":"2024-05-17T04:09:57.979370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:38:35.047051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979246+0000","last_change":"2024-05-17T04:09:56.843825+0000","last_active":"2024-05-17T04:09:57.979246+0000","last_peered":"2024-05-17T04:09:57.979246+0000","last_clean":"2024-05-17T04:09:57.979246+0000","last_became_active":"2024-05-17T04:09:56.843379+0000","last_became_peered":"2024-05-17T04:09:56.843379+0000","last_unstale":"2024-05-17T04:09:57.979246+0000","last_undegraded":"2024-05-17T04:09:57.979246+0000","last_fullsized":"2024-05-17T04:09:57.979246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:06:16.828830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.829077+0000","last_change":"2024-05-17T04:09:55.814871+0000","last_active":"2024-05-17T04:09:57.829077+0000","last_peered":"2024-05-17T04:09:57.829077+0000","last_clean":"2024-05-17T04:09:57.829077+0000","last_became_active":"2024-05-17T04:09:55.814550+0000","last_became_peered":"2024-05-17T04:09:55.814550+0000","last_unstale":"2024-05-17T04:09:57.829077+0000","last_undegraded":"2024-05-17T04:09:57.829077+0000","last_fullsized":"2024-05-17T04:09:57.829077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:01:41.468780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828931+0000","last_change":"2024-05-17T04:09:56.845482+0000","last_active":"2024-05-17T04:09:57.828931+0000","last_peered":"2024-05-17T04:09:57.828931+0000","last_clean":"2024-05-17T04:09:57.828931+0000","last_became_active":"2024-05-17T04:09:56.845150+0000","last_became_peered":"2024-05-17T04:09:56.845150+0000","last_unstale":"2024-05-17T04:09:57.828931+0000","last_undegraded":"2024-05-17T04:09:57.828931+0000","last_fullsized":"2024-05-17T04:09:57.828931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:32:10.500518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830876+0000","last_change":"2024-05-17T04:09:55.813431+0000","last_active":"2024-05-17T04:09:57.830876+0000","last_peered":"2024-05-17T04:09:57.830876+0000","last_clean":"2024-05-17T04:09:57.830876+0000","last_became_active":"2024-05-17T04:09:55.812014+0000","last_became_peered":"2024-05-17T04:09:55.812014+0000","last_unstale":"2024-05-17T04:09:57.830876+0000","last_undegraded":"2024-05-17T04:09:57.830876+0000","last_fullsized":"2024-05-17T04:09:57.830876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:33:01.782172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830943+0000","last_change":"2024-05-17T04:09:56.826828+0000","last_active":"2024-05-17T04:09:57.830943+0000","last_peered":"2024-05-17T04:09:57.830943+0000","last_clean":"2024-05-17T04:09:57.830943+0000","last_became_active":"2024-05-17T04:09:56.826498+0000","last_became_peered":"2024-05-17T04:09:56.826498+0000","last_unstale":"2024-05-17T04:09:57.830943+0000","last_undegraded":"2024-05-17T04:09:57.830943+0000","last_fullsized":"2024-05-17T04:09:57.830943+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:51:10.131566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978160+0000","last_change":"2024-05-17T04:09:55.820032+0000","last_active":"2024-05-17T04:09:57.978160+0000","last_peered":"2024-05-17T04:09:57.978160+0000","last_clean":"2024-05-17T04:09:57.978160+0000","last_became_active":"2024-05-17T04:09:55.819333+0000","last_became_peered":"2024-05-17T04:09:55.819333+0000","last_unstale":"2024-05-17T04:09:57.978160+0000","last_undegraded":"2024-05-17T04:09:57.978160+0000","last_fullsized":"2024-05-17T04:09:57.978160+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:59:12.808353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978508+0000","last_change":"2024-05-17T04:09:56.836032+0000","last_active":"2024-05-17T04:09:57.978508+0000","last_peered":"2024-05-17T04:09:57.978508+0000","last_clean":"2024-05-17T04:09:57.978508+0000","last_became_active":"2024-05-17T04:09:56.835451+0000","last_became_peered":"2024-05-17T04:09:56.835451+0000","last_unstale":"2024-05-17T04:09:57.978508+0000","last_undegraded":"2024-05-17T04:09:57.978508+0000","last_fullsized":"2024-05-17T04:09:57.978508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:56:08.379281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830527+0000","last_change":"2024-05-17T04:09:55.813681+0000","last_active":"2024-05-17T04:09:57.830527+0000","last_peered":"2024-05-17T04:09:57.830527+0000","last_clean":"2024-05-17T04:09:57.830527+0000","last_became_active":"2024-05-17T04:09:55.813092+0000","last_became_peered":"2024-05-17T04:09:55.813092+0000","last_unstale":"2024-05-17T04:09:57.830527+0000","last_undegraded":"2024-05-17T04:09:57.830527+0000","last_fullsized":"2024-05-17T04:09:57.830527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:31:59.962795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977391+0000","last_change":"2024-05-17T04:09:56.840744+0000","last_active":"2024-05-17T04:09:57.977391+0000","last_peered":"2024-05-17T04:09:57.977391+0000","last_clean":"2024-05-17T04:09:57.977391+0000","last_became_active":"2024-05-17T04:09:56.840435+0000","last_became_peered":"2024-05-17T04:09:56.840435+0000","last_unstale":"2024-05-17T04:09:57.977391+0000","last_undegraded":"2024-05-17T04:09:57.977391+0000","last_fullsized":"2024-05-17T04:09:57.977391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:09:24.677580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830625+0000","last_change":"2024-05-17T04:09:55.813684+0000","last_active":"2024-05-17T04:09:57.830625+0000","last_peered":"2024-05-17T04:09:57.830625+0000","last_clean":"2024-05-17T04:09:57.830625+0000","last_became_active":"2024-05-17T04:09:55.813359+0000","last_became_peered":"2024-05-17T04:09:55.813359+0000","last_unstale":"2024-05-17T04:09:57.830625+0000","last_undegraded":"2024-05-17T04:09:57.830625+0000","last_fullsized":"2024-05-17T04:09:57.830625+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:03:29.235687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978745+0000","last_change":"2024-05-17T04:09:56.834171+0000","last_active":"2024-05-17T04:09:57.978745+0000","last_peered":"2024-05-17T04:09:57.978745+0000","last_clean":"2024-05-17T04:09:57.978745+0000","last_became_active":"2024-05-17T04:09:56.833490+0000","last_became_peered":"2024-05-17T04:09:56.833490+0000","last_unstale":"2024-05-17T04:09:57.978745+0000","last_undegraded":"2024-05-17T04:09:57.978745+0000","last_fullsized":"2024-05-17T04:09:57.978745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:20:04.060791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978943+0000","last_change":"2024-05-17T04:09:55.810012+0000","last_active":"2024-05-17T04:09:57.978943+0000","last_peered":"2024-05-17T04:09:57.978943+0000","last_clean":"2024-05-17T04:09:57.978943+0000","last_became_active":"2024-05-17T04:09:55.809683+0000","last_became_peered":"2024-05-17T04:09:55.809683+0000","last_unstale":"2024-05-17T04:09:57.978943+0000","last_undegraded":"2024-05-17T04:09:57.978943+0000","last_fullsized":"2024-05-17T04:09:57.978943+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:55:32.614756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978379+0000","last_change":"2024-05-17T04:09:56.831909+0000","last_active":"2024-05-17T04:09:57.978379+0000","last_peered":"2024-05-17T04:09:57.978379+0000","last_clean":"2024-05-17T04:09:57.978379+0000","last_became_active":"2024-05-17T04:09:56.831615+0000","last_became_peered":"2024-05-17T04:09:56.831615+0000","last_unstale":"2024-05-17T04:09:57.978379+0000","last_undegraded":"2024-05-17T04:09:57.978379+0000","last_fullsized":"2024-05-17T04:09:57.978379+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:06:16.828830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830725+0000","last_change":"2024-05-17T04:09:55.810705+0000","last_active":"2024-05-17T04:09:57.830725+0000","last_peered":"2024-05-17T04:09:57.830725+0000","last_clean":"2024-05-17T04:09:57.830725+0000","last_became_active":"2024-05-17T04:09:55.809986+0000","last_became_peered":"2024-05-17T04:09:55.809986+0000","last_unstale":"2024-05-17T04:09:57.830725+0000","last_undegraded":"2024-05-17T04:09:57.830725+0000","last_fullsized":"2024-05-17T04:09:57.830725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:56:33.396772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978036+0000","last_change":"2024-05-17T04:09:56.845417+0000","last_active":"2024-05-17T04:09:57.978036+0000","last_peered":"2024-05-17T04:09:57.978036+0000","last_clean":"2024-05-17T04:09:57.978036+0000","last_became_active":"2024-05-17T04:09:56.845068+0000","last_became_peered":"2024-05-17T04:09:56.845068+0000","last_unstale":"2024-05-17T04:09:57.978036+0000","last_undegraded":"2024-05-17T04:09:57.978036+0000","last_fullsized":"2024-05-17T04:09:57.978036+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:43:51.560581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979536+0000","last_change":"2024-05-17T04:09:55.821625+0000","last_active":"2024-05-17T04:09:57.979536+0000","last_peered":"2024-05-17T04:09:57.979536+0000","last_clean":"2024-05-17T04:09:57.979536+0000","last_became_active":"2024-05-17T04:09:55.821375+0000","last_became_peered":"2024-05-17T04:09:55.821375+0000","last_unstale":"2024-05-17T04:09:57.979536+0000","last_undegraded":"2024-05-17T04:09:57.979536+0000","last_fullsized":"2024-05-17T04:09:57.979536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:43:50.555786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978526+0000","last_change":"2024-05-17T04:09:56.830703+0000","last_active":"2024-05-17T04:09:57.978526+0000","last_peered":"2024-05-17T04:09:57.978526+0000","last_clean":"2024-05-17T04:09:57.978526+0000","last_became_active":"2024-05-17T04:09:56.830376+0000","last_became_peered":"2024-05-17T04:09:56.830376+0000","last_unstale":"2024-05-17T04:09:57.978526+0000","last_undegraded":"2024-05-17T04:09:57.978526+0000","last_fullsized":"2024-05-17T04:09:57.978526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:58:50.752050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830932+0000","last_change":"2024-05-17T04:09:55.813989+0000","last_active":"2024-05-17T04:09:57.830932+0000","last_peered":"2024-05-17T04:09:57.830932+0000","last_clean":"2024-05-17T04:09:57.830932+0000","last_became_active":"2024-05-17T04:09:55.813713+0000","last_became_peered":"2024-05-17T04:09:55.813713+0000","last_unstale":"2024-05-17T04:09:57.830932+0000","last_undegraded":"2024-05-17T04:09:57.830932+0000","last_fullsized":"2024-05-17T04:09:57.830932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:33:29.682901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978178+0000","last_change":"2024-05-17T04:09:56.824592+0000","last_active":"2024-05-17T04:09:57.978178+0000","last_peered":"2024-05-17T04:09:57.978178+0000","last_clean":"2024-05-17T04:09:57.978178+0000","last_became_active":"2024-05-17T04:09:56.824264+0000","last_became_peered":"2024-05-17T04:09:56.824264+0000","last_unstale":"2024-05-17T04:09:57.978178+0000","last_undegraded":"2024-05-17T04:09:57.978178+0000","last_fullsized":"2024-05-17T04:09:57.978178+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:46:26.786323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977490+0000","last_change":"2024-05-17T04:09:55.820524+0000","last_active":"2024-05-17T04:09:57.977490+0000","last_peered":"2024-05-17T04:09:57.977490+0000","last_clean":"2024-05-17T04:09:57.977490+0000","last_became_active":"2024-05-17T04:09:55.820170+0000","last_became_peered":"2024-05-17T04:09:55.820170+0000","last_unstale":"2024-05-17T04:09:57.977490+0000","last_undegraded":"2024-05-17T04:09:57.977490+0000","last_fullsized":"2024-05-17T04:09:57.977490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:01:41.468780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977360+0000","last_change":"2024-05-17T04:09:56.822319+0000","last_active":"2024-05-17T04:09:57.977360+0000","last_peered":"2024-05-17T04:09:57.977360+0000","last_clean":"2024-05-17T04:09:57.977360+0000","last_became_active":"2024-05-17T04:09:56.821979+0000","last_became_peered":"2024-05-17T04:09:56.821979+0000","last_unstale":"2024-05-17T04:09:57.977360+0000","last_undegraded":"2024-05-17T04:09:57.977360+0000","last_fullsized":"2024-05-17T04:09:57.977360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:32:10.500518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978374+0000","last_change":"2024-05-17T04:09:55.812473+0000","last_active":"2024-05-17T04:09:57.978374+0000","last_peered":"2024-05-17T04:09:57.978374+0000","last_clean":"2024-05-17T04:09:57.978374+0000","last_became_active":"2024-05-17T04:09:55.812099+0000","last_became_peered":"2024-05-17T04:09:55.812099+0000","last_unstale":"2024-05-17T04:09:57.978374+0000","last_undegraded":"2024-05-17T04:09:57.978374+0000","last_fullsized":"2024-05-17T04:09:57.978374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:59:12.808353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978225+0000","last_change":"2024-05-17T04:09:56.841868+0000","last_active":"2024-05-17T04:09:57.978225+0000","last_peered":"2024-05-17T04:09:57.978225+0000","last_clean":"2024-05-17T04:09:57.978225+0000","last_became_active":"2024-05-17T04:09:56.839312+0000","last_became_peered":"2024-05-17T04:09:56.839312+0000","last_unstale":"2024-05-17T04:09:57.978225+0000","last_undegraded":"2024-05-17T04:09:57.978225+0000","last_fullsized":"2024-05-17T04:09:57.978225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:32:10.500518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828254+0000","last_change":"2024-05-17T04:09:55.814681+0000","last_active":"2024-05-17T04:09:57.828254+0000","last_peered":"2024-05-17T04:09:57.828254+0000","last_clean":"2024-05-17T04:09:57.828254+0000","last_became_active":"2024-05-17T04:09:55.814222+0000","last_became_peered":"2024-05-17T04:09:55.814222+0000","last_unstale":"2024-05-17T04:09:57.828254+0000","last_undegraded":"2024-05-17T04:09:57.828254+0000","last_fullsized":"2024-05-17T04:09:57.828254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:12:38.053932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828049+0000","last_change":"2024-05-17T04:09:56.821564+0000","last_active":"2024-05-17T04:09:57.828049+0000","last_peered":"2024-05-17T04:09:57.828049+0000","last_clean":"2024-05-17T04:09:57.828049+0000","last_became_active":"2024-05-17T04:09:56.821165+0000","last_became_peered":"2024-05-17T04:09:56.821165+0000","last_unstale":"2024-05-17T04:09:57.828049+0000","last_undegraded":"2024-05-17T04:09:57.828049+0000","last_fullsized":"2024-05-17T04:09:57.828049+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:38:36.051847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828775+0000","last_change":"2024-05-17T04:09:55.803946+0000","last_active":"2024-05-17T04:09:57.828775+0000","last_peered":"2024-05-17T04:09:57.828775+0000","last_clean":"2024-05-17T04:09:57.828775+0000","last_became_active":"2024-05-17T04:09:55.803625+0000","last_became_peered":"2024-05-17T04:09:55.803625+0000","last_unstale":"2024-05-17T04:09:57.828775+0000","last_undegraded":"2024-05-17T04:09:57.828775+0000","last_fullsized":"2024-05-17T04:09:57.828775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:29:44.829522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978668+0000","last_change":"2024-05-17T04:09:56.836711+0000","last_active":"2024-05-17T04:09:57.978668+0000","last_peered":"2024-05-17T04:09:57.978668+0000","last_clean":"2024-05-17T04:09:57.978668+0000","last_became_active":"2024-05-17T04:09:56.836091+0000","last_became_peered":"2024-05-17T04:09:56.836091+0000","last_unstale":"2024-05-17T04:09:57.978668+0000","last_undegraded":"2024-05-17T04:09:57.978668+0000","last_fullsized":"2024-05-17T04:09:57.978668+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:32:13.837690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977758+0000","last_change":"2024-05-17T04:09:55.820172+0000","last_active":"2024-05-17T04:09:57.977758+0000","last_peered":"2024-05-17T04:09:57.977758+0000","last_clean":"2024-05-17T04:09:57.977758+0000","last_became_active":"2024-05-17T04:09:55.819863+0000","last_became_peered":"2024-05-17T04:09:55.819863+0000","last_unstale":"2024-05-17T04:09:57.977758+0000","last_undegraded":"2024-05-17T04:09:57.977758+0000","last_fullsized":"2024-05-17T04:09:57.977758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:38:35.047051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979454+0000","last_change":"2024-05-17T04:09:56.832392+0000","last_active":"2024-05-17T04:09:57.979454+0000","last_peered":"2024-05-17T04:09:57.979454+0000","last_clean":"2024-05-17T04:09:57.979454+0000","last_became_active":"2024-05-17T04:09:56.832128+0000","last_became_peered":"2024-05-17T04:09:56.832128+0000","last_unstale":"2024-05-17T04:09:57.979454+0000","last_undegraded":"2024-05-17T04:09:57.979454+0000","last_fullsized":"2024-05-17T04:09:57.979454+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:47:11.150860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978575+0000","last_change":"2024-05-17T04:09:55.813505+0000","last_active":"2024-05-17T04:09:57.978575+0000","last_peered":"2024-05-17T04:09:57.978575+0000","last_clean":"2024-05-17T04:09:57.978575+0000","last_became_active":"2024-05-17T04:09:55.813190+0000","last_became_peered":"2024-05-17T04:09:55.813190+0000","last_unstale":"2024-05-17T04:09:57.978575+0000","last_undegraded":"2024-05-17T04:09:57.978575+0000","last_fullsized":"2024-05-17T04:09:57.978575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:59:12.808353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":139,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978520+0000","last_change":"2024-05-17T04:08:56.447797+0000","last_active":"2024-05-17T04:09:57.978520+0000","last_peered":"2024-05-17T04:09:57.978520+0000","last_clean":"2024-05-17T04:09:57.978520+0000","last_became_active":"2024-05-17T04:08:56.446705+0000","last_became_peered":"2024-05-17T04:08:56.446705+0000","last_unstale":"2024-05-17T04:09:57.978520+0000","last_undegraded":"2024-05-17T04:09:57.978520+0000","last_fullsized":"2024-05-17T04:09:57.978520+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_clean_scrub_stamp":"2024-05-17T04:08:54.847367+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:40:00.515431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":768021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":176083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":176575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":177617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1011712,"data_stored":766373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-17T04:10:00.884 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-17T04:10:01.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.031+0000 7f759a193640 1 Processor -- start 2024-05-17T04:10:01.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.031+0000 7f759a193640 1 -- start start 2024-05-17T04:10:01.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.032+0000 7f759a193640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f75940d27e0 0x7f75940cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.032+0000 7f759a193640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f759415dad0 con 0x7f7594071c80 2024-05-17T04:10:01.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.032+0000 7f759a193640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75940ce090 con 0x7f75940cdc80 2024-05-17T04:10:01.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.032+0000 7f759a193640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f7594072090 con 0x7f75940d27e0 2024-05-17T04:10:01.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.032+0000 7f7593fff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f7594071c80 0x7f75940d0cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46528/0 (socket says 172.21.15.131:46528) 2024-05-17T04:10:01.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.032+0000 7f7593fff640 1 -- 172.21.15.131:0/3741224356 learned_addr learned my addr 172.21.15.131:0/3741224356 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:10:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.032+0000 7f75937fe640 1 --2- 172.21.15.131:0/3741224356 >> v2:172.21.15.150:3300/0 conn(0x7f75940d27e0 0x7f75940cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.032+0000 7f75927fc640 1 -- 172.21.15.131:0/3741224356 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 42602772 0 0) 0x7f759415dad0 con 0x7f7594071c80 2024-05-17T04:10:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.032+0000 7f75927fc640 1 -- 172.21.15.131:0/3741224356 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f757c003520 con 0x7f7594071c80 2024-05-17T04:10:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f75927fc640 1 -- 172.21.15.131:0/3741224356 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3727621821 0 0) 0x7f757c003520 con 0x7f7594071c80 2024-05-17T04:10:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f75927fc640 1 -- 172.21.15.131:0/3741224356 >> v2:172.21.15.150:3300/0 conn(0x7f75940d27e0 msgr2=0x7f75940cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f75927fc640 1 --2- 172.21.15.131:0/3741224356 >> v2:172.21.15.150:3300/0 conn(0x7f75940d27e0 0x7f75940cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f75927fc640 1 -- 172.21.15.131:0/3741224356 >> v1:172.21.15.150:6789/0 conn(0x7f75940cdc80 legacy=0x7f7594071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f75927fc640 1 -- 172.21.15.131:0/3741224356 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759415dd40 con 0x7f7594071c80 2024-05-17T04:10:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f75927fc640 1 -- 172.21.15.131:0/3741224356 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7f758c001a70 con 0x7f7594071c80 2024-05-17T04:10:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f75927fc640 1 -- 172.21.15.131:0/3741224356 >> v1:172.21.15.131:6789/0 conn(0x7f7594071c80 legacy=0x7f75940d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f75927fc640 1 --2- 172.21.15.131:0/3741224356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f757c003a50 0x7f757c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f75927fc640 1 --2- 172.21.15.131:0/3741224356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f757c004800 0x7f757c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f75927fc640 1 --2- 172.21.15.131:0/3741224356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f757c005250 0x7f757c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f75927fc640 1 -- 172.21.15.131:0/3741224356 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7594072090 con 0x7f757c005250 2024-05-17T04:10:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f75927fc640 1 -- 172.21.15.131:0/3741224356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f757c00c1e0 con 0x7f757c004800 2024-05-17T04:10:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f75927fc640 1 -- 172.21.15.131:0/3741224356 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f757c00c3e0 con 0x7f757c003a50 2024-05-17T04:10:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f7593fff640 1 --2- 172.21.15.131:0/3741224356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f757c005250 0x7f757c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f75937fe640 1 --2- 172.21.15.131:0/3741224356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f757c003a50 0x7f757c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f7592ffd640 1 --2- 172.21.15.131:0/3741224356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f757c004800 0x7f757c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f7593fff640 1 -- 172.21.15.131:0/3741224356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f757c003a50 msgr2=0x7f757c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f7593fff640 1 --2- 172.21.15.131:0/3741224356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f757c003a50 0x7f757c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f7593fff640 1 -- 172.21.15.131:0/3741224356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f757c004800 msgr2=0x7f757c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f7593fff640 1 --2- 172.21.15.131:0/3741224356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f757c004800 0x7f757c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.033+0000 7f7593fff640 1 -- 172.21.15.131:0/3741224356 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757c003520 con 0x7f757c005250 2024-05-17T04:10:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.034+0000 7f7593fff640 1 -- 172.21.15.131:0/3741224356 reap_dead start 2024-05-17T04:10:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.034+0000 7f7593fff640 1 --2- 172.21.15.131:0/3741224356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f757c005250 0x7f757c00b9c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f758c0013d0 tx=0x7f757c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7e04b4ecd8bb7f server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.034+0000 7f75927fc640 1 -- 172.21.15.131:0/3741224356 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c00a480 con 0x7f757c005250 2024-05-17T04:10:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.034+0000 7f75927fc640 1 -- 172.21.15.131:0/3741224356 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758c02f070 con 0x7f757c005250 2024-05-17T04:10:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.034+0000 7f75927fc640 1 -- 172.21.15.131:0/3741224356 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c02bbe0 con 0x7f757c005250 2024-05-17T04:10:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.035+0000 7f759a193640 1 -- 172.21.15.131:0/3741224356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f757c005250 msgr2=0x7f757c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.035+0000 7f759a193640 1 --2- 172.21.15.131:0/3741224356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f757c005250 0x7f757c00b9c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f758c0013d0 tx=0x7f757c005830 comp rx=0 tx=0).stop 2024-05-17T04:10:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.035+0000 7f759a193640 1 -- 172.21.15.131:0/3741224356 shutdown_connections 2024-05-17T04:10:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.035+0000 7f759a193640 1 --2- 172.21.15.131:0/3741224356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f757c005250 0x7f757c00b9c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.035+0000 7f759a193640 1 -- 172.21.15.131:0/3741224356 >> 172.21.15.131:0/3741224356 conn(0x7f75940b4c60 msgr2=0x7f75940b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.035+0000 7f759a193640 1 -- 172.21.15.131:0/3741224356 shutdown_connections 2024-05-17T04:10:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.035+0000 7f759a193640 1 -- 172.21.15.131:0/3741224356 wait complete. 2024-05-17T04:10:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.037+0000 7f759a193640 1 Processor -- start 2024-05-17T04:10:01.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.037+0000 7f759a193640 1 -- start start 2024-05-17T04:10:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.038+0000 7f759a193640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f757c005250 0x7f75940cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.038+0000 7f759a193640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7594154420 0x7f7594153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.038+0000 7f759a193640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75940b86c0 0x7f759415f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.038+0000 7f759a193640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f75940722d0 con 0x7f757c005250 2024-05-17T04:10:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.038+0000 7f759a193640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f759415e300 con 0x7f75940b86c0 2024-05-17T04:10:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.038+0000 7f759a193640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f759415e820 con 0x7f7594154420 2024-05-17T04:10:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.038+0000 7f75937fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f757c005250 0x7f75940cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.038+0000 7f75937fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f757c005250 0x7f75940cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46456/0 (socket says 172.21.15.131:46456) 2024-05-17T04:10:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.038+0000 7f75937fe640 1 -- 172.21.15.131:0/1330811562 learned_addr learned my addr 172.21.15.131:0/1330811562 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:10:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.038+0000 7f7592ffd640 1 --2- 172.21.15.131:0/1330811562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7594154420 0x7f7594153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.038+0000 7f7593fff640 1 --2- 172.21.15.131:0/1330811562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75940b86c0 0x7f759415f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.038+0000 7f75937fe640 1 -- 172.21.15.131:0/1330811562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7594154420 msgr2=0x7f7594153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.039+0000 7f75937fe640 1 --2- 172.21.15.131:0/1330811562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7594154420 0x7f7594153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.039+0000 7f75937fe640 1 -- 172.21.15.131:0/1330811562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75940b86c0 msgr2=0x7f759415f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.039+0000 7f75937fe640 1 --2- 172.21.15.131:0/1330811562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75940b86c0 0x7f759415f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.039+0000 7f75937fe640 1 -- 172.21.15.131:0/1330811562 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75941541b0 con 0x7f757c005250 2024-05-17T04:10:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.039+0000 7f7592ffd640 1 --2- 172.21.15.131:0/1330811562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7594154420 0x7f7594153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:10:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.039+0000 7f75937fe640 1 --2- 172.21.15.131:0/1330811562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f757c005250 0x7f75940cd0c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7584011910 tx=0x7f7584011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.039+0000 7f757bfff640 1 -- 172.21.15.131:0/1330811562 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758400faf0 con 0x7f757c005250 2024-05-17T04:10:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.039+0000 7f757bfff640 1 -- 172.21.15.131:0/1330811562 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758400fc90 con 0x7f757c005250 2024-05-17T04:10:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.039+0000 7f759a193640 1 -- 172.21.15.131:0/1330811562 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75940b7900 con 0x7f757c005250 2024-05-17T04:10:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.039+0000 7f757bfff640 1 -- 172.21.15.131:0/1330811562 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7584014440 con 0x7f757c005250 2024-05-17T04:10:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.039+0000 7f759a193640 1 -- 172.21.15.131:0/1330811562 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75940b7ec0 con 0x7f757c005250 2024-05-17T04:10:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.040+0000 7f759a193640 1 -- 172.21.15.131:0/1330811562 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75940cd740 con 0x7f757c005250 2024-05-17T04:10:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.041+0000 7f757bfff640 1 -- 172.21.15.131:0/1330811562 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7584012040 con 0x7f757c005250 2024-05-17T04:10:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.041+0000 7f757bfff640 1 --2- 172.21.15.131:0/1330811562 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f75800762d0 0x7f75800787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.041+0000 7f757bfff640 1 -- 172.21.15.131:0/1330811562 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f7584097c70 con 0x7f757c005250 2024-05-17T04:10:01.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.041+0000 7f7592ffd640 1 --2- 172.21.15.131:0/1330811562 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f75800762d0 0x7f75800787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.042+0000 7f7592ffd640 1 --2- 172.21.15.131:0/1330811562 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f75800762d0 0x7f75800787e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7594157420 tx=0x7f7588009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:01.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.046+0000 7f757bfff640 1 -- 172.21.15.131:0/1330811562 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7584019030 con 0x7f757c005250 2024-05-17T04:10:01.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.222+0000 7f759a193640 1 -- 172.21.15.131:0/1330811562 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f759415b7f0 con 0x7f75800762d0 2024-05-17T04:10:01.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.226+0000 7f757bfff640 1 -- 172.21.15.131:0/1330811562 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251945 (secure 0 0 0) 0x7f759415b7f0 con 0x7f75800762d0 2024-05-17T04:10:01.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:10:01.232 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-05-17T04:10:01.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.229+0000 7f759a193640 1 -- 172.21.15.131:0/1330811562 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f75800762d0 msgr2=0x7f75800787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.229+0000 7f759a193640 1 --2- 172.21.15.131:0/1330811562 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f75800762d0 0x7f75800787e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7594157420 tx=0x7f7588009040 comp rx=0 tx=0).stop 2024-05-17T04:10:01.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.229+0000 7f759a193640 1 -- 172.21.15.131:0/1330811562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f757c005250 msgr2=0x7f75940cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.229+0000 7f759a193640 1 --2- 172.21.15.131:0/1330811562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f757c005250 0x7f75940cd0c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7584011910 tx=0x7f7584011dd0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.229+0000 7f759a193640 1 -- 172.21.15.131:0/1330811562 shutdown_connections 2024-05-17T04:10:01.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.229+0000 7f759a193640 1 --2- 172.21.15.131:0/1330811562 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f75800762d0 0x7f75800787e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.229+0000 7f759a193640 1 --2- 172.21.15.131:0/1330811562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75940b86c0 0x7f759415f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.229+0000 7f759a193640 1 --2- 172.21.15.131:0/1330811562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7594154420 0x7f7594153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.229+0000 7f759a193640 1 --2- 172.21.15.131:0/1330811562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f757c005250 0x7f75940cd0c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.229+0000 7f759a193640 1 -- 172.21.15.131:0/1330811562 >> 172.21.15.131:0/1330811562 conn(0x7f75940b4c60 msgr2=0x7f7594159df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:01.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.229+0000 7f759a193640 1 -- 172.21.15.131:0/1330811562 shutdown_connections 2024-05-17T04:10:01.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.229+0000 7f759a193640 1 -- 172.21.15.131:0/1330811562 wait complete. 2024-05-17T04:10:01.242 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-05-17T04:10:00.720064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220680,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754040,"statfs":{"total":773094113280,"available":772868136960,"internally_reserved":0,"allocated":4562944,"data_stored":2593324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.927740"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978708+0000","last_change":"2024-05-17T04:09:56.827214+0000","last_active":"2024-05-17T04:09:57.978708+0000","last_peered":"2024-05-17T04:09:57.978708+0000","last_clean":"2024-05-17T04:09:57.978708+0000","last_became_active":"2024-05-17T04:09:56.826487+0000","last_became_peered":"2024-05-17T04:09:56.826487+0000","last_unstale":"2024-05-17T04:09:57.978708+0000","last_undegraded":"2024-05-17T04:09:57.978708+0000","last_fullsized":"2024-05-17T04:09:57.978708+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:47:11.150860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978005+0000","last_change":"2024-05-17T04:09:56.829415+0000","last_active":"2024-05-17T04:09:57.978005+0000","last_peered":"2024-05-17T04:09:57.978005+0000","last_clean":"2024-05-17T04:09:57.978005+0000","last_became_active":"2024-05-17T04:09:56.828902+0000","last_became_peered":"2024-05-17T04:09:56.828902+0000","last_unstale":"2024-05-17T04:09:57.978005+0000","last_undegraded":"2024-05-17T04:09:57.978005+0000","last_fullsized":"2024-05-17T04:09:57.978005+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:20:04.060791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977374+0000","last_change":"2024-05-17T04:09:56.839790+0000","last_active":"2024-05-17T04:09:57.977374+0000","last_peered":"2024-05-17T04:09:57.977374+0000","last_clean":"2024-05-17T04:09:57.977374+0000","last_became_active":"2024-05-17T04:09:56.839486+0000","last_became_peered":"2024-05-17T04:09:56.839486+0000","last_unstale":"2024-05-17T04:09:57.977374+0000","last_undegraded":"2024-05-17T04:09:57.977374+0000","last_fullsized":"2024-05-17T04:09:57.977374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:05:56.736360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830734+0000","last_change":"2024-05-17T04:09:56.825989+0000","last_active":"2024-05-17T04:09:57.830734+0000","last_peered":"2024-05-17T04:09:57.830734+0000","last_clean":"2024-05-17T04:09:57.830734+0000","last_became_active":"2024-05-17T04:09:56.825603+0000","last_became_peered":"2024-05-17T04:09:56.825603+0000","last_unstale":"2024-05-17T04:09:57.830734+0000","last_undegraded":"2024-05-17T04:09:57.830734+0000","last_fullsized":"2024-05-17T04:09:57.830734+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:07:15.712823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830586+0000","last_change":"2024-05-17T04:09:56.821526+0000","last_active":"2024-05-17T04:09:57.830586+0000","last_peered":"2024-05-17T04:09:57.830586+0000","last_clean":"2024-05-17T04:09:57.830586+0000","last_became_active":"2024-05-17T04:09:56.821174+0000","last_became_peered":"2024-05-17T04:09:56.821174+0000","last_unstale":"2024-05-17T04:09:57.830586+0000","last_undegraded":"2024-05-17T04:09:57.830586+0000","last_fullsized":"2024-05-17T04:09:57.830586+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:28:27.612300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977345+0000","last_change":"2024-05-17T04:09:56.841371+0000","last_active":"2024-05-17T04:09:57.977345+0000","last_peered":"2024-05-17T04:09:57.977345+0000","last_clean":"2024-05-17T04:09:57.977345+0000","last_became_active":"2024-05-17T04:09:56.839665+0000","last_became_peered":"2024-05-17T04:09:56.839665+0000","last_unstale":"2024-05-17T04:09:57.977345+0000","last_undegraded":"2024-05-17T04:09:57.977345+0000","last_fullsized":"2024-05-17T04:09:57.977345+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:27:11.379666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978146+0000","last_change":"2024-05-17T04:09:56.831598+0000","last_active":"2024-05-17T04:09:57.978146+0000","last_peered":"2024-05-17T04:09:57.978146+0000","last_clean":"2024-05-17T04:09:57.978146+0000","last_became_active":"2024-05-17T04:09:56.831236+0000","last_became_peered":"2024-05-17T04:09:56.831236+0000","last_unstale":"2024-05-17T04:09:57.978146+0000","last_undegraded":"2024-05-17T04:09:57.978146+0000","last_fullsized":"2024-05-17T04:09:57.978146+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:38:40.807197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977646+0000","last_change":"2024-05-17T04:09:56.825511+0000","last_active":"2024-05-17T04:09:57.977646+0000","last_peered":"2024-05-17T04:09:57.977646+0000","last_clean":"2024-05-17T04:09:57.977646+0000","last_became_active":"2024-05-17T04:09:56.825187+0000","last_became_peered":"2024-05-17T04:09:56.825187+0000","last_unstale":"2024-05-17T04:09:57.977646+0000","last_undegraded":"2024-05-17T04:09:57.977646+0000","last_fullsized":"2024-05-17T04:09:57.977646+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:07:03.374460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977839+0000","last_change":"2024-05-17T04:09:56.824645+0000","last_active":"2024-05-17T04:09:57.977839+0000","last_peered":"2024-05-17T04:09:57.977839+0000","last_clean":"2024-05-17T04:09:57.977839+0000","last_became_active":"2024-05-17T04:09:56.824337+0000","last_became_peered":"2024-05-17T04:09:56.824337+0000","last_unstale":"2024-05-17T04:09:57.977839+0000","last_undegraded":"2024-05-17T04:09:57.977839+0000","last_fullsized":"2024-05-17T04:09:57.977839+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:29:03.731516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979253+0000","last_change":"2024-05-17T04:09:56.833198+0000","last_active":"2024-05-17T04:09:57.979253+0000","last_peered":"2024-05-17T04:09:57.979253+0000","last_clean":"2024-05-17T04:09:57.979253+0000","last_became_active":"2024-05-17T04:09:56.832883+0000","last_became_peered":"2024-05-17T04:09:56.832883+0000","last_unstale":"2024-05-17T04:09:57.979253+0000","last_undegraded":"2024-05-17T04:09:57.979253+0000","last_fullsized":"2024-05-17T04:09:57.979253+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:50:36.421863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979063+0000","last_change":"2024-05-17T04:09:56.825380+0000","last_active":"2024-05-17T04:09:57.979063+0000","last_peered":"2024-05-17T04:09:57.979063+0000","last_clean":"2024-05-17T04:09:57.979063+0000","last_became_active":"2024-05-17T04:09:56.825032+0000","last_became_peered":"2024-05-17T04:09:56.825032+0000","last_unstale":"2024-05-17T04:09:57.979063+0000","last_undegraded":"2024-05-17T04:09:57.979063+0000","last_fullsized":"2024-05-17T04:09:57.979063+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:01:18.400546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977647+0000","last_change":"2024-05-17T04:09:56.826804+0000","last_active":"2024-05-17T04:09:57.977647+0000","last_peered":"2024-05-17T04:09:57.977647+0000","last_clean":"2024-05-17T04:09:57.977647+0000","last_became_active":"2024-05-17T04:09:56.826477+0000","last_became_peered":"2024-05-17T04:09:56.826477+0000","last_unstale":"2024-05-17T04:09:57.977647+0000","last_undegraded":"2024-05-17T04:09:57.977647+0000","last_fullsized":"2024-05-17T04:09:57.977647+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T15:55:45.396403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978803+0000","last_change":"2024-05-17T04:09:56.833279+0000","last_active":"2024-05-17T04:09:57.978803+0000","last_peered":"2024-05-17T04:09:57.978803+0000","last_clean":"2024-05-17T04:09:57.978803+0000","last_became_active":"2024-05-17T04:09:56.832947+0000","last_became_peered":"2024-05-17T04:09:56.832947+0000","last_unstale":"2024-05-17T04:09:57.978803+0000","last_undegraded":"2024-05-17T04:09:57.978803+0000","last_fullsized":"2024-05-17T04:09:57.978803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:46.641376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.827902+0000","last_change":"2024-05-17T04:09:56.830066+0000","last_active":"2024-05-17T04:09:57.827902+0000","last_peered":"2024-05-17T04:09:57.827902+0000","last_clean":"2024-05-17T04:09:57.827902+0000","last_became_active":"2024-05-17T04:09:56.829732+0000","last_became_peered":"2024-05-17T04:09:56.829732+0000","last_unstale":"2024-05-17T04:09:57.827902+0000","last_undegraded":"2024-05-17T04:09:57.827902+0000","last_fullsized":"2024-05-17T04:09:57.827902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:27:11.379666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978207+0000","last_change":"2024-05-17T04:09:56.830275+0000","last_active":"2024-05-17T04:09:57.978207+0000","last_peered":"2024-05-17T04:09:57.978207+0000","last_clean":"2024-05-17T04:09:57.978207+0000","last_became_active":"2024-05-17T04:09:56.829515+0000","last_became_peered":"2024-05-17T04:09:56.829515+0000","last_unstale":"2024-05-17T04:09:57.978207+0000","last_undegraded":"2024-05-17T04:09:57.978207+0000","last_fullsized":"2024-05-17T04:09:57.978207+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:07:03.374460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978066+0000","last_change":"2024-05-17T04:09:56.835764+0000","last_active":"2024-05-17T04:09:57.978066+0000","last_peered":"2024-05-17T04:09:57.978066+0000","last_clean":"2024-05-17T04:09:57.978066+0000","last_became_active":"2024-05-17T04:09:56.835081+0000","last_became_peered":"2024-05-17T04:09:56.835081+0000","last_unstale":"2024-05-17T04:09:57.978066+0000","last_undegraded":"2024-05-17T04:09:57.978066+0000","last_fullsized":"2024-05-17T04:09:57.978066+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:09:24.677580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978724+0000","last_change":"2024-05-17T04:09:56.842209+0000","last_active":"2024-05-17T04:09:57.978724+0000","last_peered":"2024-05-17T04:09:57.978724+0000","last_clean":"2024-05-17T04:09:57.978724+0000","last_became_active":"2024-05-17T04:09:56.841876+0000","last_became_peered":"2024-05-17T04:09:56.841876+0000","last_unstale":"2024-05-17T04:09:57.978724+0000","last_undegraded":"2024-05-17T04:09:57.978724+0000","last_fullsized":"2024-05-17T04:09:57.978724+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:38:40.807197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.827951+0000","last_change":"2024-05-17T04:09:56.833456+0000","last_active":"2024-05-17T04:09:57.827951+0000","last_peered":"2024-05-17T04:09:57.827951+0000","last_clean":"2024-05-17T04:09:57.827951+0000","last_became_active":"2024-05-17T04:09:56.832947+0000","last_became_peered":"2024-05-17T04:09:56.832947+0000","last_unstale":"2024-05-17T04:09:57.827951+0000","last_undegraded":"2024-05-17T04:09:57.827951+0000","last_fullsized":"2024-05-17T04:09:57.827951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:23:42.611545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830911+0000","last_change":"2024-05-17T04:09:56.843492+0000","last_active":"2024-05-17T04:09:57.830911+0000","last_peered":"2024-05-17T04:09:57.830911+0000","last_clean":"2024-05-17T04:09:57.830911+0000","last_became_active":"2024-05-17T04:09:56.843149+0000","last_became_peered":"2024-05-17T04:09:56.843149+0000","last_unstale":"2024-05-17T04:09:57.830911+0000","last_undegraded":"2024-05-17T04:09:57.830911+0000","last_fullsized":"2024-05-17T04:09:57.830911+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:26:48.819432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828141+0000","last_change":"2024-05-17T04:09:56.832063+0000","last_active":"2024-05-17T04:09:57.828141+0000","last_peered":"2024-05-17T04:09:57.828141+0000","last_clean":"2024-05-17T04:09:57.828141+0000","last_became_active":"2024-05-17T04:09:56.831756+0000","last_became_peered":"2024-05-17T04:09:56.831756+0000","last_unstale":"2024-05-17T04:09:57.828141+0000","last_undegraded":"2024-05-17T04:09:57.828141+0000","last_fullsized":"2024-05-17T04:09:57.828141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:04:06.160726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978994+0000","last_change":"2024-05-17T04:09:56.838628+0000","last_active":"2024-05-17T04:09:57.978994+0000","last_peered":"2024-05-17T04:09:57.978994+0000","last_clean":"2024-05-17T04:09:57.978994+0000","last_became_active":"2024-05-17T04:09:56.838308+0000","last_became_peered":"2024-05-17T04:09:56.838308+0000","last_unstale":"2024-05-17T04:09:57.978994+0000","last_undegraded":"2024-05-17T04:09:57.978994+0000","last_fullsized":"2024-05-17T04:09:57.978994+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:46:26.786323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828347+0000","last_change":"2024-05-17T04:09:56.831614+0000","last_active":"2024-05-17T04:09:57.828347+0000","last_peered":"2024-05-17T04:09:57.828347+0000","last_clean":"2024-05-17T04:09:57.828347+0000","last_became_active":"2024-05-17T04:09:56.830404+0000","last_became_peered":"2024-05-17T04:09:56.830404+0000","last_unstale":"2024-05-17T04:09:57.828347+0000","last_undegraded":"2024-05-17T04:09:57.828347+0000","last_fullsized":"2024-05-17T04:09:57.828347+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:22:46.067823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978993+0000","last_change":"2024-05-17T04:09:56.835964+0000","last_active":"2024-05-17T04:09:57.978993+0000","last_peered":"2024-05-17T04:09:57.978993+0000","last_clean":"2024-05-17T04:09:57.978993+0000","last_became_active":"2024-05-17T04:09:56.835213+0000","last_became_peered":"2024-05-17T04:09:56.835213+0000","last_unstale":"2024-05-17T04:09:57.978993+0000","last_undegraded":"2024-05-17T04:09:57.978993+0000","last_fullsized":"2024-05-17T04:09:57.978993+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T16:07:03.374460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830767+0000","last_change":"2024-05-17T04:09:56.840796+0000","last_active":"2024-05-17T04:09:57.830767+0000","last_peered":"2024-05-17T04:09:57.830767+0000","last_clean":"2024-05-17T04:09:57.830767+0000","last_became_active":"2024-05-17T04:09:56.840243+0000","last_became_peered":"2024-05-17T04:09:56.840243+0000","last_unstale":"2024-05-17T04:09:57.830767+0000","last_undegraded":"2024-05-17T04:09:57.830767+0000","last_fullsized":"2024-05-17T04:09:57.830767+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:12:39.058727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828529+0000","last_change":"2024-05-17T04:09:56.827955+0000","last_active":"2024-05-17T04:09:57.828529+0000","last_peered":"2024-05-17T04:09:57.828529+0000","last_clean":"2024-05-17T04:09:57.828529+0000","last_became_active":"2024-05-17T04:09:56.827614+0000","last_became_peered":"2024-05-17T04:09:56.827614+0000","last_unstale":"2024-05-17T04:09:57.828529+0000","last_undegraded":"2024-05-17T04:09:57.828529+0000","last_fullsized":"2024-05-17T04:09:57.828529+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:27:11.379666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978424+0000","last_change":"2024-05-17T04:09:56.843755+0000","last_active":"2024-05-17T04:09:57.978424+0000","last_peered":"2024-05-17T04:09:57.978424+0000","last_clean":"2024-05-17T04:09:57.978424+0000","last_became_active":"2024-05-17T04:09:56.843458+0000","last_became_peered":"2024-05-17T04:09:56.843458+0000","last_unstale":"2024-05-17T04:09:57.978424+0000","last_undegraded":"2024-05-17T04:09:57.978424+0000","last_fullsized":"2024-05-17T04:09:57.978424+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:05:56.736360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828240+0000","last_change":"2024-05-17T04:09:56.836273+0000","last_active":"2024-05-17T04:09:57.828240+0000","last_peered":"2024-05-17T04:09:57.828240+0000","last_clean":"2024-05-17T04:09:57.828240+0000","last_became_active":"2024-05-17T04:09:56.835937+0000","last_became_peered":"2024-05-17T04:09:56.835937+0000","last_unstale":"2024-05-17T04:09:57.828240+0000","last_undegraded":"2024-05-17T04:09:57.828240+0000","last_fullsized":"2024-05-17T04:09:57.828240+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:59:52.445933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979236+0000","last_change":"2024-05-17T04:09:56.832537+0000","last_active":"2024-05-17T04:09:57.979236+0000","last_peered":"2024-05-17T04:09:57.979236+0000","last_clean":"2024-05-17T04:09:57.979236+0000","last_became_active":"2024-05-17T04:09:56.832043+0000","last_became_peered":"2024-05-17T04:09:56.832043+0000","last_unstale":"2024-05-17T04:09:57.979236+0000","last_undegraded":"2024-05-17T04:09:57.979236+0000","last_fullsized":"2024-05-17T04:09:57.979236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:01:33.323140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828047+0000","last_change":"2024-05-17T04:09:56.842305+0000","last_active":"2024-05-17T04:09:57.828047+0000","last_peered":"2024-05-17T04:09:57.828047+0000","last_clean":"2024-05-17T04:09:57.828047+0000","last_became_active":"2024-05-17T04:09:56.841368+0000","last_became_peered":"2024-05-17T04:09:56.841368+0000","last_unstale":"2024-05-17T04:09:57.828047+0000","last_undegraded":"2024-05-17T04:09:57.828047+0000","last_fullsized":"2024-05-17T04:09:57.828047+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:04:00.178469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828182+0000","last_change":"2024-05-17T04:09:56.835421+0000","last_active":"2024-05-17T04:09:57.828182+0000","last_peered":"2024-05-17T04:09:57.828182+0000","last_clean":"2024-05-17T04:09:57.828182+0000","last_became_active":"2024-05-17T04:09:56.835091+0000","last_became_peered":"2024-05-17T04:09:56.835091+0000","last_unstale":"2024-05-17T04:09:57.828182+0000","last_undegraded":"2024-05-17T04:09:57.828182+0000","last_fullsized":"2024-05-17T04:09:57.828182+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:19:17.078008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978517+0000","last_change":"2024-05-17T04:09:56.836391+0000","last_active":"2024-05-17T04:09:57.978517+0000","last_peered":"2024-05-17T04:09:57.978517+0000","last_clean":"2024-05-17T04:09:57.978517+0000","last_became_active":"2024-05-17T04:09:56.835618+0000","last_became_peered":"2024-05-17T04:09:56.835618+0000","last_unstale":"2024-05-17T04:09:57.978517+0000","last_undegraded":"2024-05-17T04:09:57.978517+0000","last_fullsized":"2024-05-17T04:09:57.978517+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:48:31.553971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977640+0000","last_change":"2024-05-17T04:09:56.835457+0000","last_active":"2024-05-17T04:09:57.977640+0000","last_peered":"2024-05-17T04:09:57.977640+0000","last_clean":"2024-05-17T04:09:57.977640+0000","last_became_active":"2024-05-17T04:09:56.835144+0000","last_became_peered":"2024-05-17T04:09:56.835144+0000","last_unstale":"2024-05-17T04:09:57.977640+0000","last_undegraded":"2024-05-17T04:09:57.977640+0000","last_fullsized":"2024-05-17T04:09:57.977640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:38:36.051847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978342+0000","last_change":"2024-05-17T04:09:56.838638+0000","last_active":"2024-05-17T04:09:57.978342+0000","last_peered":"2024-05-17T04:09:57.978342+0000","last_clean":"2024-05-17T04:09:57.978342+0000","last_became_active":"2024-05-17T04:09:56.838318+0000","last_became_peered":"2024-05-17T04:09:56.838318+0000","last_unstale":"2024-05-17T04:09:57.978342+0000","last_undegraded":"2024-05-17T04:09:57.978342+0000","last_fullsized":"2024-05-17T04:09:57.978342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:21:59.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828673+0000","last_change":"2024-05-17T04:09:55.818935+0000","last_active":"2024-05-17T04:09:57.828673+0000","last_peered":"2024-05-17T04:09:57.828673+0000","last_clean":"2024-05-17T04:09:57.828673+0000","last_became_active":"2024-05-17T04:09:55.818624+0000","last_became_peered":"2024-05-17T04:09:55.818624+0000","last_unstale":"2024-05-17T04:09:57.828673+0000","last_undegraded":"2024-05-17T04:09:57.828673+0000","last_fullsized":"2024-05-17T04:09:57.828673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:26:47.814637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978150+0000","last_change":"2024-05-17T04:09:56.848583+0000","last_active":"2024-05-17T04:09:57.978150+0000","last_peered":"2024-05-17T04:09:57.978150+0000","last_clean":"2024-05-17T04:09:57.978150+0000","last_became_active":"2024-05-17T04:09:56.848314+0000","last_became_peered":"2024-05-17T04:09:56.848314+0000","last_unstale":"2024-05-17T04:09:57.978150+0000","last_undegraded":"2024-05-17T04:09:57.978150+0000","last_fullsized":"2024-05-17T04:09:57.978150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:22:46.067823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977953+0000","last_change":"2024-05-17T04:09:55.821047+0000","last_active":"2024-05-17T04:09:57.977953+0000","last_peered":"2024-05-17T04:09:57.977953+0000","last_clean":"2024-05-17T04:09:57.977953+0000","last_became_active":"2024-05-17T04:09:55.820759+0000","last_became_peered":"2024-05-17T04:09:55.820759+0000","last_unstale":"2024-05-17T04:09:57.977953+0000","last_undegraded":"2024-05-17T04:09:57.977953+0000","last_fullsized":"2024-05-17T04:09:57.977953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:29:44.829522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.829362+0000","last_change":"2024-05-17T04:09:56.828152+0000","last_active":"2024-05-17T04:09:57.829362+0000","last_peered":"2024-05-17T04:09:57.829362+0000","last_clean":"2024-05-17T04:09:57.829362+0000","last_became_active":"2024-05-17T04:09:56.827843+0000","last_became_peered":"2024-05-17T04:09:56.827843+0000","last_unstale":"2024-05-17T04:09:57.829362+0000","last_undegraded":"2024-05-17T04:09:57.829362+0000","last_fullsized":"2024-05-17T04:09:57.829362+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:09:24.677580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978514+0000","last_change":"2024-05-17T04:09:55.820006+0000","last_active":"2024-05-17T04:09:57.978514+0000","last_peered":"2024-05-17T04:09:57.978514+0000","last_clean":"2024-05-17T04:09:57.978514+0000","last_became_active":"2024-05-17T04:09:55.819684+0000","last_became_peered":"2024-05-17T04:09:55.819684+0000","last_unstale":"2024-05-17T04:09:57.978514+0000","last_undegraded":"2024-05-17T04:09:57.978514+0000","last_fullsized":"2024-05-17T04:09:57.978514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:55:32.614756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978632+0000","last_change":"2024-05-17T04:09:56.827539+0000","last_active":"2024-05-17T04:09:57.978632+0000","last_peered":"2024-05-17T04:09:57.978632+0000","last_clean":"2024-05-17T04:09:57.978632+0000","last_became_active":"2024-05-17T04:09:56.826878+0000","last_became_peered":"2024-05-17T04:09:56.826878+0000","last_unstale":"2024-05-17T04:09:57.978632+0000","last_undegraded":"2024-05-17T04:09:57.978632+0000","last_fullsized":"2024-05-17T04:09:57.978632+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:50:36.421863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.829169+0000","last_change":"2024-05-17T04:09:55.803088+0000","last_active":"2024-05-17T04:09:57.829169+0000","last_peered":"2024-05-17T04:09:57.829169+0000","last_clean":"2024-05-17T04:09:57.829169+0000","last_became_active":"2024-05-17T04:09:55.802751+0000","last_became_peered":"2024-05-17T04:09:55.802751+0000","last_unstale":"2024-05-17T04:09:57.829169+0000","last_undegraded":"2024-05-17T04:09:57.829169+0000","last_fullsized":"2024-05-17T04:09:57.829169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:59:12.808353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977185+0000","last_change":"2024-05-17T04:09:56.825507+0000","last_active":"2024-05-17T04:09:57.977185+0000","last_peered":"2024-05-17T04:09:57.977185+0000","last_clean":"2024-05-17T04:09:57.977185+0000","last_became_active":"2024-05-17T04:09:56.825175+0000","last_became_peered":"2024-05-17T04:09:56.825175+0000","last_unstale":"2024-05-17T04:09:57.977185+0000","last_undegraded":"2024-05-17T04:09:57.977185+0000","last_fullsized":"2024-05-17T04:09:57.977185+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:22:46.067823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978959+0000","last_change":"2024-05-17T04:09:55.819632+0000","last_active":"2024-05-17T04:09:57.978959+0000","last_peered":"2024-05-17T04:09:57.978959+0000","last_clean":"2024-05-17T04:09:57.978959+0000","last_became_active":"2024-05-17T04:09:55.819271+0000","last_became_peered":"2024-05-17T04:09:55.819271+0000","last_unstale":"2024-05-17T04:09:57.978959+0000","last_undegraded":"2024-05-17T04:09:57.978959+0000","last_fullsized":"2024-05-17T04:09:57.978959+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:59:51.441138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978328+0000","last_change":"2024-05-17T04:09:56.843043+0000","last_active":"2024-05-17T04:09:57.978328+0000","last_peered":"2024-05-17T04:09:57.978328+0000","last_clean":"2024-05-17T04:09:57.978328+0000","last_became_active":"2024-05-17T04:09:56.842622+0000","last_became_peered":"2024-05-17T04:09:56.842622+0000","last_unstale":"2024-05-17T04:09:57.978328+0000","last_undegraded":"2024-05-17T04:09:57.978328+0000","last_fullsized":"2024-05-17T04:09:57.978328+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:29:33.758722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978085+0000","last_change":"2024-05-17T04:09:55.815834+0000","last_active":"2024-05-17T04:09:57.978085+0000","last_peered":"2024-05-17T04:09:57.978085+0000","last_clean":"2024-05-17T04:09:57.978085+0000","last_became_active":"2024-05-17T04:09:55.814885+0000","last_became_peered":"2024-05-17T04:09:55.814885+0000","last_unstale":"2024-05-17T04:09:57.978085+0000","last_undegraded":"2024-05-17T04:09:57.978085+0000","last_fullsized":"2024-05-17T04:09:57.978085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:29:44.829522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828310+0000","last_change":"2024-05-17T04:09:56.825054+0000","last_active":"2024-05-17T04:09:57.828310+0000","last_peered":"2024-05-17T04:09:57.828310+0000","last_clean":"2024-05-17T04:09:57.828310+0000","last_became_active":"2024-05-17T04:09:56.824266+0000","last_became_peered":"2024-05-17T04:09:56.824266+0000","last_unstale":"2024-05-17T04:09:57.828310+0000","last_undegraded":"2024-05-17T04:09:57.828310+0000","last_fullsized":"2024-05-17T04:09:57.828310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:43:51.560581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978291+0000","last_change":"2024-05-17T04:09:55.820732+0000","last_active":"2024-05-17T04:09:57.978291+0000","last_peered":"2024-05-17T04:09:57.978291+0000","last_clean":"2024-05-17T04:09:57.978291+0000","last_became_active":"2024-05-17T04:09:55.820445+0000","last_became_peered":"2024-05-17T04:09:55.820445+0000","last_unstale":"2024-05-17T04:09:57.978291+0000","last_undegraded":"2024-05-17T04:09:57.978291+0000","last_fullsized":"2024-05-17T04:09:57.978291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:01:41.468780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978201+0000","last_change":"2024-05-17T04:09:56.835846+0000","last_active":"2024-05-17T04:09:57.978201+0000","last_peered":"2024-05-17T04:09:57.978201+0000","last_clean":"2024-05-17T04:09:57.978201+0000","last_became_active":"2024-05-17T04:09:56.835477+0000","last_became_peered":"2024-05-17T04:09:56.835477+0000","last_unstale":"2024-05-17T04:09:57.978201+0000","last_undegraded":"2024-05-17T04:09:57.978201+0000","last_fullsized":"2024-05-17T04:09:57.978201+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:01:18.400546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.827717+0000","last_change":"2024-05-17T04:09:55.810472+0000","last_active":"2024-05-17T04:09:57.827717+0000","last_peered":"2024-05-17T04:09:57.827717+0000","last_clean":"2024-05-17T04:09:57.827717+0000","last_became_active":"2024-05-17T04:09:55.810163+0000","last_became_peered":"2024-05-17T04:09:55.810163+0000","last_unstale":"2024-05-17T04:09:57.827717+0000","last_undegraded":"2024-05-17T04:09:57.827717+0000","last_fullsized":"2024-05-17T04:09:57.827717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:51:09.126771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830738+0000","last_change":"2024-05-17T04:09:56.822558+0000","last_active":"2024-05-17T04:09:57.830738+0000","last_peered":"2024-05-17T04:09:57.830738+0000","last_clean":"2024-05-17T04:09:57.830738+0000","last_became_active":"2024-05-17T04:09:56.822225+0000","last_became_peered":"2024-05-17T04:09:56.822225+0000","last_unstale":"2024-05-17T04:09:57.830738+0000","last_undegraded":"2024-05-17T04:09:57.830738+0000","last_fullsized":"2024-05-17T04:09:57.830738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:51:19.045405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978750+0000","last_change":"2024-05-17T04:09:55.816188+0000","last_active":"2024-05-17T04:09:57.978750+0000","last_peered":"2024-05-17T04:09:57.978750+0000","last_clean":"2024-05-17T04:09:57.978750+0000","last_became_active":"2024-05-17T04:09:55.815864+0000","last_became_peered":"2024-05-17T04:09:55.815864+0000","last_unstale":"2024-05-17T04:09:57.978750+0000","last_undegraded":"2024-05-17T04:09:57.978750+0000","last_fullsized":"2024-05-17T04:09:57.978750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:32:09.495723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978308+0000","last_change":"2024-05-17T04:09:56.830612+0000","last_active":"2024-05-17T04:09:57.978308+0000","last_peered":"2024-05-17T04:09:57.978308+0000","last_clean":"2024-05-17T04:09:57.978308+0000","last_became_active":"2024-05-17T04:09:56.830260+0000","last_became_peered":"2024-05-17T04:09:56.830260+0000","last_unstale":"2024-05-17T04:09:57.978308+0000","last_undegraded":"2024-05-17T04:09:57.978308+0000","last_fullsized":"2024-05-17T04:09:57.978308+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:29:03.731516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979390+0000","last_change":"2024-05-17T04:09:55.813554+0000","last_active":"2024-05-17T04:09:57.979390+0000","last_peered":"2024-05-17T04:09:57.979390+0000","last_clean":"2024-05-17T04:09:57.979390+0000","last_became_active":"2024-05-17T04:09:55.813157+0000","last_became_peered":"2024-05-17T04:09:55.813157+0000","last_unstale":"2024-05-17T04:09:57.979390+0000","last_undegraded":"2024-05-17T04:09:57.979390+0000","last_fullsized":"2024-05-17T04:09:57.979390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:27:10.374871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977840+0000","last_change":"2024-05-17T04:09:56.834168+0000","last_active":"2024-05-17T04:09:57.977840+0000","last_peered":"2024-05-17T04:09:57.977840+0000","last_clean":"2024-05-17T04:09:57.977840+0000","last_became_active":"2024-05-17T04:09:56.833861+0000","last_became_peered":"2024-05-17T04:09:56.833861+0000","last_unstale":"2024-05-17T04:09:57.977840+0000","last_undegraded":"2024-05-17T04:09:57.977840+0000","last_fullsized":"2024-05-17T04:09:57.977840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:21:59.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979202+0000","last_change":"2024-05-17T04:09:55.819860+0000","last_active":"2024-05-17T04:09:57.979202+0000","last_peered":"2024-05-17T04:09:57.979202+0000","last_clean":"2024-05-17T04:09:57.979202+0000","last_became_active":"2024-05-17T04:09:55.819443+0000","last_became_peered":"2024-05-17T04:09:55.819443+0000","last_unstale":"2024-05-17T04:09:57.979202+0000","last_undegraded":"2024-05-17T04:09:57.979202+0000","last_fullsized":"2024-05-17T04:09:57.979202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:19:16.073212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.829287+0000","last_change":"2024-05-17T04:09:56.828134+0000","last_active":"2024-05-17T04:09:57.829287+0000","last_peered":"2024-05-17T04:09:57.829287+0000","last_clean":"2024-05-17T04:09:57.829287+0000","last_became_active":"2024-05-17T04:09:56.827447+0000","last_became_peered":"2024-05-17T04:09:56.827447+0000","last_unstale":"2024-05-17T04:09:57.829287+0000","last_undegraded":"2024-05-17T04:09:57.829287+0000","last_fullsized":"2024-05-17T04:09:57.829287+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:05:56.736360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977848+0000","last_change":"2024-05-17T04:09:55.809191+0000","last_active":"2024-05-17T04:09:57.977848+0000","last_peered":"2024-05-17T04:09:57.977848+0000","last_clean":"2024-05-17T04:09:57.977848+0000","last_became_active":"2024-05-17T04:09:55.808844+0000","last_became_peered":"2024-05-17T04:09:55.808844+0000","last_unstale":"2024-05-17T04:09:57.977848+0000","last_undegraded":"2024-05-17T04:09:57.977848+0000","last_fullsized":"2024-05-17T04:09:57.977848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:22:45.063028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977183+0000","last_change":"2024-05-17T04:09:56.838875+0000","last_active":"2024-05-17T04:09:57.977183+0000","last_peered":"2024-05-17T04:09:57.977183+0000","last_clean":"2024-05-17T04:09:57.977183+0000","last_became_active":"2024-05-17T04:09:56.838541+0000","last_became_peered":"2024-05-17T04:09:56.838541+0000","last_unstale":"2024-05-17T04:09:57.977183+0000","last_undegraded":"2024-05-17T04:09:57.977183+0000","last_fullsized":"2024-05-17T04:09:57.977183+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:43:51.560581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978499+0000","last_change":"2024-05-17T04:09:55.813738+0000","last_active":"2024-05-17T04:09:57.978499+0000","last_peered":"2024-05-17T04:09:57.978499+0000","last_clean":"2024-05-17T04:09:57.978499+0000","last_became_active":"2024-05-17T04:09:55.813395+0000","last_became_peered":"2024-05-17T04:09:55.813395+0000","last_unstale":"2024-05-17T04:09:57.978499+0000","last_undegraded":"2024-05-17T04:09:57.978499+0000","last_fullsized":"2024-05-17T04:09:57.978499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:43:50.555786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978166+0000","last_change":"2024-05-17T04:09:56.823839+0000","last_active":"2024-05-17T04:09:57.978166+0000","last_peered":"2024-05-17T04:09:57.978166+0000","last_clean":"2024-05-17T04:09:57.978166+0000","last_became_active":"2024-05-17T04:09:56.823497+0000","last_became_peered":"2024-05-17T04:09:56.823497+0000","last_unstale":"2024-05-17T04:09:57.978166+0000","last_undegraded":"2024-05-17T04:09:57.978166+0000","last_fullsized":"2024-05-17T04:09:57.978166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:09:46.641376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977380+0000","last_change":"2024-05-17T04:09:55.819468+0000","last_active":"2024-05-17T04:09:57.977380+0000","last_peered":"2024-05-17T04:09:57.977380+0000","last_clean":"2024-05-17T04:09:57.977380+0000","last_became_active":"2024-05-17T04:09:55.819137+0000","last_became_peered":"2024-05-17T04:09:55.819137+0000","last_unstale":"2024-05-17T04:09:57.977380+0000","last_undegraded":"2024-05-17T04:09:57.977380+0000","last_fullsized":"2024-05-17T04:09:57.977380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:29:44.829522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978228+0000","last_change":"2024-05-17T04:09:56.838101+0000","last_active":"2024-05-17T04:09:57.978228+0000","last_peered":"2024-05-17T04:09:57.978228+0000","last_clean":"2024-05-17T04:09:57.978228+0000","last_became_active":"2024-05-17T04:09:56.834695+0000","last_became_peered":"2024-05-17T04:09:56.834695+0000","last_unstale":"2024-05-17T04:09:57.978228+0000","last_undegraded":"2024-05-17T04:09:57.978228+0000","last_fullsized":"2024-05-17T04:09:57.978228+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T15:55:45.396403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.827828+0000","last_change":"2024-05-17T04:09:55.816322+0000","last_active":"2024-05-17T04:09:57.827828+0000","last_peered":"2024-05-17T04:09:57.827828+0000","last_clean":"2024-05-17T04:09:57.827828+0000","last_became_active":"2024-05-17T04:09:55.814342+0000","last_became_peered":"2024-05-17T04:09:55.814342+0000","last_unstale":"2024-05-17T04:09:57.827828+0000","last_undegraded":"2024-05-17T04:09:57.827828+0000","last_fullsized":"2024-05-17T04:09:57.827828+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:51:18.040610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978376+0000","last_change":"2024-05-17T04:09:56.828470+0000","last_active":"2024-05-17T04:09:57.978376+0000","last_peered":"2024-05-17T04:09:57.978376+0000","last_clean":"2024-05-17T04:09:57.978376+0000","last_became_active":"2024-05-17T04:09:56.828098+0000","last_became_peered":"2024-05-17T04:09:56.828098+0000","last_unstale":"2024-05-17T04:09:57.978376+0000","last_undegraded":"2024-05-17T04:09:57.978376+0000","last_fullsized":"2024-05-17T04:09:57.978376+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:01:33.323140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978418+0000","last_change":"2024-05-17T04:09:55.818372+0000","last_active":"2024-05-17T04:09:57.978418+0000","last_peered":"2024-05-17T04:09:57.978418+0000","last_clean":"2024-05-17T04:09:57.978418+0000","last_became_active":"2024-05-17T04:09:55.818044+0000","last_became_peered":"2024-05-17T04:09:55.818044+0000","last_unstale":"2024-05-17T04:09:57.978418+0000","last_undegraded":"2024-05-17T04:09:57.978418+0000","last_fullsized":"2024-05-17T04:09:57.978418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:08:21.444990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977661+0000","last_change":"2024-05-17T04:09:56.828516+0000","last_active":"2024-05-17T04:09:57.977661+0000","last_peered":"2024-05-17T04:09:57.977661+0000","last_clean":"2024-05-17T04:09:57.977661+0000","last_became_active":"2024-05-17T04:09:56.828173+0000","last_became_peered":"2024-05-17T04:09:56.828173+0000","last_unstale":"2024-05-17T04:09:57.977661+0000","last_undegraded":"2024-05-17T04:09:57.977661+0000","last_fullsized":"2024-05-17T04:09:57.977661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:29:33.758722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979370+0000","last_change":"2024-05-17T04:09:55.820473+0000","last_active":"2024-05-17T04:09:57.979370+0000","last_peered":"2024-05-17T04:09:57.979370+0000","last_clean":"2024-05-17T04:09:57.979370+0000","last_became_active":"2024-05-17T04:09:55.819912+0000","last_became_peered":"2024-05-17T04:09:55.819912+0000","last_unstale":"2024-05-17T04:09:57.979370+0000","last_undegraded":"2024-05-17T04:09:57.979370+0000","last_fullsized":"2024-05-17T04:09:57.979370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:38:35.047051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979246+0000","last_change":"2024-05-17T04:09:56.843825+0000","last_active":"2024-05-17T04:09:57.979246+0000","last_peered":"2024-05-17T04:09:57.979246+0000","last_clean":"2024-05-17T04:09:57.979246+0000","last_became_active":"2024-05-17T04:09:56.843379+0000","last_became_peered":"2024-05-17T04:09:56.843379+0000","last_unstale":"2024-05-17T04:09:57.979246+0000","last_undegraded":"2024-05-17T04:09:57.979246+0000","last_fullsized":"2024-05-17T04:09:57.979246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:06:16.828830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.829077+0000","last_change":"2024-05-17T04:09:55.814871+0000","last_active":"2024-05-17T04:09:57.829077+0000","last_peered":"2024-05-17T04:09:57.829077+0000","last_clean":"2024-05-17T04:09:57.829077+0000","last_became_active":"2024-05-17T04:09:55.814550+0000","last_became_peered":"2024-05-17T04:09:55.814550+0000","last_unstale":"2024-05-17T04:09:57.829077+0000","last_undegraded":"2024-05-17T04:09:57.829077+0000","last_fullsized":"2024-05-17T04:09:57.829077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:01:41.468780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828931+0000","last_change":"2024-05-17T04:09:56.845482+0000","last_active":"2024-05-17T04:09:57.828931+0000","last_peered":"2024-05-17T04:09:57.828931+0000","last_clean":"2024-05-17T04:09:57.828931+0000","last_became_active":"2024-05-17T04:09:56.845150+0000","last_became_peered":"2024-05-17T04:09:56.845150+0000","last_unstale":"2024-05-17T04:09:57.828931+0000","last_undegraded":"2024-05-17T04:09:57.828931+0000","last_fullsized":"2024-05-17T04:09:57.828931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:32:10.500518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830876+0000","last_change":"2024-05-17T04:09:55.813431+0000","last_active":"2024-05-17T04:09:57.830876+0000","last_peered":"2024-05-17T04:09:57.830876+0000","last_clean":"2024-05-17T04:09:57.830876+0000","last_became_active":"2024-05-17T04:09:55.812014+0000","last_became_peered":"2024-05-17T04:09:55.812014+0000","last_unstale":"2024-05-17T04:09:57.830876+0000","last_undegraded":"2024-05-17T04:09:57.830876+0000","last_fullsized":"2024-05-17T04:09:57.830876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:33:01.782172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830943+0000","last_change":"2024-05-17T04:09:56.826828+0000","last_active":"2024-05-17T04:09:57.830943+0000","last_peered":"2024-05-17T04:09:57.830943+0000","last_clean":"2024-05-17T04:09:57.830943+0000","last_became_active":"2024-05-17T04:09:56.826498+0000","last_became_peered":"2024-05-17T04:09:56.826498+0000","last_unstale":"2024-05-17T04:09:57.830943+0000","last_undegraded":"2024-05-17T04:09:57.830943+0000","last_fullsized":"2024-05-17T04:09:57.830943+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T12:51:10.131566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978160+0000","last_change":"2024-05-17T04:09:55.820032+0000","last_active":"2024-05-17T04:09:57.978160+0000","last_peered":"2024-05-17T04:09:57.978160+0000","last_clean":"2024-05-17T04:09:57.978160+0000","last_became_active":"2024-05-17T04:09:55.819333+0000","last_became_peered":"2024-05-17T04:09:55.819333+0000","last_unstale":"2024-05-17T04:09:57.978160+0000","last_undegraded":"2024-05-17T04:09:57.978160+0000","last_fullsized":"2024-05-17T04:09:57.978160+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:59:12.808353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978508+0000","last_change":"2024-05-17T04:09:56.836032+0000","last_active":"2024-05-17T04:09:57.978508+0000","last_peered":"2024-05-17T04:09:57.978508+0000","last_clean":"2024-05-17T04:09:57.978508+0000","last_became_active":"2024-05-17T04:09:56.835451+0000","last_became_peered":"2024-05-17T04:09:56.835451+0000","last_unstale":"2024-05-17T04:09:57.978508+0000","last_undegraded":"2024-05-17T04:09:57.978508+0000","last_fullsized":"2024-05-17T04:09:57.978508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:56:08.379281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830527+0000","last_change":"2024-05-17T04:09:55.813681+0000","last_active":"2024-05-17T04:09:57.830527+0000","last_peered":"2024-05-17T04:09:57.830527+0000","last_clean":"2024-05-17T04:09:57.830527+0000","last_became_active":"2024-05-17T04:09:55.813092+0000","last_became_peered":"2024-05-17T04:09:55.813092+0000","last_unstale":"2024-05-17T04:09:57.830527+0000","last_undegraded":"2024-05-17T04:09:57.830527+0000","last_fullsized":"2024-05-17T04:09:57.830527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:31:59.962795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977391+0000","last_change":"2024-05-17T04:09:56.840744+0000","last_active":"2024-05-17T04:09:57.977391+0000","last_peered":"2024-05-17T04:09:57.977391+0000","last_clean":"2024-05-17T04:09:57.977391+0000","last_became_active":"2024-05-17T04:09:56.840435+0000","last_became_peered":"2024-05-17T04:09:56.840435+0000","last_unstale":"2024-05-17T04:09:57.977391+0000","last_undegraded":"2024-05-17T04:09:57.977391+0000","last_fullsized":"2024-05-17T04:09:57.977391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:09:24.677580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830625+0000","last_change":"2024-05-17T04:09:55.813684+0000","last_active":"2024-05-17T04:09:57.830625+0000","last_peered":"2024-05-17T04:09:57.830625+0000","last_clean":"2024-05-17T04:09:57.830625+0000","last_became_active":"2024-05-17T04:09:55.813359+0000","last_became_peered":"2024-05-17T04:09:55.813359+0000","last_unstale":"2024-05-17T04:09:57.830625+0000","last_undegraded":"2024-05-17T04:09:57.830625+0000","last_fullsized":"2024-05-17T04:09:57.830625+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:03:29.235687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978745+0000","last_change":"2024-05-17T04:09:56.834171+0000","last_active":"2024-05-17T04:09:57.978745+0000","last_peered":"2024-05-17T04:09:57.978745+0000","last_clean":"2024-05-17T04:09:57.978745+0000","last_became_active":"2024-05-17T04:09:56.833490+0000","last_became_peered":"2024-05-17T04:09:56.833490+0000","last_unstale":"2024-05-17T04:09:57.978745+0000","last_undegraded":"2024-05-17T04:09:57.978745+0000","last_fullsized":"2024-05-17T04:09:57.978745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:20:04.060791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978943+0000","last_change":"2024-05-17T04:09:55.810012+0000","last_active":"2024-05-17T04:09:57.978943+0000","last_peered":"2024-05-17T04:09:57.978943+0000","last_clean":"2024-05-17T04:09:57.978943+0000","last_became_active":"2024-05-17T04:09:55.809683+0000","last_became_peered":"2024-05-17T04:09:55.809683+0000","last_unstale":"2024-05-17T04:09:57.978943+0000","last_undegraded":"2024-05-17T04:09:57.978943+0000","last_fullsized":"2024-05-17T04:09:57.978943+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:55:32.614756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978379+0000","last_change":"2024-05-17T04:09:56.831909+0000","last_active":"2024-05-17T04:09:57.978379+0000","last_peered":"2024-05-17T04:09:57.978379+0000","last_clean":"2024-05-17T04:09:57.978379+0000","last_became_active":"2024-05-17T04:09:56.831615+0000","last_became_peered":"2024-05-17T04:09:56.831615+0000","last_unstale":"2024-05-17T04:09:57.978379+0000","last_undegraded":"2024-05-17T04:09:57.978379+0000","last_fullsized":"2024-05-17T04:09:57.978379+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:06:16.828830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830725+0000","last_change":"2024-05-17T04:09:55.810705+0000","last_active":"2024-05-17T04:09:57.830725+0000","last_peered":"2024-05-17T04:09:57.830725+0000","last_clean":"2024-05-17T04:09:57.830725+0000","last_became_active":"2024-05-17T04:09:55.809986+0000","last_became_peered":"2024-05-17T04:09:55.809986+0000","last_unstale":"2024-05-17T04:09:57.830725+0000","last_undegraded":"2024-05-17T04:09:57.830725+0000","last_fullsized":"2024-05-17T04:09:57.830725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:56:33.396772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978036+0000","last_change":"2024-05-17T04:09:56.845417+0000","last_active":"2024-05-17T04:09:57.978036+0000","last_peered":"2024-05-17T04:09:57.978036+0000","last_clean":"2024-05-17T04:09:57.978036+0000","last_became_active":"2024-05-17T04:09:56.845068+0000","last_became_peered":"2024-05-17T04:09:56.845068+0000","last_unstale":"2024-05-17T04:09:57.978036+0000","last_undegraded":"2024-05-17T04:09:57.978036+0000","last_fullsized":"2024-05-17T04:09:57.978036+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:43:51.560581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979536+0000","last_change":"2024-05-17T04:09:55.821625+0000","last_active":"2024-05-17T04:09:57.979536+0000","last_peered":"2024-05-17T04:09:57.979536+0000","last_clean":"2024-05-17T04:09:57.979536+0000","last_became_active":"2024-05-17T04:09:55.821375+0000","last_became_peered":"2024-05-17T04:09:55.821375+0000","last_unstale":"2024-05-17T04:09:57.979536+0000","last_undegraded":"2024-05-17T04:09:57.979536+0000","last_fullsized":"2024-05-17T04:09:57.979536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:43:50.555786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978526+0000","last_change":"2024-05-17T04:09:56.830703+0000","last_active":"2024-05-17T04:09:57.978526+0000","last_peered":"2024-05-17T04:09:57.978526+0000","last_clean":"2024-05-17T04:09:57.978526+0000","last_became_active":"2024-05-17T04:09:56.830376+0000","last_became_peered":"2024-05-17T04:09:56.830376+0000","last_unstale":"2024-05-17T04:09:57.978526+0000","last_undegraded":"2024-05-17T04:09:57.978526+0000","last_fullsized":"2024-05-17T04:09:57.978526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T13:58:50.752050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.830932+0000","last_change":"2024-05-17T04:09:55.813989+0000","last_active":"2024-05-17T04:09:57.830932+0000","last_peered":"2024-05-17T04:09:57.830932+0000","last_clean":"2024-05-17T04:09:57.830932+0000","last_became_active":"2024-05-17T04:09:55.813713+0000","last_became_peered":"2024-05-17T04:09:55.813713+0000","last_unstale":"2024-05-17T04:09:57.830932+0000","last_undegraded":"2024-05-17T04:09:57.830932+0000","last_fullsized":"2024-05-17T04:09:57.830932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:33:29.682901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978178+0000","last_change":"2024-05-17T04:09:56.824592+0000","last_active":"2024-05-17T04:09:57.978178+0000","last_peered":"2024-05-17T04:09:57.978178+0000","last_clean":"2024-05-17T04:09:57.978178+0000","last_became_active":"2024-05-17T04:09:56.824264+0000","last_became_peered":"2024-05-17T04:09:56.824264+0000","last_unstale":"2024-05-17T04:09:57.978178+0000","last_undegraded":"2024-05-17T04:09:57.978178+0000","last_fullsized":"2024-05-17T04:09:57.978178+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T11:46:26.786323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977490+0000","last_change":"2024-05-17T04:09:55.820524+0000","last_active":"2024-05-17T04:09:57.977490+0000","last_peered":"2024-05-17T04:09:57.977490+0000","last_clean":"2024-05-17T04:09:57.977490+0000","last_became_active":"2024-05-17T04:09:55.820170+0000","last_became_peered":"2024-05-17T04:09:55.820170+0000","last_unstale":"2024-05-17T04:09:57.977490+0000","last_undegraded":"2024-05-17T04:09:57.977490+0000","last_fullsized":"2024-05-17T04:09:57.977490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:01:41.468780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977360+0000","last_change":"2024-05-17T04:09:56.822319+0000","last_active":"2024-05-17T04:09:57.977360+0000","last_peered":"2024-05-17T04:09:57.977360+0000","last_clean":"2024-05-17T04:09:57.977360+0000","last_became_active":"2024-05-17T04:09:56.821979+0000","last_became_peered":"2024-05-17T04:09:56.821979+0000","last_unstale":"2024-05-17T04:09:57.977360+0000","last_undegraded":"2024-05-17T04:09:57.977360+0000","last_fullsized":"2024-05-17T04:09:57.977360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:32:10.500518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978374+0000","last_change":"2024-05-17T04:09:55.812473+0000","last_active":"2024-05-17T04:09:57.978374+0000","last_peered":"2024-05-17T04:09:57.978374+0000","last_clean":"2024-05-17T04:09:57.978374+0000","last_became_active":"2024-05-17T04:09:55.812099+0000","last_became_peered":"2024-05-17T04:09:55.812099+0000","last_unstale":"2024-05-17T04:09:57.978374+0000","last_undegraded":"2024-05-17T04:09:57.978374+0000","last_fullsized":"2024-05-17T04:09:57.978374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:59:12.808353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978225+0000","last_change":"2024-05-17T04:09:56.841868+0000","last_active":"2024-05-17T04:09:57.978225+0000","last_peered":"2024-05-17T04:09:57.978225+0000","last_clean":"2024-05-17T04:09:57.978225+0000","last_became_active":"2024-05-17T04:09:56.839312+0000","last_became_peered":"2024-05-17T04:09:56.839312+0000","last_unstale":"2024-05-17T04:09:57.978225+0000","last_undegraded":"2024-05-17T04:09:57.978225+0000","last_fullsized":"2024-05-17T04:09:57.978225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:32:10.500518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828254+0000","last_change":"2024-05-17T04:09:55.814681+0000","last_active":"2024-05-17T04:09:57.828254+0000","last_peered":"2024-05-17T04:09:57.828254+0000","last_clean":"2024-05-17T04:09:57.828254+0000","last_became_active":"2024-05-17T04:09:55.814222+0000","last_became_peered":"2024-05-17T04:09:55.814222+0000","last_unstale":"2024-05-17T04:09:57.828254+0000","last_undegraded":"2024-05-17T04:09:57.828254+0000","last_fullsized":"2024-05-17T04:09:57.828254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:12:38.053932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828049+0000","last_change":"2024-05-17T04:09:56.821564+0000","last_active":"2024-05-17T04:09:57.828049+0000","last_peered":"2024-05-17T04:09:57.828049+0000","last_clean":"2024-05-17T04:09:57.828049+0000","last_became_active":"2024-05-17T04:09:56.821165+0000","last_became_peered":"2024-05-17T04:09:56.821165+0000","last_unstale":"2024-05-17T04:09:57.828049+0000","last_undegraded":"2024-05-17T04:09:57.828049+0000","last_fullsized":"2024-05-17T04:09:57.828049+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:38:36.051847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.828775+0000","last_change":"2024-05-17T04:09:55.803946+0000","last_active":"2024-05-17T04:09:57.828775+0000","last_peered":"2024-05-17T04:09:57.828775+0000","last_clean":"2024-05-17T04:09:57.828775+0000","last_became_active":"2024-05-17T04:09:55.803625+0000","last_became_peered":"2024-05-17T04:09:55.803625+0000","last_unstale":"2024-05-17T04:09:57.828775+0000","last_undegraded":"2024-05-17T04:09:57.828775+0000","last_fullsized":"2024-05-17T04:09:57.828775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:29:44.829522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978668+0000","last_change":"2024-05-17T04:09:56.836711+0000","last_active":"2024-05-17T04:09:57.978668+0000","last_peered":"2024-05-17T04:09:57.978668+0000","last_clean":"2024-05-17T04:09:57.978668+0000","last_became_active":"2024-05-17T04:09:56.836091+0000","last_became_peered":"2024-05-17T04:09:56.836091+0000","last_unstale":"2024-05-17T04:09:57.978668+0000","last_undegraded":"2024-05-17T04:09:57.978668+0000","last_fullsized":"2024-05-17T04:09:57.978668+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:32:13.837690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.977758+0000","last_change":"2024-05-17T04:09:55.820172+0000","last_active":"2024-05-17T04:09:57.977758+0000","last_peered":"2024-05-17T04:09:57.977758+0000","last_clean":"2024-05-17T04:09:57.977758+0000","last_became_active":"2024-05-17T04:09:55.819863+0000","last_became_peered":"2024-05-17T04:09:55.819863+0000","last_unstale":"2024-05-17T04:09:57.977758+0000","last_undegraded":"2024-05-17T04:09:57.977758+0000","last_fullsized":"2024-05-17T04:09:57.977758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:38:35.047051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.979454+0000","last_change":"2024-05-17T04:09:56.832392+0000","last_active":"2024-05-17T04:09:57.979454+0000","last_peered":"2024-05-17T04:09:57.979454+0000","last_clean":"2024-05-17T04:09:57.979454+0000","last_became_active":"2024-05-17T04:09:56.832128+0000","last_became_peered":"2024-05-17T04:09:56.832128+0000","last_unstale":"2024-05-17T04:09:57.979454+0000","last_undegraded":"2024-05-17T04:09:57.979454+0000","last_fullsized":"2024-05-17T04:09:57.979454+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:55.791811+0000","last_clean_scrub_stamp":"2024-05-17T04:09:55.791811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:47:11.150860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978575+0000","last_change":"2024-05-17T04:09:55.813505+0000","last_active":"2024-05-17T04:09:57.978575+0000","last_peered":"2024-05-17T04:09:57.978575+0000","last_clean":"2024-05-17T04:09:57.978575+0000","last_became_active":"2024-05-17T04:09:55.813190+0000","last_became_peered":"2024-05-17T04:09:55.813190+0000","last_unstale":"2024-05-17T04:09:57.978575+0000","last_undegraded":"2024-05-17T04:09:57.978575+0000","last_fullsized":"2024-05-17T04:09:57.978575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:09:54.787016+0000","last_clean_scrub_stamp":"2024-05-17T04:09:54.787016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T14:59:12.808353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":139,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-17T04:09:57.978520+0000","last_change":"2024-05-17T04:08:56.447797+0000","last_active":"2024-05-17T04:09:57.978520+0000","last_peered":"2024-05-17T04:09:57.978520+0000","last_clean":"2024-05-17T04:09:57.978520+0000","last_became_active":"2024-05-17T04:08:56.446705+0000","last_became_peered":"2024-05-17T04:08:56.446705+0000","last_unstale":"2024-05-17T04:09:57.978520+0000","last_undegraded":"2024-05-17T04:09:57.978520+0000","last_fullsized":"2024-05-17T04:09:57.978520+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_clean_scrub_stamp":"2024-05-17T04:08:54.847367+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:40:00.515431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":768021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":176083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":176575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":177617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1011712,"data_stored":766373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-17T04:10:01.248 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-17T04:10:01.248 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-17T04:10:01.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.401+0000 7f8c655eb640 1 Processor -- start 2024-05-17T04:10:01.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.401+0000 7f8c655eb640 1 -- start start 2024-05-17T04:10:01.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.402+0000 7f8c655eb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c60145a60 0x7f8c60163cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.402+0000 7f8c655eb640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c60164230 con 0x7f8c60073eb0 2024-05-17T04:10:01.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.402+0000 7f8c655eb640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c60145e70 con 0x7f8c600afa90 2024-05-17T04:10:01.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.402+0000 7f8c655eb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8c600d1840 con 0x7f8c60145a60 2024-05-17T04:10:01.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.402+0000 7f8c5e7fc640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f8c60073eb0 0x7f8c600742c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46530/0 (socket says 172.21.15.131:46530) 2024-05-17T04:10:01.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.402+0000 7f8c5e7fc640 1 -- 172.21.15.131:0/989830662 learned_addr learned my addr 172.21.15.131:0/989830662 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:10:01.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.402+0000 7f8c5effd640 1 --2- 172.21.15.131:0/989830662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c60145a60 0x7f8c60163cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.402+0000 7f8c5dffb640 1 -- 172.21.15.131:0/989830662 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1390668975 0 0) 0x7f8c54001110 con 0x7f8c60073eb0 2024-05-17T04:10:01.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.402+0000 7f8c5dffb640 1 -- 172.21.15.131:0/989830662 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c48003520 con 0x7f8c60073eb0 2024-05-17T04:10:01.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5dffb640 1 -- 172.21.15.131:0/989830662 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3279023799 0 0) 0x7f8c48003520 con 0x7f8c60073eb0 2024-05-17T04:10:01.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5dffb640 1 -- 172.21.15.131:0/989830662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c60145a60 msgr2=0x7f8c60163cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:01.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5dffb640 1 --2- 172.21.15.131:0/989830662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c60145a60 0x7f8c60163cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5dffb640 1 -- 172.21.15.131:0/989830662 >> v1:172.21.15.150:6789/0 conn(0x7f8c600afa90 legacy=0x7f8c600afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5dffb640 1 -- 172.21.15.131:0/989830662 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c600d0c30 con 0x7f8c60073eb0 2024-05-17T04:10:01.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5dffb640 1 -- 172.21.15.131:0/989830662 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7f8c540018c0 con 0x7f8c60073eb0 2024-05-17T04:10:01.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5dffb640 1 -- 172.21.15.131:0/989830662 >> v1:172.21.15.131:6789/0 conn(0x7f8c60073eb0 legacy=0x7f8c600742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5dffb640 1 --2- 172.21.15.131:0/989830662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c48003a30 0x7f8c48003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5dffb640 1 --2- 172.21.15.131:0/989830662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c60145a60 0x7f8c48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5dffb640 1 --2- 172.21.15.131:0/989830662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c48004d40 0x7f8c480051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5dffb640 1 -- 172.21.15.131:0/989830662 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8c600d1840 con 0x7f8c48004d40 2024-05-17T04:10:01.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5dffb640 1 -- 172.21.15.131:0/989830662 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4800bb80 con 0x7f8c48003a30 2024-05-17T04:10:01.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5dffb640 1 -- 172.21.15.131:0/989830662 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4800bd80 con 0x7f8c60145a60 2024-05-17T04:10:01.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5f7fe640 1 --2- 172.21.15.131:0/989830662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c48004d40 0x7f8c480051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5effd640 1 --2- 172.21.15.131:0/989830662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c48003a30 0x7f8c48003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5e7fc640 1 --2- 172.21.15.131:0/989830662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c60145a60 0x7f8c48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5f7fe640 1 -- 172.21.15.131:0/989830662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c60145a60 msgr2=0x7f8c48004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:01.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5f7fe640 1 --2- 172.21.15.131:0/989830662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c60145a60 0x7f8c48004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5f7fe640 1 -- 172.21.15.131:0/989830662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c48003a30 msgr2=0x7f8c48003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:01.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5f7fe640 1 --2- 172.21.15.131:0/989830662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c48003a30 0x7f8c48003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.403+0000 7f8c5f7fe640 1 -- 172.21.15.131:0/989830662 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c48003520 con 0x7f8c48004d40 2024-05-17T04:10:01.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.404+0000 7f8c5f7fe640 1 --2- 172.21.15.131:0/989830662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c48004d40 0x7f8c480051f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8c58001e90 tx=0x7f8c48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466d23ce34e01262 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:01.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.404+0000 7f8c5dffb640 1 -- 172.21.15.131:0/989830662 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58001ab0 con 0x7f8c48004d40 2024-05-17T04:10:01.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.404+0000 7f8c5dffb640 1 -- 172.21.15.131:0/989830662 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5802ae50 con 0x7f8c48004d40 2024-05-17T04:10:01.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.404+0000 7f8c5dffb640 1 -- 172.21.15.131:0/989830662 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58003b70 con 0x7f8c48004d40 2024-05-17T04:10:01.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.405+0000 7f8c655eb640 1 -- 172.21.15.131:0/989830662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c48004d40 msgr2=0x7f8c480051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.405+0000 7f8c655eb640 1 --2- 172.21.15.131:0/989830662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c48004d40 0x7f8c480051f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8c58001e90 tx=0x7f8c48005830 comp rx=0 tx=0).stop 2024-05-17T04:10:01.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.405+0000 7f8c5f7fe640 1 -- 172.21.15.131:0/989830662 reap_dead start 2024-05-17T04:10:01.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.405+0000 7f8c655eb640 1 -- 172.21.15.131:0/989830662 shutdown_connections 2024-05-17T04:10:01.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.405+0000 7f8c655eb640 1 -- 172.21.15.131:0/989830662 >> 172.21.15.131:0/989830662 conn(0x7f8c600b4450 msgr2=0x7f8c600737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:01.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.405+0000 7f8c655eb640 1 -- 172.21.15.131:0/989830662 shutdown_connections 2024-05-17T04:10:01.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.405+0000 7f8c655eb640 1 -- 172.21.15.131:0/989830662 wait complete. 2024-05-17T04:10:01.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.407+0000 7f8c655eb640 1 Processor -- start 2024-05-17T04:10:01.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.407+0000 7f8c655eb640 1 -- start start 2024-05-17T04:10:01.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.408+0000 7f8c655eb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c601f5a30 0x7f8c601f8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.408+0000 7f8c655eb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c600b2320 0x7f8c600b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.408+0000 7f8c655eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c601ea2c0 0x7f8c601ea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.408+0000 7f8c655eb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8c600d14d0 con 0x7f8c601ea2c0 2024-05-17T04:10:01.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.408+0000 7f8c655eb640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8c600d11f0 con 0x7f8c601f5a30 2024-05-17T04:10:01.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.408+0000 7f8c655eb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8c601490c0 con 0x7f8c600b2320 2024-05-17T04:10:01.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.408+0000 7f8c5f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c601ea2c0 0x7f8c601ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.408+0000 7f8c5f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c601ea2c0 0x7f8c601ea6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46466/0 (socket says 172.21.15.131:46466) 2024-05-17T04:10:01.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.408+0000 7f8c5f7fe640 1 -- 172.21.15.131:0/1504437978 learned_addr learned my addr 172.21.15.131:0/1504437978 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:10:01.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.408+0000 7f8c5effd640 1 --2- 172.21.15.131:0/1504437978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c601f5a30 0x7f8c601f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.408+0000 7f8c5e7fc640 1 --2- 172.21.15.131:0/1504437978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c600b2320 0x7f8c600b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.409+0000 7f8c5f7fe640 1 -- 172.21.15.131:0/1504437978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c600b2320 msgr2=0x7f8c600b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.409+0000 7f8c5f7fe640 1 --2- 172.21.15.131:0/1504437978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c600b2320 0x7f8c600b2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.409+0000 7f8c5f7fe640 1 -- 172.21.15.131:0/1504437978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c601f5a30 msgr2=0x7f8c601f8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.409+0000 7f8c5f7fe640 1 --2- 172.21.15.131:0/1504437978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c601f5a30 0x7f8c601f8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.409+0000 7f8c5f7fe640 1 -- 172.21.15.131:0/1504437978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c600b2c70 con 0x7f8c601ea2c0 2024-05-17T04:10:01.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.409+0000 7f8c5e7fc640 1 --2- 172.21.15.131:0/1504437978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c600b2320 0x7f8c600b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:10:01.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.409+0000 7f8c5f7fe640 1 --2- 172.21.15.131:0/1504437978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c601ea2c0 0x7f8c601ea6d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8c58001fb0 tx=0x7f8c580014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:01.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.409+0000 7f8c477fe640 1 -- 172.21.15.131:0/1504437978 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58001ab0 con 0x7f8c601ea2c0 2024-05-17T04:10:01.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.409+0000 7f8c477fe640 1 -- 172.21.15.131:0/1504437978 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5802ac50 con 0x7f8c601ea2c0 2024-05-17T04:10:01.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.409+0000 7f8c477fe640 1 -- 172.21.15.131:0/1504437978 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58007df0 con 0x7f8c601ea2c0 2024-05-17T04:10:01.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.409+0000 7f8c655eb640 1 -- 172.21.15.131:0/1504437978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c600b00f0 con 0x7f8c601ea2c0 2024-05-17T04:10:01.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.409+0000 7f8c655eb640 1 -- 172.21.15.131:0/1504437978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c600b06b0 con 0x7f8c601ea2c0 2024-05-17T04:10:01.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.410+0000 7f8c655eb640 1 -- 172.21.15.131:0/1504437978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c600d1cd0 con 0x7f8c601ea2c0 2024-05-17T04:10:01.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.411+0000 7f8c477fe640 1 -- 172.21.15.131:0/1504437978 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c58043020 con 0x7f8c601ea2c0 2024-05-17T04:10:01.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.411+0000 7f8c477fe640 1 --2- 172.21.15.131:0/1504437978 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8c4c0762d0 0x7f8c4c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.411+0000 7f8c477fe640 1 -- 172.21.15.131:0/1504437978 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f8c580b6b70 con 0x7f8c601ea2c0 2024-05-17T04:10:01.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.411+0000 7f8c5effd640 1 --2- 172.21.15.131:0/1504437978 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8c4c0762d0 0x7f8c4c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.412+0000 7f8c5effd640 1 --2- 172.21.15.131:0/1504437978 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8c4c0762d0 0x7f8c4c0787e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8c60144e80 tx=0x7f8c50008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:01.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.416+0000 7f8c477fe640 1 -- 172.21.15.131:0/1504437978 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8c600b2c70 con 0x7f8c601ea2c0 2024-05-17T04:10:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.667+0000 7f8c655eb640 1 -- 172.21.15.131:0/1504437978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8c60070ae0 con 0x7f8c601ea2c0 2024-05-17T04:10:01.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.670+0000 7f8c477fe640 1 -- 172.21.15.131:0/1504437978 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f8c5802ae20 con 0x7f8c601ea2c0 2024-05-17T04:10:01.671 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2024-05-17T04:10:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAo2EZm18HoMBAALbZPYs0ajHhO8BUkz1amdw== 2024-05-17T04:10:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: caps mds = "allow" 2024-05-17T04:10:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: caps mon = "allow r" 2024-05-17T04:10:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-17T04:10:01.672 INFO:teuthology.orchestra.run.smithi131.stderr:updated caps for client.0 2024-05-17T04:10:01.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.672+0000 7f8c655eb640 1 -- 172.21.15.131:0/1504437978 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8c4c0762d0 msgr2=0x7f8c4c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.672+0000 7f8c655eb640 1 --2- 172.21.15.131:0/1504437978 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8c4c0762d0 0x7f8c4c0787e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8c60144e80 tx=0x7f8c50008040 comp rx=0 tx=0).stop 2024-05-17T04:10:01.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.672+0000 7f8c655eb640 1 -- 172.21.15.131:0/1504437978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c601ea2c0 msgr2=0x7f8c601ea6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.672+0000 7f8c655eb640 1 --2- 172.21.15.131:0/1504437978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c601ea2c0 0x7f8c601ea6d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8c58001fb0 tx=0x7f8c580014a0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.672+0000 7f8c655eb640 1 -- 172.21.15.131:0/1504437978 shutdown_connections 2024-05-17T04:10:01.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.672+0000 7f8c655eb640 1 --2- 172.21.15.131:0/1504437978 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8c4c0762d0 0x7f8c4c0787e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.672+0000 7f8c655eb640 1 --2- 172.21.15.131:0/1504437978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c601ea2c0 0x7f8c601ea6d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.672+0000 7f8c655eb640 1 --2- 172.21.15.131:0/1504437978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c600b2320 0x7f8c600b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.672+0000 7f8c655eb640 1 --2- 172.21.15.131:0/1504437978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c601f5a30 0x7f8c601f8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.672+0000 7f8c655eb640 1 -- 172.21.15.131:0/1504437978 >> 172.21.15.131:0/1504437978 conn(0x7f8c600b4450 msgr2=0x7f8c6006dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:01.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.672+0000 7f8c655eb640 1 -- 172.21.15.131:0/1504437978 shutdown_connections 2024-05-17T04:10:01.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.672+0000 7f8c655eb640 1 -- 172.21.15.131:0/1504437978 wait complete. 2024-05-17T04:10:01.685 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T04:10:01.790 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-05-17T04:10:01.789+0000 7f7e7ce9a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-17T04:10:01.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.796+0000 7f79381e0640 1 Processor -- start 2024-05-17T04:10:01.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.796+0000 7f79381e0640 1 -- start start 2024-05-17T04:10:01.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.797+0000 7f79381e0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f79300cd720 0x7f79300d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.797+0000 7f79381e0640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f793006fa60 0x7f793015f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.797+0000 7f79381e0640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79300d1990 con 0x7f79300d1580 2024-05-17T04:10:01.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.797+0000 7f79381e0640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7930160930 con 0x7f79300cd720 2024-05-17T04:10:01.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.797+0000 7f79381e0640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f793006e870 con 0x7f793006fa60 2024-05-17T04:10:01.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.798+0000 7f7935f7c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f79300cd720 0x7f79300d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.798+0000 7f7935f7c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f79300cd720 0x7f79300d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46480/0 (socket says 172.21.15.131:46480) 2024-05-17T04:10:01.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.798+0000 7f7935f7c640 1 -- 172.21.15.131:0/1672575542 learned_addr learned my addr 172.21.15.131:0/1672575542 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:10:01.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.798+0000 7f7935f7c640 1 -- 172.21.15.131:0/1672575542 >> v2:172.21.15.150:3300/0 conn(0x7f793006fa60 msgr2=0x7f793015f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:01.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.798+0000 7f793677d640 1 --2- 172.21.15.131:0/1672575542 >> v2:172.21.15.150:3300/0 conn(0x7f793006fa60 0x7f793015f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.798+0000 7f7935f7c640 1 --2- 172.21.15.131:0/1672575542 >> v2:172.21.15.150:3300/0 conn(0x7f793006fa60 0x7f793015f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.798+0000 7f7935f7c640 1 -- 172.21.15.131:0/1672575542 >> v1:172.21.15.150:6789/0 conn(0x7f79300d1580 legacy=0x7f793006f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:01.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.798+0000 7f7935f7c640 1 -- 172.21.15.131:0/1672575542 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793006eb50 con 0x7f79300cd720 2024-05-17T04:10:01.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.799+0000 7f7935f7c640 1 --2- 172.21.15.131:0/1672575542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79300cd720 0x7f79300d1040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f79300d08b0 tx=0x7f792c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef570dfbbb5584d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:01.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.799+0000 7f7934f7a640 1 -- 172.21.15.131:0/1672575542 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c037070 con 0x7f79300cd720 2024-05-17T04:10:01.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.799+0000 7f7934f7a640 1 -- 172.21.15.131:0/1672575542 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792c032440 con 0x7f79300cd720 2024-05-17T04:10:01.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.799+0000 7f7934f7a640 1 -- 172.21.15.131:0/1672575542 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c032810 con 0x7f79300cd720 2024-05-17T04:10:01.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.799+0000 7f79381e0640 1 -- 172.21.15.131:0/1672575542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79300cd720 msgr2=0x7f79300d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.799+0000 7f79381e0640 1 --2- 172.21.15.131:0/1672575542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79300cd720 0x7f79300d1040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f79300d08b0 tx=0x7f792c02a1c0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.799+0000 7f79381e0640 1 -- 172.21.15.131:0/1672575542 shutdown_connections 2024-05-17T04:10:01.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.799+0000 7f79381e0640 1 --2- 172.21.15.131:0/1672575542 >> v2:172.21.15.150:3300/0 conn(0x7f793006fa60 0x7f793015f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.799+0000 7f79381e0640 1 --2- 172.21.15.131:0/1672575542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79300cd720 0x7f79300d1040 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.799+0000 7f79381e0640 1 -- 172.21.15.131:0/1672575542 >> 172.21.15.131:0/1672575542 conn(0x7f79300b4e40 msgr2=0x7f79300b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:01.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.800+0000 7f79381e0640 1 -- 172.21.15.131:0/1672575542 shutdown_connections 2024-05-17T04:10:01.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.800+0000 7f79381e0640 1 -- 172.21.15.131:0/1672575542 wait complete. 2024-05-17T04:10:01.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.801+0000 7f79381e0640 1 Processor -- start 2024-05-17T04:10:01.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.801+0000 7f79381e0640 1 -- start start 2024-05-17T04:10:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f79381e0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f793006fa60 0x7f7930155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f79381e0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79300cd720 0x7f793015c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f79381e0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79300d1580 0x7f793015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f79381e0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f793006fff0 con 0x7f79300cd720 2024-05-17T04:10:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f79381e0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f793006fe70 con 0x7f79300d1580 2024-05-17T04:10:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f79381e0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f793015fc70 con 0x7f793006fa60 2024-05-17T04:10:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f793577b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79300cd720 0x7f793015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f793577b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79300cd720 0x7f793015c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46490/0 (socket says 172.21.15.131:46490) 2024-05-17T04:10:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f793577b640 1 -- 172.21.15.131:0/4239911186 learned_addr learned my addr 172.21.15.131:0/4239911186 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:10:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f793677d640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79300d1580 0x7f793015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f7935f7c640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f793006fa60 0x7f7930155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f793577b640 1 -- 172.21.15.131:0/4239911186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f793006fa60 msgr2=0x7f7930155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f793577b640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f793006fa60 0x7f7930155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f793577b640 1 -- 172.21.15.131:0/4239911186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79300d1580 msgr2=0x7f793015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f793577b640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79300d1580 0x7f793015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f793577b640 1 -- 172.21.15.131:0/4239911186 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79300ca390 con 0x7f79300cd720 2024-05-17T04:10:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f7935f7c640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f793006fa60 0x7f7930155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:10:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f793677d640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79300d1580 0x7f793015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:10:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f793577b640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79300cd720 0x7f793015c550 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f792000b3e0 tx=0x7f792000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.803+0000 7f79267fc640 1 -- 172.21.15.131:0/4239911186 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920015020 con 0x7f79300cd720 2024-05-17T04:10:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.804+0000 7f79267fc640 1 -- 172.21.15.131:0/4239911186 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7920011850 con 0x7f79300cd720 2024-05-17T04:10:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.804+0000 7f79267fc640 1 -- 172.21.15.131:0/4239911186 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920011c40 con 0x7f79300cd720 2024-05-17T04:10:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.804+0000 7f79381e0640 1 -- 172.21.15.131:0/4239911186 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79300c6c80 con 0x7f79300cd720 2024-05-17T04:10:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.804+0000 7f79381e0640 1 -- 172.21.15.131:0/4239911186 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79300caae0 con 0x7f79300cd720 2024-05-17T04:10:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.804+0000 7f79381e0640 1 -- 172.21.15.131:0/4239911186 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f793015f730 con 0x7f79300cd720 2024-05-17T04:10:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.805+0000 7f79267fc640 1 -- 172.21.15.131:0/4239911186 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7920018020 con 0x7f79300cd720 2024-05-17T04:10:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.806+0000 7f79267fc640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f79140762d0 0x7f79140787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.806+0000 7f79267fc640 1 -- 172.21.15.131:0/4239911186 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f7920097730 con 0x7f79300cd720 2024-05-17T04:10:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.806+0000 7f7935f7c640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f79140762d0 0x7f79140787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.806+0000 7f7935f7c640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f79140762d0 0x7f79140787e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f792c034000 tx=0x7f792c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:01.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:01.810+0000 7f79267fc640 1 -- 172.21.15.131:0/4239911186 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f792001f020 con 0x7f79300cd720 2024-05-17T04:10:02.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.032+0000 7f79381e0640 1 -- 172.21.15.131:0/4239911186 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79300ca560 con 0x7f79300cd720 2024-05-17T04:10:02.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.033+0000 7f79267fc640 1 -- 172.21.15.131:0/4239911186 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5187 (secure 0 0 0) 0x7f7920060e70 con 0x7f79300cd720 2024-05-17T04:10:02.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:10:02.034 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/569182744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":569182744},{"type":"v1","addr":"172.21.15.150:6835","nonce":569182744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1749773301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1749773301},{"type":"v1","addr":"172.21.15.150:6834","nonce":1749773301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3795031678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3795031678},{"type":"v1","addr":"172.21.15.131:6837","nonce":3795031678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:56.173520+0000","modified":"2024-05-17T04:09:59.216262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4923":{"gid":4923,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/119325169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":119325169},{"type":"v1","addr":"172.21.15.131:6836","nonce":119325169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4923,"qdb_cluster":[4923]},"id":2}]} 2024-05-17T04:10:02.034 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 16 2024-05-17T04:10:02.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.035+0000 7f79381e0640 1 -- 172.21.15.131:0/4239911186 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f79140762d0 msgr2=0x7f79140787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.035+0000 7f79381e0640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f79140762d0 0x7f79140787e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f792c034000 tx=0x7f792c02e000 comp rx=0 tx=0).stop 2024-05-17T04:10:02.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.035+0000 7f79381e0640 1 -- 172.21.15.131:0/4239911186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79300cd720 msgr2=0x7f793015c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.035+0000 7f79381e0640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79300cd720 0x7f793015c550 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f792000b3e0 tx=0x7f792000b8a0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.035+0000 7f79381e0640 1 -- 172.21.15.131:0/4239911186 shutdown_connections 2024-05-17T04:10:02.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.035+0000 7f79381e0640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f79140762d0 0x7f79140787e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.035+0000 7f79381e0640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79300cd720 0x7f793015c550 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.035+0000 7f79381e0640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79300d1580 0x7f793015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.035+0000 7f79381e0640 1 --2- 172.21.15.131:0/4239911186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f793006fa60 0x7f7930155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.035+0000 7f79381e0640 1 -- 172.21.15.131:0/4239911186 >> 172.21.15.131:0/4239911186 conn(0x7f79300b4e40 msgr2=0x7f7930160080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:02.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.035+0000 7f79381e0640 1 -- 172.21.15.131:0/4239911186 shutdown_connections 2024-05-17T04:10:02.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.035+0000 7f79381e0640 1 -- 172.21.15.131:0/4239911186 wait complete. 2024-05-17T04:10:02.451 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-17T04:09:56.173520+0000', 'modified': '2024-05-17T04:09:59.216262+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4923}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4923': {'gid': 4923, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.131:6836/119325169', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6834', 'nonce': 119325169}, {'type': 'v1', 'addr': '172.21.15.131:6836', 'nonce': 119325169}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4923, 'qdb_cluster': [4923]} 2024-05-17T04:10:02.451 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-17T04:10:02.451 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-17T04:10:02.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.563+0000 7fd1b059a640 1 Processor -- start 2024-05-17T04:10:02.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.563+0000 7fd1b059a640 1 -- start start 2024-05-17T04:10:02.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.565+0000 7fd1b059a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd1a8163630 0x7fd1a8163a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.565+0000 7fd1b059a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a80d0de0 con 0x7fd1a80b74c0 2024-05-17T04:10:02.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.565+0000 7fd1b059a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a80d10c0 con 0x7fd1a8071390 2024-05-17T04:10:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.565+0000 7fd1b059a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd1a80d0b90 con 0x7fd1a8163630 2024-05-17T04:10:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.565+0000 7fd1aeb37640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd1a8163630 0x7fd1a8163a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.565+0000 7fd1adb35640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd1a80b74c0 0x7fd1a80b78d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46534/0 (socket says 172.21.15.131:46534) 2024-05-17T04:10:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.565+0000 7fd1adb35640 1 -- 172.21.15.131:0/939926122 learned_addr learned my addr 172.21.15.131:0/939926122 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:10:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.565+0000 7fd1aeb37640 1 -- 172.21.15.131:0/939926122 >> v1:172.21.15.150:6789/0 conn(0x7fd1a8071390 legacy=0x7fd1a80717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.565+0000 7fd1aeb37640 1 -- 172.21.15.131:0/939926122 >> v1:172.21.15.131:6789/0 conn(0x7fd1a80b74c0 legacy=0x7fd1a80b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.565+0000 7fd1ad334640 1 -- 172.21.15.131:0/939926122 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4138092279 0 0) 0x7fd1a80d0de0 con 0x7fd1a80b74c0 2024-05-17T04:10:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.565+0000 7fd1aeb37640 1 -- 172.21.15.131:0/939926122 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a80d13a0 con 0x7fd1a8163630 2024-05-17T04:10:02.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.566+0000 7fd1aeb37640 1 --2- 172.21.15.131:0/939926122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a8163630 0x7fd1a8163a40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd1a00097a0 tx=0x7fd1a002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63a849adec9120a server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:02.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.566+0000 7fd1ad334640 1 -- 172.21.15.131:0/939926122 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0037070 con 0x7fd1a8163630 2024-05-17T04:10:02.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.566+0000 7fd1ad334640 1 -- 172.21.15.131:0/939926122 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a002ae50 con 0x7fd1a8163630 2024-05-17T04:10:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.566+0000 7fd1ad334640 1 -- 172.21.15.131:0/939926122 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0032660 con 0x7fd1a8163630 2024-05-17T04:10:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.567+0000 7fd1b059a640 1 -- 172.21.15.131:0/939926122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a8163630 msgr2=0x7fd1a8163a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.567+0000 7fd1b059a640 1 --2- 172.21.15.131:0/939926122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a8163630 0x7fd1a8163a40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd1a00097a0 tx=0x7fd1a002a100 comp rx=0 tx=0).stop 2024-05-17T04:10:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.567+0000 7fd1b059a640 1 -- 172.21.15.131:0/939926122 shutdown_connections 2024-05-17T04:10:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.567+0000 7fd1b059a640 1 --2- 172.21.15.131:0/939926122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a8163630 0x7fd1a8163a40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.567+0000 7fd1b059a640 1 -- 172.21.15.131:0/939926122 >> 172.21.15.131:0/939926122 conn(0x7fd1a80735b0 msgr2=0x7fd1a80739c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.567+0000 7fd1b059a640 1 -- 172.21.15.131:0/939926122 shutdown_connections 2024-05-17T04:10:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.567+0000 7fd1b059a640 1 -- 172.21.15.131:0/939926122 wait complete. 2024-05-17T04:10:02.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.569+0000 7fd1b059a640 1 Processor -- start 2024-05-17T04:10:02.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.569+0000 7fd1b059a640 1 -- start start 2024-05-17T04:10:02.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1b059a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a8071390 0x7fd1a815cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1b059a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a80b74c0 0x7fd1a81f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1b059a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1a8163630 0x7fd1a81f8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1b059a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a8142820 con 0x7fd1a8071390 2024-05-17T04:10:02.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1b059a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a80d1ba0 con 0x7fd1a80b74c0 2024-05-17T04:10:02.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1b059a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a8163f80 con 0x7fd1a8163630 2024-05-17T04:10:02.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1ae336640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a8071390 0x7fd1a815cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1ae336640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a8071390 0x7fd1a815cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46508/0 (socket says 172.21.15.131:46508) 2024-05-17T04:10:02.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1ae336640 1 -- 172.21.15.131:0/3644891551 learned_addr learned my addr 172.21.15.131:0/3644891551 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:10:02.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1adb35640 1 --2- 172.21.15.131:0/3644891551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a80b74c0 0x7fd1a81f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1aeb37640 1 --2- 172.21.15.131:0/3644891551 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1a8163630 0x7fd1a81f8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1ae336640 1 -- 172.21.15.131:0/3644891551 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1a8163630 msgr2=0x7fd1a81f8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1ae336640 1 --2- 172.21.15.131:0/3644891551 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1a8163630 0x7fd1a81f8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1ae336640 1 -- 172.21.15.131:0/3644891551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a80b74c0 msgr2=0x7fd1a81f8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1ae336640 1 --2- 172.21.15.131:0/3644891551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a80b74c0 0x7fd1a81f8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1ae336640 1 -- 172.21.15.131:0/3644891551 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a815d300 con 0x7fd1a8071390 2024-05-17T04:10:02.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.570+0000 7fd1adb35640 1 --2- 172.21.15.131:0/3644891551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a80b74c0 0x7fd1a81f8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:10:02.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.571+0000 7fd1ae336640 1 --2- 172.21.15.131:0/3644891551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a8071390 0x7fd1a815cdc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400ba50 tx=0x7fd1a400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:02.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.571+0000 7fd19effd640 1 -- 172.21.15.131:0/3644891551 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4019070 con 0x7fd1a8071390 2024-05-17T04:10:02.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.571+0000 7fd19effd640 1 -- 172.21.15.131:0/3644891551 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a400cc20 con 0x7fd1a8071390 2024-05-17T04:10:02.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.571+0000 7fd1b059a640 1 -- 172.21.15.131:0/3644891551 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a81e91d0 con 0x7fd1a8071390 2024-05-17T04:10:02.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.571+0000 7fd19effd640 1 -- 172.21.15.131:0/3644891551 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4014440 con 0x7fd1a8071390 2024-05-17T04:10:02.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.571+0000 7fd1b059a640 1 -- 172.21.15.131:0/3644891551 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a815aca0 con 0x7fd1a8071390 2024-05-17T04:10:02.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.573+0000 7fd19effd640 1 -- 172.21.15.131:0/3644891551 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd1a401c070 con 0x7fd1a8071390 2024-05-17T04:10:02.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.573+0000 7fd19effd640 1 --2- 172.21.15.131:0/3644891551 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd18c0762d0 0x7fd18c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.573+0000 7fd19effd640 1 -- 172.21.15.131:0/3644891551 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fd1a4097450 con 0x7fd1a8071390 2024-05-17T04:10:02.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.573+0000 7fd1adb35640 1 --2- 172.21.15.131:0/3644891551 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd18c0762d0 0x7fd18c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.574+0000 7fd1adb35640 1 --2- 172.21.15.131:0/3644891551 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd18c0762d0 0x7fd18c0787e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8160760 tx=0x7fd198007cc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:02.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.574+0000 7fd1b7451740 1 Processor -- start 2024-05-17T04:10:02.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.574+0000 7fd1b7451740 1 -- start start 2024-05-17T04:10:02.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1b7451740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2fe270 0x563dcc6e5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1b7451740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc6e7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1b7451740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2dd590 0x563dcc69d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1b7451740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563dcc613c80 con 0x563dcc2d53b0 2024-05-17T04:10:02.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1b7451740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x563dcc603820 con 0x563dcc2fe270 2024-05-17T04:10:02.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1b7451740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x563dcc607860 con 0x563dcc2dd590 2024-05-17T04:10:02.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1adb35640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc6e7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1adb35640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc6e7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46516/0 (socket says 172.21.15.131:46516) 2024-05-17T04:10:02.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1adb35640 1 -- 172.21.15.131:0/1939208819 learned_addr learned my addr 172.21.15.131:0/1939208819 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:10:02.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1ae336640 1 --2- 172.21.15.131:0/1939208819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2fe270 0x563dcc6e5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1aeb37640 1 --2- 172.21.15.131:0/1939208819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2dd590 0x563dcc69d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1adb35640 1 -- 172.21.15.131:0/1939208819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2dd590 msgr2=0x563dcc69d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:02.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1adb35640 1 --2- 172.21.15.131:0/1939208819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2dd590 0x563dcc69d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1adb35640 1 -- 172.21.15.131:0/1939208819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2fe270 msgr2=0x563dcc6e5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:02.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1adb35640 1 --2- 172.21.15.131:0/1939208819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2fe270 0x563dcc6e5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1adb35640 1 -- 172.21.15.131:0/1939208819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dcc5cdb40 con 0x563dcc2d53b0 2024-05-17T04:10:02.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.576+0000 7fd1adb35640 1 --2- 172.21.15.131:0/1939208819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc6e7e20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd198005de0 tx=0x7fd198012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ccffee4438efac2 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:02.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.577+0000 7fd18bfff640 1 -- 172.21.15.131:0/1939208819 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd198015110 con 0x563dcc2d53b0 2024-05-17T04:10:02.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.577+0000 7fd18bfff640 1 -- 172.21.15.131:0/1939208819 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1980159c0 con 0x563dcc2d53b0 2024-05-17T04:10:02.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.577+0000 7fd18bfff640 1 -- 172.21.15.131:0/1939208819 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd198015d70 con 0x563dcc2d53b0 2024-05-17T04:10:02.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.577+0000 7fd1b7451740 1 -- 172.21.15.131:0/1939208819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 msgr2=0x563dcc6e7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.577+0000 7fd1b7451740 1 --2- 172.21.15.131:0/1939208819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc6e7e20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd198005de0 tx=0x7fd198012000 comp rx=0 tx=0).stop 2024-05-17T04:10:02.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.577+0000 7fd1b7451740 1 -- 172.21.15.131:0/1939208819 shutdown_connections 2024-05-17T04:10:02.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.577+0000 7fd1b7451740 1 --2- 172.21.15.131:0/1939208819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc6e7e20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.577+0000 7fd1b7451740 1 --2- 172.21.15.131:0/1939208819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2dd590 0x563dcc69d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.577+0000 7fd1b7451740 1 --2- 172.21.15.131:0/1939208819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2fe270 0x563dcc6e5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.577+0000 7fd1b7451740 1 -- 172.21.15.131:0/1939208819 >> 172.21.15.131:0/1939208819 conn(0x563dcc2f23c0 msgr2=0x563dcc6e7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:02.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.578+0000 7fd1b7451740 1 -- 172.21.15.131:0/1939208819 shutdown_connections 2024-05-17T04:10:02.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.578+0000 7fd1b7451740 1 -- 172.21.15.131:0/1939208819 wait complete. 2024-05-17T04:10:02.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.578+0000 7fd1b7451740 1 -- start start 2024-05-17T04:10:02.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.579+0000 7fd1b7451740 1 Processor -- start 2024-05-17T04:10:02.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1b7451740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc6ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1b7451740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2dd590 0x563dcc6fa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1b7451740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2fe270 0x563dcc6df160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1b7451740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563dcc378620 con 0x563dcc2d53b0 2024-05-17T04:10:02.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1b7451740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x563dcc5c04c0 con 0x563dcc2dd590 2024-05-17T04:10:02.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1b7451740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x563dcc6e0e00 con 0x563dcc2fe270 2024-05-17T04:10:02.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1b7451740 10 client.0 _ll_register_callbacks cb 0x563dcc5fd900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-17T04:10:02.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1ae336640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc6ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1ae336640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc6ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46532/0 (socket says 172.21.15.131:46532) 2024-05-17T04:10:02.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1ae336640 1 -- 172.21.15.131:0/418131432 learned_addr learned my addr 172.21.15.131:0/418131432 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:10:02.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1adb35640 1 --2- 172.21.15.131:0/418131432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2dd590 0x563dcc6fa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1aeb37640 1 --2- 172.21.15.131:0/418131432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2fe270 0x563dcc6df160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1ae336640 1 -- 172.21.15.131:0/418131432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2fe270 msgr2=0x563dcc6df160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:02.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1ae336640 1 --2- 172.21.15.131:0/418131432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2fe270 0x563dcc6df160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1ae336640 1 -- 172.21.15.131:0/418131432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2dd590 msgr2=0x563dcc6fa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:02.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1ae336640 1 --2- 172.21.15.131:0/418131432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2dd590 0x563dcc6fa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.580+0000 7fd1ae336640 1 -- 172.21.15.131:0/418131432 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dcc5cbb80 con 0x563dcc2d53b0 2024-05-17T04:10:02.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1ae336640 1 --2- 172.21.15.131:0/418131432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc6ca930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4060240 tx=0x7fd1a4060a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159f0e38a4415da9 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:02.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1897fa640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-05-17T04:10:02.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1897fa640 1 -- 172.21.15.131:0/418131432 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4067dc0 con 0x563dcc2d53b0 2024-05-17T04:10:02.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1897fa640 1 -- 172.21.15.131:0/418131432 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fd1a405f7a0 con 0x563dcc2d53b0 2024-05-17T04:10:02.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1b7451740 1 -- 172.21.15.131:0/418131432 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1980159c0 con 0x563dcc2d53b0 2024-05-17T04:10:02.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1897fa640 1 -- 172.21.15.131:0/418131432 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fd1a40692f0 con 0x563dcc2d53b0 2024-05-17T04:10:02.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1b7451740 10 client.5082 fetch_fsmap learned FSMap version 16 2024-05-17T04:10:02.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1b7451740 1 -- 172.21.15.131:0/418131432 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x563dcc369850 con 0x563dcc2d53b0 2024-05-17T04:10:02.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1897fa640 1 -- 172.21.15.131:0/418131432 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1980159c0 con 0x563dcc2d53b0 2024-05-17T04:10:02.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1897fa640 1 -- 172.21.15.131:0/418131432 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7fd1a405beb0 con 0x563dcc2d53b0 2024-05-17T04:10:02.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1b7451740 10 client.5082 fetch_fsmap finished waiting for FSMap version 16 2024-05-17T04:10:02.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1b7451740 10 client.5082 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-17T04:10:02.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1b7451740 20 client.5082 populate_metadata read hostname 'smithi131' 2024-05-17T04:10:02.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1b7451740 1 --2- 172.21.15.131:0/418131432 >> [v2:172.21.15.131:6834/119325169,v1:172.21.15.131:6836/119325169] conn(0x563dcc2bce40 0x563dcc6f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1b7451740 4 client.5082 mds_command: new command op to 4923 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-17T04:10:02.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1b7451740 1 -- 172.21.15.131:0/418131432 --> [v2:172.21.15.131:6834/119325169,v1:172.21.15.131:6836/119325169] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563dcc5a5780 con 0x563dcc2bce40 2024-05-17T04:10:02.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.581+0000 7fd1adb35640 1 --2- 172.21.15.131:0/418131432 >> [v2:172.21.15.131:6834/119325169,v1:172.21.15.131:6836/119325169] conn(0x563dcc2bce40 0x563dcc6f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.582+0000 7fd1897fa640 10 client.5082 ms_handle_connect on v2:172.21.15.131:6834/119325169 2024-05-17T04:10:02.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.582+0000 7fd1adb35640 1 --2- 172.21.15.131:0/418131432 >> [v2:172.21.15.131:6834/119325169,v1:172.21.15.131:6836/119325169] conn(0x563dcc2bce40 0x563dcc6f6c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2abd41d4b3657410 server_cookie=b6898e61a7a216c2 in_seq=0 out_seq=0 2024-05-17T04:10:02.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.582+0000 7fd1897fa640 1 -- 172.21.15.131:0/418131432 <== mds.0 v2:172.21.15.131:6834/119325169 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563dcc5a5780 con 0x563dcc2bce40 2024-05-17T04:10:02.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.582+0000 7fd1897fa640 10 client.5082 handle_command_reply: tid=0 2024-05-17T04:10:02.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.582+0000 7fd1b7451740 1 client.5082 shutdown 2024-05-17T04:10:02.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.583+0000 7fd1b7451740 1 -- 172.21.15.131:0/418131432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 msgr2=0x563dcc6ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.583+0000 7fd1b7451740 1 --2- 172.21.15.131:0/418131432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc6ca930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4060240 tx=0x7fd1a4060a90 comp rx=0 tx=0).stop 2024-05-17T04:10:02.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.583+0000 7fd1b7451740 1 -- 172.21.15.131:0/418131432 shutdown_connections 2024-05-17T04:10:02.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.583+0000 7fd1b7451740 1 --2- 172.21.15.131:0/418131432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2fe270 0x563dcc6df160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.583+0000 7fd1b7451740 1 --2- 172.21.15.131:0/418131432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2dd590 0x563dcc6fa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.583+0000 7fd1b7451740 1 --2- 172.21.15.131:0/418131432 >> [v2:172.21.15.131:6834/119325169,v1:172.21.15.131:6836/119325169] conn(0x563dcc2bce40 0x563dcc6f6c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.583+0000 7fd1b7451740 1 --2- 172.21.15.131:0/418131432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc6ca930 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.583+0000 7fd1b7451740 1 -- 172.21.15.131:0/418131432 >> 172.21.15.131:0/418131432 conn(0x563dcc2f23c0 msgr2=0x563dcc69bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:02.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.583+0000 7fd1897fa640 0 client.5082 ms_handle_reset on v2:172.21.15.131:6834/119325169 2024-05-17T04:10:02.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.583+0000 7fd1b7451740 1 -- 172.21.15.131:0/418131432 shutdown_connections 2024-05-17T04:10:02.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.583+0000 7fd1b7451740 1 -- 172.21.15.131:0/418131432 wait complete. 2024-05-17T04:10:02.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.583+0000 7fd1b7451740 20 client.5082 trim_cache size 0 max 16384 2024-05-17T04:10:02.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.601+0000 7fd1b7451740 1 Processor -- start 2024-05-17T04:10:02.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.601+0000 7fd1b7451740 1 -- start start 2024-05-17T04:10:02.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd1b7451740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc69d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd1b7451740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2dd590 0x563dcc69d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd1b7451740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2fe270 0x563dcc6e20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd1b7451740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a8201660 con 0x563dcc2d53b0 2024-05-17T04:10:02.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd1b7451740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a815c570 con 0x563dcc2dd590 2024-05-17T04:10:02.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd1b7451740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a8201010 con 0x563dcc2fe270 2024-05-17T04:10:02.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd1ae336640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc69d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd1ae336640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc69d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46546/0 (socket says 172.21.15.131:46546) 2024-05-17T04:10:02.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd1ae336640 1 -- 172.21.15.131:0/1279433666 learned_addr learned my addr 172.21.15.131:0/1279433666 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:10:02.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd1ae336640 1 -- 172.21.15.131:0/1279433666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2fe270 msgr2=0x563dcc6e20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:02.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd1ae336640 1 --2- 172.21.15.131:0/1279433666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2fe270 0x563dcc6e20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd1ae336640 1 -- 172.21.15.131:0/1279433666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2dd590 msgr2=0x563dcc69d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:02.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd1ae336640 1 --2- 172.21.15.131:0/1279433666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2dd590 0x563dcc69d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd1ae336640 1 -- 172.21.15.131:0/1279433666 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dcc3e06b0 con 0x563dcc2d53b0 2024-05-17T04:10:02.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd1ae336640 1 --2- 172.21.15.131:0/1279433666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc69d280 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400cfd0 tx=0x7fd1a4064000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c719a0a7aab9e04 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:02.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd18b7fe640 1 -- 172.21.15.131:0/1279433666 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4067bc0 con 0x563dcc2d53b0 2024-05-17T04:10:02.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd18b7fe640 1 -- 172.21.15.131:0/1279433666 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a4067d60 con 0x563dcc2d53b0 2024-05-17T04:10:02.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.603+0000 7fd18b7fe640 1 -- 172.21.15.131:0/1279433666 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a405f9c0 con 0x563dcc2d53b0 2024-05-17T04:10:02.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.604+0000 7fd1b7451740 1 -- 172.21.15.131:0/1279433666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 msgr2=0x563dcc69d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.604+0000 7fd1b7451740 1 --2- 172.21.15.131:0/1279433666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc69d280 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400cfd0 tx=0x7fd1a4064000 comp rx=0 tx=0).stop 2024-05-17T04:10:02.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.604+0000 7fd1b7451740 1 -- 172.21.15.131:0/1279433666 shutdown_connections 2024-05-17T04:10:02.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.604+0000 7fd1b7451740 1 --2- 172.21.15.131:0/1279433666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2fe270 0x563dcc6e20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.604+0000 7fd1b7451740 1 --2- 172.21.15.131:0/1279433666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2dd590 0x563dcc69d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.604+0000 7fd1b7451740 1 --2- 172.21.15.131:0/1279433666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc69d280 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.604+0000 7fd1b7451740 1 -- 172.21.15.131:0/1279433666 >> 172.21.15.131:0/1279433666 conn(0x563dcc2f23c0 msgr2=0x563dcc6e4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:02.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.604+0000 7fd1b7451740 1 -- 172.21.15.131:0/1279433666 shutdown_connections 2024-05-17T04:10:02.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.604+0000 7fd1b7451740 1 -- 172.21.15.131:0/1279433666 wait complete. 2024-05-17T04:10:02.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.605+0000 7fd1b7451740 1 -- start start 2024-05-17T04:10:02.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.605+0000 7fd1b7451740 1 Processor -- start 2024-05-17T04:10:02.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.606+0000 7fd1b7451740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc763e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.606+0000 7fd1b7451740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2dd590 0x563dcc69bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.606+0000 7fd1b7451740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2fe270 0x563dcc69c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.606+0000 7fd1b7451740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563dcc6e5080 con 0x563dcc2d53b0 2024-05-17T04:10:02.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.606+0000 7fd1b7451740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x563dcc6df6a0 con 0x563dcc2dd590 2024-05-17T04:10:02.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.606+0000 7fd1b7451740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x563dcc6ccc00 con 0x563dcc2fe270 2024-05-17T04:10:02.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.606+0000 7fd1b7451740 10 client.0 _ll_register_callbacks cb 0x7fd1a40600e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-17T04:10:02.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1ae336640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc763e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1ae336640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc763e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46554/0 (socket says 172.21.15.131:46554) 2024-05-17T04:10:02.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1ae336640 1 -- 172.21.15.131:0/339917818 learned_addr learned my addr 172.21.15.131:0/339917818 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:10:02.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1ae336640 1 -- 172.21.15.131:0/339917818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2fe270 msgr2=0x563dcc69c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:02.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1ae336640 1 --2- 172.21.15.131:0/339917818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2fe270 0x563dcc69c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1ae336640 1 -- 172.21.15.131:0/339917818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2dd590 msgr2=0x563dcc69bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:02.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1ae336640 1 --2- 172.21.15.131:0/339917818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2dd590 0x563dcc69bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1ae336640 1 -- 172.21.15.131:0/339917818 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dcc6deaa0 con 0x563dcc2d53b0 2024-05-17T04:10:02.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1ae336640 1 --2- 172.21.15.131:0/339917818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc763e50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd1a405c570 tx=0x7fd1a400e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c60ad198c876ad0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:02.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1897fa640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-05-17T04:10:02.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1897fa640 1 -- 172.21.15.131:0/339917818 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4067bc0 con 0x563dcc2d53b0 2024-05-17T04:10:02.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1897fa640 1 -- 172.21.15.131:0/339917818 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fd1a405f210 con 0x563dcc2d53b0 2024-05-17T04:10:02.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1b7451740 1 -- 172.21.15.131:0/339917818 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1a4067d60 con 0x563dcc2d53b0 2024-05-17T04:10:02.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1897fa640 1 -- 172.21.15.131:0/339917818 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fd1a405f410 con 0x563dcc2d53b0 2024-05-17T04:10:02.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1b7451740 10 client.5088 fetch_fsmap learned FSMap version 16 2024-05-17T04:10:02.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1b7451740 1 -- 172.21.15.131:0/339917818 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x563dcc6deaa0 con 0x563dcc2d53b0 2024-05-17T04:10:02.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1897fa640 1 -- 172.21.15.131:0/339917818 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a4067d60 con 0x563dcc2d53b0 2024-05-17T04:10:02.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.607+0000 7fd1897fa640 1 -- 172.21.15.131:0/339917818 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7fd1a40659d0 con 0x563dcc2d53b0 2024-05-17T04:10:02.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.608+0000 7fd1b7451740 10 client.5088 fetch_fsmap finished waiting for FSMap version 16 2024-05-17T04:10:02.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.608+0000 7fd1b7451740 10 client.5088 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-17T04:10:02.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.608+0000 7fd1b7451740 20 client.5088 populate_metadata read hostname 'smithi131' 2024-05-17T04:10:02.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.608+0000 7fd1b7451740 1 --2- 172.21.15.131:0/339917818 >> [v2:172.21.15.131:6834/119325169,v1:172.21.15.131:6836/119325169] conn(0x563dcc6c6f50 0x563dcc6c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.608+0000 7fd1b7451740 4 client.5088 mds_command: new command op to 4923 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-17T04:10:02.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.608+0000 7fd1b7451740 1 -- 172.21.15.131:0/339917818 --> [v2:172.21.15.131:6834/119325169,v1:172.21.15.131:6836/119325169] -- command(tid 0: {"prefix": "status"}) -- 0x563dcc615bd0 con 0x563dcc6c6f50 2024-05-17T04:10:02.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.608+0000 7fd1adb35640 1 --2- 172.21.15.131:0/339917818 >> [v2:172.21.15.131:6834/119325169,v1:172.21.15.131:6836/119325169] conn(0x563dcc6c6f50 0x563dcc6c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.608+0000 7fd1897fa640 10 client.5088 ms_handle_connect on v2:172.21.15.131:6834/119325169 2024-05-17T04:10:02.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.608+0000 7fd1adb35640 1 --2- 172.21.15.131:0/339917818 >> [v2:172.21.15.131:6834/119325169,v1:172.21.15.131:6836/119325169] conn(0x563dcc6c6f50 0x563dcc6c7360 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=229205a3b718f285 server_cookie=3b1d566999b3f894 in_seq=0 out_seq=0 2024-05-17T04:10:02.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.608+0000 7fd1897fa640 1 -- 172.21.15.131:0/339917818 <== mds.0 v2:172.21.15.131:6834/119325169 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x563dcc615bd0 con 0x563dcc6c6f50 2024-05-17T04:10:02.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.608+0000 7fd1897fa640 10 client.5088 handle_command_reply: tid=0 2024-05-17T04:10:02.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.608+0000 7fd1b7451740 1 client.5088 shutdown 2024-05-17T04:10:02.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.608+0000 7fd1b7451740 1 -- 172.21.15.131:0/339917818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 msgr2=0x563dcc763e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.608+0000 7fd1b7451740 1 --2- 172.21.15.131:0/339917818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc763e50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd1a405c570 tx=0x7fd1a400e040 comp rx=0 tx=0).stop 2024-05-17T04:10:02.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b7451740 1 -- 172.21.15.131:0/339917818 shutdown_connections 2024-05-17T04:10:02.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b7451740 1 --2- 172.21.15.131:0/339917818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x563dcc2fe270 0x563dcc69c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b7451740 1 --2- 172.21.15.131:0/339917818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563dcc2dd590 0x563dcc69bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b7451740 1 --2- 172.21.15.131:0/339917818 >> [v2:172.21.15.131:6834/119325169,v1:172.21.15.131:6836/119325169] conn(0x563dcc6c6f50 0x563dcc6c7360 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b7451740 1 --2- 172.21.15.131:0/339917818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563dcc2d53b0 0x563dcc763e50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b7451740 1 -- 172.21.15.131:0/339917818 >> 172.21.15.131:0/339917818 conn(0x563dcc2f23c0 msgr2=0x563dcc6df820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:02.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1897fa640 0 client.5088 ms_handle_reset on v2:172.21.15.131:6834/119325169 2024-05-17T04:10:02.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b7451740 1 -- 172.21.15.131:0/339917818 shutdown_connections 2024-05-17T04:10:02.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b7451740 1 -- 172.21.15.131:0/339917818 wait complete. 2024-05-17T04:10:02.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b7451740 20 client.5088 trim_cache size 0 max 16384 2024-05-17T04:10:02.615 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T04:10:02.615 INFO:teuthology.orchestra.run.smithi131.stdout: "cluster_fsid": "c9e29f2b-51db-4d2a-bace-3a87edcda397", 2024-05-17T04:10:02.615 INFO:teuthology.orchestra.run.smithi131.stdout: "whoami": 0, 2024-05-17T04:10:02.615 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4923, 2024-05-17T04:10:02.615 INFO:teuthology.orchestra.run.smithi131.stdout: "want_state": "up:active", 2024-05-17T04:10:02.615 INFO:teuthology.orchestra.run.smithi131.stdout: "state": "up:active", 2024-05-17T04:10:02.615 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs", 2024-05-17T04:10:02.615 INFO:teuthology.orchestra.run.smithi131.stdout: "rank_uptime": 5.7878305509999999, 2024-05-17T04:10:02.615 INFO:teuthology.orchestra.run.smithi131.stdout: "mdsmap_epoch": 16, 2024-05-17T04:10:02.616 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch": 36, 2024-05-17T04:10:02.616 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch_barrier": 36, 2024-05-17T04:10:02.616 INFO:teuthology.orchestra.run.smithi131.stdout: "uptime": 12.664233246 2024-05-17T04:10:02.616 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T04:10:02.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b059a640 1 -- 172.21.15.131:0/3644891551 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd18c0762d0 msgr2=0x7fd18c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b059a640 1 --2- 172.21.15.131:0/3644891551 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd18c0762d0 0x7fd18c0787e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8160760 tx=0x7fd198007cc0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b059a640 1 -- 172.21.15.131:0/3644891551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a8071390 msgr2=0x7fd1a815cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b059a640 1 --2- 172.21.15.131:0/3644891551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a8071390 0x7fd1a815cdc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400ba50 tx=0x7fd1a400bf10 comp rx=0 tx=0).stop 2024-05-17T04:10:02.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b059a640 1 -- 172.21.15.131:0/3644891551 shutdown_connections 2024-05-17T04:10:02.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b059a640 1 --2- 172.21.15.131:0/3644891551 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd18c0762d0 0x7fd18c0787e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b059a640 1 --2- 172.21.15.131:0/3644891551 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1a8163630 0x7fd1a81f8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b059a640 1 --2- 172.21.15.131:0/3644891551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1a80b74c0 0x7fd1a81f8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b059a640 1 --2- 172.21.15.131:0/3644891551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a8071390 0x7fd1a815cdc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b059a640 1 -- 172.21.15.131:0/3644891551 >> 172.21.15.131:0/3644891551 conn(0x7fd1a80735b0 msgr2=0x7fd1a815e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:02.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b059a640 1 -- 172.21.15.131:0/3644891551 shutdown_connections 2024-05-17T04:10:02.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.609+0000 7fd1b059a640 1 -- 172.21.15.131:0/3644891551 wait complete. 2024-05-17T04:10:02.621 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-17T04:10:02.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.733+0000 7fe9cee2d640 1 Processor -- start 2024-05-17T04:10:02.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.733+0000 7fe9cee2d640 1 -- start start 2024-05-17T04:10:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.734+0000 7fe9cee2d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe9c815f690 0x7fe9c80afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.734+0000 7fe9cee2d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9c80b1440 0x7fe9c806c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.734+0000 7fe9cee2d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c80aebc0 con 0x7fe9c80b3d30 2024-05-17T04:10:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.734+0000 7fe9cee2d640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe9c80b3140 con 0x7fe9c815f690 2024-05-17T04:10:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.734+0000 7fe9cee2d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c80b01a0 con 0x7fe9c80b1440 2024-05-17T04:10:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.734+0000 7fe9c7fff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe9c80b3d30 0x7fe9c80b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46542/0 (socket says 172.21.15.131:46542) 2024-05-17T04:10:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.734+0000 7fe9c7fff640 1 -- 172.21.15.131:0/2684519971 learned_addr learned my addr 172.21.15.131:0/2684519971 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:10:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.734+0000 7fe9cd3ca640 1 --2- 172.21.15.131:0/2684519971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9c80b1440 0x7fe9c806c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.734+0000 7fe9ccbc9640 1 --2- 172.21.15.131:0/2684519971 >> v2:172.21.15.150:3300/0 conn(0x7fe9c815f690 0x7fe9c80afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.734+0000 7fe9c77fe640 1 -- 172.21.15.131:0/2684519971 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3324911726 0 0) 0x7fe9c80aebc0 con 0x7fe9c80b3d30 2024-05-17T04:10:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.734+0000 7fe9c77fe640 1 -- 172.21.15.131:0/2684519971 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9b0003520 con 0x7fe9c80b3d30 2024-05-17T04:10:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9c77fe640 1 -- 172.21.15.131:0/2684519971 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2909859439 0 0) 0x7fe9b0003520 con 0x7fe9c80b3d30 2024-05-17T04:10:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9c77fe640 1 -- 172.21.15.131:0/2684519971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9c80b1440 msgr2=0x7fe9c806c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9c77fe640 1 --2- 172.21.15.131:0/2684519971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9c80b1440 0x7fe9c806c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9c77fe640 1 -- 172.21.15.131:0/2684519971 >> v2:172.21.15.150:3300/0 conn(0x7fe9c815f690 msgr2=0x7fe9c80afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9c77fe640 1 --2- 172.21.15.131:0/2684519971 >> v2:172.21.15.150:3300/0 conn(0x7fe9c815f690 0x7fe9c80afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9c77fe640 1 -- 172.21.15.131:0/2684519971 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c80aeea0 con 0x7fe9c80b3d30 2024-05-17T04:10:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9c77fe640 1 -- 172.21.15.131:0/2684519971 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7fe9bc001a70 con 0x7fe9c80b3d30 2024-05-17T04:10:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9c77fe640 1 -- 172.21.15.131:0/2684519971 >> v1:172.21.15.131:6789/0 conn(0x7fe9c80b3d30 legacy=0x7fe9c80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9c77fe640 1 --2- 172.21.15.131:0/2684519971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b0003a00 0x7fe9b0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9c77fe640 1 --2- 172.21.15.131:0/2684519971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9b0004800 0x7fe9b0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9c77fe640 1 --2- 172.21.15.131:0/2684519971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9b0005150 0x7fe9b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9c77fe640 1 -- 172.21.15.131:0/2684519971 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c80b01a0 con 0x7fe9b0003a00 2024-05-17T04:10:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9c77fe640 1 -- 172.21.15.131:0/2684519971 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b000bf00 con 0x7fe9b0005150 2024-05-17T04:10:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9c77fe640 1 -- 172.21.15.131:0/2684519971 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b000c080 con 0x7fe9b0004800 2024-05-17T04:10:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9ccbc9640 1 --2- 172.21.15.131:0/2684519971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b0003a00 0x7fe9b0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9c7fff640 1 --2- 172.21.15.131:0/2684519971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9b0004800 0x7fe9b0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9cd3ca640 1 --2- 172.21.15.131:0/2684519971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9b0005150 0x7fe9b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9ccbc9640 1 -- 172.21.15.131:0/2684519971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9b0004800 msgr2=0x7fe9b0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9ccbc9640 1 --2- 172.21.15.131:0/2684519971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9b0004800 0x7fe9b0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9ccbc9640 1 -- 172.21.15.131:0/2684519971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9b0005150 msgr2=0x7fe9b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:02.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9ccbc9640 1 --2- 172.21.15.131:0/2684519971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9b0005150 0x7fe9b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9ccbc9640 1 -- 172.21.15.131:0/2684519971 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b0003520 con 0x7fe9b0003a00 2024-05-17T04:10:02.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.735+0000 7fe9cd3ca640 1 --2- 172.21.15.131:0/2684519971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9b0005150 0x7fe9b000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:10:02.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.736+0000 7fe9ccbc9640 1 --2- 172.21.15.131:0/2684519971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b0003a00 0x7fe9b0003e70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009ac0 tx=0x7fe9b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5662831f619464d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:02.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.736+0000 7fe9c77fe640 1 -- 172.21.15.131:0/2684519971 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8036070 con 0x7fe9b0003a00 2024-05-17T04:10:02.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.736+0000 7fe9c77fe640 1 -- 172.21.15.131:0/2684519971 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b8031400 con 0x7fe9b0003a00 2024-05-17T04:10:02.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.736+0000 7fe9c77fe640 1 -- 172.21.15.131:0/2684519971 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8009690 con 0x7fe9b0003a00 2024-05-17T04:10:02.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.737+0000 7fe9cee2d640 1 -- 172.21.15.131:0/2684519971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b0003a00 msgr2=0x7fe9b0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.737+0000 7fe9cee2d640 1 --2- 172.21.15.131:0/2684519971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b0003a00 0x7fe9b0003e70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009ac0 tx=0x7fe9b0005830 comp rx=0 tx=0).stop 2024-05-17T04:10:02.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.737+0000 7fe9cd3ca640 1 -- 172.21.15.131:0/2684519971 reap_dead start 2024-05-17T04:10:02.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.737+0000 7fe9cee2d640 1 -- 172.21.15.131:0/2684519971 shutdown_connections 2024-05-17T04:10:02.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.737+0000 7fe9cee2d640 1 -- 172.21.15.131:0/2684519971 >> 172.21.15.131:0/2684519971 conn(0x7fe9c8073150 msgr2=0x7fe9c8073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:02.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.737+0000 7fe9cee2d640 1 -- 172.21.15.131:0/2684519971 shutdown_connections 2024-05-17T04:10:02.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.737+0000 7fe9cee2d640 1 -- 172.21.15.131:0/2684519971 wait complete. 2024-05-17T04:10:02.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.739+0000 7fe9cee2d640 1 Processor -- start 2024-05-17T04:10:02.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.739+0000 7fe9cee2d640 1 -- start start 2024-05-17T04:10:02.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.740+0000 7fe9cee2d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b0003a00 0x7fe9c8150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.740+0000 7fe9cee2d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9c815d4e0 0x7fe9c81535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.740+0000 7fe9cee2d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9c815d8f0 0x7fe9c8153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.740+0000 7fe9cee2d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c80af740 con 0x7fe9b0003a00 2024-05-17T04:10:02.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.740+0000 7fe9cee2d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c80af460 con 0x7fe9c815d8f0 2024-05-17T04:10:02.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.740+0000 7fe9cee2d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c80ae850 con 0x7fe9c815d4e0 2024-05-17T04:10:02.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.740+0000 7fe9ccbc9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b0003a00 0x7fe9c8150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.740+0000 7fe9ccbc9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b0003a00 0x7fe9c8150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46572/0 (socket says 172.21.15.131:46572) 2024-05-17T04:10:02.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.740+0000 7fe9ccbc9640 1 -- 172.21.15.131:0/2775357236 learned_addr learned my addr 172.21.15.131:0/2775357236 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:10:02.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.740+0000 7fe9cd3ca640 1 --2- 172.21.15.131:0/2775357236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9c815d8f0 0x7fe9c8153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.740+0000 7fe9ccbc9640 1 -- 172.21.15.131:0/2775357236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9c815d4e0 msgr2=0x7fe9c81535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.740+0000 7fe9ccbc9640 1 --2- 172.21.15.131:0/2775357236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9c815d4e0 0x7fe9c81535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.740+0000 7fe9ccbc9640 1 -- 172.21.15.131:0/2775357236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9c815d8f0 msgr2=0x7fe9c8153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.740+0000 7fe9ccbc9640 1 --2- 172.21.15.131:0/2775357236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9c815d8f0 0x7fe9c8153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.741+0000 7fe9ccbc9640 1 -- 172.21.15.131:0/2775357236 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c81f8dd0 con 0x7fe9b0003a00 2024-05-17T04:10:02.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.741+0000 7fe9ccbc9640 1 --2- 172.21.15.131:0/2775357236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b0003a00 0x7fe9c8150850 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8034040 tx=0x7fe9b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:02.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.741+0000 7fe9c57fa640 1 -- 172.21.15.131:0/2775357236 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8040020 con 0x7fe9b0003a00 2024-05-17T04:10:02.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.741+0000 7fe9c57fa640 1 -- 172.21.15.131:0/2775357236 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b8003950 con 0x7fe9b0003a00 2024-05-17T04:10:02.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.741+0000 7fe9c57fa640 1 -- 172.21.15.131:0/2775357236 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8036040 con 0x7fe9b0003a00 2024-05-17T04:10:02.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.741+0000 7fe9cee2d640 1 -- 172.21.15.131:0/2775357236 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c81f90b0 con 0x7fe9b0003a00 2024-05-17T04:10:02.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.741+0000 7fe9cee2d640 1 -- 172.21.15.131:0/2775357236 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c81f9670 con 0x7fe9b0003a00 2024-05-17T04:10:02.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.742+0000 7fe9cee2d640 1 -- 172.21.15.131:0/2775357236 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c80b4140 con 0x7fe9b0003a00 2024-05-17T04:10:02.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.743+0000 7fe9c57fa640 1 -- 172.21.15.131:0/2775357236 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe9b8043020 con 0x7fe9b0003a00 2024-05-17T04:10:02.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.743+0000 7fe9c57fa640 1 --2- 172.21.15.131:0/2775357236 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe9b40762d0 0x7fe9b40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:02.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.743+0000 7fe9c57fa640 1 -- 172.21.15.131:0/2775357236 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fe9b80b7d70 con 0x7fe9b0003a00 2024-05-17T04:10:02.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.743+0000 7fe9c7fff640 1 --2- 172.21.15.131:0/2775357236 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe9b40762d0 0x7fe9b40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:02.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.744+0000 7fe9c7fff640 1 --2- 172.21.15.131:0/2775357236 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe9b40762d0 0x7fe9b40787e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8154330 tx=0x7fe9bc001fc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:02.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.748+0000 7fe9c57fa640 1 -- 172.21.15.131:0/2775357236 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe9b804a030 con 0x7fe9b0003a00 2024-05-17T04:10:02.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.970+0000 7fe9cee2d640 1 -- 172.21.15.131:0/2775357236 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe9c8150dc0 con 0x7fe9b0003a00 2024-05-17T04:10:02.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.970+0000 7fe9c57fa640 1 -- 172.21.15.131:0/2775357236 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7fe9b80814b0 con 0x7fe9b0003a00 2024-05-17T04:10:02.971 INFO:teuthology.orchestra.run.smithi131.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-17T04:10:02.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.972+0000 7fe9cee2d640 1 -- 172.21.15.131:0/2775357236 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe9b40762d0 msgr2=0x7fe9b40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.972+0000 7fe9cee2d640 1 --2- 172.21.15.131:0/2775357236 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe9b40762d0 0x7fe9b40787e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8154330 tx=0x7fe9bc001fc0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.972+0000 7fe9cee2d640 1 -- 172.21.15.131:0/2775357236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b0003a00 msgr2=0x7fe9c8150850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:02.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.972+0000 7fe9cee2d640 1 --2- 172.21.15.131:0/2775357236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b0003a00 0x7fe9c8150850 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8034040 tx=0x7fe9b8004730 comp rx=0 tx=0).stop 2024-05-17T04:10:02.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.972+0000 7fe9cee2d640 1 -- 172.21.15.131:0/2775357236 shutdown_connections 2024-05-17T04:10:02.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.972+0000 7fe9cee2d640 1 --2- 172.21.15.131:0/2775357236 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe9b40762d0 0x7fe9b40787e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.972+0000 7fe9cee2d640 1 --2- 172.21.15.131:0/2775357236 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9c815d8f0 0x7fe9c8153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.972+0000 7fe9cee2d640 1 --2- 172.21.15.131:0/2775357236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9c815d4e0 0x7fe9c81535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.972+0000 7fe9cee2d640 1 --2- 172.21.15.131:0/2775357236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9b0003a00 0x7fe9c8150850 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:02.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.972+0000 7fe9cee2d640 1 -- 172.21.15.131:0/2775357236 >> 172.21.15.131:0/2775357236 conn(0x7fe9c8073150 msgr2=0x7fe9c80b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:02.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.973+0000 7fe9cee2d640 1 -- 172.21.15.131:0/2775357236 shutdown_connections 2024-05-17T04:10:02.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:02.973+0000 7fe9cee2d640 1 -- 172.21.15.131:0/2775357236 wait complete. 2024-05-17T04:10:02.986 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-17T04:10:02.986 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-17T04:10:02.987 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-05-17T04:10:02.987 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-17T04:10:02.987 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-17T04:10:02.987 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-17T04:10:02.987 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-17T04:10:02.987 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-17T04:10:02.987 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-17T04:10:02.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:10:02.988 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-05-17T04:10:03.004 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-17T04:10:03.004 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-17T04:10:03.005 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-05-17T04:10:03.005 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:10:03.005 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-05-17T04:10:03.005 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:10:03.005 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:10:03.005 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:10:03.005 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-05-17T04:10:03.005 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:10:03.005 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:10:03.005 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-05-17T04:10:03.005 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-17T04:10:03.005 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:10:03.006 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-17T04:10:03.006 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:10:03.006 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-17T04:10:03.006 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42630sec preferred_lft 42630sec 2024-05-17T04:10:03.006 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2024-05-17T04:10:03.006 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:10:03.006 INFO:teuthology.orchestra.run.smithi131.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-17T04:10:03.006 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 5e:1a:ab:fb:ac:02 brd ff:ff:ff:ff:ff:ff 2024-05-17T04:10:03.006 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-17T04:10:03.006 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:10:03.006 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::4cae:6fff:fe57:53f7/64 scope link 2024-05-17T04:10:03.006 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:10:03.006 INFO:teuthology.orchestra.run.smithi131.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-17T04:10:03.007 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether b6:67:b9:f7:d5:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T04:10:03.007 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::b467:b9ff:fef7:d584/64 scope link 2024-05-17T04:10:03.007 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:10:03.007 INFO:teuthology.orchestra.run.smithi131.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-17T04:10:03.007 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 5e:1a:ab:fb:ac:02 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-17T04:10:03.007 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::5c1a:abff:fefb:ac02/64 scope link 2024-05-17T04:10:03.007 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-05-17T04:10:03.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:10:03.007 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-17T04:10:03.069 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-05-17T04:10:03.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:10:03.070 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-05-17T04:10:03.128 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-05-17T04:10:03.128 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-17T04:10:03.128 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-17T04:10:03.128 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-17T04:10:03.128 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-17T04:10:03.128 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-17T04:10:03.129 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-05-17T04:10:03.129 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-17T04:10:03.129 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-17T04:10:03.129 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-17T04:10:03.129 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-05-17T04:10:03.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-17T04:10:03.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:10:03.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:10:03.256 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-05-17T04:10:03.271 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-17T04:10:03.271 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-17T04:10:03.271 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-17T04:10:03.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:10:03.272 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2024-05-17T04:10:03.337 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-17T04:10:03.337 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-17T04:10:03.337 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-17T04:10:03.394 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-17T04:10:03.394 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-17T04:10:03.394 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-17T04:10:03.450 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-05-17T04:10:03.516 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-05-17T04:10:03.572 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-05-17T04:10:03.572 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-05-17T04:10:03.572 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-05-17T04:10:03.572 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-05-17T04:10:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-05-17T04:10:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-05-17T04:10:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-05-17T04:10:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-05-17T04:10:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-05-17T04:10:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-05-17T04:10:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-05-17T04:10:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/selinux 2024-05-17T04:10:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-05-17T04:10:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-05-17T04:10:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-05-17T04:10:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-05-17T04:10:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-05-17T04:10:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-05-17T04:10:03.574 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-05-17T04:10:03.574 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysctl.service 2024-05-17T04:10:03.574 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-17T04:10:03.574 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-17T04:10:03.574 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/nfs/rpc_pipefs 2024-05-17T04:10:03.574 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-05-17T04:10:03.574 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-05-17T04:10:03.574 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-0 2024-05-17T04:10:03.574 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-1 2024-05-17T04:10:03.574 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-2 2024-05-17T04:10:03.574 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-3 2024-05-17T04:10:03.574 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-05-17T04:10:03.574 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T04:10:03.575 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T04:10:03.575 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-17T04:10:03.575 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-17T04:10:03.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:10:03.575 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-05-17T04:10:03.628 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-17T04:10:03.628 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-17T04:10:03.672 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-05-17T04:10:03.696 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-05-17T04:10:03.755 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-05-17T04:10:03.755 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-05-17T04:10:03.755 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-05-17T04:10:03.755 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-05-17T04:10:03.755 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-05-17T04:10:03.756 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-05-17T04:10:03.756 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-05-17T04:10:03.756 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-05-17T04:10:03.756 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-05-17T04:10:03.756 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-05-17T04:10:03.756 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-05-17T04:10:03.756 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/selinux 2024-05-17T04:10:03.756 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-05-17T04:10:03.756 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-05-17T04:10:03.756 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-05-17T04:10:03.756 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-05-17T04:10:03.756 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-05-17T04:10:03.756 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-05-17T04:10:03.757 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-05-17T04:10:03.757 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysctl.service 2024-05-17T04:10:03.757 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-17T04:10:03.757 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-17T04:10:03.757 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/nfs/rpc_pipefs 2024-05-17T04:10:03.757 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-05-17T04:10:03.757 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-05-17T04:10:03.757 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-0 2024-05-17T04:10:03.757 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-1 2024-05-17T04:10:03.757 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-2 2024-05-17T04:10:03.757 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-3 2024-05-17T04:10:03.757 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-05-17T04:10:03.757 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T04:10:03.757 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T04:10:03.758 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-17T04:10:03.758 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-17T04:10:03.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:10:03.758 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-05-17T04:10:03.764 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi131.stderr:2024-05-17T04:10:03.763+0000 7f6a5065b480 -1 init, newargv = 0x55935a6a9520 newargc=15 2024-05-17T04:10:03.764 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi131.stderr:ceph-fuse[49946]: starting ceph client 2024-05-17T04:10:03.769 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi131.stderr:ceph-fuse[49946]: starting fuse 2024-05-17T04:10:03.780 INFO:teuthology.orchestra.run.smithi131.stdout:41 2024-05-17T04:10:03.781 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-05-17T04:10:03.781 DEBUG:teuthology.orchestra.run.smithi131:> sudo stdin-killer -- python3 -c ' 2024-05-17T04:10:03.781 DEBUG:teuthology.orchestra.run.smithi131:> import glob 2024-05-17T04:10:03.781 DEBUG:teuthology.orchestra.run.smithi131:> import re 2024-05-17T04:10:03.781 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-05-17T04:10:03.781 DEBUG:teuthology.orchestra.run.smithi131:> import subprocess 2024-05-17T04:10:03.781 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:10:03.781 DEBUG:teuthology.orchestra.run.smithi131:> def _find_admin_socket(client_name): 2024-05-17T04:10:03.781 DEBUG:teuthology.orchestra.run.smithi131:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-17T04:10:03.781 DEBUG:teuthology.orchestra.run.smithi131:> files = glob.glob(asok_path) 2024-05-17T04:10:03.781 DEBUG:teuthology.orchestra.run.smithi131:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-17T04:10:03.782 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:10:03.782 DEBUG:teuthology.orchestra.run.smithi131:> # Given a non-glob path, it better be there 2024-05-17T04:10:03.782 DEBUG:teuthology.orchestra.run.smithi131:> if "*" not in asok_path: 2024-05-17T04:10:03.782 DEBUG:teuthology.orchestra.run.smithi131:> assert(len(files) == 1) 2024-05-17T04:10:03.782 DEBUG:teuthology.orchestra.run.smithi131:> return files[0] 2024-05-17T04:10:03.782 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:10:03.782 DEBUG:teuthology.orchestra.run.smithi131:> for f in files: 2024-05-17T04:10:03.782 DEBUG:teuthology.orchestra.run.smithi131:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-17T04:10:03.782 DEBUG:teuthology.orchestra.run.smithi131:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-17T04:10:03.782 DEBUG:teuthology.orchestra.run.smithi131:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-17T04:10:03.782 DEBUG:teuthology.orchestra.run.smithi131:> contents = proc_f.read() 2024-05-17T04:10:03.782 DEBUG:teuthology.orchestra.run.smithi131:> if mountpoint in contents: 2024-05-17T04:10:03.783 DEBUG:teuthology.orchestra.run.smithi131:> return f 2024-05-17T04:10:03.783 DEBUG:teuthology.orchestra.run.smithi131:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-17T04:10:03.783 DEBUG:teuthology.orchestra.run.smithi131:> 2024-05-17T04:10:03.783 DEBUG:teuthology.orchestra.run.smithi131:> print(_find_admin_socket("client.0")) 2024-05-17T04:10:03.783 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-05-17T04:10:03.900 INFO:teuthology.orchestra.run.smithi131.stdout:/var/run/ceph/ceph-client.0.49946.asok 2024-05-17T04:10:03.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-17T04:10:03.910 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49946.asok 2024-05-17T04:10:03.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:10:03.911 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49946.asok status 2024-05-17T04:10:04.055 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T04:10:04.055 INFO:teuthology.orchestra.run.smithi131.stdout: "metadata": { 2024-05-17T04:10:04.055 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_sha1": "931809a9e5d295bd61984693cac44fe131ded4bc", 2024-05-17T04:10:04.055 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_version": "ceph version 19.0.0-3794-g931809a9 (931809a9e5d295bd61984693cac44fe131ded4bc) squid (dev)", 2024-05-17T04:10:04.055 INFO:teuthology.orchestra.run.smithi131.stdout: "entity_id": "0", 2024-05-17T04:10:04.056 INFO:teuthology.orchestra.run.smithi131.stdout: "hostname": "smithi131", 2024-05-17T04:10:04.056 INFO:teuthology.orchestra.run.smithi131.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-17T04:10:04.056 INFO:teuthology.orchestra.run.smithi131.stdout: "pid": "49946", 2024-05-17T04:10:04.056 INFO:teuthology.orchestra.run.smithi131.stdout: "root": "/" 2024-05-17T04:10:04.056 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:10:04.056 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_count": 0, 2024-05-17T04:10:04.056 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_pinned_count": 0, 2024-05-17T04:10:04.056 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 5100, 2024-05-17T04:10:04.056 INFO:teuthology.orchestra.run.smithi131.stdout: "inst": { 2024-05-17T04:10:04.056 INFO:teuthology.orchestra.run.smithi131.stdout: "name": { 2024-05-17T04:10:04.056 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "client", 2024-05-17T04:10:04.056 INFO:teuthology.orchestra.run.smithi131.stdout: "num": 5100 2024-05-17T04:10:04.056 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:10:04.056 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-05-17T04:10:04.057 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-05-17T04:10:04.057 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.1:0", 2024-05-17T04:10:04.057 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 415627114 2024-05-17T04:10:04.057 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-05-17T04:10:04.057 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:10:04.057 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-05-17T04:10:04.057 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-05-17T04:10:04.057 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.1:0", 2024-05-17T04:10:04.057 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 415627114 2024-05-17T04:10:04.057 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-05-17T04:10:04.057 INFO:teuthology.orchestra.run.smithi131.stdout: "inst_str": "client.5100 192.168.0.1:0/415627114", 2024-05-17T04:10:04.057 INFO:teuthology.orchestra.run.smithi131.stdout: "addr_str": "192.168.0.1:0/415627114", 2024-05-17T04:10:04.057 INFO:teuthology.orchestra.run.smithi131.stdout: "inode_count": 1, 2024-05-17T04:10:04.058 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_epoch": 16, 2024-05-17T04:10:04.058 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch": 36, 2024-05-17T04:10:04.058 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch_barrier": 0, 2024-05-17T04:10:04.058 INFO:teuthology.orchestra.run.smithi131.stdout: "blocklisted": false, 2024-05-17T04:10:04.058 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs" 2024-05-17T04:10:04.058 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T04:10:04.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:10:04.064 DEBUG:teuthology.orchestra.run.smithi131:> stat --file-system '--printf=%T 2024-05-17T04:10:04.064 DEBUG:teuthology.orchestra.run.smithi131:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-17T04:10:04.080 INFO:teuthology.orchestra.run.smithi131.stdout:fuseblk 2024-05-17T04:10:04.080 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-17T04:10:04.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:10:04.080 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-17T04:10:04.145 DEBUG:teuthology.orchestra.run.smithi131:> mktemp -d --suffix=xfstests-dev 2024-05-17T04:10:04.201 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.bj85EVPhOZxfstests-dev 2024-05-17T04:10:04.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:10:04.202 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.bj85EVPhOZxfstests-dev) 2024-05-17T04:10:04.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:10:04.269 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.bj85EVPhOZxfstests-dev) 2024-05-17T04:10:04.328 INFO:teuthology.orchestra.run.smithi131.stderr:Cloning into '/tmp/tmp.bj85EVPhOZxfstests-dev'... 2024-05-17T04:10:05.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:10:05.196 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-05-17T04:10:05.255 DEBUG:teuthology.orchestra.run.smithi131:> mktemp -d --suffix=test 2024-05-17T04:10:05.311 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.2OgBg7y0wTtest 2024-05-17T04:10:05.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:10:05.311 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-05-17T04:10:05.369 DEBUG:teuthology.orchestra.run.smithi131:> mktemp -d --suffix=scratch 2024-05-17T04:10:05.425 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.yv2TaT2zDPscratch 2024-05-17T04:10:05.425 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-05-17T04:10:05.425 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-05-17T04:10:06.043 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:03:27 ago on Fri 17 May 2024 04:06:39 AM UTC. 2024-05-17T04:10:06.123 INFO:teuthology.orchestra.run.smithi131.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-05-17T04:10:06.124 INFO:teuthology.orchestra.run.smithi131.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-05-17T04:10:06.125 INFO:teuthology.orchestra.run.smithi131.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-05-17T04:10:06.125 INFO:teuthology.orchestra.run.smithi131.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-05-17T04:10:06.126 INFO:teuthology.orchestra.run.smithi131.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-05-17T04:10:06.128 INFO:teuthology.orchestra.run.smithi131.stdout:Package e2fsprogs-1.46.5-5.el9.x86_64 is already installed. 2024-05-17T04:10:06.129 INFO:teuthology.orchestra.run.smithi131.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-05-17T04:10:06.130 INFO:teuthology.orchestra.run.smithi131.stdout:Package gcc-11.4.1-3.el9.x86_64 is already installed. 2024-05-17T04:10:06.132 INFO:teuthology.orchestra.run.smithi131.stdout:Package git-2.43.0-1.el9.x86_64 is already installed. 2024-05-17T04:10:06.134 INFO:teuthology.orchestra.run.smithi131.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-17T04:10:06.135 INFO:teuthology.orchestra.run.smithi131.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-05-17T04:10:06.136 INFO:teuthology.orchestra.run.smithi131.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-05-17T04:10:06.137 INFO:teuthology.orchestra.run.smithi131.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-05-17T04:10:06.138 INFO:teuthology.orchestra.run.smithi131.stdout:Package lvm2-9:2.03.23-2.el9.x86_64 is already installed. 2024-05-17T04:10:06.139 INFO:teuthology.orchestra.run.smithi131.stdout:Package make-1:4.3-8.el9.x86_64 is already installed. 2024-05-17T04:10:06.139 INFO:teuthology.orchestra.run.smithi131.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-05-17T04:10:06.140 INFO:teuthology.orchestra.run.smithi131.stdout:Package python3-3.9.18-3.el9.x86_64 is already installed. 2024-05-17T04:10:06.141 INFO:teuthology.orchestra.run.smithi131.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-05-17T04:10:06.142 INFO:teuthology.orchestra.run.smithi131.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-05-17T04:10:06.144 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-17T04:10:06.166 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:10:06.169 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:10:06.191 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-05-17T04:10:06.193 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-05-17T04:10:06.193 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-05-17T04:10:06.193 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-05-17T04:10:06.193 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-05-17T04:10:06.193 INFO:teuthology.orchestra.run.smithi131.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-05-17T04:10:06.193 INFO:teuthology.orchestra.run.smithi131.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2024-05-17T04:10:06.193 INFO:teuthology.orchestra.run.smithi131.stdout: gdbm-devel x86_64 1:1.23-1.el9 crb 81 k 2024-05-17T04:10:06.193 INFO:teuthology.orchestra.run.smithi131.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-05-17T04:10:06.193 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-devel x86_64 5.14.0-446.el9 appstream 16 M 2024-05-17T04:10:06.193 INFO:teuthology.orchestra.run.smithi131.stdout: libcap-devel x86_64 2.48-9.el9 appstream 41 k 2024-05-17T04:10:06.193 INFO:teuthology.orchestra.run.smithi131.stdout: sqlite x86_64 3.34.1-7.el9 appstream 748 k 2024-05-17T04:10:06.193 INFO:teuthology.orchestra.run.smithi131.stdout: udftools x86_64 2.2-5.el9 appstream 149 k 2024-05-17T04:10:06.194 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2024-05-17T04:10:06.194 INFO:teuthology.orchestra.run.smithi131.stdout: gdbm-libs x86_64 1:1.23-1.el9 baseos 56 k 2024-05-17T04:10:06.194 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-05-17T04:10:06.194 INFO:teuthology.orchestra.run.smithi131.stdout: gdbm x86_64 1:1.23-1.el9 crb 153 k 2024-05-17T04:10:06.194 INFO:teuthology.orchestra.run.smithi131.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-05-17T04:10:06.194 INFO:teuthology.orchestra.run.smithi131.stdout: rmt x86_64 2:1.6-6.el9 baseos 46 k 2024-05-17T04:10:06.194 INFO:teuthology.orchestra.run.smithi131.stdout:Installing weak dependencies: 2024-05-17T04:10:06.194 INFO:teuthology.orchestra.run.smithi131.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2024-05-17T04:10:06.194 INFO:teuthology.orchestra.run.smithi131.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2024-05-17T04:10:06.194 INFO:teuthology.orchestra.run.smithi131.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2024-05-17T04:10:06.194 INFO:teuthology.orchestra.run.smithi131.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2024-05-17T04:10:06.194 INFO:teuthology.orchestra.run.smithi131.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2024-05-17T04:10:06.194 INFO:teuthology.orchestra.run.smithi131.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2024-05-17T04:10:06.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:10:06.195 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-05-17T04:10:06.195 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-05-17T04:10:06.195 INFO:teuthology.orchestra.run.smithi131.stdout:Install 17 Packages 2024-05-17T04:10:06.195 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 1 Package 2024-05-17T04:10:06.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:10:06.195 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 24 M 2024-05-17T04:10:06.195 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-05-17T04:10:06.829 INFO:teuthology.orchestra.run.smithi131.stdout:(1/18): fio-engine-http-3.35-1.el9.x86_64.rpm 213 kB/s | 18 kB 00:00 2024-05-17T04:10:06.854 INFO:teuthology.orchestra.run.smithi131.stdout:(2/18): rmt-1.6-6.el9.x86_64.rpm 418 kB/s | 46 kB 00:00 2024-05-17T04:10:06.880 INFO:teuthology.orchestra.run.smithi131.stdout:(3/18): fio-engine-libaio-3.35-1.el9.x86_64.rpm 310 kB/s | 16 kB 00:00 2024-05-17T04:10:06.905 INFO:teuthology.orchestra.run.smithi131.stdout:(4/18): fio-engine-nbd-3.35-1.el9.x86_64.rpm 291 kB/s | 15 kB 00:00 2024-05-17T04:10:06.930 INFO:teuthology.orchestra.run.smithi131.stdout:(5/18): fio-engine-rados-3.35-1.el9.x86_64.rpm 313 kB/s | 16 kB 00:00 2024-05-17T04:10:06.955 INFO:teuthology.orchestra.run.smithi131.stdout:(6/18): fio-engine-rbd-3.35-1.el9.x86_64.rpm 321 kB/s | 16 kB 00:00 2024-05-17T04:10:06.981 INFO:teuthology.orchestra.run.smithi131.stdout:(7/18): fio-engine-rdma-3.35-1.el9.x86_64.rpm 410 kB/s | 21 kB 00:00 2024-05-17T04:10:07.038 INFO:teuthology.orchestra.run.smithi131.stdout:(8/18): libcap-devel-2.48-9.el9.x86_64.rpm 713 kB/s | 41 kB 00:00 2024-05-17T04:10:07.171 INFO:teuthology.orchestra.run.smithi131.stdout:(9/18): fio-3.35-1.el9.x86_64.rpm 15 MB/s | 6.2 MB 00:00 2024-05-17T04:10:07.197 INFO:teuthology.orchestra.run.smithi131.stdout:(10/18): libnbd-1.18.1-3.el9.x86_64.rpm 1.0 MB/s | 166 kB 00:00 2024-05-17T04:10:07.230 INFO:teuthology.orchestra.run.smithi131.stdout:(11/18): sqlite-3.34.1-7.el9.x86_64.rpm 13 MB/s | 748 kB 00:00 2024-05-17T04:10:07.256 INFO:teuthology.orchestra.run.smithi131.stdout:(12/18): udftools-2.2-5.el9.x86_64.rpm 2.5 MB/s | 149 kB 00:00 2024-05-17T04:10:07.490 INFO:teuthology.orchestra.run.smithi131.stdout:(13/18): kernel-devel-5.14.0-446.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-05-17T04:10:07.515 INFO:teuthology.orchestra.run.smithi131.stdout:(14/18): gdbm-devel-1.23-1.el9.x86_64.rpm 311 kB/s | 81 kB 00:00 2024-05-17T04:10:07.540 INFO:teuthology.orchestra.run.smithi131.stdout:(15/18): gdbm-1.23-1.el9.x86_64.rpm 495 kB/s | 153 kB 00:00 2024-05-17T04:10:07.607 INFO:teuthology.orchestra.run.smithi131.stdout:(16/18): gdbm-libs-1.23-1.el9.x86_64.rpm 843 kB/s | 56 kB 00:00 2024-05-17T04:10:08.940 INFO:teuthology.orchestra.run.smithi131.stdout:(17/18): dump-0.4-0.51.b47.el9.x86_64.rpm 61 kB/s | 88 kB 00:01 2024-05-17T04:10:08.990 INFO:teuthology.orchestra.run.smithi131.stdout:(18/18): indent-2.2.13-5.el9.x86_64.rpm 122 kB/s | 179 kB 00:01 2024-05-17T04:10:08.993 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-05-17T04:10:08.993 INFO:teuthology.orchestra.run.smithi131.stdout:Total 8.6 MB/s | 24 MB 00:02 2024-05-17T04:10:09.347 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-05-17T04:10:09.402 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-05-17T04:10:09.402 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-05-17T04:10:09.976 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-05-17T04:10:09.977 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-05-17T04:10:11.031 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-05-17T04:10:11.105 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : gdbm-libs-1:1.23-1.el9.x86_64 1/19 2024-05-17T04:10:11.143 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gdbm-1:1.23-1.el9.x86_64 2/19 2024-05-17T04:10:11.171 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 3/19 2024-05-17T04:10:11.196 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 4/19 2024-05-17T04:10:11.222 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 5/19 2024-05-17T04:10:11.247 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 6/19 2024-05-17T04:10:11.272 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 7/19 2024-05-17T04:10:11.298 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 8/19 2024-05-17T04:10:11.454 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 9/19 2024-05-17T04:10:11.495 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fio-3.35-1.el9.x86_64 10/19 2024-05-17T04:10:11.531 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rmt-2:1.6-6.el9.x86_64 11/19 2024-05-17T04:10:11.562 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 12/19 2024-05-17T04:10:11.606 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gdbm-devel-1:1.23-1.el9.x86_64 13/19 2024-05-17T04:10:11.649 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : indent-2.2.13-5.el9.x86_64 14/19 2024-05-17T04:10:11.689 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : udftools-2.2-5.el9.x86_64 15/19 2024-05-17T04:10:11.738 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 16/19 2024-05-17T04:10:21.217 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 17/19 2024-05-17T04:10:21.597 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-devel-5.14.0-446.el9.x86_64 18/19 2024-05-17T04:10:32.390 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-devel-5.14.0-446.el9.x86_64 18/19 2024-05-17T04:10:32.476 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-05-17T04:10:34.416 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-05-17T04:10:34.416 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 1/19 2024-05-17T04:10:34.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fio-3.35-1.el9.x86_64 2/19 2024-05-17T04:10:34.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 3/19 2024-05-17T04:10:34.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 4/19 2024-05-17T04:10:34.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 5/19 2024-05-17T04:10:34.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 6/19 2024-05-17T04:10:34.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 7/19 2024-05-17T04:10:34.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 8/19 2024-05-17T04:10:34.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-devel-5.14.0-446.el9.x86_64 9/19 2024-05-17T04:10:34.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 10/19 2024-05-17T04:10:34.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 11/19 2024-05-17T04:10:34.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 12/19 2024-05-17T04:10:34.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : udftools-2.2-5.el9.x86_64 13/19 2024-05-17T04:10:34.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gdbm-1:1.23-1.el9.x86_64 14/19 2024-05-17T04:10:34.418 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gdbm-devel-1:1.23-1.el9.x86_64 15/19 2024-05-17T04:10:34.418 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/19 2024-05-17T04:10:34.418 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/19 2024-05-17T04:10:34.418 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gdbm-libs-1:1.23-1.el9.x86_64 18/19 2024-05-17T04:10:34.928 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-05-17T04:10:34.929 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:10:34.929 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2024-05-17T04:10:34.929 INFO:teuthology.orchestra.run.smithi131.stdout: gdbm-libs-1:1.23-1.el9.x86_64 2024-05-17T04:10:34.929 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-05-17T04:10:34.929 INFO:teuthology.orchestra.run.smithi131.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-05-17T04:10:34.929 INFO:teuthology.orchestra.run.smithi131.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-05-17T04:10:34.929 INFO:teuthology.orchestra.run.smithi131.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-05-17T04:10:34.929 INFO:teuthology.orchestra.run.smithi131.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-05-17T04:10:34.929 INFO:teuthology.orchestra.run.smithi131.stdout: gdbm-1:1.23-1.el9.x86_64 gdbm-devel-1:1.23-1.el9.x86_64 2024-05-17T04:10:34.929 INFO:teuthology.orchestra.run.smithi131.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-446.el9.x86_64 2024-05-17T04:10:34.929 INFO:teuthology.orchestra.run.smithi131.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-05-17T04:10:34.930 INFO:teuthology.orchestra.run.smithi131.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-05-17T04:10:34.930 INFO:teuthology.orchestra.run.smithi131.stdout: udftools-2.2-5.el9.x86_64 2024-05-17T04:10:34.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:10:34.930 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-05-17T04:10:35.280 DEBUG:teuthology.orchestra.run.smithi131:> sudo useradd -m fsgqa 2024-05-17T04:10:35.308 INFO:teuthology.orchestra.run.smithi131.stderr:useradd: user 'fsgqa' already exists 2024-05-17T04:10:35.310 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-05-17T04:10:35.310 DEBUG:teuthology.orchestra.run.smithi131:> sudo groupadd fsgqa 2024-05-17T04:10:35.378 INFO:teuthology.orchestra.run.smithi131.stderr:groupadd: group 'fsgqa' already exists 2024-05-17T04:10:35.379 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-05-17T04:10:35.380 DEBUG:teuthology.orchestra.run.smithi131:> sudo useradd fsgqa2 2024-05-17T04:10:36.121 DEBUG:teuthology.orchestra.run.smithi131:> sudo useradd 123456-fsgqa 2024-05-17T04:10:36.317 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:10:36.320 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:10:37.066 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-05-17T04:10:37.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.178+0000 7f4fb8531640 1 Processor -- start 2024-05-17T04:10:37.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.178+0000 7f4fb8531640 1 -- start start 2024-05-17T04:10:37.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.180+0000 7f4fb8531640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fb015d3c0 0x7f4fb0071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:37.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.180+0000 7f4fb8531640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fb0070370 con 0x7f4fb00d0b90 2024-05-17T04:10:37.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.180+0000 7f4fb8531640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fb0070650 con 0x7f4fb006e090 2024-05-17T04:10:37.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.180+0000 7f4fb8531640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4fb0070ca0 con 0x7f4fb015d3c0 2024-05-17T04:10:37.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.180+0000 7f4fb5acc640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f4fb00d0b90 0x7f4fb00d0fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:32998/0 (socket says 172.21.15.131:32998) 2024-05-17T04:10:37.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.180+0000 7f4fb5acc640 1 -- 172.21.15.131:0/2267818582 learned_addr learned my addr 172.21.15.131:0/2267818582 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:10:37.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.180+0000 7f4fb62cd640 1 --2- 172.21.15.131:0/2267818582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fb015d3c0 0x7f4fb0071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:37.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.180+0000 7f4fb52cb640 1 -- 172.21.15.131:0/2267818582 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 559995706 0 0) 0x7f4fb0070370 con 0x7f4fb00d0b90 2024-05-17T04:10:37.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.180+0000 7f4fb52cb640 1 -- 172.21.15.131:0/2267818582 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f9c003520 con 0x7f4fb00d0b90 2024-05-17T04:10:37.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.180+0000 7f4fb52cb640 1 -- 172.21.15.131:0/2267818582 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3585248569 0 0) 0x7f4f9c003520 con 0x7f4fb00d0b90 2024-05-17T04:10:37.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.180+0000 7f4fb52cb640 1 -- 172.21.15.131:0/2267818582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fb015d3c0 msgr2=0x7f4fb0071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:37.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.180+0000 7f4fb52cb640 1 --2- 172.21.15.131:0/2267818582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fb015d3c0 0x7f4fb0071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.180+0000 7f4fb52cb640 1 -- 172.21.15.131:0/2267818582 >> v1:172.21.15.150:6789/0 conn(0x7f4fb006e090 legacy=0x7f4fb006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:37.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb52cb640 1 -- 172.21.15.131:0/2267818582 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb0070930 con 0x7f4fb00d0b90 2024-05-17T04:10:37.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb52cb640 1 -- 172.21.15.131:0/2267818582 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7f4fa00016f0 con 0x7f4fb00d0b90 2024-05-17T04:10:37.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb52cb640 1 -- 172.21.15.131:0/2267818582 >> v1:172.21.15.131:6789/0 conn(0x7f4fb00d0b90 legacy=0x7f4fb00d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:37.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb52cb640 1 --2- 172.21.15.131:0/2267818582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f9c0039e0 0x7f4f9c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:37.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb52cb640 1 --2- 172.21.15.131:0/2267818582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fb015d3c0 0x7f4f9c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:37.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb52cb640 1 --2- 172.21.15.131:0/2267818582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f9c004d40 0x7f4f9c005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:37.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb52cb640 1 -- 172.21.15.131:0/2267818582 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb0070ca0 con 0x7f4f9c0039e0 2024-05-17T04:10:37.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb52cb640 1 -- 172.21.15.131:0/2267818582 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c00bb50 con 0x7f4f9c004d40 2024-05-17T04:10:37.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb52cb640 1 -- 172.21.15.131:0/2267818582 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9c00bd00 con 0x7f4fb015d3c0 2024-05-17T04:10:37.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb62cd640 1 --2- 172.21.15.131:0/2267818582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f9c0039e0 0x7f4f9c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:37.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb5acc640 1 --2- 172.21.15.131:0/2267818582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fb015d3c0 0x7f4f9c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:37.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb6ace640 1 --2- 172.21.15.131:0/2267818582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f9c004d40 0x7f4f9c005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:37.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb62cd640 1 -- 172.21.15.131:0/2267818582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fb015d3c0 msgr2=0x7f4f9c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:37.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb62cd640 1 --2- 172.21.15.131:0/2267818582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fb015d3c0 0x7f4f9c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb62cd640 1 -- 172.21.15.131:0/2267818582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f9c004d40 msgr2=0x7f4f9c005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:37.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb62cd640 1 --2- 172.21.15.131:0/2267818582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f9c004d40 0x7f4f9c005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.181+0000 7f4fb62cd640 1 -- 172.21.15.131:0/2267818582 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c003520 con 0x7f4f9c0039e0 2024-05-17T04:10:37.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.182+0000 7f4fb62cd640 1 --2- 172.21.15.131:0/2267818582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f9c0039e0 0x7f4f9c003e10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009fc0 tx=0x7f4f9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa9f5031f840cd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:37.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.182+0000 7f4fb52cb640 1 -- 172.21.15.131:0/2267818582 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fac034020 con 0x7f4f9c0039e0 2024-05-17T04:10:37.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.182+0000 7f4fb52cb640 1 -- 172.21.15.131:0/2267818582 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fac0305f0 con 0x7f4f9c0039e0 2024-05-17T04:10:37.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.182+0000 7f4fb52cb640 1 -- 172.21.15.131:0/2267818582 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fac009c10 con 0x7f4f9c0039e0 2024-05-17T04:10:37.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.182+0000 7f4fb8531640 1 -- 172.21.15.131:0/2267818582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f9c0039e0 msgr2=0x7f4f9c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:37.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.182+0000 7f4fb8531640 1 --2- 172.21.15.131:0/2267818582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f9c0039e0 0x7f4f9c003e10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009fc0 tx=0x7f4f9c005830 comp rx=0 tx=0).stop 2024-05-17T04:10:37.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.183+0000 7f4fb6ace640 1 -- 172.21.15.131:0/2267818582 reap_dead start 2024-05-17T04:10:37.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.183+0000 7f4fb8531640 1 -- 172.21.15.131:0/2267818582 shutdown_connections 2024-05-17T04:10:37.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.183+0000 7f4fb8531640 1 -- 172.21.15.131:0/2267818582 >> 172.21.15.131:0/2267818582 conn(0x7f4fb00735b0 msgr2=0x7f4fb00739c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:37.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.183+0000 7f4fb8531640 1 -- 172.21.15.131:0/2267818582 shutdown_connections 2024-05-17T04:10:37.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.183+0000 7f4fb8531640 1 -- 172.21.15.131:0/2267818582 wait complete. 2024-05-17T04:10:37.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.184+0000 7f4fb8531640 1 Processor -- start 2024-05-17T04:10:37.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.185+0000 7f4fb8531640 1 -- start start 2024-05-17T04:10:37.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb8531640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f9c0039e0 0x7f4fb014f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:37.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb8531640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fb01f7a50 0x7f4fb006cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:37.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb8531640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fb006d4c0 0x7f4fb014b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:37.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb8531640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb0070110 con 0x7f4fb01f7a50 2024-05-17T04:10:37.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb8531640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb006ff90 con 0x7f4f9c0039e0 2024-05-17T04:10:37.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb8531640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4fb0071130 con 0x7f4fb006d4c0 2024-05-17T04:10:37.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb5acc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fb01f7a50 0x7f4fb006cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:37.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb5acc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fb01f7a50 0x7f4fb006cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42880/0 (socket says 172.21.15.131:42880) 2024-05-17T04:10:37.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb5acc640 1 -- 172.21.15.131:0/2143003035 learned_addr learned my addr 172.21.15.131:0/2143003035 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:10:37.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb62cd640 1 --2- 172.21.15.131:0/2143003035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f9c0039e0 0x7f4fb014f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:37.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb6ace640 1 --2- 172.21.15.131:0/2143003035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fb006d4c0 0x7f4fb014b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:37.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb5acc640 1 -- 172.21.15.131:0/2143003035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fb006d4c0 msgr2=0x7f4fb014b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:37.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb5acc640 1 --2- 172.21.15.131:0/2143003035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fb006d4c0 0x7f4fb014b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb5acc640 1 -- 172.21.15.131:0/2143003035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f9c0039e0 msgr2=0x7f4fb014f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:37.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb5acc640 1 --2- 172.21.15.131:0/2143003035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f9c0039e0 0x7f4fb014f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb5acc640 1 -- 172.21.15.131:0/2143003035 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb015f600 con 0x7f4fb01f7a50 2024-05-17T04:10:37.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb62cd640 1 --2- 172.21.15.131:0/2143003035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f9c0039e0 0x7f4fb014f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T04:10:37.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.186+0000 7f4fb5acc640 1 --2- 172.21.15.131:0/2143003035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fb01f7a50 0x7f4fb006cf80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0001160 tx=0x7f4fa00077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:37.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.187+0000 7f4fa6ffd640 1 -- 172.21.15.131:0/2143003035 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000f960 con 0x7f4fb01f7a50 2024-05-17T04:10:37.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.187+0000 7f4fa6ffd640 1 -- 172.21.15.131:0/2143003035 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa0018070 con 0x7f4fb01f7a50 2024-05-17T04:10:37.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.187+0000 7f4fb8531640 1 -- 172.21.15.131:0/2143003035 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb006d8d0 con 0x7f4fb01f7a50 2024-05-17T04:10:37.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.187+0000 7f4fa6ffd640 1 -- 172.21.15.131:0/2143003035 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000fd40 con 0x7f4fb01f7a50 2024-05-17T04:10:37.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.187+0000 7f4fb8531640 1 -- 172.21.15.131:0/2143003035 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb01f4380 con 0x7f4fb01f7a50 2024-05-17T04:10:37.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.188+0000 7f4fb8531640 1 -- 172.21.15.131:0/2143003035 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb01f3e10 con 0x7f4fb01f7a50 2024-05-17T04:10:37.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.188+0000 7f4fa6ffd640 1 -- 172.21.15.131:0/2143003035 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4fa001d460 con 0x7f4fb01f7a50 2024-05-17T04:10:37.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.189+0000 7f4fa6ffd640 1 --2- 172.21.15.131:0/2143003035 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f4f94076300 0x7f4f94078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:37.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.189+0000 7f4fb62cd640 1 --2- 172.21.15.131:0/2143003035 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f4f94076300 0x7f4f94078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:37.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.189+0000 7f4fa6ffd640 1 -- 172.21.15.131:0/2143003035 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f4fa0097850 con 0x7f4fb01f7a50 2024-05-17T04:10:37.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.190+0000 7f4fb62cd640 1 --2- 172.21.15.131:0/2143003035 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f4f94076300 0x7f4f94078810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4fac035000 tx=0x7f4fac02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:37.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.194+0000 7f4fa6ffd640 1 -- 172.21.15.131:0/2143003035 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4fb006d8d0 con 0x7f4fb01f7a50 2024-05-17T04:10:37.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.452+0000 7f4fb8531640 1 -- 172.21.15.131:0/2143003035 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4fb00714e0 con 0x7f4fb01f7a50 2024-05-17T04:10:37.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.452+0000 7f4fa6ffd640 1 -- 172.21.15.131:0/2143003035 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1289 (secure 0 0 0) 0x7f4fa0060f90 con 0x7f4fb01f7a50 2024-05-17T04:10:37.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:10:37.453 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","modified":"2024-05-17T04:08:07.672618Z","created":"2024-05-17T04:08:07.672618Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:3300","nonce":0},{"type":"v1","addr":"172.21.15.131:6789","nonce":0}]},"addr":"172.21.15.131:6789/0","public_addr":"172.21.15.131:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3301","nonce":0},{"type":"v1","addr":"172.21.15.150:6790","nonce":0}]},"addr":"172.21.15.150:6790/0","public_addr":"172.21.15.150:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-17T04:10:37.453 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-05-17T04:10:37.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.455+0000 7f4fb8531640 1 -- 172.21.15.131:0/2143003035 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f4f94076300 msgr2=0x7f4f94078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:37.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.455+0000 7f4fb8531640 1 --2- 172.21.15.131:0/2143003035 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f4f94076300 0x7f4f94078810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4fac035000 tx=0x7f4fac02f000 comp rx=0 tx=0).stop 2024-05-17T04:10:37.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.455+0000 7f4fb8531640 1 -- 172.21.15.131:0/2143003035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fb01f7a50 msgr2=0x7f4fb006cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:37.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.455+0000 7f4fb8531640 1 --2- 172.21.15.131:0/2143003035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fb01f7a50 0x7f4fb006cf80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0001160 tx=0x7f4fa00077a0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.455+0000 7f4fb8531640 1 -- 172.21.15.131:0/2143003035 shutdown_connections 2024-05-17T04:10:37.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.455+0000 7f4fb8531640 1 --2- 172.21.15.131:0/2143003035 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f4f94076300 0x7f4f94078810 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.455+0000 7f4fb8531640 1 --2- 172.21.15.131:0/2143003035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fb01f7a50 0x7f4fb006cf80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.455+0000 7f4fb8531640 1 --2- 172.21.15.131:0/2143003035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fb006d4c0 0x7f4fb014b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.455+0000 7f4fb8531640 1 --2- 172.21.15.131:0/2143003035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f9c0039e0 0x7f4fb014f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.455+0000 7f4fb8531640 1 -- 172.21.15.131:0/2143003035 >> 172.21.15.131:0/2143003035 conn(0x7f4fb00735b0 msgr2=0x7f4fb00b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:37.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.455+0000 7f4fb8531640 1 -- 172.21.15.131:0/2143003035 shutdown_connections 2024-05-17T04:10:37.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.455+0000 7f4fb8531640 1 -- 172.21.15.131:0/2143003035 wait complete. 2024-05-17T04:10:37.467 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2024-05-17T04:10:37.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.579+0000 7f3a6d647640 1 Processor -- start 2024-05-17T04:10:37.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.579+0000 7f3a6d647640 1 -- start start 2024-05-17T04:10:37.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.581+0000 7f3a6d647640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3a680b3d20 0x7f3a6815f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:37.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.581+0000 7f3a6d647640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a680b4270 0x7f3a6806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:37.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.581+0000 7f3a6d647640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a6815fb90 con 0x7f3a680d3e10 2024-05-17T04:10:37.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.581+0000 7f3a6d647640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f3a680d19d0 con 0x7f3a680b3d20 2024-05-17T04:10:37.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.581+0000 7f3a6d647640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3a6806d880 con 0x7f3a680b4270 2024-05-17T04:10:37.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.581+0000 7f3a677fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f3a680d3e10 0x7f3a680d4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:33010/0 (socket says 172.21.15.131:33010) 2024-05-17T04:10:37.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.581+0000 7f3a677fe640 1 -- 172.21.15.131:0/2196422363 learned_addr learned my addr 172.21.15.131:0/2196422363 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T04:10:37.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.581+0000 7f3a66ffd640 1 --2- 172.21.15.131:0/2196422363 >> v2:172.21.15.150:3300/0 conn(0x7f3a680b3d20 0x7f3a6815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:37.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.581+0000 7f3a5e7fc640 1 --2- 172.21.15.131:0/2196422363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a680b4270 0x7f3a6806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:37.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.581+0000 7f3a667fc640 1 -- 172.21.15.131:0/2196422363 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722429394 0 0) 0x7f3a6815fb90 con 0x7f3a680d3e10 2024-05-17T04:10:37.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.581+0000 7f3a667fc640 1 -- 172.21.15.131:0/2196422363 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a54003520 con 0x7f3a680d3e10 2024-05-17T04:10:37.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.581+0000 7f3a66ffd640 1 -- 172.21.15.131:0/2196422363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a680b4270 msgr2=0x7f3a6806dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T04:10:37.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.581+0000 7f3a66ffd640 1 --2- 172.21.15.131:0/2196422363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a680b4270 0x7f3a6806dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.581+0000 7f3a66ffd640 1 -- 172.21.15.131:0/2196422363 >> v1:172.21.15.131:6789/0 conn(0x7f3a680d3e10 legacy=0x7f3a680d4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:37.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.581+0000 7f3a66ffd640 1 -- 172.21.15.131:0/2196422363 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a680b4a50 con 0x7f3a680b3d20 2024-05-17T04:10:37.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.582+0000 7f3a66ffd640 1 --2- 172.21.15.131:0/2196422363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a680b3d20 0x7f3a6815f650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3a580097a0 tx=0x7f3a5802a0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76811656cfc0bbf3 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:37.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.583+0000 7f3a667fc640 1 -- 172.21.15.131:0/2196422363 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58037070 con 0x7f3a680b3d20 2024-05-17T04:10:37.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.583+0000 7f3a667fc640 1 -- 172.21.15.131:0/2196422363 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a5802ae30 con 0x7f3a680b3d20 2024-05-17T04:10:37.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.583+0000 7f3a667fc640 1 -- 172.21.15.131:0/2196422363 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58032640 con 0x7f3a680b3d20 2024-05-17T04:10:37.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.583+0000 7f3a6d647640 1 -- 172.21.15.131:0/2196422363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a680b3d20 msgr2=0x7f3a6815f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:37.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.583+0000 7f3a6d647640 1 --2- 172.21.15.131:0/2196422363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a680b3d20 0x7f3a6815f650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3a580097a0 tx=0x7f3a5802a0e0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.583+0000 7f3a6d647640 1 -- 172.21.15.131:0/2196422363 shutdown_connections 2024-05-17T04:10:37.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.583+0000 7f3a6d647640 1 --2- 172.21.15.131:0/2196422363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a680b4270 0x7f3a6806dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.583+0000 7f3a6d647640 1 --2- 172.21.15.131:0/2196422363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a680b3d20 0x7f3a6815f650 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.583+0000 7f3a6d647640 1 -- 172.21.15.131:0/2196422363 >> 172.21.15.131:0/2196422363 conn(0x7f3a680d5860 msgr2=0x7f3a680d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:37.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.583+0000 7f3a6d647640 1 -- 172.21.15.131:0/2196422363 shutdown_connections 2024-05-17T04:10:37.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.583+0000 7f3a6d647640 1 -- 172.21.15.131:0/2196422363 wait complete. 2024-05-17T04:10:37.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.585+0000 7f3a6d647640 1 Processor -- start 2024-05-17T04:10:37.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.585+0000 7f3a6d647640 1 -- start start 2024-05-17T04:10:37.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a6d647640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a680b3d20 0x7f3a68154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:37.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a6d647640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a680b4270 0x7f3a68155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:37.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a6d647640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a680d3e10 0x7f3a681562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:37.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a6d647640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6806d510 con 0x7f3a680d3e10 2024-05-17T04:10:37.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a6d647640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3a680d1730 con 0x7f3a680b4270 2024-05-17T04:10:37.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a6d647640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3a6806e250 con 0x7f3a680b3d20 2024-05-17T04:10:37.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a677fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a680d3e10 0x7f3a681562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:37.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a677fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a680d3e10 0x7f3a681562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:42890/0 (socket says 172.21.15.131:42890) 2024-05-17T04:10:37.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a677fe640 1 -- 172.21.15.131:0/2108300616 learned_addr learned my addr 172.21.15.131:0/2108300616 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T04:10:37.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a66ffd640 1 --2- 172.21.15.131:0/2108300616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a680b3d20 0x7f3a68154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:37.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a5e7fc640 1 --2- 172.21.15.131:0/2108300616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a680b4270 0x7f3a68155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:37.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a677fe640 1 -- 172.21.15.131:0/2108300616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a680b3d20 msgr2=0x7f3a68154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:37.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a677fe640 1 --2- 172.21.15.131:0/2108300616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a680b3d20 0x7f3a68154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a677fe640 1 -- 172.21.15.131:0/2108300616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a680b4270 msgr2=0x7f3a68155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:37.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a677fe640 1 --2- 172.21.15.131:0/2108300616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a680b4270 0x7f3a68155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a677fe640 1 -- 172.21.15.131:0/2108300616 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a68159020 con 0x7f3a680d3e10 2024-05-17T04:10:37.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a5e7fc640 1 --2- 172.21.15.131:0/2108300616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a680b4270 0x7f3a68155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T04:10:37.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a677fe640 1 --2- 172.21.15.131:0/2108300616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a680d3e10 0x7f3a681562d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000caa0 tx=0x7f3a6000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:37.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a5ffff640 1 -- 172.21.15.131:0/2108300616 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6000ac00 con 0x7f3a680d3e10 2024-05-17T04:10:37.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.587+0000 7f3a5ffff640 1 -- 172.21.15.131:0/2108300616 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a6000ada0 con 0x7f3a680d3e10 2024-05-17T04:10:37.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.588+0000 7f3a6d647640 1 -- 172.21.15.131:0/2108300616 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a68159300 con 0x7f3a680d3e10 2024-05-17T04:10:37.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.588+0000 7f3a5ffff640 1 -- 172.21.15.131:0/2108300616 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60012620 con 0x7f3a680d3e10 2024-05-17T04:10:37.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.588+0000 7f3a6d647640 1 -- 172.21.15.131:0/2108300616 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a681598c0 con 0x7f3a680d3e10 2024-05-17T04:10:37.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.588+0000 7f3a6d647640 1 -- 172.21.15.131:0/2108300616 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a6806dd10 con 0x7f3a680d3e10 2024-05-17T04:10:37.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.589+0000 7f3a5ffff640 1 -- 172.21.15.131:0/2108300616 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3a600127c0 con 0x7f3a680d3e10 2024-05-17T04:10:37.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.590+0000 7f3a5ffff640 1 --2- 172.21.15.131:0/2108300616 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3a480762d0 0x7f3a480787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T04:10:37.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.590+0000 7f3a66ffd640 1 --2- 172.21.15.131:0/2108300616 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3a480762d0 0x7f3a480787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T04:10:37.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.590+0000 7f3a5ffff640 1 -- 172.21.15.131:0/2108300616 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f3a60097e20 con 0x7f3a680d3e10 2024-05-17T04:10:37.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.590+0000 7f3a66ffd640 1 --2- 172.21.15.131:0/2108300616 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3a480762d0 0x7f3a480787e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3a58034000 tx=0x7f3a5802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T04:10:37.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.594+0000 7f3a5ffff640 1 -- 172.21.15.131:0/2108300616 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3a60061560 con 0x7f3a680d3e10 2024-05-17T04:10:37.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.843+0000 7f3a6d647640 1 -- 172.21.15.131:0/2108300616 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) -- 0x7f3a6815c510 con 0x7f3a680d3e10 2024-05-17T04:10:37.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.844+0000 7f3a5ffff640 1 -- 172.21.15.131:0/2108300616 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v9) ==== 82+0+151 (secure 0 0 0) 0x7f3a60060e60 con 0x7f3a680d3e10 2024-05-17T04:10:37.844 INFO:teuthology.orchestra.run.smithi131.stdout:[client.admin] 2024-05-17T04:10:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAn2EZmvfO5NRAAocsT8xp7O+U89lf5zNmKtw== 2024-05-17T04:10:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: caps mds = "allow *" 2024-05-17T04:10:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: caps mgr = "allow *" 2024-05-17T04:10:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: caps mon = "allow *" 2024-05-17T04:10:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: caps osd = "allow *" 2024-05-17T04:10:37.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.846+0000 7f3a6d647640 1 -- 172.21.15.131:0/2108300616 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3a480762d0 msgr2=0x7f3a480787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:37.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.846+0000 7f3a6d647640 1 --2- 172.21.15.131:0/2108300616 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3a480762d0 0x7f3a480787e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3a58034000 tx=0x7f3a5802e000 comp rx=0 tx=0).stop 2024-05-17T04:10:37.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.846+0000 7f3a6d647640 1 -- 172.21.15.131:0/2108300616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a680d3e10 msgr2=0x7f3a681562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T04:10:37.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.846+0000 7f3a6d647640 1 --2- 172.21.15.131:0/2108300616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a680d3e10 0x7f3a681562d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000caa0 tx=0x7f3a6000cf60 comp rx=0 tx=0).stop 2024-05-17T04:10:37.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.846+0000 7f3a6d647640 1 -- 172.21.15.131:0/2108300616 shutdown_connections 2024-05-17T04:10:37.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.846+0000 7f3a6d647640 1 --2- 172.21.15.131:0/2108300616 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3a480762d0 0x7f3a480787e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.846+0000 7f3a6d647640 1 --2- 172.21.15.131:0/2108300616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a680d3e10 0x7f3a681562d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.846+0000 7f3a6d647640 1 --2- 172.21.15.131:0/2108300616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a680b4270 0x7f3a68155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.846+0000 7f3a6d647640 1 --2- 172.21.15.131:0/2108300616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a680b3d20 0x7f3a68154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T04:10:37.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.846+0000 7f3a6d647640 1 -- 172.21.15.131:0/2108300616 >> 172.21.15.131:0/2108300616 conn(0x7f3a680d5860 msgr2=0x7f3a680d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T04:10:37.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.846+0000 7f3a6d647640 1 -- 172.21.15.131:0/2108300616 shutdown_connections 2024-05-17T04:10:37.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T04:10:37.846+0000 7f3a6d647640 1 -- 172.21.15.131:0/2108300616 wait complete. 2024-05-17T04:10:37.858 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-05-17T04:10:37.874 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.DeOOmM4sVQ 2024-05-17T04:10:37.874 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:10:37.874 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/tmp/tmp.DeOOmM4sVQ 2024-05-17T04:10:37.930 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:10:37.930 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/tmp/tmp.bj85EVPhOZxfstests-dev/local.config 2024-05-17T04:10:37.999 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.2OgBg7y0wTtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.yv2TaT2zDPscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.131:6789 -k /tmp/tmp.DeOOmM4sVQ --client_mountpoint /test" 2024-05-17T04:10:37.999 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T04:10:38.000 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/tmp/tmp.bj85EVPhOZxfstests-dev/ceph.exclude 2024-05-17T04:10:38.065 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo make) 2024-05-17T04:10:38.156 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize -cfi 2024-05-17T04:10:38.516 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: putting auxiliary files in '.'. 2024-05-17T04:10:38.517 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file './config.guess' 2024-05-17T04:10:38.520 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file './config.sub' 2024-05-17T04:10:38.524 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file './install-sh' 2024-05-17T04:10:38.528 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file './ltmain.sh' 2024-05-17T04:10:38.550 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-05-17T04:10:38.551 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-05-17T04:10:38.555 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-05-17T04:10:38.563 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-05-17T04:10:38.564 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-05-17T04:10:38.569 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-05-17T04:10:38.575 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-05-17T04:10:38.576 INFO:teuthology.orchestra.run.smithi131.stdout:cp include/install-sh . 2024-05-17T04:10:38.577 INFO:teuthology.orchestra.run.smithi131.stdout:aclocal -I m4 2024-05-17T04:10:39.569 INFO:teuthology.orchestra.run.smithi131.stdout:autoheader 2024-05-17T04:10:39.858 INFO:teuthology.orchestra.run.smithi131.stdout:autoconf 2024-05-17T04:10:40.028 INFO:teuthology.orchestra.run.smithi131.stdout:./configure \ 2024-05-17T04:10:40.028 INFO:teuthology.orchestra.run.smithi131.stdout: --libexecdir=/usr/lib \ 2024-05-17T04:10:40.028 INFO:teuthology.orchestra.run.smithi131.stdout: --exec_prefix=/var/lib 2024-05-17T04:10:40.381 INFO:teuthology.orchestra.run.smithi131.stdout:checking build system type... x86_64-pc-linux-gnu 2024-05-17T04:10:40.381 INFO:teuthology.orchestra.run.smithi131.stdout:checking host system type... x86_64-pc-linux-gnu 2024-05-17T04:10:40.382 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to print strings... printf 2024-05-17T04:10:40.382 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc... gcc 2024-05-17T04:10:40.491 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether the C compiler works... yes 2024-05-17T04:10:40.491 INFO:teuthology.orchestra.run.smithi131.stdout:checking for C compiler default output file name... a.out 2024-05-17T04:10:40.518 INFO:teuthology.orchestra.run.smithi131.stdout:checking for suffix of executables... 2024-05-17T04:10:40.575 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether we are cross compiling... no 2024-05-17T04:10:40.592 INFO:teuthology.orchestra.run.smithi131.stdout:checking for suffix of object files... o 2024-05-17T04:10:40.608 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether we are using the GNU C compiler... yes 2024-05-17T04:10:40.623 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether gcc accepts -g... yes 2024-05-17T04:10:40.679 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-17T04:10:40.682 INFO:teuthology.orchestra.run.smithi131.stdout:checking for a sed that does not truncate output... /bin/sed 2024-05-17T04:10:40.684 INFO:teuthology.orchestra.run.smithi131.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-05-17T04:10:40.685 INFO:teuthology.orchestra.run.smithi131.stdout:checking for egrep... /bin/grep -E 2024-05-17T04:10:40.686 INFO:teuthology.orchestra.run.smithi131.stdout:checking for fgrep... /bin/grep -F 2024-05-17T04:10:40.689 INFO:teuthology.orchestra.run.smithi131.stdout:checking for ld used by gcc... /bin/ld 2024-05-17T04:10:40.691 INFO:teuthology.orchestra.run.smithi131.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-05-17T04:10:40.702 INFO:teuthology.orchestra.run.smithi131.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-05-17T04:10:41.549 INFO:teuthology.orchestra.run.smithi131.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-05-17T04:10:41.549 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether ln -s works... yes 2024-05-17T04:10:41.557 INFO:teuthology.orchestra.run.smithi131.stdout:checking the maximum length of command line arguments... 1572864 2024-05-17T04:10:41.560 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-05-17T04:10:41.560 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-05-17T04:10:41.560 INFO:teuthology.orchestra.run.smithi131.stdout:checking for /bin/ld option to reload object files... -r 2024-05-17T04:10:41.560 INFO:teuthology.orchestra.run.smithi131.stdout:checking for objdump... objdump 2024-05-17T04:10:41.561 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to recognize dependent libraries... pass_all 2024-05-17T04:10:41.562 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dlltool... no 2024-05-17T04:10:41.562 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-05-17T04:10:41.562 INFO:teuthology.orchestra.run.smithi131.stdout:checking for ar... ar 2024-05-17T04:10:41.609 INFO:teuthology.orchestra.run.smithi131.stdout:checking for archiver @FILE support... @ 2024-05-17T04:10:41.610 INFO:teuthology.orchestra.run.smithi131.stdout:checking for strip... strip 2024-05-17T04:10:41.610 INFO:teuthology.orchestra.run.smithi131.stdout:checking for ranlib... ranlib 2024-05-17T04:10:41.610 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gawk... gawk 2024-05-17T04:10:41.673 INFO:teuthology.orchestra.run.smithi131.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-05-17T04:10:41.674 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sysroot... no 2024-05-17T04:10:41.677 INFO:teuthology.orchestra.run.smithi131.stdout:checking for a working dd... /bin/dd 2024-05-17T04:10:41.680 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-05-17T04:10:41.693 INFO:teuthology.orchestra.run.smithi131.stdout:checking for mt... no 2024-05-17T04:10:41.695 INFO:teuthology.orchestra.run.smithi131.stdout:checking if : is a manifest tool... no 2024-05-17T04:10:41.759 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to run the C preprocessor... gcc -E 2024-05-17T04:10:41.906 INFO:teuthology.orchestra.run.smithi131.stdout:checking for ANSI C header files... yes 2024-05-17T04:10:41.927 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/types.h... yes 2024-05-17T04:10:41.951 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/stat.h... yes 2024-05-17T04:10:41.975 INFO:teuthology.orchestra.run.smithi131.stdout:checking for stdlib.h... yes 2024-05-17T04:10:42.000 INFO:teuthology.orchestra.run.smithi131.stdout:checking for string.h... yes 2024-05-17T04:10:42.025 INFO:teuthology.orchestra.run.smithi131.stdout:checking for memory.h... yes 2024-05-17T04:10:42.049 INFO:teuthology.orchestra.run.smithi131.stdout:checking for strings.h... yes 2024-05-17T04:10:42.085 INFO:teuthology.orchestra.run.smithi131.stdout:checking for inttypes.h... yes 2024-05-17T04:10:42.110 INFO:teuthology.orchestra.run.smithi131.stdout:checking for stdint.h... yes 2024-05-17T04:10:42.140 INFO:teuthology.orchestra.run.smithi131.stdout:checking for unistd.h... yes 2024-05-17T04:10:42.166 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dlfcn.h... yes 2024-05-17T04:10:42.169 INFO:teuthology.orchestra.run.smithi131.stdout:checking for objdir... .libs 2024-05-17T04:10:42.233 INFO:teuthology.orchestra.run.smithi131.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-05-17T04:10:42.233 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-05-17T04:10:42.248 INFO:teuthology.orchestra.run.smithi131.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-05-17T04:10:42.273 INFO:teuthology.orchestra.run.smithi131.stdout:checking if gcc static flag -static works... no 2024-05-17T04:10:42.294 INFO:teuthology.orchestra.run.smithi131.stdout:checking if gcc supports -c -o file.o... yes 2024-05-17T04:10:42.294 INFO:teuthology.orchestra.run.smithi131.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-05-17T04:10:42.301 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-05-17T04:10:42.327 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether -lc should be explicitly linked in... no 2024-05-17T04:10:42.389 INFO:teuthology.orchestra.run.smithi131.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-05-17T04:10:42.389 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to hardcode library paths into programs... immediate 2024-05-17T04:10:42.390 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether stripping libraries is possible... yes 2024-05-17T04:10:42.390 INFO:teuthology.orchestra.run.smithi131.stdout:checking if libtool supports shared libraries... yes 2024-05-17T04:10:42.390 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether to build shared libraries... yes 2024-05-17T04:10:42.390 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether to build static libraries... yes 2024-05-17T04:10:42.396 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc... (cached) gcc 2024-05-17T04:10:42.412 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-17T04:10:42.412 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-17T04:10:42.412 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-17T04:10:42.412 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gmake... /usr/bin/gmake 2024-05-17T04:10:42.413 INFO:teuthology.orchestra.run.smithi131.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-05-17T04:10:42.413 INFO:teuthology.orchestra.run.smithi131.stdout:checking for tar... /bin/tar 2024-05-17T04:10:42.413 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gzip... /bin/gzip 2024-05-17T04:10:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether gcc -MM is supported... yes 2024-05-17T04:10:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sort... /bin/sort 2024-05-17T04:10:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether ln -s works... yes 2024-05-17T04:10:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:checking for rpm... /bin/rpm 2024-05-17T04:10:42.444 INFO:teuthology.orchestra.run.smithi131.stdout:checking for rpmbuild... no 2024-05-17T04:10:42.469 INFO:teuthology.orchestra.run.smithi131.stdout:checking assert.h usability... yes 2024-05-17T04:10:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:checking assert.h presence... yes 2024-05-17T04:10:42.478 INFO:teuthology.orchestra.run.smithi131.stdout:checking for assert.h... yes 2024-05-17T04:10:42.505 INFO:teuthology.orchestra.run.smithi131.stdout:checking bstring.h usability... no 2024-05-17T04:10:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:checking bstring.h presence... no 2024-05-17T04:10:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:checking for bstring.h... no 2024-05-17T04:10:42.541 INFO:teuthology.orchestra.run.smithi131.stdout:checking libgen.h usability... yes 2024-05-17T04:10:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:checking libgen.h presence... yes 2024-05-17T04:10:42.549 INFO:teuthology.orchestra.run.smithi131.stdout:checking for libgen.h... yes 2024-05-17T04:10:42.578 INFO:teuthology.orchestra.run.smithi131.stdout:checking dirent.h usability... yes 2024-05-17T04:10:42.587 INFO:teuthology.orchestra.run.smithi131.stdout:checking dirent.h presence... yes 2024-05-17T04:10:42.587 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dirent.h... yes 2024-05-17T04:10:42.634 INFO:teuthology.orchestra.run.smithi131.stdout:checking errno.h usability... yes 2024-05-17T04:10:42.643 INFO:teuthology.orchestra.run.smithi131.stdout:checking errno.h presence... yes 2024-05-17T04:10:42.643 INFO:teuthology.orchestra.run.smithi131.stdout:checking for errno.h... yes 2024-05-17T04:10:42.670 INFO:teuthology.orchestra.run.smithi131.stdout:checking malloc.h usability... yes 2024-05-17T04:10:42.681 INFO:teuthology.orchestra.run.smithi131.stdout:checking malloc.h presence... yes 2024-05-17T04:10:42.681 INFO:teuthology.orchestra.run.smithi131.stdout:checking for malloc.h... yes 2024-05-17T04:10:42.707 INFO:teuthology.orchestra.run.smithi131.stdout:checking uuid.h usability... no 2024-05-17T04:10:42.719 INFO:teuthology.orchestra.run.smithi131.stdout:checking uuid.h presence... no 2024-05-17T04:10:42.719 INFO:teuthology.orchestra.run.smithi131.stdout:checking for uuid.h... no 2024-05-17T04:10:42.746 INFO:teuthology.orchestra.run.smithi131.stdout:checking uuid/uuid.h usability... yes 2024-05-17T04:10:42.757 INFO:teuthology.orchestra.run.smithi131.stdout:checking uuid/uuid.h presence... yes 2024-05-17T04:10:42.757 INFO:teuthology.orchestra.run.smithi131.stdout:checking for uuid/uuid.h... yes 2024-05-17T04:10:42.784 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/uuid.h usability... no 2024-05-17T04:10:42.794 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/uuid.h presence... no 2024-05-17T04:10:42.795 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/uuid.h... no 2024-05-17T04:10:42.824 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/file.h usability... yes 2024-05-17T04:10:42.834 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/file.h presence... yes 2024-05-17T04:10:42.834 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/file.h... yes 2024-05-17T04:10:42.862 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/fcntl.h usability... yes 2024-05-17T04:10:42.871 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/fcntl.h presence... yes 2024-05-17T04:10:42.871 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/fcntl.h... yes 2024-05-17T04:10:42.898 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/syssgi.h usability... no 2024-05-17T04:10:42.928 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/syssgi.h presence... no 2024-05-17T04:10:42.928 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/syssgi.h... no 2024-05-17T04:10:42.971 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/param.h usability... yes 2024-05-17T04:10:42.983 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/param.h presence... yes 2024-05-17T04:10:42.983 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/param.h... yes 2024-05-17T04:10:42.988 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/stat.h... (cached) yes 2024-05-17T04:10:43.016 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/statvfs.h usability... yes 2024-05-17T04:10:43.025 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/statvfs.h presence... yes 2024-05-17T04:10:43.025 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/statvfs.h... yes 2024-05-17T04:10:43.052 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/time.h usability... yes 2024-05-17T04:10:43.061 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/time.h presence... yes 2024-05-17T04:10:43.062 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/time.h... yes 2024-05-17T04:10:43.099 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/ioctl.h usability... yes 2024-05-17T04:10:43.110 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/ioctl.h presence... yes 2024-05-17T04:10:43.110 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/ioctl.h... yes 2024-05-17T04:10:43.144 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/wait.h usability... yes 2024-05-17T04:10:43.155 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/wait.h presence... yes 2024-05-17T04:10:43.155 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/wait.h... yes 2024-05-17T04:10:43.159 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/types.h... (cached) yes 2024-05-17T04:10:43.164 INFO:teuthology.orchestra.run.smithi131.stdout:checking for strings.h... (cached) yes 2024-05-17T04:10:43.191 INFO:teuthology.orchestra.run.smithi131.stdout:checking err.h usability... yes 2024-05-17T04:10:43.200 INFO:teuthology.orchestra.run.smithi131.stdout:checking err.h presence... yes 2024-05-17T04:10:43.200 INFO:teuthology.orchestra.run.smithi131.stdout:checking for err.h... yes 2024-05-17T04:10:43.228 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/falloc.h usability... yes 2024-05-17T04:10:43.236 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/falloc.h presence... yes 2024-05-17T04:10:43.236 INFO:teuthology.orchestra.run.smithi131.stdout:checking for linux/falloc.h... yes 2024-05-17T04:10:43.263 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-05-17T04:10:43.274 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-05-17T04:10:43.274 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/fs/xfs_fsops.h... no 2024-05-17T04:10:43.298 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/fs/xfs_itable.h usability... no 2024-05-17T04:10:43.309 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/fs/xfs_itable.h presence... no 2024-05-17T04:10:43.309 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/fs/xfs_itable.h... no 2024-05-17T04:10:43.334 INFO:teuthology.orchestra.run.smithi131.stdout:checking xfs/platform_defs.h usability... no 2024-05-17T04:10:43.345 INFO:teuthology.orchestra.run.smithi131.stdout:checking xfs/platform_defs.h presence... no 2024-05-17T04:10:43.345 INFO:teuthology.orchestra.run.smithi131.stdout:checking for xfs/platform_defs.h... no 2024-05-17T04:10:43.369 INFO:teuthology.orchestra.run.smithi131.stdout:checking btrfs/ioctl.h usability... no 2024-05-17T04:10:43.380 INFO:teuthology.orchestra.run.smithi131.stdout:checking btrfs/ioctl.h presence... no 2024-05-17T04:10:43.380 INFO:teuthology.orchestra.run.smithi131.stdout:checking for btrfs/ioctl.h... no 2024-05-17T04:10:43.405 INFO:teuthology.orchestra.run.smithi131.stdout:checking cifs/ioctl.h usability... no 2024-05-17T04:10:43.416 INFO:teuthology.orchestra.run.smithi131.stdout:checking cifs/ioctl.h presence... no 2024-05-17T04:10:43.417 INFO:teuthology.orchestra.run.smithi131.stdout:checking for cifs/ioctl.h... no 2024-05-17T04:10:43.452 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/mman.h usability... yes 2024-05-17T04:10:43.461 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/mman.h presence... yes 2024-05-17T04:10:43.461 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/mman.h... yes 2024-05-17T04:10:43.488 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/ext4.h usability... no 2024-05-17T04:10:43.499 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/ext4.h presence... no 2024-05-17T04:10:43.499 INFO:teuthology.orchestra.run.smithi131.stdout:checking for linux/ext4.h... no 2024-05-17T04:10:43.512 INFO:teuthology.orchestra.run.smithi131.stdout:checking for xfs/xfs_log_format.h... no 2024-05-17T04:10:43.552 INFO:teuthology.orchestra.run.smithi131.stdout:checking for uuid_compare... no 2024-05-17T04:10:43.582 INFO:teuthology.orchestra.run.smithi131.stdout:checking for uuid_compare in -luuid... yes 2024-05-17T04:10:43.639 INFO:teuthology.orchestra.run.smithi131.stdout:checking for xfs/xfs.h... yes 2024-05-17T04:10:43.652 INFO:teuthology.orchestra.run.smithi131.stdout:checking for xfs/libxfs.h... no 2024-05-17T04:10:43.668 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether xlog_assign_lsn is declared... no 2024-05-17T04:10:43.697 INFO:teuthology.orchestra.run.smithi131.stdout:checking for xfs/xqm.h... yes 2024-05-17T04:10:43.745 INFO:teuthology.orchestra.run.smithi131.stdout:checking xfsctl from xfs/xfs.h... ok 2024-05-17T04:10:43.769 INFO:teuthology.orchestra.run.smithi131.stdout:checking xfs/handle.h usability... yes 2024-05-17T04:10:43.777 INFO:teuthology.orchestra.run.smithi131.stdout:checking xfs/handle.h presence... yes 2024-05-17T04:10:43.777 INFO:teuthology.orchestra.run.smithi131.stdout:checking for xfs/handle.h... yes 2024-05-17T04:10:43.816 INFO:teuthology.orchestra.run.smithi131.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-05-17T04:10:43.849 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/acl.h usability... yes 2024-05-17T04:10:43.859 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/acl.h presence... yes 2024-05-17T04:10:43.859 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/acl.h... yes 2024-05-17T04:10:43.889 INFO:teuthology.orchestra.run.smithi131.stdout:checking acl/libacl.h usability... yes 2024-05-17T04:10:43.899 INFO:teuthology.orchestra.run.smithi131.stdout:checking acl/libacl.h presence... yes 2024-05-17T04:10:43.899 INFO:teuthology.orchestra.run.smithi131.stdout:checking for acl/libacl.h... yes 2024-05-17T04:10:43.931 INFO:teuthology.orchestra.run.smithi131.stdout:checking for acl_init in -lacl... yes 2024-05-17T04:10:43.954 INFO:teuthology.orchestra.run.smithi131.stdout:checking gdbm-ndbm.h usability... no 2024-05-17T04:10:43.965 INFO:teuthology.orchestra.run.smithi131.stdout:checking gdbm-ndbm.h presence... no 2024-05-17T04:10:43.966 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gdbm-ndbm.h... no 2024-05-17T04:10:43.990 INFO:teuthology.orchestra.run.smithi131.stdout:checking gdbm/ndbm.h usability... yes 2024-05-17T04:10:44.002 INFO:teuthology.orchestra.run.smithi131.stdout:checking gdbm/ndbm.h presence... yes 2024-05-17T04:10:44.002 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gdbm/ndbm.h... yes 2024-05-17T04:10:44.037 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dbm_open in -lgdbm... no 2024-05-17T04:10:44.072 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dbm_fetch in -lgdbm... no 2024-05-17T04:10:44.106 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dbm_store in -lgdbm... no 2024-05-17T04:10:44.141 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dbm_close in -lgdbm... no 2024-05-17T04:10:44.172 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-05-17T04:10:44.203 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-05-17T04:10:44.235 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-05-17T04:10:44.268 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-05-17T04:10:44.292 INFO:teuthology.orchestra.run.smithi131.stdout:checking libaio.h usability... yes 2024-05-17T04:10:44.303 INFO:teuthology.orchestra.run.smithi131.stdout:checking libaio.h presence... yes 2024-05-17T04:10:44.303 INFO:teuthology.orchestra.run.smithi131.stdout:checking for libaio.h... yes 2024-05-17T04:10:44.326 INFO:teuthology.orchestra.run.smithi131.stdout:checking liburing.h usability... no 2024-05-17T04:10:44.337 INFO:teuthology.orchestra.run.smithi131.stdout:checking liburing.h presence... no 2024-05-17T04:10:44.337 INFO:teuthology.orchestra.run.smithi131.stdout:checking for liburing.h... no 2024-05-17T04:10:44.361 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/capability.h usability... yes 2024-05-17T04:10:44.371 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/capability.h presence... yes 2024-05-17T04:10:44.372 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/capability.h... yes 2024-05-17T04:10:44.396 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/fiemap.h usability... yes 2024-05-17T04:10:44.404 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/fiemap.h presence... yes 2024-05-17T04:10:44.404 INFO:teuthology.orchestra.run.smithi131.stdout:checking for linux/fiemap.h... yes 2024-05-17T04:10:44.438 INFO:teuthology.orchestra.run.smithi131.stdout:checking for fallocate... yes 2024-05-17T04:10:44.472 INFO:teuthology.orchestra.run.smithi131.stdout:checking for open_by_handle_at... yes 2024-05-17T04:10:44.496 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/fs.h usability... yes 2024-05-17T04:10:44.505 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/fs.h presence... yes 2024-05-17T04:10:44.505 INFO:teuthology.orchestra.run.smithi131.stdout:checking for linux/fs.h... yes 2024-05-17T04:10:44.528 INFO:teuthology.orchestra.run.smithi131.stdout:checking btrfsutil.h usability... no 2024-05-17T04:10:44.539 INFO:teuthology.orchestra.run.smithi131.stdout:checking btrfsutil.h presence... no 2024-05-17T04:10:44.539 INFO:teuthology.orchestra.run.smithi131.stdout:checking for btrfsutil.h... no 2024-05-17T04:10:44.576 INFO:teuthology.orchestra.run.smithi131.stdout:checking for copy_file_range... yes 2024-05-17T04:10:44.613 INFO:teuthology.orchestra.run.smithi131.stdout:checking for SEEK_DATA... yes 2024-05-17T04:10:44.662 INFO:teuthology.orchestra.run.smithi131.stdout:checking for BMV_OF_SHARED... yes 2024-05-17T04:10:44.699 INFO:teuthology.orchestra.run.smithi131.stdout:checking for nftw... yes 2024-05-17T04:10:44.738 INFO:teuthology.orchestra.run.smithi131.stdout:checking for RLIMIT_NOFILE... yes 2024-05-17T04:10:44.770 INFO:teuthology.orchestra.run.smithi131.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-05-17T04:10:44.804 INFO:teuthology.orchestra.run.smithi131.stdout:checking for FICLONE... yes 2024-05-17T04:10:44.838 INFO:teuthology.orchestra.run.smithi131.stdout:checking for renameat2... yes 2024-05-17T04:10:44.872 INFO:teuthology.orchestra.run.smithi131.stdout:checking for reallocarray... yes 2024-05-17T04:10:44.904 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct mount_attr... yes 2024-05-17T04:10:44.939 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_qgroup_limit... yes 2024-05-17T04:10:44.971 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-05-17T04:10:45.004 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-05-17T04:10:45.038 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-05-17T04:10:45.071 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-05-17T04:10:45.103 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-05-17T04:10:45.136 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-05-17T04:10:45.164 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/btrfs.h usability... yes 2024-05-17T04:10:45.172 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/btrfs.h presence... yes 2024-05-17T04:10:45.172 INFO:teuthology.orchestra.run.smithi131.stdout:checking for linux/btrfs.h... yes 2024-05-17T04:10:45.202 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/btrfs_tree.h usability... yes 2024-05-17T04:10:45.211 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/btrfs_tree.h presence... yes 2024-05-17T04:10:45.211 INFO:teuthology.orchestra.run.smithi131.stdout:checking for linux/btrfs_tree.h... yes 2024-05-17T04:10:45.232 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-05-17T04:10:45.254 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-05-17T04:10:45.270 INFO:teuthology.orchestra.run.smithi131.stdout:configure: creating ./config.status 2024-05-17T04:10:45.564 INFO:teuthology.orchestra.run.smithi131.stdout:config.status: creating include/builddefs 2024-05-17T04:10:45.574 INFO:teuthology.orchestra.run.smithi131.stdout:config.status: creating include/config.h 2024-05-17T04:10:45.583 INFO:teuthology.orchestra.run.smithi131.stdout:config.status: executing libtool commands 2024-05-17T04:10:45.621 INFO:teuthology.orchestra.run.smithi131.stdout:Building include 2024-05-17T04:10:45.624 INFO:teuthology.orchestra.run.smithi131.stdout:Building lib 2024-05-17T04:10:45.627 INFO:teuthology.orchestra.run.smithi131.stdout: [LTDEP] 2024-05-17T04:10:45.763 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dataascii.lo 2024-05-17T04:10:45.882 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] databin.lo 2024-05-17T04:10:46.018 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] datapid.lo 2024-05-17T04:10:46.112 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] file_lock.lo 2024-05-17T04:10:46.247 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] forker.lo 2024-05-17T04:10:46.370 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] pattern.lo 2024-05-17T04:10:46.481 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] open_flags.lo 2024-05-17T04:10:46.610 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] random_range.lo 2024-05-17T04:10:46.818 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] string_to_tokens.lo 2024-05-17T04:10:46.912 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] str_to_bytes.lo 2024-05-17T04:10:47.045 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] tlibio.lo 2024-05-17T04:10:47.364 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] write_log.lo 2024-05-17T04:10:47.484 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] random.lo 2024-05-17T04:10:47.581 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] 2024-05-17T04:10:47.661 INFO:teuthology.orchestra.run.smithi131.stdout:Building ltp 2024-05-17T04:10:47.663 INFO:teuthology.orchestra.run.smithi131.stdout: [DEP] 2024-05-17T04:10:47.792 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] doio 2024-05-17T04:10:48.406 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fsstress 2024-05-17T04:10:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fsx 2024-05-17T04:10:50.415 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] growfiles 2024-05-17T04:10:50.877 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] iogen 2024-05-17T04:10:51.215 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-stress 2024-05-17T04:10:51.599 INFO:teuthology.orchestra.run.smithi131.stdout:Building src 2024-05-17T04:10:51.605 INFO:teuthology.orchestra.run.smithi131.stdout: [DEP] 2024-05-17T04:10:53.337 INFO:teuthology.orchestra.run.smithi131.stdout: [DEP] 2024-05-17T04:10:53.367 INFO:teuthology.orchestra.run.smithi131.stdout: [DEP] 2024-05-17T04:10:53.375 INFO:teuthology.orchestra.run.smithi131.stdout: [DEP] 2024-05-17T04:10:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: [DEP] 2024-05-17T04:10:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dirstress 2024-05-17T04:10:53.815 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fill 2024-05-17T04:10:53.947 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fill2 2024-05-17T04:10:54.147 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] getpagesize 2024-05-17T04:10:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] holes 2024-05-17T04:10:54.429 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] lstat64 2024-05-17T04:10:54.588 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] nametest 2024-05-17T04:10:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] permname 2024-05-17T04:10:54.972 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] randholes 2024-05-17T04:10:55.203 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] runas 2024-05-17T04:10:55.351 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] truncfile 2024-05-17T04:10:55.505 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] usemem 2024-05-17T04:10:55.633 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] mmapcat 2024-05-17T04:10:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] append_reader 2024-05-17T04:10:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] append_writer 2024-05-17T04:10:56.015 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dirperf 2024-05-17T04:10:56.214 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] metaperf 2024-05-17T04:10:56.454 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] devzero 2024-05-17T04:10:56.603 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] feature 2024-05-17T04:10:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] alloc 2024-05-17T04:10:56.976 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fault 2024-05-17T04:10:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fstest 2024-05-17T04:10:57.320 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_access_root 2024-05-17T04:10:57.453 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] godown 2024-05-17T04:10:57.597 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] resvtest 2024-05-17T04:10:57.755 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] writemod 2024-05-17T04:10:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] writev_on_pagefault 2024-05-17T04:10:58.015 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] makeextents 2024-05-17T04:10:58.167 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] itrash 2024-05-17T04:10:58.297 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] rename 2024-05-17T04:10:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] multi_open_unlink 2024-05-17T04:10:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] unwritten_sync 2024-05-17T04:10:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] genhashnames 2024-05-17T04:10:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_holes 2024-05-17T04:10:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_writev 2024-05-17T04:10:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_truncate_cmtime 2024-05-17T04:10:59.271 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dirhash_collide 2024-05-17T04:10:59.438 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_rename_overwrite 2024-05-17T04:10:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] holetest 2024-05-17T04:10:59.757 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_truncate_self 2024-05-17T04:10:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] af_unix 2024-05-17T04:11:00.008 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_stale_pmd 2024-05-17T04:11:00.138 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_cow_race 2024-05-17T04:11:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_fallocate 2024-05-17T04:11:00.408 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fsync-err 2024-05-17T04:11:00.566 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_write_ro 2024-05-17T04:11:00.696 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_ext4_dax_journal_corruption 2024-05-17T04:11:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_ext4_dax_inline_corruption 2024-05-17T04:11:00.965 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_ofd_locks 2024-05-17T04:11:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_collision 2024-05-17T04:11:01.305 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] mmap-write-concurrent 2024-05-17T04:11:01.451 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_get_file_time 2024-05-17T04:11:01.576 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_create_short_dirs 2024-05-17T04:11:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_create_long_dirs 2024-05-17T04:11:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_enospc 2024-05-17T04:11:02.038 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_writev_overlap 2024-05-17T04:11:02.185 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] checkpoint_journal 2024-05-17T04:11:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] mmap-rw-fault 2024-05-17T04:11:02.476 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] allocstale 2024-05-17T04:11:02.620 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_cow_memory_failure 2024-05-17T04:11:02.766 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fake-dump-rootino 2024-05-17T04:11:02.894 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dio-buf-fault 2024-05-17T04:11:03.027 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] rewinddir-test 2024-05-17T04:11:03.172 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] readdir-while-renames 2024-05-17T04:11:03.312 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfsctl 2024-05-17T04:11:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bstat 2024-05-17T04:11:03.655 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mtab 2024-05-17T04:11:03.818 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] getdevicesize 2024-05-17T04:11:03.937 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] preallo_rw_pattern_reader 2024-05-17T04:11:04.072 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] preallo_rw_pattern_writer 2024-05-17T04:11:04.206 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] ftrunc 2024-05-17T04:11:04.332 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] trunc 2024-05-17T04:11:04.471 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fs_perms 2024-05-17T04:11:04.611 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] testx 2024-05-17T04:11:04.723 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] looptest 2024-05-17T04:11:04.890 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] locktest 2024-05-17T04:11:05.162 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] unwritten_mmap 2024-05-17T04:11:05.301 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bulkstat_unlink_test 2024-05-17T04:11:05.473 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] deduperace 2024-05-17T04:11:05.642 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bulkstat_unlink_test_modified 2024-05-17T04:11:05.811 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_dir_offset 2024-05-17T04:11:05.938 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_futimens 2024-05-17T04:11:06.056 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_immutable 2024-05-17T04:11:06.408 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:11:06.411 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:11:06.624 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] stale_handle 2024-05-17T04:11:06.770 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] pwrite_mmap_blocked 2024-05-17T04:11:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_dir_offset2 2024-05-17T04:11:07.068 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] seek_sanity_test 2024-05-17T04:11:07.464 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] seek_copy_test 2024-05-17T04:11:07.617 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_readdir_1 2024-05-17T04:11:07.743 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_readdir_2 2024-05-17T04:11:07.871 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fsync-tester 2024-05-17T04:11:08.092 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] nsexec 2024-05-17T04:11:08.246 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] cloner 2024-05-17T04:11:08.401 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] renameat2 2024-05-17T04:11:08.544 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_getcwd 2024-05-17T04:11:08.680 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] e4compact 2024-05-17T04:11:08.860 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] test-nextquota 2024-05-17T04:11:09.007 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] punch-alternating 2024-05-17T04:11:09.152 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] attr-list-by-handle-cursor-test 2024-05-17T04:11:09.296 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] listxattr 2024-05-17T04:11:09.422 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dio-interleaved 2024-05-17T04:11:09.560 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_dir_type 2024-05-17T04:11:09.693 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dio-invalidate-cache 2024-05-17T04:11:09.870 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] stat_test 2024-05-17T04:11:10.130 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_encrypted_d_revalidate 2024-05-17T04:11:10.272 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] attr_replace_test 2024-05-17T04:11:10.410 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] swapon 2024-05-17T04:11:10.551 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] mkswap 2024-05-17T04:11:10.681 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_attr_corruption 2024-05-17T04:11:10.809 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_open_tmpfiles 2024-05-17T04:11:10.964 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fscrypt-crypt-util 2024-05-17T04:11:11.560 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bulkstat_null_ocount 2024-05-17T04:11:11.695 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] splice-test 2024-05-17T04:11:11.851 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] chprojid_fail 2024-05-17T04:11:11.990 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] detached_mounts_propagation 2024-05-17T04:11:12.149 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] ext4_resize 2024-05-17T04:11:12.277 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_readdir_3 2024-05-17T04:11:12.446 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] splice2pipe 2024-05-17T04:11:12.585 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] uuid_ioctl 2024-05-17T04:11:12.879 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_snapshot_deleted_subvolume 2024-05-17T04:11:12.880 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fiemap-fault 2024-05-17T04:11:12.994 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fiemap-tester 2024-05-17T04:11:13.224 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_stripealign 2024-05-17T04:11:13.357 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] open_by_handle 2024-05-17T04:11:13.578 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dbtest 2024-05-17T04:11:13.805 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_dio 2024-05-17T04:11:13.943 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfsfind 2024-05-17T04:11:14.112 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_reflink_read_race 2024-05-17T04:11:14.277 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fssum 2024-05-17T04:11:14.674 INFO:teuthology.orchestra.run.smithi131.stdout:Building log-writes 2024-05-17T04:11:14.679 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] replay-log 2024-05-17T04:11:14.966 INFO:teuthology.orchestra.run.smithi131.stdout:Building perf 2024-05-17T04:11:14.969 INFO:teuthology.orchestra.run.smithi131.stdout:Building aio-dio-regress 2024-05-17T04:11:14.975 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aiocp 2024-05-17T04:11:15.176 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-append-write-fallocate-race 2024-05-17T04:11:15.320 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-append-write-read-race 2024-05-17T04:11:15.471 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-cow-race 2024-05-17T04:11:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-cycle-write 2024-05-17T04:11:15.760 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-eof-race 2024-05-17T04:11:15.918 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-extend-stat 2024-05-17T04:11:16.060 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-fcntl-race 2024-05-17T04:11:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-hole-filling-race 2024-05-17T04:11:16.326 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-invalidate-failure 2024-05-17T04:11:16.463 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-invalidate-readahead 2024-05-17T04:11:16.605 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aiodio_sparse2 2024-05-17T04:11:16.797 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-subblock-eof-read 2024-05-17T04:11:16.920 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-write-verify 2024-05-17T04:11:17.091 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-05-17T04:11:17.205 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-05-17T04:11:17.317 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-last-ref-held-by-io 2024-05-17T04:11:17.466 INFO:teuthology.orchestra.run.smithi131.stdout:Building vfs 2024-05-17T04:11:17.471 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] vfstest 2024-05-17T04:11:20.779 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] mount-idmapped 2024-05-17T04:11:21.119 INFO:teuthology.orchestra.run.smithi131.stdout:Building m4 2024-05-17T04:11:21.122 INFO:teuthology.orchestra.run.smithi131.stdout:Building common 2024-05-17T04:11:21.125 INFO:teuthology.orchestra.run.smithi131.stdout:Building tests 2024-05-17T04:11:21.131 INFO:teuthology.orchestra.run.smithi131.stdout:Building btrfs 2024-05-17T04:11:21.137 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/btrfs/group.list 2024-05-17T04:11:21.200 INFO:teuthology.orchestra.run.smithi131.stdout:Building ceph 2024-05-17T04:11:21.205 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/ceph/group.list 2024-05-17T04:11:21.220 INFO:teuthology.orchestra.run.smithi131.stdout:Building cifs 2024-05-17T04:11:21.225 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/cifs/group.list 2024-05-17T04:11:21.238 INFO:teuthology.orchestra.run.smithi131.stdout:Building ext4 2024-05-17T04:11:21.243 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/ext4/group.list 2024-05-17T04:11:21.283 INFO:teuthology.orchestra.run.smithi131.stdout:Building f2fs 2024-05-17T04:11:21.288 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/f2fs/group.list 2024-05-17T04:11:21.306 INFO:teuthology.orchestra.run.smithi131.stdout:Building generic 2024-05-17T04:11:21.312 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/generic/group.list 2024-05-17T04:11:21.413 INFO:teuthology.orchestra.run.smithi131.stdout:Building nfs 2024-05-17T04:11:21.419 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/nfs/group.list 2024-05-17T04:11:21.434 INFO:teuthology.orchestra.run.smithi131.stdout:Building ocfs2 2024-05-17T04:11:21.438 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/ocfs2/group.list 2024-05-17T04:11:21.454 INFO:teuthology.orchestra.run.smithi131.stdout:Building overlay 2024-05-17T04:11:21.459 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/overlay/group.list 2024-05-17T04:11:21.501 INFO:teuthology.orchestra.run.smithi131.stdout:Building perf 2024-05-17T04:11:21.506 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/perf/group.list 2024-05-17T04:11:21.517 INFO:teuthology.orchestra.run.smithi131.stdout:Building selftest 2024-05-17T04:11:21.522 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/selftest/group.list 2024-05-17T04:11:21.535 INFO:teuthology.orchestra.run.smithi131.stdout:Building shared 2024-05-17T04:11:21.540 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/shared/group.list 2024-05-17T04:11:21.557 INFO:teuthology.orchestra.run.smithi131.stdout:Building tmpfs 2024-05-17T04:11:21.562 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/tmpfs/group.list 2024-05-17T04:11:21.576 INFO:teuthology.orchestra.run.smithi131.stdout:Building udf 2024-05-17T04:11:21.581 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/udf/group.list 2024-05-17T04:11:21.593 INFO:teuthology.orchestra.run.smithi131.stdout:Building xfs 2024-05-17T04:11:21.599 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/xfs/group.list 2024-05-17T04:11:21.700 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo make install) 2024-05-17T04:11:21.736 INFO:teuthology.orchestra.run.smithi131.stdout:Building include 2024-05-17T04:11:21.740 INFO:teuthology.orchestra.run.smithi131.stdout:Building lib 2024-05-17T04:11:21.743 INFO:teuthology.orchestra.run.smithi131.stdout:Building ltp 2024-05-17T04:11:21.748 INFO:teuthology.orchestra.run.smithi131.stdout:Building src 2024-05-17T04:11:21.782 INFO:teuthology.orchestra.run.smithi131.stdout:Building log-writes 2024-05-17T04:11:21.785 INFO:teuthology.orchestra.run.smithi131.stdout:Building perf 2024-05-17T04:11:21.788 INFO:teuthology.orchestra.run.smithi131.stdout:Building aio-dio-regress 2024-05-17T04:11:21.792 INFO:teuthology.orchestra.run.smithi131.stdout:Building vfs 2024-05-17T04:11:21.796 INFO:teuthology.orchestra.run.smithi131.stdout:Building m4 2024-05-17T04:11:21.800 INFO:teuthology.orchestra.run.smithi131.stdout:Building common 2024-05-17T04:11:21.803 INFO:teuthology.orchestra.run.smithi131.stdout:Building tests 2024-05-17T04:11:21.808 INFO:teuthology.orchestra.run.smithi131.stdout:Building btrfs 2024-05-17T04:11:21.814 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/btrfs/group.list 2024-05-17T04:11:21.877 INFO:teuthology.orchestra.run.smithi131.stdout:Building ceph 2024-05-17T04:11:21.882 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/ceph/group.list 2024-05-17T04:11:21.897 INFO:teuthology.orchestra.run.smithi131.stdout:Building cifs 2024-05-17T04:11:21.902 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/cifs/group.list 2024-05-17T04:11:21.914 INFO:teuthology.orchestra.run.smithi131.stdout:Building ext4 2024-05-17T04:11:21.919 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/ext4/group.list 2024-05-17T04:11:21.959 INFO:teuthology.orchestra.run.smithi131.stdout:Building f2fs 2024-05-17T04:11:21.963 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/f2fs/group.list 2024-05-17T04:11:21.981 INFO:teuthology.orchestra.run.smithi131.stdout:Building generic 2024-05-17T04:11:21.988 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/generic/group.list 2024-05-17T04:11:22.088 INFO:teuthology.orchestra.run.smithi131.stdout:Building nfs 2024-05-17T04:11:22.093 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/nfs/group.list 2024-05-17T04:11:22.107 INFO:teuthology.orchestra.run.smithi131.stdout:Building ocfs2 2024-05-17T04:11:22.112 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/ocfs2/group.list 2024-05-17T04:11:22.126 INFO:teuthology.orchestra.run.smithi131.stdout:Building overlay 2024-05-17T04:11:22.131 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/overlay/group.list 2024-05-17T04:11:22.174 INFO:teuthology.orchestra.run.smithi131.stdout:Building perf 2024-05-17T04:11:22.179 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/perf/group.list 2024-05-17T04:11:22.191 INFO:teuthology.orchestra.run.smithi131.stdout:Building selftest 2024-05-17T04:11:22.196 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/selftest/group.list 2024-05-17T04:11:22.209 INFO:teuthology.orchestra.run.smithi131.stdout:Building shared 2024-05-17T04:11:22.214 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/shared/group.list 2024-05-17T04:11:22.232 INFO:teuthology.orchestra.run.smithi131.stdout:Building tmpfs 2024-05-17T04:11:22.236 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/tmpfs/group.list 2024-05-17T04:11:22.250 INFO:teuthology.orchestra.run.smithi131.stdout:Building udf 2024-05-17T04:11:22.255 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/udf/group.list 2024-05-17T04:11:22.267 INFO:teuthology.orchestra.run.smithi131.stdout:Building xfs 2024-05-17T04:11:22.273 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/xfs/group.list 2024-05-17T04:11:22.371 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-05-17T04:11:22.373 INFO:teuthology.orchestra.run.smithi131.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-17T04:11:22.373 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-05-17T04:11:22.375 INFO:teuthology.orchestra.run.smithi131.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-17T04:11:22.375 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-05-17T04:11:22.377 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-05-17T04:11:22.386 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-05-17T04:11:22.456 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-05-17T04:11:22.465 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-05-17T04:11:22.482 INFO:teuthology.orchestra.run.smithi131.stdout:Building log-writes 2024-05-17T04:11:22.485 INFO:teuthology.orchestra.run.smithi131.stdout:Building perf 2024-05-17T04:11:22.489 INFO:teuthology.orchestra.run.smithi131.stdout:Building aio-dio-regress 2024-05-17T04:11:22.493 INFO:teuthology.orchestra.run.smithi131.stdout:Building vfs 2024-05-17T04:11:22.496 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake -C log-writes install 2024-05-17T04:11:22.497 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-05-17T04:11:22.506 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-05-17T04:11:22.515 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake -C perf install 2024-05-17T04:11:22.516 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-05-17T04:11:22.525 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-05-17T04:11:22.547 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-05-17T04:11:22.549 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-05-17T04:11:22.558 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-05-17T04:11:22.608 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake -C vfs install 2024-05-17T04:11:22.609 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-05-17T04:11:22.618 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-05-17T04:11:22.630 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-05-17T04:11:22.638 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-fault fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-05-17T04:11:23.825 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-05-17T04:11:23.920 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-05-17T04:11:23.944 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-05-17T04:11:23.946 INFO:teuthology.orchestra.run.smithi131.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-17T04:11:23.946 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-05-17T04:11:23.948 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-05-17T04:11:23.956 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-05-17T04:11:24.090 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-05-17T04:11:24.091 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.bj85EVPhOZxfstests-dev/tests/btrfs/ install 2024-05-17T04:11:24.094 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/btrfs/group.list 2024-05-17T04:11:24.157 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-05-17T04:11:24.166 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 313 314 315 316 317 318 320 330 /var/lib/xfstests/tests/btrfs 2024-05-17T04:11:24.994 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-05-17T04:11:25.003 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 313.out 314.out 315.out 316.out 317.out 318.out 320.out 330.out /var/lib/xfstests/tests/btrfs 2024-05-17T04:11:25.838 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.bj85EVPhOZxfstests-dev/tests/ceph/ install 2024-05-17T04:11:25.840 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/ceph/group.list 2024-05-17T04:11:25.854 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-05-17T04:11:25.862 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-05-17T04:11:25.881 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-05-17T04:11:25.890 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-05-17T04:11:25.908 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.bj85EVPhOZxfstests-dev/tests/cifs/ install 2024-05-17T04:11:25.911 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/cifs/group.list 2024-05-17T04:11:25.923 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-05-17T04:11:25.931 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-05-17T04:11:25.940 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-05-17T04:11:25.949 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-05-17T04:11:25.958 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.bj85EVPhOZxfstests-dev/tests/ext4/ install 2024-05-17T04:11:25.960 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/ext4/group.list 2024-05-17T04:11:25.999 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-05-17T04:11:26.008 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-05-17T04:11:26.188 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-05-17T04:11:26.197 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-05-17T04:11:26.388 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.bj85EVPhOZxfstests-dev/tests/f2fs/ install 2024-05-17T04:11:26.390 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/f2fs/group.list 2024-05-17T04:11:26.407 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-05-17T04:11:26.415 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-05-17T04:11:26.426 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-05-17T04:11:26.435 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-05-17T04:11:26.447 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.bj85EVPhOZxfstests-dev/tests/generic/ install 2024-05-17T04:11:26.451 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/generic/group.list 2024-05-17T04:11:26.553 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-05-17T04:11:26.562 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 741 742 743 744 /var/lib/xfstests/tests/generic 2024-05-17T04:11:28.505 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-05-17T04:11:28.513 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 741.out 742.out 743.out 744.out /var/lib/xfstests/tests/generic 2024-05-17T04:11:30.482 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.bj85EVPhOZxfstests-dev/tests/nfs/ install 2024-05-17T04:11:30.484 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/nfs/group.list 2024-05-17T04:11:30.498 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-05-17T04:11:30.506 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-05-17T04:11:30.515 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-05-17T04:11:30.524 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-05-17T04:11:30.533 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.bj85EVPhOZxfstests-dev/tests/ocfs2/ install 2024-05-17T04:11:30.535 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/ocfs2/group.list 2024-05-17T04:11:30.548 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-05-17T04:11:30.557 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-05-17T04:11:30.565 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-05-17T04:11:30.574 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-05-17T04:11:30.583 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.bj85EVPhOZxfstests-dev/tests/overlay/ install 2024-05-17T04:11:30.586 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/overlay/group.list 2024-05-17T04:11:30.627 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-05-17T04:11:30.636 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-05-17T04:11:30.912 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-05-17T04:11:30.921 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-05-17T04:11:31.197 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.bj85EVPhOZxfstests-dev/tests/perf/ install 2024-05-17T04:11:31.200 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/perf/group.list 2024-05-17T04:11:31.211 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-05-17T04:11:31.220 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-05-17T04:11:31.228 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-05-17T04:11:31.238 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-05-17T04:11:31.246 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.bj85EVPhOZxfstests-dev/tests/selftest/ install 2024-05-17T04:11:31.249 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/selftest/group.list 2024-05-17T04:11:31.261 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-05-17T04:11:31.269 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-05-17T04:11:31.291 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-05-17T04:11:31.300 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-05-17T04:11:31.321 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.bj85EVPhOZxfstests-dev/tests/shared/ install 2024-05-17T04:11:31.324 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/shared/group.list 2024-05-17T04:11:31.341 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-05-17T04:11:31.350 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-05-17T04:11:31.364 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-05-17T04:11:31.373 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-05-17T04:11:31.387 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.bj85EVPhOZxfstests-dev/tests/tmpfs/ install 2024-05-17T04:11:31.389 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/tmpfs/group.list 2024-05-17T04:11:31.402 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-05-17T04:11:31.410 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-05-17T04:11:31.419 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-05-17T04:11:31.428 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-05-17T04:11:31.437 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.bj85EVPhOZxfstests-dev/tests/udf/ install 2024-05-17T04:11:31.439 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/udf/group.list 2024-05-17T04:11:31.451 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-05-17T04:11:31.459 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-05-17T04:11:31.468 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-05-17T04:11:31.476 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-05-17T04:11:31.485 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.bj85EVPhOZxfstests-dev/tests/xfs/ install 2024-05-17T04:11:31.488 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.bj85EVPhOZxfstests-dev/tests/xfs/group.list 2024-05-17T04:11:31.589 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-05-17T04:11:31.598 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 612 613 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-05-17T04:11:33.423 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-05-17T04:11:33.432 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 612.out 613.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-05-17T04:11:35.284 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-05-17T04:11:35.292 INFO:teuthology.orchestra.run.smithi131.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-05-17T04:11:35.301 INFO:teuthology.orchestra.run.smithi131.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-05-17T04:11:35.309 INFO:teuthology.orchestra.run.smithi131.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-05-17T04:11:35.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T04:11:35.321 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec ls tests/generic) 2024-05-17T04:11:35.377 INFO:teuthology.orchestra.run.smithi131.stdout:001 2024-05-17T04:11:35.377 INFO:teuthology.orchestra.run.smithi131.stdout:001.out 2024-05-17T04:11:35.377 INFO:teuthology.orchestra.run.smithi131.stdout:002 2024-05-17T04:11:35.377 INFO:teuthology.orchestra.run.smithi131.stdout:002.out 2024-05-17T04:11:35.377 INFO:teuthology.orchestra.run.smithi131.stdout:003 2024-05-17T04:11:35.378 INFO:teuthology.orchestra.run.smithi131.stdout:003.out 2024-05-17T04:11:35.378 INFO:teuthology.orchestra.run.smithi131.stdout:004 2024-05-17T04:11:35.378 INFO:teuthology.orchestra.run.smithi131.stdout:004.out 2024-05-17T04:11:35.378 INFO:teuthology.orchestra.run.smithi131.stdout:005 2024-05-17T04:11:35.378 INFO:teuthology.orchestra.run.smithi131.stdout:005.out 2024-05-17T04:11:35.378 INFO:teuthology.orchestra.run.smithi131.stdout:006 2024-05-17T04:11:35.378 INFO:teuthology.orchestra.run.smithi131.stdout:006.out 2024-05-17T04:11:35.378 INFO:teuthology.orchestra.run.smithi131.stdout:007 2024-05-17T04:11:35.378 INFO:teuthology.orchestra.run.smithi131.stdout:007.out 2024-05-17T04:11:35.378 INFO:teuthology.orchestra.run.smithi131.stdout:008 2024-05-17T04:11:35.378 INFO:teuthology.orchestra.run.smithi131.stdout:008.out 2024-05-17T04:11:35.378 INFO:teuthology.orchestra.run.smithi131.stdout:009 2024-05-17T04:11:35.379 INFO:teuthology.orchestra.run.smithi131.stdout:009.out 2024-05-17T04:11:35.379 INFO:teuthology.orchestra.run.smithi131.stdout:010 2024-05-17T04:11:35.379 INFO:teuthology.orchestra.run.smithi131.stdout:010.out 2024-05-17T04:11:35.379 INFO:teuthology.orchestra.run.smithi131.stdout:011 2024-05-17T04:11:35.379 INFO:teuthology.orchestra.run.smithi131.stdout:011.out 2024-05-17T04:11:35.379 INFO:teuthology.orchestra.run.smithi131.stdout:012 2024-05-17T04:11:35.379 INFO:teuthology.orchestra.run.smithi131.stdout:012.out 2024-05-17T04:11:35.379 INFO:teuthology.orchestra.run.smithi131.stdout:013 2024-05-17T04:11:35.379 INFO:teuthology.orchestra.run.smithi131.stdout:013.out 2024-05-17T04:11:35.379 INFO:teuthology.orchestra.run.smithi131.stdout:014 2024-05-17T04:11:35.379 INFO:teuthology.orchestra.run.smithi131.stdout:014.out 2024-05-17T04:11:35.379 INFO:teuthology.orchestra.run.smithi131.stdout:015 2024-05-17T04:11:35.379 INFO:teuthology.orchestra.run.smithi131.stdout:015.out 2024-05-17T04:11:35.380 INFO:teuthology.orchestra.run.smithi131.stdout:016 2024-05-17T04:11:35.380 INFO:teuthology.orchestra.run.smithi131.stdout:016.out 2024-05-17T04:11:35.380 INFO:teuthology.orchestra.run.smithi131.stdout:017 2024-05-17T04:11:35.380 INFO:teuthology.orchestra.run.smithi131.stdout:017.out 2024-05-17T04:11:35.380 INFO:teuthology.orchestra.run.smithi131.stdout:018 2024-05-17T04:11:35.380 INFO:teuthology.orchestra.run.smithi131.stdout:018.out 2024-05-17T04:11:35.380 INFO:teuthology.orchestra.run.smithi131.stdout:019 2024-05-17T04:11:35.380 INFO:teuthology.orchestra.run.smithi131.stdout:019.out 2024-05-17T04:11:35.380 INFO:teuthology.orchestra.run.smithi131.stdout:020 2024-05-17T04:11:35.380 INFO:teuthology.orchestra.run.smithi131.stdout:020.out 2024-05-17T04:11:35.380 INFO:teuthology.orchestra.run.smithi131.stdout:021 2024-05-17T04:11:35.380 INFO:teuthology.orchestra.run.smithi131.stdout:021.out 2024-05-17T04:11:35.380 INFO:teuthology.orchestra.run.smithi131.stdout:022 2024-05-17T04:11:35.381 INFO:teuthology.orchestra.run.smithi131.stdout:022.out 2024-05-17T04:11:35.381 INFO:teuthology.orchestra.run.smithi131.stdout:023 2024-05-17T04:11:35.381 INFO:teuthology.orchestra.run.smithi131.stdout:023.out 2024-05-17T04:11:35.381 INFO:teuthology.orchestra.run.smithi131.stdout:024 2024-05-17T04:11:35.381 INFO:teuthology.orchestra.run.smithi131.stdout:024.out 2024-05-17T04:11:35.381 INFO:teuthology.orchestra.run.smithi131.stdout:025 2024-05-17T04:11:35.381 INFO:teuthology.orchestra.run.smithi131.stdout:025.out 2024-05-17T04:11:35.381 INFO:teuthology.orchestra.run.smithi131.stdout:026 2024-05-17T04:11:35.381 INFO:teuthology.orchestra.run.smithi131.stdout:026.out 2024-05-17T04:11:35.381 INFO:teuthology.orchestra.run.smithi131.stdout:027 2024-05-17T04:11:35.381 INFO:teuthology.orchestra.run.smithi131.stdout:027.out 2024-05-17T04:11:35.381 INFO:teuthology.orchestra.run.smithi131.stdout:028 2024-05-17T04:11:35.381 INFO:teuthology.orchestra.run.smithi131.stdout:028.out 2024-05-17T04:11:35.382 INFO:teuthology.orchestra.run.smithi131.stdout:029 2024-05-17T04:11:35.382 INFO:teuthology.orchestra.run.smithi131.stdout:029.out 2024-05-17T04:11:35.382 INFO:teuthology.orchestra.run.smithi131.stdout:030 2024-05-17T04:11:35.382 INFO:teuthology.orchestra.run.smithi131.stdout:030.out 2024-05-17T04:11:35.382 INFO:teuthology.orchestra.run.smithi131.stdout:031 2024-05-17T04:11:35.382 INFO:teuthology.orchestra.run.smithi131.stdout:031.out 2024-05-17T04:11:35.382 INFO:teuthology.orchestra.run.smithi131.stdout:032 2024-05-17T04:11:35.382 INFO:teuthology.orchestra.run.smithi131.stdout:032.out 2024-05-17T04:11:35.382 INFO:teuthology.orchestra.run.smithi131.stdout:033 2024-05-17T04:11:35.382 INFO:teuthology.orchestra.run.smithi131.stdout:033.out 2024-05-17T04:11:35.382 INFO:teuthology.orchestra.run.smithi131.stdout:034 2024-05-17T04:11:35.382 INFO:teuthology.orchestra.run.smithi131.stdout:034.out 2024-05-17T04:11:35.383 INFO:teuthology.orchestra.run.smithi131.stdout:035 2024-05-17T04:11:35.383 INFO:teuthology.orchestra.run.smithi131.stdout:035.cfg 2024-05-17T04:11:35.383 INFO:teuthology.orchestra.run.smithi131.stdout:035.out.default 2024-05-17T04:11:35.383 INFO:teuthology.orchestra.run.smithi131.stdout:035.out.nfs 2024-05-17T04:11:35.383 INFO:teuthology.orchestra.run.smithi131.stdout:036 2024-05-17T04:11:35.383 INFO:teuthology.orchestra.run.smithi131.stdout:036.out 2024-05-17T04:11:35.383 INFO:teuthology.orchestra.run.smithi131.stdout:037 2024-05-17T04:11:35.383 INFO:teuthology.orchestra.run.smithi131.stdout:037.out 2024-05-17T04:11:35.383 INFO:teuthology.orchestra.run.smithi131.stdout:038 2024-05-17T04:11:35.383 INFO:teuthology.orchestra.run.smithi131.stdout:038.out 2024-05-17T04:11:35.383 INFO:teuthology.orchestra.run.smithi131.stdout:039 2024-05-17T04:11:35.384 INFO:teuthology.orchestra.run.smithi131.stdout:039.out 2024-05-17T04:11:35.384 INFO:teuthology.orchestra.run.smithi131.stdout:040 2024-05-17T04:11:35.384 INFO:teuthology.orchestra.run.smithi131.stdout:040.out 2024-05-17T04:11:35.384 INFO:teuthology.orchestra.run.smithi131.stdout:041 2024-05-17T04:11:35.384 INFO:teuthology.orchestra.run.smithi131.stdout:041.out 2024-05-17T04:11:35.384 INFO:teuthology.orchestra.run.smithi131.stdout:042 2024-05-17T04:11:35.384 INFO:teuthology.orchestra.run.smithi131.stdout:042.out 2024-05-17T04:11:35.384 INFO:teuthology.orchestra.run.smithi131.stdout:043 2024-05-17T04:11:35.384 INFO:teuthology.orchestra.run.smithi131.stdout:043.out 2024-05-17T04:11:35.384 INFO:teuthology.orchestra.run.smithi131.stdout:044 2024-05-17T04:11:35.384 INFO:teuthology.orchestra.run.smithi131.stdout:044.out 2024-05-17T04:11:35.384 INFO:teuthology.orchestra.run.smithi131.stdout:045 2024-05-17T04:11:35.384 INFO:teuthology.orchestra.run.smithi131.stdout:045.out 2024-05-17T04:11:35.384 INFO:teuthology.orchestra.run.smithi131.stdout:046 2024-05-17T04:11:35.385 INFO:teuthology.orchestra.run.smithi131.stdout:046.out 2024-05-17T04:11:35.385 INFO:teuthology.orchestra.run.smithi131.stdout:047 2024-05-17T04:11:35.385 INFO:teuthology.orchestra.run.smithi131.stdout:047.out 2024-05-17T04:11:35.385 INFO:teuthology.orchestra.run.smithi131.stdout:048 2024-05-17T04:11:35.385 INFO:teuthology.orchestra.run.smithi131.stdout:048.out 2024-05-17T04:11:35.385 INFO:teuthology.orchestra.run.smithi131.stdout:049 2024-05-17T04:11:35.385 INFO:teuthology.orchestra.run.smithi131.stdout:049.out 2024-05-17T04:11:35.385 INFO:teuthology.orchestra.run.smithi131.stdout:050 2024-05-17T04:11:35.385 INFO:teuthology.orchestra.run.smithi131.stdout:050.cfg 2024-05-17T04:11:35.385 INFO:teuthology.orchestra.run.smithi131.stdout:050.out.default 2024-05-17T04:11:35.385 INFO:teuthology.orchestra.run.smithi131.stdout:050.out.nojournal 2024-05-17T04:11:35.385 INFO:teuthology.orchestra.run.smithi131.stdout:050.out.xfsquota 2024-05-17T04:11:35.385 INFO:teuthology.orchestra.run.smithi131.stdout:051 2024-05-17T04:11:35.385 INFO:teuthology.orchestra.run.smithi131.stdout:051.out 2024-05-17T04:11:35.386 INFO:teuthology.orchestra.run.smithi131.stdout:052 2024-05-17T04:11:35.386 INFO:teuthology.orchestra.run.smithi131.stdout:052.out 2024-05-17T04:11:35.386 INFO:teuthology.orchestra.run.smithi131.stdout:053 2024-05-17T04:11:35.386 INFO:teuthology.orchestra.run.smithi131.stdout:053.out 2024-05-17T04:11:35.386 INFO:teuthology.orchestra.run.smithi131.stdout:054 2024-05-17T04:11:35.386 INFO:teuthology.orchestra.run.smithi131.stdout:054.out 2024-05-17T04:11:35.386 INFO:teuthology.orchestra.run.smithi131.stdout:055 2024-05-17T04:11:35.386 INFO:teuthology.orchestra.run.smithi131.stdout:055.out 2024-05-17T04:11:35.386 INFO:teuthology.orchestra.run.smithi131.stdout:056 2024-05-17T04:11:35.386 INFO:teuthology.orchestra.run.smithi131.stdout:056.out 2024-05-17T04:11:35.386 INFO:teuthology.orchestra.run.smithi131.stdout:057 2024-05-17T04:11:35.386 INFO:teuthology.orchestra.run.smithi131.stdout:057.out 2024-05-17T04:11:35.387 INFO:teuthology.orchestra.run.smithi131.stdout:058 2024-05-17T04:11:35.387 INFO:teuthology.orchestra.run.smithi131.stdout:058.out 2024-05-17T04:11:35.387 INFO:teuthology.orchestra.run.smithi131.stdout:059 2024-05-17T04:11:35.387 INFO:teuthology.orchestra.run.smithi131.stdout:059.out 2024-05-17T04:11:35.387 INFO:teuthology.orchestra.run.smithi131.stdout:060 2024-05-17T04:11:35.387 INFO:teuthology.orchestra.run.smithi131.stdout:060.out 2024-05-17T04:11:35.387 INFO:teuthology.orchestra.run.smithi131.stdout:061 2024-05-17T04:11:35.387 INFO:teuthology.orchestra.run.smithi131.stdout:061.out 2024-05-17T04:11:35.387 INFO:teuthology.orchestra.run.smithi131.stdout:062 2024-05-17T04:11:35.387 INFO:teuthology.orchestra.run.smithi131.stdout:062.out 2024-05-17T04:11:35.387 INFO:teuthology.orchestra.run.smithi131.stdout:063 2024-05-17T04:11:35.387 INFO:teuthology.orchestra.run.smithi131.stdout:063.out 2024-05-17T04:11:35.387 INFO:teuthology.orchestra.run.smithi131.stdout:064 2024-05-17T04:11:35.387 INFO:teuthology.orchestra.run.smithi131.stdout:064.out 2024-05-17T04:11:35.388 INFO:teuthology.orchestra.run.smithi131.stdout:065 2024-05-17T04:11:35.388 INFO:teuthology.orchestra.run.smithi131.stdout:065.out 2024-05-17T04:11:35.388 INFO:teuthology.orchestra.run.smithi131.stdout:066 2024-05-17T04:11:35.388 INFO:teuthology.orchestra.run.smithi131.stdout:066.out 2024-05-17T04:11:35.388 INFO:teuthology.orchestra.run.smithi131.stdout:067 2024-05-17T04:11:35.388 INFO:teuthology.orchestra.run.smithi131.stdout:067.out 2024-05-17T04:11:35.388 INFO:teuthology.orchestra.run.smithi131.stdout:068 2024-05-17T04:11:35.388 INFO:teuthology.orchestra.run.smithi131.stdout:068.out 2024-05-17T04:11:35.388 INFO:teuthology.orchestra.run.smithi131.stdout:069 2024-05-17T04:11:35.388 INFO:teuthology.orchestra.run.smithi131.stdout:069.out 2024-05-17T04:11:35.389 INFO:teuthology.orchestra.run.smithi131.stdout:070 2024-05-17T04:11:35.389 INFO:teuthology.orchestra.run.smithi131.stdout:070.out 2024-05-17T04:11:35.389 INFO:teuthology.orchestra.run.smithi131.stdout:071 2024-05-17T04:11:35.389 INFO:teuthology.orchestra.run.smithi131.stdout:071.out 2024-05-17T04:11:35.389 INFO:teuthology.orchestra.run.smithi131.stdout:072 2024-05-17T04:11:35.389 INFO:teuthology.orchestra.run.smithi131.stdout:072.out 2024-05-17T04:11:35.389 INFO:teuthology.orchestra.run.smithi131.stdout:073 2024-05-17T04:11:35.389 INFO:teuthology.orchestra.run.smithi131.stdout:073.out 2024-05-17T04:11:35.389 INFO:teuthology.orchestra.run.smithi131.stdout:074 2024-05-17T04:11:35.389 INFO:teuthology.orchestra.run.smithi131.stdout:074.out 2024-05-17T04:11:35.389 INFO:teuthology.orchestra.run.smithi131.stdout:075 2024-05-17T04:11:35.389 INFO:teuthology.orchestra.run.smithi131.stdout:075.out 2024-05-17T04:11:35.389 INFO:teuthology.orchestra.run.smithi131.stdout:076 2024-05-17T04:11:35.389 INFO:teuthology.orchestra.run.smithi131.stdout:076.out 2024-05-17T04:11:35.390 INFO:teuthology.orchestra.run.smithi131.stdout:077 2024-05-17T04:11:35.390 INFO:teuthology.orchestra.run.smithi131.stdout:077.out 2024-05-17T04:11:35.390 INFO:teuthology.orchestra.run.smithi131.stdout:078 2024-05-17T04:11:35.390 INFO:teuthology.orchestra.run.smithi131.stdout:078.out 2024-05-17T04:11:35.390 INFO:teuthology.orchestra.run.smithi131.stdout:079 2024-05-17T04:11:35.390 INFO:teuthology.orchestra.run.smithi131.stdout:079.out 2024-05-17T04:11:35.390 INFO:teuthology.orchestra.run.smithi131.stdout:080 2024-05-17T04:11:35.390 INFO:teuthology.orchestra.run.smithi131.stdout:080.out 2024-05-17T04:11:35.390 INFO:teuthology.orchestra.run.smithi131.stdout:081 2024-05-17T04:11:35.390 INFO:teuthology.orchestra.run.smithi131.stdout:081.out 2024-05-17T04:11:35.390 INFO:teuthology.orchestra.run.smithi131.stdout:082 2024-05-17T04:11:35.390 INFO:teuthology.orchestra.run.smithi131.stdout:082.out 2024-05-17T04:11:35.390 INFO:teuthology.orchestra.run.smithi131.stdout:083 2024-05-17T04:11:35.391 INFO:teuthology.orchestra.run.smithi131.stdout:083.out 2024-05-17T04:11:35.391 INFO:teuthology.orchestra.run.smithi131.stdout:084 2024-05-17T04:11:35.391 INFO:teuthology.orchestra.run.smithi131.stdout:084.out 2024-05-17T04:11:35.391 INFO:teuthology.orchestra.run.smithi131.stdout:085 2024-05-17T04:11:35.391 INFO:teuthology.orchestra.run.smithi131.stdout:085.out 2024-05-17T04:11:35.391 INFO:teuthology.orchestra.run.smithi131.stdout:086 2024-05-17T04:11:35.391 INFO:teuthology.orchestra.run.smithi131.stdout:086.out 2024-05-17T04:11:35.391 INFO:teuthology.orchestra.run.smithi131.stdout:087 2024-05-17T04:11:35.391 INFO:teuthology.orchestra.run.smithi131.stdout:087.out 2024-05-17T04:11:35.391 INFO:teuthology.orchestra.run.smithi131.stdout:088 2024-05-17T04:11:35.391 INFO:teuthology.orchestra.run.smithi131.stdout:088.out 2024-05-17T04:11:35.391 INFO:teuthology.orchestra.run.smithi131.stdout:089 2024-05-17T04:11:35.391 INFO:teuthology.orchestra.run.smithi131.stdout:089.out 2024-05-17T04:11:35.392 INFO:teuthology.orchestra.run.smithi131.stdout:090 2024-05-17T04:11:35.392 INFO:teuthology.orchestra.run.smithi131.stdout:090.out 2024-05-17T04:11:35.392 INFO:teuthology.orchestra.run.smithi131.stdout:091 2024-05-17T04:11:35.392 INFO:teuthology.orchestra.run.smithi131.stdout:091.out 2024-05-17T04:11:35.392 INFO:teuthology.orchestra.run.smithi131.stdout:092 2024-05-17T04:11:35.392 INFO:teuthology.orchestra.run.smithi131.stdout:092.out 2024-05-17T04:11:35.392 INFO:teuthology.orchestra.run.smithi131.stdout:093 2024-05-17T04:11:35.392 INFO:teuthology.orchestra.run.smithi131.stdout:093.out 2024-05-17T04:11:35.392 INFO:teuthology.orchestra.run.smithi131.stdout:094 2024-05-17T04:11:35.392 INFO:teuthology.orchestra.run.smithi131.stdout:094.out 2024-05-17T04:11:35.392 INFO:teuthology.orchestra.run.smithi131.stdout:095 2024-05-17T04:11:35.392 INFO:teuthology.orchestra.run.smithi131.stdout:095.out 2024-05-17T04:11:35.392 INFO:teuthology.orchestra.run.smithi131.stdout:096 2024-05-17T04:11:35.392 INFO:teuthology.orchestra.run.smithi131.stdout:096.out 2024-05-17T04:11:35.393 INFO:teuthology.orchestra.run.smithi131.stdout:097 2024-05-17T04:11:35.393 INFO:teuthology.orchestra.run.smithi131.stdout:097.out 2024-05-17T04:11:35.393 INFO:teuthology.orchestra.run.smithi131.stdout:098 2024-05-17T04:11:35.393 INFO:teuthology.orchestra.run.smithi131.stdout:098.out 2024-05-17T04:11:35.393 INFO:teuthology.orchestra.run.smithi131.stdout:099 2024-05-17T04:11:35.393 INFO:teuthology.orchestra.run.smithi131.stdout:099.out 2024-05-17T04:11:35.393 INFO:teuthology.orchestra.run.smithi131.stdout:100 2024-05-17T04:11:35.393 INFO:teuthology.orchestra.run.smithi131.stdout:100.out 2024-05-17T04:11:35.393 INFO:teuthology.orchestra.run.smithi131.stdout:101 2024-05-17T04:11:35.393 INFO:teuthology.orchestra.run.smithi131.stdout:101.out 2024-05-17T04:11:35.393 INFO:teuthology.orchestra.run.smithi131.stdout:102 2024-05-17T04:11:35.393 INFO:teuthology.orchestra.run.smithi131.stdout:102.out 2024-05-17T04:11:35.393 INFO:teuthology.orchestra.run.smithi131.stdout:103 2024-05-17T04:11:35.393 INFO:teuthology.orchestra.run.smithi131.stdout:103.out 2024-05-17T04:11:35.394 INFO:teuthology.orchestra.run.smithi131.stdout:104 2024-05-17T04:11:35.394 INFO:teuthology.orchestra.run.smithi131.stdout:104.out 2024-05-17T04:11:35.394 INFO:teuthology.orchestra.run.smithi131.stdout:105 2024-05-17T04:11:35.394 INFO:teuthology.orchestra.run.smithi131.stdout:105.out 2024-05-17T04:11:35.394 INFO:teuthology.orchestra.run.smithi131.stdout:106 2024-05-17T04:11:35.394 INFO:teuthology.orchestra.run.smithi131.stdout:106.out 2024-05-17T04:11:35.394 INFO:teuthology.orchestra.run.smithi131.stdout:107 2024-05-17T04:11:35.394 INFO:teuthology.orchestra.run.smithi131.stdout:107.out 2024-05-17T04:11:35.394 INFO:teuthology.orchestra.run.smithi131.stdout:108 2024-05-17T04:11:35.394 INFO:teuthology.orchestra.run.smithi131.stdout:108.out 2024-05-17T04:11:35.394 INFO:teuthology.orchestra.run.smithi131.stdout:109 2024-05-17T04:11:35.394 INFO:teuthology.orchestra.run.smithi131.stdout:109.out 2024-05-17T04:11:35.394 INFO:teuthology.orchestra.run.smithi131.stdout:110 2024-05-17T04:11:35.395 INFO:teuthology.orchestra.run.smithi131.stdout:110.out 2024-05-17T04:11:35.395 INFO:teuthology.orchestra.run.smithi131.stdout:111 2024-05-17T04:11:35.395 INFO:teuthology.orchestra.run.smithi131.stdout:111.out 2024-05-17T04:11:35.395 INFO:teuthology.orchestra.run.smithi131.stdout:112 2024-05-17T04:11:35.395 INFO:teuthology.orchestra.run.smithi131.stdout:112.out 2024-05-17T04:11:35.395 INFO:teuthology.orchestra.run.smithi131.stdout:113 2024-05-17T04:11:35.395 INFO:teuthology.orchestra.run.smithi131.stdout:113.out 2024-05-17T04:11:35.395 INFO:teuthology.orchestra.run.smithi131.stdout:114 2024-05-17T04:11:35.395 INFO:teuthology.orchestra.run.smithi131.stdout:114.out 2024-05-17T04:11:35.395 INFO:teuthology.orchestra.run.smithi131.stdout:115 2024-05-17T04:11:35.395 INFO:teuthology.orchestra.run.smithi131.stdout:115.out 2024-05-17T04:11:35.395 INFO:teuthology.orchestra.run.smithi131.stdout:116 2024-05-17T04:11:35.395 INFO:teuthology.orchestra.run.smithi131.stdout:116.out 2024-05-17T04:11:35.396 INFO:teuthology.orchestra.run.smithi131.stdout:117 2024-05-17T04:11:35.396 INFO:teuthology.orchestra.run.smithi131.stdout:117.out 2024-05-17T04:11:35.396 INFO:teuthology.orchestra.run.smithi131.stdout:118 2024-05-17T04:11:35.396 INFO:teuthology.orchestra.run.smithi131.stdout:118.out 2024-05-17T04:11:35.396 INFO:teuthology.orchestra.run.smithi131.stdout:119 2024-05-17T04:11:35.396 INFO:teuthology.orchestra.run.smithi131.stdout:119.out 2024-05-17T04:11:35.396 INFO:teuthology.orchestra.run.smithi131.stdout:120 2024-05-17T04:11:35.396 INFO:teuthology.orchestra.run.smithi131.stdout:120.out 2024-05-17T04:11:35.396 INFO:teuthology.orchestra.run.smithi131.stdout:121 2024-05-17T04:11:35.396 INFO:teuthology.orchestra.run.smithi131.stdout:121.out 2024-05-17T04:11:35.396 INFO:teuthology.orchestra.run.smithi131.stdout:122 2024-05-17T04:11:35.396 INFO:teuthology.orchestra.run.smithi131.stdout:122.out 2024-05-17T04:11:35.396 INFO:teuthology.orchestra.run.smithi131.stdout:123 2024-05-17T04:11:35.396 INFO:teuthology.orchestra.run.smithi131.stdout:123.out 2024-05-17T04:11:35.397 INFO:teuthology.orchestra.run.smithi131.stdout:124 2024-05-17T04:11:35.397 INFO:teuthology.orchestra.run.smithi131.stdout:124.out 2024-05-17T04:11:35.397 INFO:teuthology.orchestra.run.smithi131.stdout:125 2024-05-17T04:11:35.397 INFO:teuthology.orchestra.run.smithi131.stdout:125.out 2024-05-17T04:11:35.397 INFO:teuthology.orchestra.run.smithi131.stdout:126 2024-05-17T04:11:35.397 INFO:teuthology.orchestra.run.smithi131.stdout:126.out 2024-05-17T04:11:35.397 INFO:teuthology.orchestra.run.smithi131.stdout:127 2024-05-17T04:11:35.397 INFO:teuthology.orchestra.run.smithi131.stdout:127.out 2024-05-17T04:11:35.397 INFO:teuthology.orchestra.run.smithi131.stdout:128 2024-05-17T04:11:35.397 INFO:teuthology.orchestra.run.smithi131.stdout:128.out 2024-05-17T04:11:35.397 INFO:teuthology.orchestra.run.smithi131.stdout:129 2024-05-17T04:11:35.397 INFO:teuthology.orchestra.run.smithi131.stdout:129.out 2024-05-17T04:11:35.398 INFO:teuthology.orchestra.run.smithi131.stdout:130 2024-05-17T04:11:35.398 INFO:teuthology.orchestra.run.smithi131.stdout:130.out 2024-05-17T04:11:35.398 INFO:teuthology.orchestra.run.smithi131.stdout:131 2024-05-17T04:11:35.398 INFO:teuthology.orchestra.run.smithi131.stdout:131.out 2024-05-17T04:11:35.398 INFO:teuthology.orchestra.run.smithi131.stdout:132 2024-05-17T04:11:35.398 INFO:teuthology.orchestra.run.smithi131.stdout:132.out 2024-05-17T04:11:35.398 INFO:teuthology.orchestra.run.smithi131.stdout:133 2024-05-17T04:11:35.398 INFO:teuthology.orchestra.run.smithi131.stdout:133.out 2024-05-17T04:11:35.398 INFO:teuthology.orchestra.run.smithi131.stdout:134 2024-05-17T04:11:35.398 INFO:teuthology.orchestra.run.smithi131.stdout:134.out 2024-05-17T04:11:35.398 INFO:teuthology.orchestra.run.smithi131.stdout:135 2024-05-17T04:11:35.398 INFO:teuthology.orchestra.run.smithi131.stdout:135.out 2024-05-17T04:11:35.398 INFO:teuthology.orchestra.run.smithi131.stdout:136 2024-05-17T04:11:35.399 INFO:teuthology.orchestra.run.smithi131.stdout:136.out 2024-05-17T04:11:35.399 INFO:teuthology.orchestra.run.smithi131.stdout:137 2024-05-17T04:11:35.399 INFO:teuthology.orchestra.run.smithi131.stdout:137.out 2024-05-17T04:11:35.399 INFO:teuthology.orchestra.run.smithi131.stdout:138 2024-05-17T04:11:35.399 INFO:teuthology.orchestra.run.smithi131.stdout:138.out 2024-05-17T04:11:35.399 INFO:teuthology.orchestra.run.smithi131.stdout:139 2024-05-17T04:11:35.399 INFO:teuthology.orchestra.run.smithi131.stdout:139.out 2024-05-17T04:11:35.399 INFO:teuthology.orchestra.run.smithi131.stdout:140 2024-05-17T04:11:35.399 INFO:teuthology.orchestra.run.smithi131.stdout:140.out 2024-05-17T04:11:35.399 INFO:teuthology.orchestra.run.smithi131.stdout:141 2024-05-17T04:11:35.399 INFO:teuthology.orchestra.run.smithi131.stdout:141.out 2024-05-17T04:11:35.399 INFO:teuthology.orchestra.run.smithi131.stdout:142 2024-05-17T04:11:35.399 INFO:teuthology.orchestra.run.smithi131.stdout:142.out 2024-05-17T04:11:35.399 INFO:teuthology.orchestra.run.smithi131.stdout:143 2024-05-17T04:11:35.400 INFO:teuthology.orchestra.run.smithi131.stdout:143.out 2024-05-17T04:11:35.400 INFO:teuthology.orchestra.run.smithi131.stdout:144 2024-05-17T04:11:35.400 INFO:teuthology.orchestra.run.smithi131.stdout:144.out 2024-05-17T04:11:35.400 INFO:teuthology.orchestra.run.smithi131.stdout:145 2024-05-17T04:11:35.400 INFO:teuthology.orchestra.run.smithi131.stdout:145.out 2024-05-17T04:11:35.400 INFO:teuthology.orchestra.run.smithi131.stdout:146 2024-05-17T04:11:35.400 INFO:teuthology.orchestra.run.smithi131.stdout:146.out 2024-05-17T04:11:35.400 INFO:teuthology.orchestra.run.smithi131.stdout:147 2024-05-17T04:11:35.400 INFO:teuthology.orchestra.run.smithi131.stdout:147.out 2024-05-17T04:11:35.400 INFO:teuthology.orchestra.run.smithi131.stdout:148 2024-05-17T04:11:35.400 INFO:teuthology.orchestra.run.smithi131.stdout:148.out 2024-05-17T04:11:35.400 INFO:teuthology.orchestra.run.smithi131.stdout:149 2024-05-17T04:11:35.400 INFO:teuthology.orchestra.run.smithi131.stdout:149.out 2024-05-17T04:11:35.401 INFO:teuthology.orchestra.run.smithi131.stdout:150 2024-05-17T04:11:35.401 INFO:teuthology.orchestra.run.smithi131.stdout:150.out 2024-05-17T04:11:35.401 INFO:teuthology.orchestra.run.smithi131.stdout:151 2024-05-17T04:11:35.401 INFO:teuthology.orchestra.run.smithi131.stdout:151.out 2024-05-17T04:11:35.401 INFO:teuthology.orchestra.run.smithi131.stdout:152 2024-05-17T04:11:35.401 INFO:teuthology.orchestra.run.smithi131.stdout:152.out 2024-05-17T04:11:35.401 INFO:teuthology.orchestra.run.smithi131.stdout:153 2024-05-17T04:11:35.401 INFO:teuthology.orchestra.run.smithi131.stdout:153.out 2024-05-17T04:11:35.401 INFO:teuthology.orchestra.run.smithi131.stdout:154 2024-05-17T04:11:35.401 INFO:teuthology.orchestra.run.smithi131.stdout:154.out 2024-05-17T04:11:35.401 INFO:teuthology.orchestra.run.smithi131.stdout:155 2024-05-17T04:11:35.401 INFO:teuthology.orchestra.run.smithi131.stdout:155.out 2024-05-17T04:11:35.401 INFO:teuthology.orchestra.run.smithi131.stdout:156 2024-05-17T04:11:35.401 INFO:teuthology.orchestra.run.smithi131.stdout:156.out 2024-05-17T04:11:35.402 INFO:teuthology.orchestra.run.smithi131.stdout:157 2024-05-17T04:11:35.402 INFO:teuthology.orchestra.run.smithi131.stdout:157.out 2024-05-17T04:11:35.402 INFO:teuthology.orchestra.run.smithi131.stdout:158 2024-05-17T04:11:35.402 INFO:teuthology.orchestra.run.smithi131.stdout:158.out 2024-05-17T04:11:35.402 INFO:teuthology.orchestra.run.smithi131.stdout:159 2024-05-17T04:11:35.402 INFO:teuthology.orchestra.run.smithi131.stdout:159.out 2024-05-17T04:11:35.402 INFO:teuthology.orchestra.run.smithi131.stdout:160 2024-05-17T04:11:35.402 INFO:teuthology.orchestra.run.smithi131.stdout:160.out 2024-05-17T04:11:35.402 INFO:teuthology.orchestra.run.smithi131.stdout:161 2024-05-17T04:11:35.402 INFO:teuthology.orchestra.run.smithi131.stdout:161.out 2024-05-17T04:11:35.402 INFO:teuthology.orchestra.run.smithi131.stdout:162 2024-05-17T04:11:35.402 INFO:teuthology.orchestra.run.smithi131.stdout:162.out 2024-05-17T04:11:35.402 INFO:teuthology.orchestra.run.smithi131.stdout:163 2024-05-17T04:11:35.402 INFO:teuthology.orchestra.run.smithi131.stdout:163.out 2024-05-17T04:11:35.403 INFO:teuthology.orchestra.run.smithi131.stdout:164 2024-05-17T04:11:35.403 INFO:teuthology.orchestra.run.smithi131.stdout:164.out 2024-05-17T04:11:35.403 INFO:teuthology.orchestra.run.smithi131.stdout:165 2024-05-17T04:11:35.403 INFO:teuthology.orchestra.run.smithi131.stdout:165.out 2024-05-17T04:11:35.403 INFO:teuthology.orchestra.run.smithi131.stdout:166 2024-05-17T04:11:35.403 INFO:teuthology.orchestra.run.smithi131.stdout:166.out 2024-05-17T04:11:35.403 INFO:teuthology.orchestra.run.smithi131.stdout:167 2024-05-17T04:11:35.403 INFO:teuthology.orchestra.run.smithi131.stdout:167.out 2024-05-17T04:11:35.403 INFO:teuthology.orchestra.run.smithi131.stdout:168 2024-05-17T04:11:35.403 INFO:teuthology.orchestra.run.smithi131.stdout:168.out 2024-05-17T04:11:35.403 INFO:teuthology.orchestra.run.smithi131.stdout:169 2024-05-17T04:11:35.403 INFO:teuthology.orchestra.run.smithi131.stdout:169.out 2024-05-17T04:11:35.404 INFO:teuthology.orchestra.run.smithi131.stdout:170 2024-05-17T04:11:35.404 INFO:teuthology.orchestra.run.smithi131.stdout:170.out 2024-05-17T04:11:35.404 INFO:teuthology.orchestra.run.smithi131.stdout:171 2024-05-17T04:11:35.404 INFO:teuthology.orchestra.run.smithi131.stdout:171.out 2024-05-17T04:11:35.404 INFO:teuthology.orchestra.run.smithi131.stdout:172 2024-05-17T04:11:35.404 INFO:teuthology.orchestra.run.smithi131.stdout:172.out 2024-05-17T04:11:35.404 INFO:teuthology.orchestra.run.smithi131.stdout:173 2024-05-17T04:11:35.404 INFO:teuthology.orchestra.run.smithi131.stdout:173.out 2024-05-17T04:11:35.404 INFO:teuthology.orchestra.run.smithi131.stdout:174 2024-05-17T04:11:35.404 INFO:teuthology.orchestra.run.smithi131.stdout:174.out 2024-05-17T04:11:35.404 INFO:teuthology.orchestra.run.smithi131.stdout:175 2024-05-17T04:11:35.404 INFO:teuthology.orchestra.run.smithi131.stdout:175.out 2024-05-17T04:11:35.405 INFO:teuthology.orchestra.run.smithi131.stdout:176 2024-05-17T04:11:35.405 INFO:teuthology.orchestra.run.smithi131.stdout:176.out 2024-05-17T04:11:35.405 INFO:teuthology.orchestra.run.smithi131.stdout:177 2024-05-17T04:11:35.405 INFO:teuthology.orchestra.run.smithi131.stdout:177.out 2024-05-17T04:11:35.405 INFO:teuthology.orchestra.run.smithi131.stdout:178 2024-05-17T04:11:35.405 INFO:teuthology.orchestra.run.smithi131.stdout:178.out 2024-05-17T04:11:35.405 INFO:teuthology.orchestra.run.smithi131.stdout:179 2024-05-17T04:11:35.405 INFO:teuthology.orchestra.run.smithi131.stdout:179.out 2024-05-17T04:11:35.405 INFO:teuthology.orchestra.run.smithi131.stdout:180 2024-05-17T04:11:35.405 INFO:teuthology.orchestra.run.smithi131.stdout:180.out 2024-05-17T04:11:35.405 INFO:teuthology.orchestra.run.smithi131.stdout:181 2024-05-17T04:11:35.405 INFO:teuthology.orchestra.run.smithi131.stdout:181.out 2024-05-17T04:11:35.405 INFO:teuthology.orchestra.run.smithi131.stdout:182 2024-05-17T04:11:35.405 INFO:teuthology.orchestra.run.smithi131.stdout:182.out 2024-05-17T04:11:35.406 INFO:teuthology.orchestra.run.smithi131.stdout:183 2024-05-17T04:11:35.406 INFO:teuthology.orchestra.run.smithi131.stdout:183.out 2024-05-17T04:11:35.406 INFO:teuthology.orchestra.run.smithi131.stdout:184 2024-05-17T04:11:35.406 INFO:teuthology.orchestra.run.smithi131.stdout:184.out 2024-05-17T04:11:35.406 INFO:teuthology.orchestra.run.smithi131.stdout:185 2024-05-17T04:11:35.406 INFO:teuthology.orchestra.run.smithi131.stdout:185.out 2024-05-17T04:11:35.406 INFO:teuthology.orchestra.run.smithi131.stdout:186 2024-05-17T04:11:35.406 INFO:teuthology.orchestra.run.smithi131.stdout:186.out 2024-05-17T04:11:35.406 INFO:teuthology.orchestra.run.smithi131.stdout:187 2024-05-17T04:11:35.406 INFO:teuthology.orchestra.run.smithi131.stdout:187.out 2024-05-17T04:11:35.406 INFO:teuthology.orchestra.run.smithi131.stdout:188 2024-05-17T04:11:35.406 INFO:teuthology.orchestra.run.smithi131.stdout:188.out 2024-05-17T04:11:35.407 INFO:teuthology.orchestra.run.smithi131.stdout:189 2024-05-17T04:11:35.407 INFO:teuthology.orchestra.run.smithi131.stdout:189.out 2024-05-17T04:11:35.407 INFO:teuthology.orchestra.run.smithi131.stdout:190 2024-05-17T04:11:35.407 INFO:teuthology.orchestra.run.smithi131.stdout:190.out 2024-05-17T04:11:35.407 INFO:teuthology.orchestra.run.smithi131.stdout:191 2024-05-17T04:11:35.407 INFO:teuthology.orchestra.run.smithi131.stdout:191.out 2024-05-17T04:11:35.407 INFO:teuthology.orchestra.run.smithi131.stdout:192 2024-05-17T04:11:35.407 INFO:teuthology.orchestra.run.smithi131.stdout:192.out 2024-05-17T04:11:35.407 INFO:teuthology.orchestra.run.smithi131.stdout:193 2024-05-17T04:11:35.407 INFO:teuthology.orchestra.run.smithi131.stdout:193.out 2024-05-17T04:11:35.407 INFO:teuthology.orchestra.run.smithi131.stdout:194 2024-05-17T04:11:35.407 INFO:teuthology.orchestra.run.smithi131.stdout:194.out 2024-05-17T04:11:35.408 INFO:teuthology.orchestra.run.smithi131.stdout:195 2024-05-17T04:11:35.408 INFO:teuthology.orchestra.run.smithi131.stdout:195.out 2024-05-17T04:11:35.408 INFO:teuthology.orchestra.run.smithi131.stdout:196 2024-05-17T04:11:35.408 INFO:teuthology.orchestra.run.smithi131.stdout:196.out 2024-05-17T04:11:35.408 INFO:teuthology.orchestra.run.smithi131.stdout:197 2024-05-17T04:11:35.408 INFO:teuthology.orchestra.run.smithi131.stdout:197.out 2024-05-17T04:11:35.408 INFO:teuthology.orchestra.run.smithi131.stdout:198 2024-05-17T04:11:35.408 INFO:teuthology.orchestra.run.smithi131.stdout:198.out 2024-05-17T04:11:35.408 INFO:teuthology.orchestra.run.smithi131.stdout:199 2024-05-17T04:11:35.408 INFO:teuthology.orchestra.run.smithi131.stdout:199.out 2024-05-17T04:11:35.408 INFO:teuthology.orchestra.run.smithi131.stdout:200 2024-05-17T04:11:35.408 INFO:teuthology.orchestra.run.smithi131.stdout:200.out 2024-05-17T04:11:35.409 INFO:teuthology.orchestra.run.smithi131.stdout:201 2024-05-17T04:11:35.409 INFO:teuthology.orchestra.run.smithi131.stdout:201.out 2024-05-17T04:11:35.409 INFO:teuthology.orchestra.run.smithi131.stdout:202 2024-05-17T04:11:35.409 INFO:teuthology.orchestra.run.smithi131.stdout:202.out 2024-05-17T04:11:35.409 INFO:teuthology.orchestra.run.smithi131.stdout:203 2024-05-17T04:11:35.409 INFO:teuthology.orchestra.run.smithi131.stdout:203.out 2024-05-17T04:11:35.409 INFO:teuthology.orchestra.run.smithi131.stdout:204 2024-05-17T04:11:35.409 INFO:teuthology.orchestra.run.smithi131.stdout:204.out 2024-05-17T04:11:35.409 INFO:teuthology.orchestra.run.smithi131.stdout:205 2024-05-17T04:11:35.409 INFO:teuthology.orchestra.run.smithi131.stdout:205.out 2024-05-17T04:11:35.409 INFO:teuthology.orchestra.run.smithi131.stdout:206 2024-05-17T04:11:35.409 INFO:teuthology.orchestra.run.smithi131.stdout:206.out 2024-05-17T04:11:35.409 INFO:teuthology.orchestra.run.smithi131.stdout:207 2024-05-17T04:11:35.410 INFO:teuthology.orchestra.run.smithi131.stdout:207.out 2024-05-17T04:11:35.410 INFO:teuthology.orchestra.run.smithi131.stdout:208 2024-05-17T04:11:35.410 INFO:teuthology.orchestra.run.smithi131.stdout:208.out 2024-05-17T04:11:35.410 INFO:teuthology.orchestra.run.smithi131.stdout:209 2024-05-17T04:11:35.410 INFO:teuthology.orchestra.run.smithi131.stdout:209.out 2024-05-17T04:11:35.410 INFO:teuthology.orchestra.run.smithi131.stdout:210 2024-05-17T04:11:35.410 INFO:teuthology.orchestra.run.smithi131.stdout:210.out 2024-05-17T04:11:35.410 INFO:teuthology.orchestra.run.smithi131.stdout:211 2024-05-17T04:11:35.410 INFO:teuthology.orchestra.run.smithi131.stdout:211.out 2024-05-17T04:11:35.410 INFO:teuthology.orchestra.run.smithi131.stdout:212 2024-05-17T04:11:35.410 INFO:teuthology.orchestra.run.smithi131.stdout:212.out 2024-05-17T04:11:35.410 INFO:teuthology.orchestra.run.smithi131.stdout:213 2024-05-17T04:11:35.411 INFO:teuthology.orchestra.run.smithi131.stdout:213.out 2024-05-17T04:11:35.411 INFO:teuthology.orchestra.run.smithi131.stdout:214 2024-05-17T04:11:35.412 INFO:teuthology.orchestra.run.smithi131.stdout:214.out 2024-05-17T04:11:35.412 INFO:teuthology.orchestra.run.smithi131.stdout:215 2024-05-17T04:11:35.412 INFO:teuthology.orchestra.run.smithi131.stdout:215.out 2024-05-17T04:11:35.412 INFO:teuthology.orchestra.run.smithi131.stdout:216 2024-05-17T04:11:35.412 INFO:teuthology.orchestra.run.smithi131.stdout:216.out 2024-05-17T04:11:35.412 INFO:teuthology.orchestra.run.smithi131.stdout:217 2024-05-17T04:11:35.412 INFO:teuthology.orchestra.run.smithi131.stdout:217.out 2024-05-17T04:11:35.412 INFO:teuthology.orchestra.run.smithi131.stdout:218 2024-05-17T04:11:35.412 INFO:teuthology.orchestra.run.smithi131.stdout:218.out 2024-05-17T04:11:35.412 INFO:teuthology.orchestra.run.smithi131.stdout:219 2024-05-17T04:11:35.412 INFO:teuthology.orchestra.run.smithi131.stdout:219.out 2024-05-17T04:11:35.412 INFO:teuthology.orchestra.run.smithi131.stdout:220 2024-05-17T04:11:35.412 INFO:teuthology.orchestra.run.smithi131.stdout:220.out 2024-05-17T04:11:35.413 INFO:teuthology.orchestra.run.smithi131.stdout:221 2024-05-17T04:11:35.413 INFO:teuthology.orchestra.run.smithi131.stdout:221.out 2024-05-17T04:11:35.413 INFO:teuthology.orchestra.run.smithi131.stdout:222 2024-05-17T04:11:35.413 INFO:teuthology.orchestra.run.smithi131.stdout:222.out 2024-05-17T04:11:35.413 INFO:teuthology.orchestra.run.smithi131.stdout:223 2024-05-17T04:11:35.413 INFO:teuthology.orchestra.run.smithi131.stdout:223.out 2024-05-17T04:11:35.413 INFO:teuthology.orchestra.run.smithi131.stdout:224 2024-05-17T04:11:35.413 INFO:teuthology.orchestra.run.smithi131.stdout:224.out 2024-05-17T04:11:35.413 INFO:teuthology.orchestra.run.smithi131.stdout:225 2024-05-17T04:11:35.413 INFO:teuthology.orchestra.run.smithi131.stdout:225.out 2024-05-17T04:11:35.413 INFO:teuthology.orchestra.run.smithi131.stdout:226 2024-05-17T04:11:35.413 INFO:teuthology.orchestra.run.smithi131.stdout:226.out 2024-05-17T04:11:35.413 INFO:teuthology.orchestra.run.smithi131.stdout:227 2024-05-17T04:11:35.413 INFO:teuthology.orchestra.run.smithi131.stdout:227.out 2024-05-17T04:11:35.414 INFO:teuthology.orchestra.run.smithi131.stdout:228 2024-05-17T04:11:35.414 INFO:teuthology.orchestra.run.smithi131.stdout:228.out 2024-05-17T04:11:35.414 INFO:teuthology.orchestra.run.smithi131.stdout:229 2024-05-17T04:11:35.414 INFO:teuthology.orchestra.run.smithi131.stdout:229.out 2024-05-17T04:11:35.414 INFO:teuthology.orchestra.run.smithi131.stdout:230 2024-05-17T04:11:35.414 INFO:teuthology.orchestra.run.smithi131.stdout:230.out 2024-05-17T04:11:35.414 INFO:teuthology.orchestra.run.smithi131.stdout:231 2024-05-17T04:11:35.414 INFO:teuthology.orchestra.run.smithi131.stdout:231.out 2024-05-17T04:11:35.414 INFO:teuthology.orchestra.run.smithi131.stdout:232 2024-05-17T04:11:35.414 INFO:teuthology.orchestra.run.smithi131.stdout:232.out 2024-05-17T04:11:35.414 INFO:teuthology.orchestra.run.smithi131.stdout:233 2024-05-17T04:11:35.414 INFO:teuthology.orchestra.run.smithi131.stdout:233.out 2024-05-17T04:11:35.414 INFO:teuthology.orchestra.run.smithi131.stdout:234 2024-05-17T04:11:35.415 INFO:teuthology.orchestra.run.smithi131.stdout:234.out 2024-05-17T04:11:35.415 INFO:teuthology.orchestra.run.smithi131.stdout:235 2024-05-17T04:11:35.415 INFO:teuthology.orchestra.run.smithi131.stdout:235.out 2024-05-17T04:11:35.415 INFO:teuthology.orchestra.run.smithi131.stdout:236 2024-05-17T04:11:35.415 INFO:teuthology.orchestra.run.smithi131.stdout:236.out 2024-05-17T04:11:35.415 INFO:teuthology.orchestra.run.smithi131.stdout:237 2024-05-17T04:11:35.415 INFO:teuthology.orchestra.run.smithi131.stdout:237.out 2024-05-17T04:11:35.415 INFO:teuthology.orchestra.run.smithi131.stdout:238 2024-05-17T04:11:35.415 INFO:teuthology.orchestra.run.smithi131.stdout:238.out 2024-05-17T04:11:35.415 INFO:teuthology.orchestra.run.smithi131.stdout:239 2024-05-17T04:11:35.415 INFO:teuthology.orchestra.run.smithi131.stdout:239.out 2024-05-17T04:11:35.415 INFO:teuthology.orchestra.run.smithi131.stdout:240 2024-05-17T04:11:35.415 INFO:teuthology.orchestra.run.smithi131.stdout:240.out 2024-05-17T04:11:35.416 INFO:teuthology.orchestra.run.smithi131.stdout:241 2024-05-17T04:11:35.416 INFO:teuthology.orchestra.run.smithi131.stdout:241.out 2024-05-17T04:11:35.416 INFO:teuthology.orchestra.run.smithi131.stdout:242 2024-05-17T04:11:35.416 INFO:teuthology.orchestra.run.smithi131.stdout:242.out 2024-05-17T04:11:35.416 INFO:teuthology.orchestra.run.smithi131.stdout:243 2024-05-17T04:11:35.416 INFO:teuthology.orchestra.run.smithi131.stdout:243.out 2024-05-17T04:11:35.416 INFO:teuthology.orchestra.run.smithi131.stdout:244 2024-05-17T04:11:35.416 INFO:teuthology.orchestra.run.smithi131.stdout:244.out 2024-05-17T04:11:35.416 INFO:teuthology.orchestra.run.smithi131.stdout:245 2024-05-17T04:11:35.416 INFO:teuthology.orchestra.run.smithi131.stdout:245.out 2024-05-17T04:11:35.416 INFO:teuthology.orchestra.run.smithi131.stdout:246 2024-05-17T04:11:35.416 INFO:teuthology.orchestra.run.smithi131.stdout:246.out 2024-05-17T04:11:35.416 INFO:teuthology.orchestra.run.smithi131.stdout:247 2024-05-17T04:11:35.416 INFO:teuthology.orchestra.run.smithi131.stdout:247.out 2024-05-17T04:11:35.417 INFO:teuthology.orchestra.run.smithi131.stdout:248 2024-05-17T04:11:35.417 INFO:teuthology.orchestra.run.smithi131.stdout:248.out 2024-05-17T04:11:35.417 INFO:teuthology.orchestra.run.smithi131.stdout:249 2024-05-17T04:11:35.417 INFO:teuthology.orchestra.run.smithi131.stdout:249.out 2024-05-17T04:11:35.417 INFO:teuthology.orchestra.run.smithi131.stdout:250 2024-05-17T04:11:35.417 INFO:teuthology.orchestra.run.smithi131.stdout:250.out 2024-05-17T04:11:35.417 INFO:teuthology.orchestra.run.smithi131.stdout:251 2024-05-17T04:11:35.417 INFO:teuthology.orchestra.run.smithi131.stdout:251.out 2024-05-17T04:11:35.417 INFO:teuthology.orchestra.run.smithi131.stdout:252 2024-05-17T04:11:35.417 INFO:teuthology.orchestra.run.smithi131.stdout:252.out 2024-05-17T04:11:35.417 INFO:teuthology.orchestra.run.smithi131.stdout:253 2024-05-17T04:11:35.417 INFO:teuthology.orchestra.run.smithi131.stdout:253.out 2024-05-17T04:11:35.417 INFO:teuthology.orchestra.run.smithi131.stdout:254 2024-05-17T04:11:35.417 INFO:teuthology.orchestra.run.smithi131.stdout:254.out 2024-05-17T04:11:35.418 INFO:teuthology.orchestra.run.smithi131.stdout:255 2024-05-17T04:11:35.418 INFO:teuthology.orchestra.run.smithi131.stdout:255.out 2024-05-17T04:11:35.418 INFO:teuthology.orchestra.run.smithi131.stdout:256 2024-05-17T04:11:35.418 INFO:teuthology.orchestra.run.smithi131.stdout:256.out 2024-05-17T04:11:35.418 INFO:teuthology.orchestra.run.smithi131.stdout:257 2024-05-17T04:11:35.418 INFO:teuthology.orchestra.run.smithi131.stdout:257.out 2024-05-17T04:11:35.418 INFO:teuthology.orchestra.run.smithi131.stdout:258 2024-05-17T04:11:35.418 INFO:teuthology.orchestra.run.smithi131.stdout:258.out 2024-05-17T04:11:35.418 INFO:teuthology.orchestra.run.smithi131.stdout:259 2024-05-17T04:11:35.419 INFO:teuthology.orchestra.run.smithi131.stdout:259.out 2024-05-17T04:11:35.419 INFO:teuthology.orchestra.run.smithi131.stdout:260 2024-05-17T04:11:35.419 INFO:teuthology.orchestra.run.smithi131.stdout:260.out 2024-05-17T04:11:35.419 INFO:teuthology.orchestra.run.smithi131.stdout:261 2024-05-17T04:11:35.419 INFO:teuthology.orchestra.run.smithi131.stdout:261.out 2024-05-17T04:11:35.419 INFO:teuthology.orchestra.run.smithi131.stdout:262 2024-05-17T04:11:35.419 INFO:teuthology.orchestra.run.smithi131.stdout:262.out 2024-05-17T04:11:35.419 INFO:teuthology.orchestra.run.smithi131.stdout:263 2024-05-17T04:11:35.419 INFO:teuthology.orchestra.run.smithi131.stdout:263.out 2024-05-17T04:11:35.419 INFO:teuthology.orchestra.run.smithi131.stdout:264 2024-05-17T04:11:35.419 INFO:teuthology.orchestra.run.smithi131.stdout:264.out 2024-05-17T04:11:35.419 INFO:teuthology.orchestra.run.smithi131.stdout:265 2024-05-17T04:11:35.420 INFO:teuthology.orchestra.run.smithi131.stdout:265.out 2024-05-17T04:11:35.420 INFO:teuthology.orchestra.run.smithi131.stdout:266 2024-05-17T04:11:35.420 INFO:teuthology.orchestra.run.smithi131.stdout:266.out 2024-05-17T04:11:35.420 INFO:teuthology.orchestra.run.smithi131.stdout:267 2024-05-17T04:11:35.420 INFO:teuthology.orchestra.run.smithi131.stdout:267.out 2024-05-17T04:11:35.420 INFO:teuthology.orchestra.run.smithi131.stdout:268 2024-05-17T04:11:35.420 INFO:teuthology.orchestra.run.smithi131.stdout:268.out 2024-05-17T04:11:35.420 INFO:teuthology.orchestra.run.smithi131.stdout:269 2024-05-17T04:11:35.420 INFO:teuthology.orchestra.run.smithi131.stdout:269.out 2024-05-17T04:11:35.420 INFO:teuthology.orchestra.run.smithi131.stdout:270 2024-05-17T04:11:35.420 INFO:teuthology.orchestra.run.smithi131.stdout:270.out 2024-05-17T04:11:35.420 INFO:teuthology.orchestra.run.smithi131.stdout:271 2024-05-17T04:11:35.420 INFO:teuthology.orchestra.run.smithi131.stdout:271.out 2024-05-17T04:11:35.420 INFO:teuthology.orchestra.run.smithi131.stdout:272 2024-05-17T04:11:35.421 INFO:teuthology.orchestra.run.smithi131.stdout:272.out 2024-05-17T04:11:35.421 INFO:teuthology.orchestra.run.smithi131.stdout:273 2024-05-17T04:11:35.421 INFO:teuthology.orchestra.run.smithi131.stdout:273.out 2024-05-17T04:11:35.421 INFO:teuthology.orchestra.run.smithi131.stdout:274 2024-05-17T04:11:35.421 INFO:teuthology.orchestra.run.smithi131.stdout:274.out 2024-05-17T04:11:35.421 INFO:teuthology.orchestra.run.smithi131.stdout:275 2024-05-17T04:11:35.421 INFO:teuthology.orchestra.run.smithi131.stdout:275.out 2024-05-17T04:11:35.421 INFO:teuthology.orchestra.run.smithi131.stdout:276 2024-05-17T04:11:35.421 INFO:teuthology.orchestra.run.smithi131.stdout:276.out 2024-05-17T04:11:35.421 INFO:teuthology.orchestra.run.smithi131.stdout:277 2024-05-17T04:11:35.421 INFO:teuthology.orchestra.run.smithi131.stdout:277.out 2024-05-17T04:11:35.421 INFO:teuthology.orchestra.run.smithi131.stdout:278 2024-05-17T04:11:35.421 INFO:teuthology.orchestra.run.smithi131.stdout:278.out 2024-05-17T04:11:35.421 INFO:teuthology.orchestra.run.smithi131.stdout:279 2024-05-17T04:11:35.422 INFO:teuthology.orchestra.run.smithi131.stdout:279.out 2024-05-17T04:11:35.422 INFO:teuthology.orchestra.run.smithi131.stdout:280 2024-05-17T04:11:35.422 INFO:teuthology.orchestra.run.smithi131.stdout:280.out 2024-05-17T04:11:35.422 INFO:teuthology.orchestra.run.smithi131.stdout:281 2024-05-17T04:11:35.422 INFO:teuthology.orchestra.run.smithi131.stdout:281.out 2024-05-17T04:11:35.422 INFO:teuthology.orchestra.run.smithi131.stdout:282 2024-05-17T04:11:35.422 INFO:teuthology.orchestra.run.smithi131.stdout:282.out 2024-05-17T04:11:35.422 INFO:teuthology.orchestra.run.smithi131.stdout:283 2024-05-17T04:11:35.422 INFO:teuthology.orchestra.run.smithi131.stdout:283.out 2024-05-17T04:11:35.422 INFO:teuthology.orchestra.run.smithi131.stdout:284 2024-05-17T04:11:35.422 INFO:teuthology.orchestra.run.smithi131.stdout:284.out 2024-05-17T04:11:35.422 INFO:teuthology.orchestra.run.smithi131.stdout:285 2024-05-17T04:11:35.422 INFO:teuthology.orchestra.run.smithi131.stdout:285.out 2024-05-17T04:11:35.423 INFO:teuthology.orchestra.run.smithi131.stdout:286 2024-05-17T04:11:35.423 INFO:teuthology.orchestra.run.smithi131.stdout:286.out 2024-05-17T04:11:35.423 INFO:teuthology.orchestra.run.smithi131.stdout:287 2024-05-17T04:11:35.423 INFO:teuthology.orchestra.run.smithi131.stdout:287.out 2024-05-17T04:11:35.423 INFO:teuthology.orchestra.run.smithi131.stdout:288 2024-05-17T04:11:35.423 INFO:teuthology.orchestra.run.smithi131.stdout:288.out 2024-05-17T04:11:35.423 INFO:teuthology.orchestra.run.smithi131.stdout:289 2024-05-17T04:11:35.423 INFO:teuthology.orchestra.run.smithi131.stdout:289.out 2024-05-17T04:11:35.423 INFO:teuthology.orchestra.run.smithi131.stdout:290 2024-05-17T04:11:35.423 INFO:teuthology.orchestra.run.smithi131.stdout:290.out 2024-05-17T04:11:35.423 INFO:teuthology.orchestra.run.smithi131.stdout:291 2024-05-17T04:11:35.423 INFO:teuthology.orchestra.run.smithi131.stdout:291.out 2024-05-17T04:11:35.423 INFO:teuthology.orchestra.run.smithi131.stdout:292 2024-05-17T04:11:35.424 INFO:teuthology.orchestra.run.smithi131.stdout:292.out 2024-05-17T04:11:35.424 INFO:teuthology.orchestra.run.smithi131.stdout:293 2024-05-17T04:11:35.424 INFO:teuthology.orchestra.run.smithi131.stdout:293.out 2024-05-17T04:11:35.424 INFO:teuthology.orchestra.run.smithi131.stdout:294 2024-05-17T04:11:35.424 INFO:teuthology.orchestra.run.smithi131.stdout:294.out 2024-05-17T04:11:35.424 INFO:teuthology.orchestra.run.smithi131.stdout:295 2024-05-17T04:11:35.424 INFO:teuthology.orchestra.run.smithi131.stdout:295.out 2024-05-17T04:11:35.424 INFO:teuthology.orchestra.run.smithi131.stdout:296 2024-05-17T04:11:35.424 INFO:teuthology.orchestra.run.smithi131.stdout:296.out 2024-05-17T04:11:35.424 INFO:teuthology.orchestra.run.smithi131.stdout:297 2024-05-17T04:11:35.424 INFO:teuthology.orchestra.run.smithi131.stdout:297.out 2024-05-17T04:11:35.424 INFO:teuthology.orchestra.run.smithi131.stdout:298 2024-05-17T04:11:35.424 INFO:teuthology.orchestra.run.smithi131.stdout:298.out 2024-05-17T04:11:35.424 INFO:teuthology.orchestra.run.smithi131.stdout:299 2024-05-17T04:11:35.425 INFO:teuthology.orchestra.run.smithi131.stdout:299.out 2024-05-17T04:11:35.425 INFO:teuthology.orchestra.run.smithi131.stdout:300 2024-05-17T04:11:35.425 INFO:teuthology.orchestra.run.smithi131.stdout:300.out 2024-05-17T04:11:35.425 INFO:teuthology.orchestra.run.smithi131.stdout:301 2024-05-17T04:11:35.425 INFO:teuthology.orchestra.run.smithi131.stdout:301.out 2024-05-17T04:11:35.425 INFO:teuthology.orchestra.run.smithi131.stdout:302 2024-05-17T04:11:35.425 INFO:teuthology.orchestra.run.smithi131.stdout:302.out 2024-05-17T04:11:35.425 INFO:teuthology.orchestra.run.smithi131.stdout:303 2024-05-17T04:11:35.425 INFO:teuthology.orchestra.run.smithi131.stdout:303.out 2024-05-17T04:11:35.425 INFO:teuthology.orchestra.run.smithi131.stdout:304 2024-05-17T04:11:35.425 INFO:teuthology.orchestra.run.smithi131.stdout:304.out 2024-05-17T04:11:35.425 INFO:teuthology.orchestra.run.smithi131.stdout:305 2024-05-17T04:11:35.425 INFO:teuthology.orchestra.run.smithi131.stdout:305.out 2024-05-17T04:11:35.426 INFO:teuthology.orchestra.run.smithi131.stdout:306 2024-05-17T04:11:35.426 INFO:teuthology.orchestra.run.smithi131.stdout:306.out 2024-05-17T04:11:35.426 INFO:teuthology.orchestra.run.smithi131.stdout:307 2024-05-17T04:11:35.426 INFO:teuthology.orchestra.run.smithi131.stdout:307.out 2024-05-17T04:11:35.426 INFO:teuthology.orchestra.run.smithi131.stdout:308 2024-05-17T04:11:35.426 INFO:teuthology.orchestra.run.smithi131.stdout:308.out 2024-05-17T04:11:35.426 INFO:teuthology.orchestra.run.smithi131.stdout:309 2024-05-17T04:11:35.426 INFO:teuthology.orchestra.run.smithi131.stdout:309.out 2024-05-17T04:11:35.426 INFO:teuthology.orchestra.run.smithi131.stdout:310 2024-05-17T04:11:35.426 INFO:teuthology.orchestra.run.smithi131.stdout:310.out 2024-05-17T04:11:35.426 INFO:teuthology.orchestra.run.smithi131.stdout:311 2024-05-17T04:11:35.427 INFO:teuthology.orchestra.run.smithi131.stdout:311.out 2024-05-17T04:11:35.427 INFO:teuthology.orchestra.run.smithi131.stdout:312 2024-05-17T04:11:35.427 INFO:teuthology.orchestra.run.smithi131.stdout:312.out 2024-05-17T04:11:35.427 INFO:teuthology.orchestra.run.smithi131.stdout:313 2024-05-17T04:11:35.427 INFO:teuthology.orchestra.run.smithi131.stdout:313.out 2024-05-17T04:11:35.427 INFO:teuthology.orchestra.run.smithi131.stdout:314 2024-05-17T04:11:35.427 INFO:teuthology.orchestra.run.smithi131.stdout:314.out 2024-05-17T04:11:35.427 INFO:teuthology.orchestra.run.smithi131.stdout:315 2024-05-17T04:11:35.427 INFO:teuthology.orchestra.run.smithi131.stdout:315.out 2024-05-17T04:11:35.428 INFO:teuthology.orchestra.run.smithi131.stdout:316 2024-05-17T04:11:35.428 INFO:teuthology.orchestra.run.smithi131.stdout:316.out 2024-05-17T04:11:35.428 INFO:teuthology.orchestra.run.smithi131.stdout:317 2024-05-17T04:11:35.428 INFO:teuthology.orchestra.run.smithi131.stdout:317.out 2024-05-17T04:11:35.428 INFO:teuthology.orchestra.run.smithi131.stdout:318 2024-05-17T04:11:35.429 INFO:teuthology.orchestra.run.smithi131.stdout:318.out 2024-05-17T04:11:35.429 INFO:teuthology.orchestra.run.smithi131.stdout:319 2024-05-17T04:11:35.429 INFO:teuthology.orchestra.run.smithi131.stdout:319.out 2024-05-17T04:11:35.429 INFO:teuthology.orchestra.run.smithi131.stdout:320 2024-05-17T04:11:35.429 INFO:teuthology.orchestra.run.smithi131.stdout:320.out 2024-05-17T04:11:35.429 INFO:teuthology.orchestra.run.smithi131.stdout:321 2024-05-17T04:11:35.429 INFO:teuthology.orchestra.run.smithi131.stdout:321.out 2024-05-17T04:11:35.429 INFO:teuthology.orchestra.run.smithi131.stdout:322 2024-05-17T04:11:35.430 INFO:teuthology.orchestra.run.smithi131.stdout:322.out 2024-05-17T04:11:35.430 INFO:teuthology.orchestra.run.smithi131.stdout:323 2024-05-17T04:11:35.430 INFO:teuthology.orchestra.run.smithi131.stdout:323.out 2024-05-17T04:11:35.430 INFO:teuthology.orchestra.run.smithi131.stdout:324 2024-05-17T04:11:35.430 INFO:teuthology.orchestra.run.smithi131.stdout:324.out 2024-05-17T04:11:35.430 INFO:teuthology.orchestra.run.smithi131.stdout:325 2024-05-17T04:11:35.430 INFO:teuthology.orchestra.run.smithi131.stdout:325.out 2024-05-17T04:11:35.430 INFO:teuthology.orchestra.run.smithi131.stdout:326 2024-05-17T04:11:35.430 INFO:teuthology.orchestra.run.smithi131.stdout:326.out 2024-05-17T04:11:35.430 INFO:teuthology.orchestra.run.smithi131.stdout:327 2024-05-17T04:11:35.430 INFO:teuthology.orchestra.run.smithi131.stdout:327.out 2024-05-17T04:11:35.430 INFO:teuthology.orchestra.run.smithi131.stdout:328 2024-05-17T04:11:35.430 INFO:teuthology.orchestra.run.smithi131.stdout:328.out 2024-05-17T04:11:35.431 INFO:teuthology.orchestra.run.smithi131.stdout:329 2024-05-17T04:11:35.431 INFO:teuthology.orchestra.run.smithi131.stdout:329.out 2024-05-17T04:11:35.431 INFO:teuthology.orchestra.run.smithi131.stdout:330 2024-05-17T04:11:35.431 INFO:teuthology.orchestra.run.smithi131.stdout:330.out 2024-05-17T04:11:35.431 INFO:teuthology.orchestra.run.smithi131.stdout:331 2024-05-17T04:11:35.431 INFO:teuthology.orchestra.run.smithi131.stdout:331.out 2024-05-17T04:11:35.431 INFO:teuthology.orchestra.run.smithi131.stdout:332 2024-05-17T04:11:35.431 INFO:teuthology.orchestra.run.smithi131.stdout:332.out 2024-05-17T04:11:35.431 INFO:teuthology.orchestra.run.smithi131.stdout:333 2024-05-17T04:11:35.431 INFO:teuthology.orchestra.run.smithi131.stdout:333.out 2024-05-17T04:11:35.431 INFO:teuthology.orchestra.run.smithi131.stdout:334 2024-05-17T04:11:35.431 INFO:teuthology.orchestra.run.smithi131.stdout:334.out 2024-05-17T04:11:35.431 INFO:teuthology.orchestra.run.smithi131.stdout:335 2024-05-17T04:11:35.431 INFO:teuthology.orchestra.run.smithi131.stdout:335.out 2024-05-17T04:11:35.432 INFO:teuthology.orchestra.run.smithi131.stdout:336 2024-05-17T04:11:35.432 INFO:teuthology.orchestra.run.smithi131.stdout:336.out 2024-05-17T04:11:35.432 INFO:teuthology.orchestra.run.smithi131.stdout:337 2024-05-17T04:11:35.432 INFO:teuthology.orchestra.run.smithi131.stdout:337.out 2024-05-17T04:11:35.432 INFO:teuthology.orchestra.run.smithi131.stdout:338 2024-05-17T04:11:35.432 INFO:teuthology.orchestra.run.smithi131.stdout:338.out 2024-05-17T04:11:35.432 INFO:teuthology.orchestra.run.smithi131.stdout:339 2024-05-17T04:11:35.432 INFO:teuthology.orchestra.run.smithi131.stdout:339.out 2024-05-17T04:11:35.432 INFO:teuthology.orchestra.run.smithi131.stdout:340 2024-05-17T04:11:35.432 INFO:teuthology.orchestra.run.smithi131.stdout:340.out 2024-05-17T04:11:35.432 INFO:teuthology.orchestra.run.smithi131.stdout:341 2024-05-17T04:11:35.432 INFO:teuthology.orchestra.run.smithi131.stdout:341.out 2024-05-17T04:11:35.432 INFO:teuthology.orchestra.run.smithi131.stdout:342 2024-05-17T04:11:35.432 INFO:teuthology.orchestra.run.smithi131.stdout:342.out 2024-05-17T04:11:35.433 INFO:teuthology.orchestra.run.smithi131.stdout:343 2024-05-17T04:11:35.433 INFO:teuthology.orchestra.run.smithi131.stdout:343.out 2024-05-17T04:11:35.433 INFO:teuthology.orchestra.run.smithi131.stdout:344 2024-05-17T04:11:35.433 INFO:teuthology.orchestra.run.smithi131.stdout:344.out 2024-05-17T04:11:35.433 INFO:teuthology.orchestra.run.smithi131.stdout:345 2024-05-17T04:11:35.433 INFO:teuthology.orchestra.run.smithi131.stdout:345.out 2024-05-17T04:11:35.433 INFO:teuthology.orchestra.run.smithi131.stdout:346 2024-05-17T04:11:35.433 INFO:teuthology.orchestra.run.smithi131.stdout:346.out 2024-05-17T04:11:35.433 INFO:teuthology.orchestra.run.smithi131.stdout:347 2024-05-17T04:11:35.433 INFO:teuthology.orchestra.run.smithi131.stdout:347.out 2024-05-17T04:11:35.433 INFO:teuthology.orchestra.run.smithi131.stdout:348 2024-05-17T04:11:35.433 INFO:teuthology.orchestra.run.smithi131.stdout:348.out 2024-05-17T04:11:35.433 INFO:teuthology.orchestra.run.smithi131.stdout:349 2024-05-17T04:11:35.434 INFO:teuthology.orchestra.run.smithi131.stdout:349.out 2024-05-17T04:11:35.434 INFO:teuthology.orchestra.run.smithi131.stdout:350 2024-05-17T04:11:35.434 INFO:teuthology.orchestra.run.smithi131.stdout:350.out 2024-05-17T04:11:35.434 INFO:teuthology.orchestra.run.smithi131.stdout:351 2024-05-17T04:11:35.434 INFO:teuthology.orchestra.run.smithi131.stdout:351.out 2024-05-17T04:11:35.434 INFO:teuthology.orchestra.run.smithi131.stdout:352 2024-05-17T04:11:35.434 INFO:teuthology.orchestra.run.smithi131.stdout:352.out 2024-05-17T04:11:35.434 INFO:teuthology.orchestra.run.smithi131.stdout:353 2024-05-17T04:11:35.434 INFO:teuthology.orchestra.run.smithi131.stdout:353.out 2024-05-17T04:11:35.434 INFO:teuthology.orchestra.run.smithi131.stdout:354 2024-05-17T04:11:35.434 INFO:teuthology.orchestra.run.smithi131.stdout:354.out 2024-05-17T04:11:35.434 INFO:teuthology.orchestra.run.smithi131.stdout:355 2024-05-17T04:11:35.434 INFO:teuthology.orchestra.run.smithi131.stdout:355.out 2024-05-17T04:11:35.435 INFO:teuthology.orchestra.run.smithi131.stdout:356 2024-05-17T04:11:35.435 INFO:teuthology.orchestra.run.smithi131.stdout:356.out 2024-05-17T04:11:35.435 INFO:teuthology.orchestra.run.smithi131.stdout:357 2024-05-17T04:11:35.435 INFO:teuthology.orchestra.run.smithi131.stdout:357.out 2024-05-17T04:11:35.435 INFO:teuthology.orchestra.run.smithi131.stdout:358 2024-05-17T04:11:35.435 INFO:teuthology.orchestra.run.smithi131.stdout:358.out 2024-05-17T04:11:35.435 INFO:teuthology.orchestra.run.smithi131.stdout:359 2024-05-17T04:11:35.435 INFO:teuthology.orchestra.run.smithi131.stdout:359.out 2024-05-17T04:11:35.435 INFO:teuthology.orchestra.run.smithi131.stdout:360 2024-05-17T04:11:35.435 INFO:teuthology.orchestra.run.smithi131.stdout:360.out 2024-05-17T04:11:35.435 INFO:teuthology.orchestra.run.smithi131.stdout:361 2024-05-17T04:11:35.435 INFO:teuthology.orchestra.run.smithi131.stdout:361.out 2024-05-17T04:11:35.435 INFO:teuthology.orchestra.run.smithi131.stdout:362 2024-05-17T04:11:35.436 INFO:teuthology.orchestra.run.smithi131.stdout:362.out 2024-05-17T04:11:35.436 INFO:teuthology.orchestra.run.smithi131.stdout:363 2024-05-17T04:11:35.436 INFO:teuthology.orchestra.run.smithi131.stdout:363.out 2024-05-17T04:11:35.436 INFO:teuthology.orchestra.run.smithi131.stdout:364 2024-05-17T04:11:35.436 INFO:teuthology.orchestra.run.smithi131.stdout:364.out 2024-05-17T04:11:35.436 INFO:teuthology.orchestra.run.smithi131.stdout:365 2024-05-17T04:11:35.436 INFO:teuthology.orchestra.run.smithi131.stdout:365.out 2024-05-17T04:11:35.436 INFO:teuthology.orchestra.run.smithi131.stdout:366 2024-05-17T04:11:35.436 INFO:teuthology.orchestra.run.smithi131.stdout:366.out 2024-05-17T04:11:35.436 INFO:teuthology.orchestra.run.smithi131.stdout:367 2024-05-17T04:11:35.436 INFO:teuthology.orchestra.run.smithi131.stdout:367.out 2024-05-17T04:11:35.436 INFO:teuthology.orchestra.run.smithi131.stdout:368 2024-05-17T04:11:35.436 INFO:teuthology.orchestra.run.smithi131.stdout:368.out 2024-05-17T04:11:35.436 INFO:teuthology.orchestra.run.smithi131.stdout:369 2024-05-17T04:11:35.437 INFO:teuthology.orchestra.run.smithi131.stdout:369.out 2024-05-17T04:11:35.437 INFO:teuthology.orchestra.run.smithi131.stdout:370 2024-05-17T04:11:35.437 INFO:teuthology.orchestra.run.smithi131.stdout:370.out 2024-05-17T04:11:35.437 INFO:teuthology.orchestra.run.smithi131.stdout:371 2024-05-17T04:11:35.437 INFO:teuthology.orchestra.run.smithi131.stdout:371.out 2024-05-17T04:11:35.437 INFO:teuthology.orchestra.run.smithi131.stdout:372 2024-05-17T04:11:35.437 INFO:teuthology.orchestra.run.smithi131.stdout:372.out 2024-05-17T04:11:35.437 INFO:teuthology.orchestra.run.smithi131.stdout:373 2024-05-17T04:11:35.437 INFO:teuthology.orchestra.run.smithi131.stdout:373.out 2024-05-17T04:11:35.437 INFO:teuthology.orchestra.run.smithi131.stdout:374 2024-05-17T04:11:35.437 INFO:teuthology.orchestra.run.smithi131.stdout:374.out 2024-05-17T04:11:35.437 INFO:teuthology.orchestra.run.smithi131.stdout:375 2024-05-17T04:11:35.437 INFO:teuthology.orchestra.run.smithi131.stdout:375.out 2024-05-17T04:11:35.437 INFO:teuthology.orchestra.run.smithi131.stdout:376 2024-05-17T04:11:35.438 INFO:teuthology.orchestra.run.smithi131.stdout:376.out 2024-05-17T04:11:35.438 INFO:teuthology.orchestra.run.smithi131.stdout:377 2024-05-17T04:11:35.438 INFO:teuthology.orchestra.run.smithi131.stdout:377.out 2024-05-17T04:11:35.438 INFO:teuthology.orchestra.run.smithi131.stdout:378 2024-05-17T04:11:35.438 INFO:teuthology.orchestra.run.smithi131.stdout:378.out 2024-05-17T04:11:35.438 INFO:teuthology.orchestra.run.smithi131.stdout:379 2024-05-17T04:11:35.438 INFO:teuthology.orchestra.run.smithi131.stdout:379.out 2024-05-17T04:11:35.438 INFO:teuthology.orchestra.run.smithi131.stdout:380 2024-05-17T04:11:35.438 INFO:teuthology.orchestra.run.smithi131.stdout:380.out 2024-05-17T04:11:35.438 INFO:teuthology.orchestra.run.smithi131.stdout:381 2024-05-17T04:11:35.438 INFO:teuthology.orchestra.run.smithi131.stdout:381.out 2024-05-17T04:11:35.438 INFO:teuthology.orchestra.run.smithi131.stdout:382 2024-05-17T04:11:35.438 INFO:teuthology.orchestra.run.smithi131.stdout:382.out 2024-05-17T04:11:35.439 INFO:teuthology.orchestra.run.smithi131.stdout:383 2024-05-17T04:11:35.439 INFO:teuthology.orchestra.run.smithi131.stdout:383.out 2024-05-17T04:11:35.439 INFO:teuthology.orchestra.run.smithi131.stdout:384 2024-05-17T04:11:35.439 INFO:teuthology.orchestra.run.smithi131.stdout:384.out 2024-05-17T04:11:35.439 INFO:teuthology.orchestra.run.smithi131.stdout:385 2024-05-17T04:11:35.439 INFO:teuthology.orchestra.run.smithi131.stdout:385.out 2024-05-17T04:11:35.439 INFO:teuthology.orchestra.run.smithi131.stdout:386 2024-05-17T04:11:35.439 INFO:teuthology.orchestra.run.smithi131.stdout:386.out 2024-05-17T04:11:35.439 INFO:teuthology.orchestra.run.smithi131.stdout:387 2024-05-17T04:11:35.439 INFO:teuthology.orchestra.run.smithi131.stdout:387.out 2024-05-17T04:11:35.439 INFO:teuthology.orchestra.run.smithi131.stdout:388 2024-05-17T04:11:35.439 INFO:teuthology.orchestra.run.smithi131.stdout:388.out 2024-05-17T04:11:35.439 INFO:teuthology.orchestra.run.smithi131.stdout:389 2024-05-17T04:11:35.440 INFO:teuthology.orchestra.run.smithi131.stdout:389.out 2024-05-17T04:11:35.440 INFO:teuthology.orchestra.run.smithi131.stdout:390 2024-05-17T04:11:35.440 INFO:teuthology.orchestra.run.smithi131.stdout:390.out 2024-05-17T04:11:35.440 INFO:teuthology.orchestra.run.smithi131.stdout:391 2024-05-17T04:11:35.440 INFO:teuthology.orchestra.run.smithi131.stdout:391.out 2024-05-17T04:11:35.440 INFO:teuthology.orchestra.run.smithi131.stdout:392 2024-05-17T04:11:35.440 INFO:teuthology.orchestra.run.smithi131.stdout:392.out 2024-05-17T04:11:35.440 INFO:teuthology.orchestra.run.smithi131.stdout:393 2024-05-17T04:11:35.440 INFO:teuthology.orchestra.run.smithi131.stdout:393.out 2024-05-17T04:11:35.440 INFO:teuthology.orchestra.run.smithi131.stdout:394 2024-05-17T04:11:35.440 INFO:teuthology.orchestra.run.smithi131.stdout:394.out 2024-05-17T04:11:35.440 INFO:teuthology.orchestra.run.smithi131.stdout:395 2024-05-17T04:11:35.440 INFO:teuthology.orchestra.run.smithi131.stdout:395.out 2024-05-17T04:11:35.441 INFO:teuthology.orchestra.run.smithi131.stdout:396 2024-05-17T04:11:35.441 INFO:teuthology.orchestra.run.smithi131.stdout:396.out 2024-05-17T04:11:35.441 INFO:teuthology.orchestra.run.smithi131.stdout:397 2024-05-17T04:11:35.441 INFO:teuthology.orchestra.run.smithi131.stdout:397.out 2024-05-17T04:11:35.441 INFO:teuthology.orchestra.run.smithi131.stdout:398 2024-05-17T04:11:35.441 INFO:teuthology.orchestra.run.smithi131.stdout:398.out 2024-05-17T04:11:35.441 INFO:teuthology.orchestra.run.smithi131.stdout:399 2024-05-17T04:11:35.441 INFO:teuthology.orchestra.run.smithi131.stdout:399.out 2024-05-17T04:11:35.441 INFO:teuthology.orchestra.run.smithi131.stdout:400 2024-05-17T04:11:35.441 INFO:teuthology.orchestra.run.smithi131.stdout:400.out 2024-05-17T04:11:35.441 INFO:teuthology.orchestra.run.smithi131.stdout:401 2024-05-17T04:11:35.442 INFO:teuthology.orchestra.run.smithi131.stdout:401.out 2024-05-17T04:11:35.442 INFO:teuthology.orchestra.run.smithi131.stdout:402 2024-05-17T04:11:35.442 INFO:teuthology.orchestra.run.smithi131.stdout:402.out 2024-05-17T04:11:35.442 INFO:teuthology.orchestra.run.smithi131.stdout:403 2024-05-17T04:11:35.442 INFO:teuthology.orchestra.run.smithi131.stdout:403.out 2024-05-17T04:11:35.442 INFO:teuthology.orchestra.run.smithi131.stdout:404 2024-05-17T04:11:35.442 INFO:teuthology.orchestra.run.smithi131.stdout:404.out 2024-05-17T04:11:35.442 INFO:teuthology.orchestra.run.smithi131.stdout:405 2024-05-17T04:11:35.442 INFO:teuthology.orchestra.run.smithi131.stdout:405.out 2024-05-17T04:11:35.442 INFO:teuthology.orchestra.run.smithi131.stdout:406 2024-05-17T04:11:35.442 INFO:teuthology.orchestra.run.smithi131.stdout:406.out 2024-05-17T04:11:35.442 INFO:teuthology.orchestra.run.smithi131.stdout:407 2024-05-17T04:11:35.442 INFO:teuthology.orchestra.run.smithi131.stdout:407.out 2024-05-17T04:11:35.443 INFO:teuthology.orchestra.run.smithi131.stdout:408 2024-05-17T04:11:35.443 INFO:teuthology.orchestra.run.smithi131.stdout:408.out 2024-05-17T04:11:35.443 INFO:teuthology.orchestra.run.smithi131.stdout:409 2024-05-17T04:11:35.443 INFO:teuthology.orchestra.run.smithi131.stdout:409.out 2024-05-17T04:11:35.443 INFO:teuthology.orchestra.run.smithi131.stdout:410 2024-05-17T04:11:35.443 INFO:teuthology.orchestra.run.smithi131.stdout:410.out 2024-05-17T04:11:35.443 INFO:teuthology.orchestra.run.smithi131.stdout:411 2024-05-17T04:11:35.443 INFO:teuthology.orchestra.run.smithi131.stdout:411.out 2024-05-17T04:11:35.443 INFO:teuthology.orchestra.run.smithi131.stdout:412 2024-05-17T04:11:35.443 INFO:teuthology.orchestra.run.smithi131.stdout:412.out 2024-05-17T04:11:35.443 INFO:teuthology.orchestra.run.smithi131.stdout:413 2024-05-17T04:11:35.444 INFO:teuthology.orchestra.run.smithi131.stdout:413.out 2024-05-17T04:11:35.444 INFO:teuthology.orchestra.run.smithi131.stdout:414 2024-05-17T04:11:35.444 INFO:teuthology.orchestra.run.smithi131.stdout:414.out 2024-05-17T04:11:35.444 INFO:teuthology.orchestra.run.smithi131.stdout:415 2024-05-17T04:11:35.444 INFO:teuthology.orchestra.run.smithi131.stdout:415.out 2024-05-17T04:11:35.444 INFO:teuthology.orchestra.run.smithi131.stdout:416 2024-05-17T04:11:35.444 INFO:teuthology.orchestra.run.smithi131.stdout:416.out 2024-05-17T04:11:35.444 INFO:teuthology.orchestra.run.smithi131.stdout:417 2024-05-17T04:11:35.444 INFO:teuthology.orchestra.run.smithi131.stdout:417.out 2024-05-17T04:11:35.444 INFO:teuthology.orchestra.run.smithi131.stdout:418 2024-05-17T04:11:35.444 INFO:teuthology.orchestra.run.smithi131.stdout:418.out 2024-05-17T04:11:35.444 INFO:teuthology.orchestra.run.smithi131.stdout:419 2024-05-17T04:11:35.444 INFO:teuthology.orchestra.run.smithi131.stdout:419.out 2024-05-17T04:11:35.444 INFO:teuthology.orchestra.run.smithi131.stdout:420 2024-05-17T04:11:35.445 INFO:teuthology.orchestra.run.smithi131.stdout:420.out 2024-05-17T04:11:35.445 INFO:teuthology.orchestra.run.smithi131.stdout:421 2024-05-17T04:11:35.445 INFO:teuthology.orchestra.run.smithi131.stdout:421.out 2024-05-17T04:11:35.445 INFO:teuthology.orchestra.run.smithi131.stdout:422 2024-05-17T04:11:35.445 INFO:teuthology.orchestra.run.smithi131.stdout:422.out 2024-05-17T04:11:35.445 INFO:teuthology.orchestra.run.smithi131.stdout:423 2024-05-17T04:11:35.445 INFO:teuthology.orchestra.run.smithi131.stdout:423.out 2024-05-17T04:11:35.445 INFO:teuthology.orchestra.run.smithi131.stdout:424 2024-05-17T04:11:35.445 INFO:teuthology.orchestra.run.smithi131.stdout:424.out 2024-05-17T04:11:35.445 INFO:teuthology.orchestra.run.smithi131.stdout:425 2024-05-17T04:11:35.445 INFO:teuthology.orchestra.run.smithi131.stdout:425.out 2024-05-17T04:11:35.445 INFO:teuthology.orchestra.run.smithi131.stdout:426 2024-05-17T04:11:35.445 INFO:teuthology.orchestra.run.smithi131.stdout:426.out 2024-05-17T04:11:35.446 INFO:teuthology.orchestra.run.smithi131.stdout:427 2024-05-17T04:11:35.446 INFO:teuthology.orchestra.run.smithi131.stdout:427.out 2024-05-17T04:11:35.446 INFO:teuthology.orchestra.run.smithi131.stdout:428 2024-05-17T04:11:35.446 INFO:teuthology.orchestra.run.smithi131.stdout:428.out 2024-05-17T04:11:35.446 INFO:teuthology.orchestra.run.smithi131.stdout:429 2024-05-17T04:11:35.446 INFO:teuthology.orchestra.run.smithi131.stdout:429.out 2024-05-17T04:11:35.446 INFO:teuthology.orchestra.run.smithi131.stdout:430 2024-05-17T04:11:35.446 INFO:teuthology.orchestra.run.smithi131.stdout:430.out 2024-05-17T04:11:35.446 INFO:teuthology.orchestra.run.smithi131.stdout:431 2024-05-17T04:11:35.446 INFO:teuthology.orchestra.run.smithi131.stdout:431.out 2024-05-17T04:11:35.446 INFO:teuthology.orchestra.run.smithi131.stdout:432 2024-05-17T04:11:35.446 INFO:teuthology.orchestra.run.smithi131.stdout:432.out 2024-05-17T04:11:35.446 INFO:teuthology.orchestra.run.smithi131.stdout:433 2024-05-17T04:11:35.446 INFO:teuthology.orchestra.run.smithi131.stdout:433.out 2024-05-17T04:11:35.447 INFO:teuthology.orchestra.run.smithi131.stdout:434 2024-05-17T04:11:35.447 INFO:teuthology.orchestra.run.smithi131.stdout:434.out 2024-05-17T04:11:35.447 INFO:teuthology.orchestra.run.smithi131.stdout:435 2024-05-17T04:11:35.447 INFO:teuthology.orchestra.run.smithi131.stdout:435.out 2024-05-17T04:11:35.447 INFO:teuthology.orchestra.run.smithi131.stdout:436 2024-05-17T04:11:35.447 INFO:teuthology.orchestra.run.smithi131.stdout:436.out 2024-05-17T04:11:35.447 INFO:teuthology.orchestra.run.smithi131.stdout:437 2024-05-17T04:11:35.447 INFO:teuthology.orchestra.run.smithi131.stdout:437.out 2024-05-17T04:11:35.447 INFO:teuthology.orchestra.run.smithi131.stdout:438 2024-05-17T04:11:35.447 INFO:teuthology.orchestra.run.smithi131.stdout:438.out 2024-05-17T04:11:35.447 INFO:teuthology.orchestra.run.smithi131.stdout:439 2024-05-17T04:11:35.447 INFO:teuthology.orchestra.run.smithi131.stdout:439.out 2024-05-17T04:11:35.447 INFO:teuthology.orchestra.run.smithi131.stdout:440 2024-05-17T04:11:35.448 INFO:teuthology.orchestra.run.smithi131.stdout:440.out 2024-05-17T04:11:35.448 INFO:teuthology.orchestra.run.smithi131.stdout:441 2024-05-17T04:11:35.448 INFO:teuthology.orchestra.run.smithi131.stdout:441.out 2024-05-17T04:11:35.448 INFO:teuthology.orchestra.run.smithi131.stdout:442 2024-05-17T04:11:35.448 INFO:teuthology.orchestra.run.smithi131.stdout:442.out 2024-05-17T04:11:35.448 INFO:teuthology.orchestra.run.smithi131.stdout:443 2024-05-17T04:11:35.448 INFO:teuthology.orchestra.run.smithi131.stdout:443.out 2024-05-17T04:11:35.448 INFO:teuthology.orchestra.run.smithi131.stdout:444 2024-05-17T04:11:35.448 INFO:teuthology.orchestra.run.smithi131.stdout:444.out 2024-05-17T04:11:35.448 INFO:teuthology.orchestra.run.smithi131.stdout:445 2024-05-17T04:11:35.448 INFO:teuthology.orchestra.run.smithi131.stdout:445.out 2024-05-17T04:11:35.448 INFO:teuthology.orchestra.run.smithi131.stdout:446 2024-05-17T04:11:35.448 INFO:teuthology.orchestra.run.smithi131.stdout:446.out 2024-05-17T04:11:35.448 INFO:teuthology.orchestra.run.smithi131.stdout:447 2024-05-17T04:11:35.449 INFO:teuthology.orchestra.run.smithi131.stdout:447.out 2024-05-17T04:11:35.449 INFO:teuthology.orchestra.run.smithi131.stdout:448 2024-05-17T04:11:35.449 INFO:teuthology.orchestra.run.smithi131.stdout:448.out 2024-05-17T04:11:35.449 INFO:teuthology.orchestra.run.smithi131.stdout:449 2024-05-17T04:11:35.449 INFO:teuthology.orchestra.run.smithi131.stdout:449.out 2024-05-17T04:11:35.449 INFO:teuthology.orchestra.run.smithi131.stdout:450 2024-05-17T04:11:35.449 INFO:teuthology.orchestra.run.smithi131.stdout:450.out 2024-05-17T04:11:35.449 INFO:teuthology.orchestra.run.smithi131.stdout:451 2024-05-17T04:11:35.449 INFO:teuthology.orchestra.run.smithi131.stdout:451.out 2024-05-17T04:11:35.449 INFO:teuthology.orchestra.run.smithi131.stdout:452 2024-05-17T04:11:35.449 INFO:teuthology.orchestra.run.smithi131.stdout:452.out 2024-05-17T04:11:35.449 INFO:teuthology.orchestra.run.smithi131.stdout:453 2024-05-17T04:11:35.449 INFO:teuthology.orchestra.run.smithi131.stdout:453.out 2024-05-17T04:11:35.450 INFO:teuthology.orchestra.run.smithi131.stdout:454 2024-05-17T04:11:35.450 INFO:teuthology.orchestra.run.smithi131.stdout:454.out 2024-05-17T04:11:35.450 INFO:teuthology.orchestra.run.smithi131.stdout:455 2024-05-17T04:11:35.450 INFO:teuthology.orchestra.run.smithi131.stdout:455.out 2024-05-17T04:11:35.450 INFO:teuthology.orchestra.run.smithi131.stdout:456 2024-05-17T04:11:35.450 INFO:teuthology.orchestra.run.smithi131.stdout:456.out 2024-05-17T04:11:35.450 INFO:teuthology.orchestra.run.smithi131.stdout:457 2024-05-17T04:11:35.450 INFO:teuthology.orchestra.run.smithi131.stdout:457.out 2024-05-17T04:11:35.450 INFO:teuthology.orchestra.run.smithi131.stdout:458 2024-05-17T04:11:35.451 INFO:teuthology.orchestra.run.smithi131.stdout:458.out 2024-05-17T04:11:35.451 INFO:teuthology.orchestra.run.smithi131.stdout:459 2024-05-17T04:11:35.451 INFO:teuthology.orchestra.run.smithi131.stdout:459.out 2024-05-17T04:11:35.451 INFO:teuthology.orchestra.run.smithi131.stdout:460 2024-05-17T04:11:35.451 INFO:teuthology.orchestra.run.smithi131.stdout:460.out 2024-05-17T04:11:35.451 INFO:teuthology.orchestra.run.smithi131.stdout:461 2024-05-17T04:11:35.451 INFO:teuthology.orchestra.run.smithi131.stdout:461.out 2024-05-17T04:11:35.451 INFO:teuthology.orchestra.run.smithi131.stdout:462 2024-05-17T04:11:35.451 INFO:teuthology.orchestra.run.smithi131.stdout:462.out 2024-05-17T04:11:35.451 INFO:teuthology.orchestra.run.smithi131.stdout:463 2024-05-17T04:11:35.451 INFO:teuthology.orchestra.run.smithi131.stdout:463.out 2024-05-17T04:11:35.451 INFO:teuthology.orchestra.run.smithi131.stdout:464 2024-05-17T04:11:35.451 INFO:teuthology.orchestra.run.smithi131.stdout:464.out 2024-05-17T04:11:35.451 INFO:teuthology.orchestra.run.smithi131.stdout:465 2024-05-17T04:11:35.452 INFO:teuthology.orchestra.run.smithi131.stdout:465.out 2024-05-17T04:11:35.452 INFO:teuthology.orchestra.run.smithi131.stdout:466 2024-05-17T04:11:35.452 INFO:teuthology.orchestra.run.smithi131.stdout:466.out 2024-05-17T04:11:35.452 INFO:teuthology.orchestra.run.smithi131.stdout:467 2024-05-17T04:11:35.452 INFO:teuthology.orchestra.run.smithi131.stdout:467.out 2024-05-17T04:11:35.452 INFO:teuthology.orchestra.run.smithi131.stdout:468 2024-05-17T04:11:35.452 INFO:teuthology.orchestra.run.smithi131.stdout:468.out 2024-05-17T04:11:35.452 INFO:teuthology.orchestra.run.smithi131.stdout:469 2024-05-17T04:11:35.452 INFO:teuthology.orchestra.run.smithi131.stdout:469.out 2024-05-17T04:11:35.452 INFO:teuthology.orchestra.run.smithi131.stdout:470 2024-05-17T04:11:35.452 INFO:teuthology.orchestra.run.smithi131.stdout:470.out 2024-05-17T04:11:35.452 INFO:teuthology.orchestra.run.smithi131.stdout:471 2024-05-17T04:11:35.452 INFO:teuthology.orchestra.run.smithi131.stdout:471.out 2024-05-17T04:11:35.452 INFO:teuthology.orchestra.run.smithi131.stdout:472 2024-05-17T04:11:35.453 INFO:teuthology.orchestra.run.smithi131.stdout:472.out 2024-05-17T04:11:35.453 INFO:teuthology.orchestra.run.smithi131.stdout:473 2024-05-17T04:11:35.453 INFO:teuthology.orchestra.run.smithi131.stdout:473.out 2024-05-17T04:11:35.453 INFO:teuthology.orchestra.run.smithi131.stdout:474 2024-05-17T04:11:35.453 INFO:teuthology.orchestra.run.smithi131.stdout:474.out 2024-05-17T04:11:35.453 INFO:teuthology.orchestra.run.smithi131.stdout:475 2024-05-17T04:11:35.453 INFO:teuthology.orchestra.run.smithi131.stdout:475.out 2024-05-17T04:11:35.453 INFO:teuthology.orchestra.run.smithi131.stdout:476 2024-05-17T04:11:35.453 INFO:teuthology.orchestra.run.smithi131.stdout:476.out 2024-05-17T04:11:35.453 INFO:teuthology.orchestra.run.smithi131.stdout:477 2024-05-17T04:11:35.453 INFO:teuthology.orchestra.run.smithi131.stdout:477.out 2024-05-17T04:11:35.453 INFO:teuthology.orchestra.run.smithi131.stdout:478 2024-05-17T04:11:35.453 INFO:teuthology.orchestra.run.smithi131.stdout:478.out 2024-05-17T04:11:35.453 INFO:teuthology.orchestra.run.smithi131.stdout:479 2024-05-17T04:11:35.454 INFO:teuthology.orchestra.run.smithi131.stdout:479.out 2024-05-17T04:11:35.454 INFO:teuthology.orchestra.run.smithi131.stdout:480 2024-05-17T04:11:35.454 INFO:teuthology.orchestra.run.smithi131.stdout:480.out 2024-05-17T04:11:35.454 INFO:teuthology.orchestra.run.smithi131.stdout:481 2024-05-17T04:11:35.454 INFO:teuthology.orchestra.run.smithi131.stdout:481.out 2024-05-17T04:11:35.454 INFO:teuthology.orchestra.run.smithi131.stdout:482 2024-05-17T04:11:35.454 INFO:teuthology.orchestra.run.smithi131.stdout:482.out 2024-05-17T04:11:35.454 INFO:teuthology.orchestra.run.smithi131.stdout:483 2024-05-17T04:11:35.454 INFO:teuthology.orchestra.run.smithi131.stdout:483.out 2024-05-17T04:11:35.454 INFO:teuthology.orchestra.run.smithi131.stdout:484 2024-05-17T04:11:35.454 INFO:teuthology.orchestra.run.smithi131.stdout:484.out 2024-05-17T04:11:35.454 INFO:teuthology.orchestra.run.smithi131.stdout:485 2024-05-17T04:11:35.454 INFO:teuthology.orchestra.run.smithi131.stdout:485.out 2024-05-17T04:11:35.455 INFO:teuthology.orchestra.run.smithi131.stdout:486 2024-05-17T04:11:35.455 INFO:teuthology.orchestra.run.smithi131.stdout:486.out 2024-05-17T04:11:35.455 INFO:teuthology.orchestra.run.smithi131.stdout:487 2024-05-17T04:11:35.455 INFO:teuthology.orchestra.run.smithi131.stdout:487.out 2024-05-17T04:11:35.455 INFO:teuthology.orchestra.run.smithi131.stdout:488 2024-05-17T04:11:35.455 INFO:teuthology.orchestra.run.smithi131.stdout:488.out 2024-05-17T04:11:35.455 INFO:teuthology.orchestra.run.smithi131.stdout:489 2024-05-17T04:11:35.455 INFO:teuthology.orchestra.run.smithi131.stdout:489.out 2024-05-17T04:11:35.455 INFO:teuthology.orchestra.run.smithi131.stdout:490 2024-05-17T04:11:35.455 INFO:teuthology.orchestra.run.smithi131.stdout:490.out 2024-05-17T04:11:35.456 INFO:teuthology.orchestra.run.smithi131.stdout:491 2024-05-17T04:11:35.456 INFO:teuthology.orchestra.run.smithi131.stdout:491.out 2024-05-17T04:11:35.456 INFO:teuthology.orchestra.run.smithi131.stdout:492 2024-05-17T04:11:35.456 INFO:teuthology.orchestra.run.smithi131.stdout:492.out 2024-05-17T04:11:35.456 INFO:teuthology.orchestra.run.smithi131.stdout:493 2024-05-17T04:11:35.456 INFO:teuthology.orchestra.run.smithi131.stdout:493.out 2024-05-17T04:11:35.456 INFO:teuthology.orchestra.run.smithi131.stdout:494 2024-05-17T04:11:35.456 INFO:teuthology.orchestra.run.smithi131.stdout:494.out 2024-05-17T04:11:35.456 INFO:teuthology.orchestra.run.smithi131.stdout:495 2024-05-17T04:11:35.456 INFO:teuthology.orchestra.run.smithi131.stdout:495.out 2024-05-17T04:11:35.456 INFO:teuthology.orchestra.run.smithi131.stdout:496 2024-05-17T04:11:35.456 INFO:teuthology.orchestra.run.smithi131.stdout:496.out 2024-05-17T04:11:35.456 INFO:teuthology.orchestra.run.smithi131.stdout:497 2024-05-17T04:11:35.457 INFO:teuthology.orchestra.run.smithi131.stdout:497.out 2024-05-17T04:11:35.457 INFO:teuthology.orchestra.run.smithi131.stdout:498 2024-05-17T04:11:35.457 INFO:teuthology.orchestra.run.smithi131.stdout:498.out 2024-05-17T04:11:35.457 INFO:teuthology.orchestra.run.smithi131.stdout:499 2024-05-17T04:11:35.457 INFO:teuthology.orchestra.run.smithi131.stdout:499.out 2024-05-17T04:11:35.457 INFO:teuthology.orchestra.run.smithi131.stdout:500 2024-05-17T04:11:35.457 INFO:teuthology.orchestra.run.smithi131.stdout:500.out 2024-05-17T04:11:35.457 INFO:teuthology.orchestra.run.smithi131.stdout:501 2024-05-17T04:11:35.457 INFO:teuthology.orchestra.run.smithi131.stdout:501.out 2024-05-17T04:11:35.457 INFO:teuthology.orchestra.run.smithi131.stdout:502 2024-05-17T04:11:35.457 INFO:teuthology.orchestra.run.smithi131.stdout:502.out 2024-05-17T04:11:35.457 INFO:teuthology.orchestra.run.smithi131.stdout:503 2024-05-17T04:11:35.457 INFO:teuthology.orchestra.run.smithi131.stdout:503.out 2024-05-17T04:11:35.457 INFO:teuthology.orchestra.run.smithi131.stdout:504 2024-05-17T04:11:35.458 INFO:teuthology.orchestra.run.smithi131.stdout:504.out 2024-05-17T04:11:35.458 INFO:teuthology.orchestra.run.smithi131.stdout:505 2024-05-17T04:11:35.458 INFO:teuthology.orchestra.run.smithi131.stdout:505.out 2024-05-17T04:11:35.458 INFO:teuthology.orchestra.run.smithi131.stdout:506 2024-05-17T04:11:35.458 INFO:teuthology.orchestra.run.smithi131.stdout:506.out 2024-05-17T04:11:35.458 INFO:teuthology.orchestra.run.smithi131.stdout:507 2024-05-17T04:11:35.458 INFO:teuthology.orchestra.run.smithi131.stdout:507.out 2024-05-17T04:11:35.458 INFO:teuthology.orchestra.run.smithi131.stdout:508 2024-05-17T04:11:35.458 INFO:teuthology.orchestra.run.smithi131.stdout:508.out 2024-05-17T04:11:35.458 INFO:teuthology.orchestra.run.smithi131.stdout:509 2024-05-17T04:11:35.458 INFO:teuthology.orchestra.run.smithi131.stdout:509.out 2024-05-17T04:11:35.458 INFO:teuthology.orchestra.run.smithi131.stdout:510 2024-05-17T04:11:35.458 INFO:teuthology.orchestra.run.smithi131.stdout:510.out 2024-05-17T04:11:35.459 INFO:teuthology.orchestra.run.smithi131.stdout:511 2024-05-17T04:11:35.459 INFO:teuthology.orchestra.run.smithi131.stdout:511.out 2024-05-17T04:11:35.459 INFO:teuthology.orchestra.run.smithi131.stdout:512 2024-05-17T04:11:35.459 INFO:teuthology.orchestra.run.smithi131.stdout:512.out 2024-05-17T04:11:35.459 INFO:teuthology.orchestra.run.smithi131.stdout:513 2024-05-17T04:11:35.459 INFO:teuthology.orchestra.run.smithi131.stdout:513.out 2024-05-17T04:11:35.459 INFO:teuthology.orchestra.run.smithi131.stdout:514 2024-05-17T04:11:35.459 INFO:teuthology.orchestra.run.smithi131.stdout:514.out 2024-05-17T04:11:35.459 INFO:teuthology.orchestra.run.smithi131.stdout:515 2024-05-17T04:11:35.459 INFO:teuthology.orchestra.run.smithi131.stdout:515.out 2024-05-17T04:11:35.459 INFO:teuthology.orchestra.run.smithi131.stdout:516 2024-05-17T04:11:35.459 INFO:teuthology.orchestra.run.smithi131.stdout:516.out 2024-05-17T04:11:35.460 INFO:teuthology.orchestra.run.smithi131.stdout:517 2024-05-17T04:11:35.460 INFO:teuthology.orchestra.run.smithi131.stdout:517.out 2024-05-17T04:11:35.460 INFO:teuthology.orchestra.run.smithi131.stdout:518 2024-05-17T04:11:35.460 INFO:teuthology.orchestra.run.smithi131.stdout:518.out 2024-05-17T04:11:35.460 INFO:teuthology.orchestra.run.smithi131.stdout:519 2024-05-17T04:11:35.460 INFO:teuthology.orchestra.run.smithi131.stdout:519.out 2024-05-17T04:11:35.461 INFO:teuthology.orchestra.run.smithi131.stdout:520 2024-05-17T04:11:35.461 INFO:teuthology.orchestra.run.smithi131.stdout:520.out 2024-05-17T04:11:35.461 INFO:teuthology.orchestra.run.smithi131.stdout:521 2024-05-17T04:11:35.461 INFO:teuthology.orchestra.run.smithi131.stdout:521.out 2024-05-17T04:11:35.461 INFO:teuthology.orchestra.run.smithi131.stdout:522 2024-05-17T04:11:35.461 INFO:teuthology.orchestra.run.smithi131.stdout:522.out 2024-05-17T04:11:35.462 INFO:teuthology.orchestra.run.smithi131.stdout:523 2024-05-17T04:11:35.462 INFO:teuthology.orchestra.run.smithi131.stdout:523.out 2024-05-17T04:11:35.462 INFO:teuthology.orchestra.run.smithi131.stdout:524 2024-05-17T04:11:35.462 INFO:teuthology.orchestra.run.smithi131.stdout:524.out 2024-05-17T04:11:35.462 INFO:teuthology.orchestra.run.smithi131.stdout:525 2024-05-17T04:11:35.462 INFO:teuthology.orchestra.run.smithi131.stdout:525.out 2024-05-17T04:11:35.462 INFO:teuthology.orchestra.run.smithi131.stdout:526 2024-05-17T04:11:35.462 INFO:teuthology.orchestra.run.smithi131.stdout:526.out 2024-05-17T04:11:35.462 INFO:teuthology.orchestra.run.smithi131.stdout:527 2024-05-17T04:11:35.462 INFO:teuthology.orchestra.run.smithi131.stdout:527.out 2024-05-17T04:11:35.462 INFO:teuthology.orchestra.run.smithi131.stdout:528 2024-05-17T04:11:35.462 INFO:teuthology.orchestra.run.smithi131.stdout:528.out 2024-05-17T04:11:35.463 INFO:teuthology.orchestra.run.smithi131.stdout:529 2024-05-17T04:11:35.463 INFO:teuthology.orchestra.run.smithi131.stdout:529.out 2024-05-17T04:11:35.463 INFO:teuthology.orchestra.run.smithi131.stdout:530 2024-05-17T04:11:35.463 INFO:teuthology.orchestra.run.smithi131.stdout:530.out 2024-05-17T04:11:35.463 INFO:teuthology.orchestra.run.smithi131.stdout:531 2024-05-17T04:11:35.463 INFO:teuthology.orchestra.run.smithi131.stdout:531.out 2024-05-17T04:11:35.463 INFO:teuthology.orchestra.run.smithi131.stdout:532 2024-05-17T04:11:35.463 INFO:teuthology.orchestra.run.smithi131.stdout:532.out 2024-05-17T04:11:35.463 INFO:teuthology.orchestra.run.smithi131.stdout:533 2024-05-17T04:11:35.463 INFO:teuthology.orchestra.run.smithi131.stdout:533.out 2024-05-17T04:11:35.463 INFO:teuthology.orchestra.run.smithi131.stdout:534 2024-05-17T04:11:35.463 INFO:teuthology.orchestra.run.smithi131.stdout:534.out 2024-05-17T04:11:35.463 INFO:teuthology.orchestra.run.smithi131.stdout:535 2024-05-17T04:11:35.464 INFO:teuthology.orchestra.run.smithi131.stdout:535.out 2024-05-17T04:11:35.464 INFO:teuthology.orchestra.run.smithi131.stdout:536 2024-05-17T04:11:35.464 INFO:teuthology.orchestra.run.smithi131.stdout:536.out 2024-05-17T04:11:35.464 INFO:teuthology.orchestra.run.smithi131.stdout:537 2024-05-17T04:11:35.464 INFO:teuthology.orchestra.run.smithi131.stdout:537.out 2024-05-17T04:11:35.464 INFO:teuthology.orchestra.run.smithi131.stdout:538 2024-05-17T04:11:35.464 INFO:teuthology.orchestra.run.smithi131.stdout:538.out 2024-05-17T04:11:35.464 INFO:teuthology.orchestra.run.smithi131.stdout:539 2024-05-17T04:11:35.464 INFO:teuthology.orchestra.run.smithi131.stdout:539.out 2024-05-17T04:11:35.464 INFO:teuthology.orchestra.run.smithi131.stdout:540 2024-05-17T04:11:35.464 INFO:teuthology.orchestra.run.smithi131.stdout:540.out 2024-05-17T04:11:35.464 INFO:teuthology.orchestra.run.smithi131.stdout:541 2024-05-17T04:11:35.464 INFO:teuthology.orchestra.run.smithi131.stdout:541.out 2024-05-17T04:11:35.465 INFO:teuthology.orchestra.run.smithi131.stdout:542 2024-05-17T04:11:35.465 INFO:teuthology.orchestra.run.smithi131.stdout:542.out 2024-05-17T04:11:35.465 INFO:teuthology.orchestra.run.smithi131.stdout:543 2024-05-17T04:11:35.465 INFO:teuthology.orchestra.run.smithi131.stdout:543.out 2024-05-17T04:11:35.465 INFO:teuthology.orchestra.run.smithi131.stdout:544 2024-05-17T04:11:35.465 INFO:teuthology.orchestra.run.smithi131.stdout:544.out 2024-05-17T04:11:35.465 INFO:teuthology.orchestra.run.smithi131.stdout:545 2024-05-17T04:11:35.465 INFO:teuthology.orchestra.run.smithi131.stdout:545.out 2024-05-17T04:11:35.465 INFO:teuthology.orchestra.run.smithi131.stdout:546 2024-05-17T04:11:35.465 INFO:teuthology.orchestra.run.smithi131.stdout:546.out 2024-05-17T04:11:35.465 INFO:teuthology.orchestra.run.smithi131.stdout:547 2024-05-17T04:11:35.465 INFO:teuthology.orchestra.run.smithi131.stdout:547.out 2024-05-17T04:11:35.465 INFO:teuthology.orchestra.run.smithi131.stdout:548 2024-05-17T04:11:35.465 INFO:teuthology.orchestra.run.smithi131.stdout:548.out 2024-05-17T04:11:35.466 INFO:teuthology.orchestra.run.smithi131.stdout:549 2024-05-17T04:11:35.466 INFO:teuthology.orchestra.run.smithi131.stdout:549.out 2024-05-17T04:11:35.466 INFO:teuthology.orchestra.run.smithi131.stdout:550 2024-05-17T04:11:35.466 INFO:teuthology.orchestra.run.smithi131.stdout:550.out 2024-05-17T04:11:35.466 INFO:teuthology.orchestra.run.smithi131.stdout:551 2024-05-17T04:11:35.466 INFO:teuthology.orchestra.run.smithi131.stdout:551.out 2024-05-17T04:11:35.466 INFO:teuthology.orchestra.run.smithi131.stdout:552 2024-05-17T04:11:35.466 INFO:teuthology.orchestra.run.smithi131.stdout:552.out 2024-05-17T04:11:35.466 INFO:teuthology.orchestra.run.smithi131.stdout:553 2024-05-17T04:11:35.467 INFO:teuthology.orchestra.run.smithi131.stdout:553.out 2024-05-17T04:11:35.467 INFO:teuthology.orchestra.run.smithi131.stdout:554 2024-05-17T04:11:35.467 INFO:teuthology.orchestra.run.smithi131.stdout:554.out 2024-05-17T04:11:35.467 INFO:teuthology.orchestra.run.smithi131.stdout:555 2024-05-17T04:11:35.467 INFO:teuthology.orchestra.run.smithi131.stdout:555.out 2024-05-17T04:11:35.467 INFO:teuthology.orchestra.run.smithi131.stdout:556 2024-05-17T04:11:35.467 INFO:teuthology.orchestra.run.smithi131.stdout:556.out 2024-05-17T04:11:35.467 INFO:teuthology.orchestra.run.smithi131.stdout:557 2024-05-17T04:11:35.467 INFO:teuthology.orchestra.run.smithi131.stdout:557.out 2024-05-17T04:11:35.467 INFO:teuthology.orchestra.run.smithi131.stdout:558 2024-05-17T04:11:35.467 INFO:teuthology.orchestra.run.smithi131.stdout:558.out 2024-05-17T04:11:35.467 INFO:teuthology.orchestra.run.smithi131.stdout:559 2024-05-17T04:11:35.467 INFO:teuthology.orchestra.run.smithi131.stdout:559.out 2024-05-17T04:11:35.468 INFO:teuthology.orchestra.run.smithi131.stdout:560 2024-05-17T04:11:35.468 INFO:teuthology.orchestra.run.smithi131.stdout:560.out 2024-05-17T04:11:35.468 INFO:teuthology.orchestra.run.smithi131.stdout:561 2024-05-17T04:11:35.468 INFO:teuthology.orchestra.run.smithi131.stdout:561.out 2024-05-17T04:11:35.468 INFO:teuthology.orchestra.run.smithi131.stdout:562 2024-05-17T04:11:35.468 INFO:teuthology.orchestra.run.smithi131.stdout:562.out 2024-05-17T04:11:35.468 INFO:teuthology.orchestra.run.smithi131.stdout:563 2024-05-17T04:11:35.468 INFO:teuthology.orchestra.run.smithi131.stdout:563.out 2024-05-17T04:11:35.468 INFO:teuthology.orchestra.run.smithi131.stdout:564 2024-05-17T04:11:35.468 INFO:teuthology.orchestra.run.smithi131.stdout:564.out 2024-05-17T04:11:35.468 INFO:teuthology.orchestra.run.smithi131.stdout:565 2024-05-17T04:11:35.468 INFO:teuthology.orchestra.run.smithi131.stdout:565.out 2024-05-17T04:11:35.469 INFO:teuthology.orchestra.run.smithi131.stdout:566 2024-05-17T04:11:35.469 INFO:teuthology.orchestra.run.smithi131.stdout:566.out 2024-05-17T04:11:35.469 INFO:teuthology.orchestra.run.smithi131.stdout:567 2024-05-17T04:11:35.469 INFO:teuthology.orchestra.run.smithi131.stdout:567.out 2024-05-17T04:11:35.469 INFO:teuthology.orchestra.run.smithi131.stdout:568 2024-05-17T04:11:35.469 INFO:teuthology.orchestra.run.smithi131.stdout:568.out 2024-05-17T04:11:35.469 INFO:teuthology.orchestra.run.smithi131.stdout:569 2024-05-17T04:11:35.469 INFO:teuthology.orchestra.run.smithi131.stdout:569.out 2024-05-17T04:11:35.469 INFO:teuthology.orchestra.run.smithi131.stdout:570 2024-05-17T04:11:35.469 INFO:teuthology.orchestra.run.smithi131.stdout:570.out 2024-05-17T04:11:35.469 INFO:teuthology.orchestra.run.smithi131.stdout:571 2024-05-17T04:11:35.469 INFO:teuthology.orchestra.run.smithi131.stdout:571.out 2024-05-17T04:11:35.469 INFO:teuthology.orchestra.run.smithi131.stdout:572 2024-05-17T04:11:35.469 INFO:teuthology.orchestra.run.smithi131.stdout:572.out 2024-05-17T04:11:35.470 INFO:teuthology.orchestra.run.smithi131.stdout:573 2024-05-17T04:11:35.470 INFO:teuthology.orchestra.run.smithi131.stdout:573.out 2024-05-17T04:11:35.470 INFO:teuthology.orchestra.run.smithi131.stdout:574 2024-05-17T04:11:35.470 INFO:teuthology.orchestra.run.smithi131.stdout:574.out 2024-05-17T04:11:35.470 INFO:teuthology.orchestra.run.smithi131.stdout:575 2024-05-17T04:11:35.470 INFO:teuthology.orchestra.run.smithi131.stdout:575.out 2024-05-17T04:11:35.470 INFO:teuthology.orchestra.run.smithi131.stdout:576 2024-05-17T04:11:35.470 INFO:teuthology.orchestra.run.smithi131.stdout:576.out 2024-05-17T04:11:35.470 INFO:teuthology.orchestra.run.smithi131.stdout:577 2024-05-17T04:11:35.470 INFO:teuthology.orchestra.run.smithi131.stdout:577.out 2024-05-17T04:11:35.470 INFO:teuthology.orchestra.run.smithi131.stdout:578 2024-05-17T04:11:35.470 INFO:teuthology.orchestra.run.smithi131.stdout:578.out 2024-05-17T04:11:35.471 INFO:teuthology.orchestra.run.smithi131.stdout:579 2024-05-17T04:11:35.471 INFO:teuthology.orchestra.run.smithi131.stdout:579.out 2024-05-17T04:11:35.471 INFO:teuthology.orchestra.run.smithi131.stdout:580 2024-05-17T04:11:35.471 INFO:teuthology.orchestra.run.smithi131.stdout:580.out 2024-05-17T04:11:35.471 INFO:teuthology.orchestra.run.smithi131.stdout:581 2024-05-17T04:11:35.471 INFO:teuthology.orchestra.run.smithi131.stdout:581.out 2024-05-17T04:11:35.471 INFO:teuthology.orchestra.run.smithi131.stdout:582 2024-05-17T04:11:35.471 INFO:teuthology.orchestra.run.smithi131.stdout:582.out 2024-05-17T04:11:35.472 INFO:teuthology.orchestra.run.smithi131.stdout:583 2024-05-17T04:11:35.472 INFO:teuthology.orchestra.run.smithi131.stdout:583.out 2024-05-17T04:11:35.472 INFO:teuthology.orchestra.run.smithi131.stdout:584 2024-05-17T04:11:35.472 INFO:teuthology.orchestra.run.smithi131.stdout:584.out 2024-05-17T04:11:35.472 INFO:teuthology.orchestra.run.smithi131.stdout:585 2024-05-17T04:11:35.472 INFO:teuthology.orchestra.run.smithi131.stdout:585.out 2024-05-17T04:11:35.472 INFO:teuthology.orchestra.run.smithi131.stdout:586 2024-05-17T04:11:35.472 INFO:teuthology.orchestra.run.smithi131.stdout:586.out 2024-05-17T04:11:35.472 INFO:teuthology.orchestra.run.smithi131.stdout:587 2024-05-17T04:11:35.472 INFO:teuthology.orchestra.run.smithi131.stdout:587.out 2024-05-17T04:11:35.472 INFO:teuthology.orchestra.run.smithi131.stdout:588 2024-05-17T04:11:35.473 INFO:teuthology.orchestra.run.smithi131.stdout:588.out 2024-05-17T04:11:35.473 INFO:teuthology.orchestra.run.smithi131.stdout:589 2024-05-17T04:11:35.473 INFO:teuthology.orchestra.run.smithi131.stdout:589.out 2024-05-17T04:11:35.473 INFO:teuthology.orchestra.run.smithi131.stdout:590 2024-05-17T04:11:35.473 INFO:teuthology.orchestra.run.smithi131.stdout:590.out 2024-05-17T04:11:35.473 INFO:teuthology.orchestra.run.smithi131.stdout:591 2024-05-17T04:11:35.473 INFO:teuthology.orchestra.run.smithi131.stdout:591.out 2024-05-17T04:11:35.474 INFO:teuthology.orchestra.run.smithi131.stdout:592 2024-05-17T04:11:35.474 INFO:teuthology.orchestra.run.smithi131.stdout:592.out 2024-05-17T04:11:35.474 INFO:teuthology.orchestra.run.smithi131.stdout:593 2024-05-17T04:11:35.474 INFO:teuthology.orchestra.run.smithi131.stdout:593.out 2024-05-17T04:11:35.474 INFO:teuthology.orchestra.run.smithi131.stdout:594 2024-05-17T04:11:35.475 INFO:teuthology.orchestra.run.smithi131.stdout:594.out 2024-05-17T04:11:35.475 INFO:teuthology.orchestra.run.smithi131.stdout:595 2024-05-17T04:11:35.475 INFO:teuthology.orchestra.run.smithi131.stdout:595.out 2024-05-17T04:11:35.475 INFO:teuthology.orchestra.run.smithi131.stdout:596 2024-05-17T04:11:35.475 INFO:teuthology.orchestra.run.smithi131.stdout:596.out 2024-05-17T04:11:35.475 INFO:teuthology.orchestra.run.smithi131.stdout:597 2024-05-17T04:11:35.475 INFO:teuthology.orchestra.run.smithi131.stdout:597.out 2024-05-17T04:11:35.475 INFO:teuthology.orchestra.run.smithi131.stdout:598 2024-05-17T04:11:35.475 INFO:teuthology.orchestra.run.smithi131.stdout:598.out 2024-05-17T04:11:35.475 INFO:teuthology.orchestra.run.smithi131.stdout:599 2024-05-17T04:11:35.475 INFO:teuthology.orchestra.run.smithi131.stdout:599.out 2024-05-17T04:11:35.475 INFO:teuthology.orchestra.run.smithi131.stdout:600 2024-05-17T04:11:35.475 INFO:teuthology.orchestra.run.smithi131.stdout:600.out 2024-05-17T04:11:35.476 INFO:teuthology.orchestra.run.smithi131.stdout:601 2024-05-17T04:11:35.476 INFO:teuthology.orchestra.run.smithi131.stdout:601.out 2024-05-17T04:11:35.476 INFO:teuthology.orchestra.run.smithi131.stdout:602 2024-05-17T04:11:35.476 INFO:teuthology.orchestra.run.smithi131.stdout:602.out 2024-05-17T04:11:35.476 INFO:teuthology.orchestra.run.smithi131.stdout:603 2024-05-17T04:11:35.476 INFO:teuthology.orchestra.run.smithi131.stdout:603.out 2024-05-17T04:11:35.476 INFO:teuthology.orchestra.run.smithi131.stdout:604 2024-05-17T04:11:35.476 INFO:teuthology.orchestra.run.smithi131.stdout:604.out 2024-05-17T04:11:35.476 INFO:teuthology.orchestra.run.smithi131.stdout:605 2024-05-17T04:11:35.476 INFO:teuthology.orchestra.run.smithi131.stdout:605.out 2024-05-17T04:11:35.476 INFO:teuthology.orchestra.run.smithi131.stdout:606 2024-05-17T04:11:35.476 INFO:teuthology.orchestra.run.smithi131.stdout:606.out 2024-05-17T04:11:35.476 INFO:teuthology.orchestra.run.smithi131.stdout:607 2024-05-17T04:11:35.477 INFO:teuthology.orchestra.run.smithi131.stdout:607.out 2024-05-17T04:11:35.477 INFO:teuthology.orchestra.run.smithi131.stdout:608 2024-05-17T04:11:35.477 INFO:teuthology.orchestra.run.smithi131.stdout:608.out 2024-05-17T04:11:35.477 INFO:teuthology.orchestra.run.smithi131.stdout:609 2024-05-17T04:11:35.477 INFO:teuthology.orchestra.run.smithi131.stdout:609.out 2024-05-17T04:11:35.477 INFO:teuthology.orchestra.run.smithi131.stdout:610 2024-05-17T04:11:35.477 INFO:teuthology.orchestra.run.smithi131.stdout:610.out 2024-05-17T04:11:35.477 INFO:teuthology.orchestra.run.smithi131.stdout:611 2024-05-17T04:11:35.477 INFO:teuthology.orchestra.run.smithi131.stdout:611.out 2024-05-17T04:11:35.477 INFO:teuthology.orchestra.run.smithi131.stdout:612 2024-05-17T04:11:35.477 INFO:teuthology.orchestra.run.smithi131.stdout:612.out 2024-05-17T04:11:35.477 INFO:teuthology.orchestra.run.smithi131.stdout:613 2024-05-17T04:11:35.477 INFO:teuthology.orchestra.run.smithi131.stdout:613.out 2024-05-17T04:11:35.477 INFO:teuthology.orchestra.run.smithi131.stdout:614 2024-05-17T04:11:35.478 INFO:teuthology.orchestra.run.smithi131.stdout:614.out 2024-05-17T04:11:35.478 INFO:teuthology.orchestra.run.smithi131.stdout:615 2024-05-17T04:11:35.478 INFO:teuthology.orchestra.run.smithi131.stdout:615.out 2024-05-17T04:11:35.478 INFO:teuthology.orchestra.run.smithi131.stdout:616 2024-05-17T04:11:35.478 INFO:teuthology.orchestra.run.smithi131.stdout:616.out 2024-05-17T04:11:35.478 INFO:teuthology.orchestra.run.smithi131.stdout:617 2024-05-17T04:11:35.478 INFO:teuthology.orchestra.run.smithi131.stdout:617.out 2024-05-17T04:11:35.478 INFO:teuthology.orchestra.run.smithi131.stdout:618 2024-05-17T04:11:35.478 INFO:teuthology.orchestra.run.smithi131.stdout:618.out 2024-05-17T04:11:35.478 INFO:teuthology.orchestra.run.smithi131.stdout:619 2024-05-17T04:11:35.478 INFO:teuthology.orchestra.run.smithi131.stdout:619.out 2024-05-17T04:11:35.478 INFO:teuthology.orchestra.run.smithi131.stdout:620 2024-05-17T04:11:35.479 INFO:teuthology.orchestra.run.smithi131.stdout:620.out 2024-05-17T04:11:35.479 INFO:teuthology.orchestra.run.smithi131.stdout:621 2024-05-17T04:11:35.479 INFO:teuthology.orchestra.run.smithi131.stdout:621.out 2024-05-17T04:11:35.479 INFO:teuthology.orchestra.run.smithi131.stdout:622 2024-05-17T04:11:35.479 INFO:teuthology.orchestra.run.smithi131.stdout:622.out 2024-05-17T04:11:35.480 INFO:teuthology.orchestra.run.smithi131.stdout:623 2024-05-17T04:11:35.480 INFO:teuthology.orchestra.run.smithi131.stdout:623.out 2024-05-17T04:11:35.480 INFO:teuthology.orchestra.run.smithi131.stdout:624 2024-05-17T04:11:35.480 INFO:teuthology.orchestra.run.smithi131.stdout:624.out 2024-05-17T04:11:35.480 INFO:teuthology.orchestra.run.smithi131.stdout:625 2024-05-17T04:11:35.480 INFO:teuthology.orchestra.run.smithi131.stdout:625.out 2024-05-17T04:11:35.481 INFO:teuthology.orchestra.run.smithi131.stdout:626 2024-05-17T04:11:35.481 INFO:teuthology.orchestra.run.smithi131.stdout:626.out 2024-05-17T04:11:35.481 INFO:teuthology.orchestra.run.smithi131.stdout:627 2024-05-17T04:11:35.481 INFO:teuthology.orchestra.run.smithi131.stdout:627.out 2024-05-17T04:11:35.481 INFO:teuthology.orchestra.run.smithi131.stdout:628 2024-05-17T04:11:35.481 INFO:teuthology.orchestra.run.smithi131.stdout:628.out 2024-05-17T04:11:35.481 INFO:teuthology.orchestra.run.smithi131.stdout:629 2024-05-17T04:11:35.481 INFO:teuthology.orchestra.run.smithi131.stdout:629.out 2024-05-17T04:11:35.481 INFO:teuthology.orchestra.run.smithi131.stdout:630 2024-05-17T04:11:35.481 INFO:teuthology.orchestra.run.smithi131.stdout:630.out 2024-05-17T04:11:35.481 INFO:teuthology.orchestra.run.smithi131.stdout:631 2024-05-17T04:11:35.481 INFO:teuthology.orchestra.run.smithi131.stdout:631.out 2024-05-17T04:11:35.482 INFO:teuthology.orchestra.run.smithi131.stdout:632 2024-05-17T04:11:35.482 INFO:teuthology.orchestra.run.smithi131.stdout:632.out 2024-05-17T04:11:35.482 INFO:teuthology.orchestra.run.smithi131.stdout:633 2024-05-17T04:11:35.482 INFO:teuthology.orchestra.run.smithi131.stdout:633.out 2024-05-17T04:11:35.482 INFO:teuthology.orchestra.run.smithi131.stdout:634 2024-05-17T04:11:35.482 INFO:teuthology.orchestra.run.smithi131.stdout:634.out 2024-05-17T04:11:35.482 INFO:teuthology.orchestra.run.smithi131.stdout:635 2024-05-17T04:11:35.482 INFO:teuthology.orchestra.run.smithi131.stdout:635.out 2024-05-17T04:11:35.483 INFO:teuthology.orchestra.run.smithi131.stdout:636 2024-05-17T04:11:35.483 INFO:teuthology.orchestra.run.smithi131.stdout:636.out 2024-05-17T04:11:35.483 INFO:teuthology.orchestra.run.smithi131.stdout:637 2024-05-17T04:11:35.483 INFO:teuthology.orchestra.run.smithi131.stdout:637.out 2024-05-17T04:11:35.483 INFO:teuthology.orchestra.run.smithi131.stdout:638 2024-05-17T04:11:35.483 INFO:teuthology.orchestra.run.smithi131.stdout:638.out 2024-05-17T04:11:35.483 INFO:teuthology.orchestra.run.smithi131.stdout:639 2024-05-17T04:11:35.483 INFO:teuthology.orchestra.run.smithi131.stdout:639.out 2024-05-17T04:11:35.483 INFO:teuthology.orchestra.run.smithi131.stdout:640 2024-05-17T04:11:35.483 INFO:teuthology.orchestra.run.smithi131.stdout:640.out 2024-05-17T04:11:35.483 INFO:teuthology.orchestra.run.smithi131.stdout:641 2024-05-17T04:11:35.483 INFO:teuthology.orchestra.run.smithi131.stdout:641.out 2024-05-17T04:11:35.483 INFO:teuthology.orchestra.run.smithi131.stdout:642 2024-05-17T04:11:35.483 INFO:teuthology.orchestra.run.smithi131.stdout:642.out 2024-05-17T04:11:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:643 2024-05-17T04:11:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:643.out 2024-05-17T04:11:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:644 2024-05-17T04:11:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:644.out 2024-05-17T04:11:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:645 2024-05-17T04:11:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:645.out 2024-05-17T04:11:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:646 2024-05-17T04:11:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:646.out 2024-05-17T04:11:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:647 2024-05-17T04:11:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:647.out 2024-05-17T04:11:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:648 2024-05-17T04:11:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:648.out 2024-05-17T04:11:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:649 2024-05-17T04:11:35.485 INFO:teuthology.orchestra.run.smithi131.stdout:649.out 2024-05-17T04:11:35.485 INFO:teuthology.orchestra.run.smithi131.stdout:650 2024-05-17T04:11:35.485 INFO:teuthology.orchestra.run.smithi131.stdout:650.out 2024-05-17T04:11:35.485 INFO:teuthology.orchestra.run.smithi131.stdout:651 2024-05-17T04:11:35.485 INFO:teuthology.orchestra.run.smithi131.stdout:651.out 2024-05-17T04:11:35.485 INFO:teuthology.orchestra.run.smithi131.stdout:652 2024-05-17T04:11:35.485 INFO:teuthology.orchestra.run.smithi131.stdout:652.out 2024-05-17T04:11:35.485 INFO:teuthology.orchestra.run.smithi131.stdout:653 2024-05-17T04:11:35.485 INFO:teuthology.orchestra.run.smithi131.stdout:653.out 2024-05-17T04:11:35.485 INFO:teuthology.orchestra.run.smithi131.stdout:654 2024-05-17T04:11:35.485 INFO:teuthology.orchestra.run.smithi131.stdout:654.out 2024-05-17T04:11:35.485 INFO:teuthology.orchestra.run.smithi131.stdout:655 2024-05-17T04:11:35.486 INFO:teuthology.orchestra.run.smithi131.stdout:655.out 2024-05-17T04:11:35.486 INFO:teuthology.orchestra.run.smithi131.stdout:656 2024-05-17T04:11:35.486 INFO:teuthology.orchestra.run.smithi131.stdout:656.out 2024-05-17T04:11:35.486 INFO:teuthology.orchestra.run.smithi131.stdout:657 2024-05-17T04:11:35.486 INFO:teuthology.orchestra.run.smithi131.stdout:657.out 2024-05-17T04:11:35.486 INFO:teuthology.orchestra.run.smithi131.stdout:658 2024-05-17T04:11:35.486 INFO:teuthology.orchestra.run.smithi131.stdout:658.out 2024-05-17T04:11:35.486 INFO:teuthology.orchestra.run.smithi131.stdout:659 2024-05-17T04:11:35.486 INFO:teuthology.orchestra.run.smithi131.stdout:659.out 2024-05-17T04:11:35.486 INFO:teuthology.orchestra.run.smithi131.stdout:660 2024-05-17T04:11:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:660.out 2024-05-17T04:11:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:661 2024-05-17T04:11:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:661.out 2024-05-17T04:11:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:662 2024-05-17T04:11:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:662.out 2024-05-17T04:11:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:663 2024-05-17T04:11:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:663.out 2024-05-17T04:11:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:664 2024-05-17T04:11:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:664.out 2024-05-17T04:11:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:665 2024-05-17T04:11:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:665.out 2024-05-17T04:11:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:666 2024-05-17T04:11:35.488 INFO:teuthology.orchestra.run.smithi131.stdout:666.out 2024-05-17T04:11:35.488 INFO:teuthology.orchestra.run.smithi131.stdout:667 2024-05-17T04:11:35.488 INFO:teuthology.orchestra.run.smithi131.stdout:667.out 2024-05-17T04:11:35.488 INFO:teuthology.orchestra.run.smithi131.stdout:668 2024-05-17T04:11:35.488 INFO:teuthology.orchestra.run.smithi131.stdout:668.out 2024-05-17T04:11:35.488 INFO:teuthology.orchestra.run.smithi131.stdout:669 2024-05-17T04:11:35.488 INFO:teuthology.orchestra.run.smithi131.stdout:669.out 2024-05-17T04:11:35.488 INFO:teuthology.orchestra.run.smithi131.stdout:670 2024-05-17T04:11:35.488 INFO:teuthology.orchestra.run.smithi131.stdout:670.out 2024-05-17T04:11:35.488 INFO:teuthology.orchestra.run.smithi131.stdout:671 2024-05-17T04:11:35.488 INFO:teuthology.orchestra.run.smithi131.stdout:671.out 2024-05-17T04:11:35.488 INFO:teuthology.orchestra.run.smithi131.stdout:672 2024-05-17T04:11:35.488 INFO:teuthology.orchestra.run.smithi131.stdout:672.out 2024-05-17T04:11:35.489 INFO:teuthology.orchestra.run.smithi131.stdout:673 2024-05-17T04:11:35.489 INFO:teuthology.orchestra.run.smithi131.stdout:673.out 2024-05-17T04:11:35.489 INFO:teuthology.orchestra.run.smithi131.stdout:674 2024-05-17T04:11:35.489 INFO:teuthology.orchestra.run.smithi131.stdout:674.out 2024-05-17T04:11:35.489 INFO:teuthology.orchestra.run.smithi131.stdout:675 2024-05-17T04:11:35.489 INFO:teuthology.orchestra.run.smithi131.stdout:675.out 2024-05-17T04:11:35.489 INFO:teuthology.orchestra.run.smithi131.stdout:676 2024-05-17T04:11:35.489 INFO:teuthology.orchestra.run.smithi131.stdout:676.out 2024-05-17T04:11:35.489 INFO:teuthology.orchestra.run.smithi131.stdout:677 2024-05-17T04:11:35.489 INFO:teuthology.orchestra.run.smithi131.stdout:677.out 2024-05-17T04:11:35.489 INFO:teuthology.orchestra.run.smithi131.stdout:678 2024-05-17T04:11:35.489 INFO:teuthology.orchestra.run.smithi131.stdout:678.out 2024-05-17T04:11:35.489 INFO:teuthology.orchestra.run.smithi131.stdout:679 2024-05-17T04:11:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:679.out 2024-05-17T04:11:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:680 2024-05-17T04:11:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:680.out 2024-05-17T04:11:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:681 2024-05-17T04:11:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:681.out 2024-05-17T04:11:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:682 2024-05-17T04:11:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:682.out 2024-05-17T04:11:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:683 2024-05-17T04:11:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:683.out 2024-05-17T04:11:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:684 2024-05-17T04:11:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:684.out 2024-05-17T04:11:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:685 2024-05-17T04:11:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:685.out 2024-05-17T04:11:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:686 2024-05-17T04:11:35.491 INFO:teuthology.orchestra.run.smithi131.stdout:686.out 2024-05-17T04:11:35.491 INFO:teuthology.orchestra.run.smithi131.stdout:687 2024-05-17T04:11:35.491 INFO:teuthology.orchestra.run.smithi131.stdout:687.out 2024-05-17T04:11:35.491 INFO:teuthology.orchestra.run.smithi131.stdout:688 2024-05-17T04:11:35.491 INFO:teuthology.orchestra.run.smithi131.stdout:688.out 2024-05-17T04:11:35.491 INFO:teuthology.orchestra.run.smithi131.stdout:689 2024-05-17T04:11:35.491 INFO:teuthology.orchestra.run.smithi131.stdout:689.out 2024-05-17T04:11:35.491 INFO:teuthology.orchestra.run.smithi131.stdout:690 2024-05-17T04:11:35.491 INFO:teuthology.orchestra.run.smithi131.stdout:690.out 2024-05-17T04:11:35.491 INFO:teuthology.orchestra.run.smithi131.stdout:691 2024-05-17T04:11:35.491 INFO:teuthology.orchestra.run.smithi131.stdout:691.out 2024-05-17T04:11:35.491 INFO:teuthology.orchestra.run.smithi131.stdout:692 2024-05-17T04:11:35.491 INFO:teuthology.orchestra.run.smithi131.stdout:692.out 2024-05-17T04:11:35.491 INFO:teuthology.orchestra.run.smithi131.stdout:693 2024-05-17T04:11:35.492 INFO:teuthology.orchestra.run.smithi131.stdout:693.out 2024-05-17T04:11:35.492 INFO:teuthology.orchestra.run.smithi131.stdout:694 2024-05-17T04:11:35.492 INFO:teuthology.orchestra.run.smithi131.stdout:694.out 2024-05-17T04:11:35.492 INFO:teuthology.orchestra.run.smithi131.stdout:695 2024-05-17T04:11:35.492 INFO:teuthology.orchestra.run.smithi131.stdout:695.out 2024-05-17T04:11:35.492 INFO:teuthology.orchestra.run.smithi131.stdout:696 2024-05-17T04:11:35.492 INFO:teuthology.orchestra.run.smithi131.stdout:696.out 2024-05-17T04:11:35.492 INFO:teuthology.orchestra.run.smithi131.stdout:697 2024-05-17T04:11:35.492 INFO:teuthology.orchestra.run.smithi131.stdout:697.out 2024-05-17T04:11:35.492 INFO:teuthology.orchestra.run.smithi131.stdout:698 2024-05-17T04:11:35.492 INFO:teuthology.orchestra.run.smithi131.stdout:698.out 2024-05-17T04:11:35.493 INFO:teuthology.orchestra.run.smithi131.stdout:699 2024-05-17T04:11:35.493 INFO:teuthology.orchestra.run.smithi131.stdout:699.out 2024-05-17T04:11:35.493 INFO:teuthology.orchestra.run.smithi131.stdout:700 2024-05-17T04:11:35.493 INFO:teuthology.orchestra.run.smithi131.stdout:700.out 2024-05-17T04:11:35.493 INFO:teuthology.orchestra.run.smithi131.stdout:701 2024-05-17T04:11:35.493 INFO:teuthology.orchestra.run.smithi131.stdout:701.out 2024-05-17T04:11:35.493 INFO:teuthology.orchestra.run.smithi131.stdout:702 2024-05-17T04:11:35.493 INFO:teuthology.orchestra.run.smithi131.stdout:702.out 2024-05-17T04:11:35.493 INFO:teuthology.orchestra.run.smithi131.stdout:703 2024-05-17T04:11:35.493 INFO:teuthology.orchestra.run.smithi131.stdout:703.out 2024-05-17T04:11:35.493 INFO:teuthology.orchestra.run.smithi131.stdout:704 2024-05-17T04:11:35.493 INFO:teuthology.orchestra.run.smithi131.stdout:704.out 2024-05-17T04:11:35.494 INFO:teuthology.orchestra.run.smithi131.stdout:705 2024-05-17T04:11:35.494 INFO:teuthology.orchestra.run.smithi131.stdout:705.out 2024-05-17T04:11:35.494 INFO:teuthology.orchestra.run.smithi131.stdout:706 2024-05-17T04:11:35.494 INFO:teuthology.orchestra.run.smithi131.stdout:706.out 2024-05-17T04:11:35.494 INFO:teuthology.orchestra.run.smithi131.stdout:707 2024-05-17T04:11:35.494 INFO:teuthology.orchestra.run.smithi131.stdout:707.out 2024-05-17T04:11:35.494 INFO:teuthology.orchestra.run.smithi131.stdout:708 2024-05-17T04:11:35.494 INFO:teuthology.orchestra.run.smithi131.stdout:708.out 2024-05-17T04:11:35.494 INFO:teuthology.orchestra.run.smithi131.stdout:709 2024-05-17T04:11:35.495 INFO:teuthology.orchestra.run.smithi131.stdout:709.out 2024-05-17T04:11:35.495 INFO:teuthology.orchestra.run.smithi131.stdout:710 2024-05-17T04:11:35.495 INFO:teuthology.orchestra.run.smithi131.stdout:710.out 2024-05-17T04:11:35.495 INFO:teuthology.orchestra.run.smithi131.stdout:711 2024-05-17T04:11:35.495 INFO:teuthology.orchestra.run.smithi131.stdout:711.out 2024-05-17T04:11:35.495 INFO:teuthology.orchestra.run.smithi131.stdout:712 2024-05-17T04:11:35.495 INFO:teuthology.orchestra.run.smithi131.stdout:712.out 2024-05-17T04:11:35.495 INFO:teuthology.orchestra.run.smithi131.stdout:713 2024-05-17T04:11:35.495 INFO:teuthology.orchestra.run.smithi131.stdout:713.out 2024-05-17T04:11:35.495 INFO:teuthology.orchestra.run.smithi131.stdout:714 2024-05-17T04:11:35.495 INFO:teuthology.orchestra.run.smithi131.stdout:714.out 2024-05-17T04:11:35.495 INFO:teuthology.orchestra.run.smithi131.stdout:715 2024-05-17T04:11:35.495 INFO:teuthology.orchestra.run.smithi131.stdout:715.out 2024-05-17T04:11:35.496 INFO:teuthology.orchestra.run.smithi131.stdout:716 2024-05-17T04:11:35.496 INFO:teuthology.orchestra.run.smithi131.stdout:716.out 2024-05-17T04:11:35.496 INFO:teuthology.orchestra.run.smithi131.stdout:717 2024-05-17T04:11:35.496 INFO:teuthology.orchestra.run.smithi131.stdout:717.out 2024-05-17T04:11:35.496 INFO:teuthology.orchestra.run.smithi131.stdout:718 2024-05-17T04:11:35.496 INFO:teuthology.orchestra.run.smithi131.stdout:718.out 2024-05-17T04:11:35.496 INFO:teuthology.orchestra.run.smithi131.stdout:719 2024-05-17T04:11:35.496 INFO:teuthology.orchestra.run.smithi131.stdout:719.out 2024-05-17T04:11:35.496 INFO:teuthology.orchestra.run.smithi131.stdout:720 2024-05-17T04:11:35.496 INFO:teuthology.orchestra.run.smithi131.stdout:720.out 2024-05-17T04:11:35.496 INFO:teuthology.orchestra.run.smithi131.stdout:721 2024-05-17T04:11:35.496 INFO:teuthology.orchestra.run.smithi131.stdout:721.out 2024-05-17T04:11:35.496 INFO:teuthology.orchestra.run.smithi131.stdout:722 2024-05-17T04:11:35.496 INFO:teuthology.orchestra.run.smithi131.stdout:722.out 2024-05-17T04:11:35.496 INFO:teuthology.orchestra.run.smithi131.stdout:723 2024-05-17T04:11:35.497 INFO:teuthology.orchestra.run.smithi131.stdout:723.out 2024-05-17T04:11:35.497 INFO:teuthology.orchestra.run.smithi131.stdout:724 2024-05-17T04:11:35.497 INFO:teuthology.orchestra.run.smithi131.stdout:724.out 2024-05-17T04:11:35.497 INFO:teuthology.orchestra.run.smithi131.stdout:725 2024-05-17T04:11:35.497 INFO:teuthology.orchestra.run.smithi131.stdout:725.out 2024-05-17T04:11:35.497 INFO:teuthology.orchestra.run.smithi131.stdout:726 2024-05-17T04:11:35.497 INFO:teuthology.orchestra.run.smithi131.stdout:726.out 2024-05-17T04:11:35.497 INFO:teuthology.orchestra.run.smithi131.stdout:727 2024-05-17T04:11:35.497 INFO:teuthology.orchestra.run.smithi131.stdout:727.out 2024-05-17T04:11:35.497 INFO:teuthology.orchestra.run.smithi131.stdout:728 2024-05-17T04:11:35.497 INFO:teuthology.orchestra.run.smithi131.stdout:728.out 2024-05-17T04:11:35.497 INFO:teuthology.orchestra.run.smithi131.stdout:729 2024-05-17T04:11:35.497 INFO:teuthology.orchestra.run.smithi131.stdout:729.out 2024-05-17T04:11:35.497 INFO:teuthology.orchestra.run.smithi131.stdout:730 2024-05-17T04:11:35.498 INFO:teuthology.orchestra.run.smithi131.stdout:730.out 2024-05-17T04:11:35.498 INFO:teuthology.orchestra.run.smithi131.stdout:731 2024-05-17T04:11:35.498 INFO:teuthology.orchestra.run.smithi131.stdout:731.out 2024-05-17T04:11:35.498 INFO:teuthology.orchestra.run.smithi131.stdout:732 2024-05-17T04:11:35.498 INFO:teuthology.orchestra.run.smithi131.stdout:732.out 2024-05-17T04:11:35.498 INFO:teuthology.orchestra.run.smithi131.stdout:733 2024-05-17T04:11:35.498 INFO:teuthology.orchestra.run.smithi131.stdout:733.out 2024-05-17T04:11:35.498 INFO:teuthology.orchestra.run.smithi131.stdout:734 2024-05-17T04:11:35.498 INFO:teuthology.orchestra.run.smithi131.stdout:734.out 2024-05-17T04:11:35.498 INFO:teuthology.orchestra.run.smithi131.stdout:735 2024-05-17T04:11:35.498 INFO:teuthology.orchestra.run.smithi131.stdout:735.out 2024-05-17T04:11:35.498 INFO:teuthology.orchestra.run.smithi131.stdout:736 2024-05-17T04:11:35.498 INFO:teuthology.orchestra.run.smithi131.stdout:736.out 2024-05-17T04:11:35.499 INFO:teuthology.orchestra.run.smithi131.stdout:737 2024-05-17T04:11:35.499 INFO:teuthology.orchestra.run.smithi131.stdout:737.out 2024-05-17T04:11:35.499 INFO:teuthology.orchestra.run.smithi131.stdout:738 2024-05-17T04:11:35.499 INFO:teuthology.orchestra.run.smithi131.stdout:738.out 2024-05-17T04:11:35.499 INFO:teuthology.orchestra.run.smithi131.stdout:739 2024-05-17T04:11:35.499 INFO:teuthology.orchestra.run.smithi131.stdout:739.out 2024-05-17T04:11:35.499 INFO:teuthology.orchestra.run.smithi131.stdout:741 2024-05-17T04:11:35.499 INFO:teuthology.orchestra.run.smithi131.stdout:741.out 2024-05-17T04:11:35.499 INFO:teuthology.orchestra.run.smithi131.stdout:742 2024-05-17T04:11:35.499 INFO:teuthology.orchestra.run.smithi131.stdout:742.out 2024-05-17T04:11:35.499 INFO:teuthology.orchestra.run.smithi131.stdout:743 2024-05-17T04:11:35.499 INFO:teuthology.orchestra.run.smithi131.stdout:743.out 2024-05-17T04:11:35.499 INFO:teuthology.orchestra.run.smithi131.stdout:744 2024-05-17T04:11:35.499 INFO:teuthology.orchestra.run.smithi131.stdout:744.out 2024-05-17T04:11:35.500 INFO:teuthology.orchestra.run.smithi131.stdout:group.list 2024-05-17T04:11:35.500 INFO:teuthology.orchestra.run.smithi131.stdout:Makefile 2024-05-17T04:11:35.500 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-05-17T04:11:35.697 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:11:35.701 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:11:35.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:11:36.519 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:11:36.521 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:11:37.747 INFO:teuthology.orchestra.run.smithi131.stdout:generic/001 2s 2024-05-17T04:11:37.753 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/001 2024-05-17T04:11:37.753 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:11:37.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:11:37.756 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi131.stderr:ceph-fuse[49946]: fuse finished with error 0 and tester_r 0 2024-05-17T04:11:37.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:11:37.765 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-05-17T04:11:37.962 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:11:37.966 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:11:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:11:38.349 INFO:teuthology.orchestra.run.smithi131.stdout:generic/002 1s 2024-05-17T04:11:38.354 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/002 2024-05-17T04:11:38.354 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:11:38.357 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:11:38.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:11:38.367 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-05-17T04:11:38.575 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:11:38.579 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:11:38.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:11:38.702 INFO:teuthology.orchestra.run.smithi131.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:11:38.706 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/003 2024-05-17T04:11:38.706 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/003 2024-05-17T04:11:38.706 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:11:38.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:11:38.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:11:38.717 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-05-17T04:11:38.911 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:11:38.916 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:11:38.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:11:39.054 INFO:teuthology.orchestra.run.smithi131.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-05-17T04:11:39.058 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/004 2024-05-17T04:11:39.058 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/004 2024-05-17T04:11:39.058 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:11:39.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:11:39.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:11:39.069 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-05-17T04:11:39.251 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:11:39.255 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:11:39.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:11:39.737 INFO:teuthology.orchestra.run.smithi131.stdout:generic/005 0s 2024-05-17T04:11:39.743 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/005 2024-05-17T04:11:39.743 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:11:39.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:11:39.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:11:39.754 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-05-17T04:11:39.977 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:11:39.981 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:11:39.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:12:06.633 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:12:06.636 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:12:15.559 INFO:teuthology.orchestra.run.smithi131.stdout:generic/006 36s 2024-05-17T04:12:15.624 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/006 2024-05-17T04:12:15.624 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:12:15.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:12:15.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:12:15.670 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-05-17T04:12:15.866 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:12:15.869 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:12:15.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:12:36.777 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:12:36.781 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:13:06.916 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:13:06.919 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:13:30.040 INFO:teuthology.orchestra.run.smithi131.stdout:generic/007 75s 2024-05-17T04:13:30.044 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/007 2024-05-17T04:13:30.045 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:13:30.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:13:30.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:13:30.058 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-05-17T04:13:30.284 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:13:30.288 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:13:30.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:13:31.193 INFO:teuthology.orchestra.run.smithi131.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-17T04:13:31.196 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/008 2024-05-17T04:13:31.196 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/008 2024-05-17T04:13:31.197 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:13:31.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:13:31.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:13:31.208 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-05-17T04:13:31.400 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:13:31.404 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:13:31.404 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:13:32.223 INFO:teuthology.orchestra.run.smithi131.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-17T04:13:32.227 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/009 2024-05-17T04:13:32.227 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/009 2024-05-17T04:13:32.227 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:13:32.229 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:13:32.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:13:32.238 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-05-17T04:13:32.425 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:13:32.429 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:13:32.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:13:33.047 INFO:teuthology.orchestra.run.smithi131.stdout:generic/010 1s 2024-05-17T04:13:33.206 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/010 2024-05-17T04:13:33.206 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:13:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:13:33.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:13:33.224 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-05-17T04:13:33.439 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:13:33.443 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:13:33.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:13:37.225 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:13:37.228 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:14:07.370 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:14:07.373 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:14:13.033 INFO:teuthology.orchestra.run.smithi131.stdout:generic/011 39s 2024-05-17T04:14:13.121 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/011 2024-05-17T04:14:13.121 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:14:13.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:14:13.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:14:13.134 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-05-17T04:14:13.367 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:14:13.371 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:14:13.371 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:14:14.282 INFO:teuthology.orchestra.run.smithi131.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-17T04:14:14.285 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/012 2024-05-17T04:14:14.286 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/012 2024-05-17T04:14:14.286 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:14:14.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:14:14.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:14:14.323 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-05-17T04:14:14.520 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:14:14.524 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:14:14.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:14:37.756 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:14:37.760 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:15:08.536 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:15:08.542 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:15:38.899 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:15:38.902 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:15:38.968 INFO:tasks.ceph.mds.c.smithi131.stderr:2024-05-17T04:15:38.967+0000 7fbe21f5f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 114485) UID: 0 2024-05-17T04:15:38.969 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-05-17T04:15:38.967+0000 7f7e80ea2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 114485) UID: 0 2024-05-17T04:15:52.911 INFO:teuthology.orchestra.run.smithi131.stdout:generic/013 98s 2024-05-17T04:15:52.991 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/013 2024-05-17T04:15:52.991 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:15:52.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:15:53.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:15:53.006 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-05-17T04:15:53.315 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:15:53.321 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:15:53.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:15:53.626 INFO:teuthology.orchestra.run.smithi131.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-05-17T04:15:53.630 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/014 2024-05-17T04:15:53.630 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/014 2024-05-17T04:15:53.630 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:15:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:15:53.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:15:53.649 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-05-17T04:15:53.954 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:15:53.959 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:15:53.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:15:54.137 INFO:teuthology.orchestra.run.smithi131.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:15:54.142 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/015 2024-05-17T04:15:54.142 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/015 2024-05-17T04:15:54.142 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:15:54.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:15:54.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:15:54.159 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-05-17T04:15:54.455 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:15:54.465 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:15:54.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:15:55.966 INFO:teuthology.orchestra.run.smithi131.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-17T04:15:55.973 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/016 2024-05-17T04:15:55.973 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/016 2024-05-17T04:15:55.973 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:15:55.977 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:15:55.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:15:55.992 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-05-17T04:15:56.359 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:15:56.368 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:15:56.369 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:15:56.548 INFO:teuthology.orchestra.run.smithi131.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:15:56.555 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/017 2024-05-17T04:15:56.555 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/017 2024-05-17T04:15:56.555 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:15:56.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:15:56.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:15:56.572 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-05-17T04:15:56.866 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:15:56.872 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:15:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:15:57.060 INFO:teuthology.orchestra.run.smithi131.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:15:57.065 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/018 2024-05-17T04:15:57.065 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/018 2024-05-17T04:15:57.065 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:15:57.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:15:57.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:15:57.082 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-05-17T04:15:57.376 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:15:57.383 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:15:57.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:15:57.573 INFO:teuthology.orchestra.run.smithi131.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:15:57.578 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/019 2024-05-17T04:15:57.578 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/019 2024-05-17T04:15:57.578 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:15:57.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:15:57.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:15:57.595 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-05-17T04:15:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:15:57.900 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:15:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:09.016 INFO:teuthology.orchestra.run.smithi131.stdout:generic/020 - output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/020.out.bad) 2024-05-17T04:16:09.020 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/020.out 2024-05-17 04:10:05.097702232 +0000 2024-05-17T04:16:09.020 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/020.out.bad 2024-05-17 04:16:09.015189705 +0000 2024-05-17T04:16:09.020 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -47,9 +47,13 @@ 2024-05-17T04:16:09.020 INFO:teuthology.orchestra.run.smithi131.stdout: user.snrub="fish2\012" 2024-05-17T04:16:09.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:09.020 INFO:teuthology.orchestra.run.smithi131.stdout: *** really long value 2024-05-17T04:16:09.020 INFO:teuthology.orchestra.run.smithi131.stdout: -0000000 00 2024-05-17T04:16:09.020 INFO:teuthology.orchestra.run.smithi131.stdout: -* 2024-05-17T04:16:09.021 INFO:teuthology.orchestra.run.smithi131.stdout: -ATTRSIZE 2024-05-17T04:16:09.021 INFO:teuthology.orchestra.run.smithi131.stdout: +attr_set: No space left on device 2024-05-17T04:16:09.021 INFO:teuthology.orchestra.run.smithi131.stdout: +Could not set "long_attr" for 2024-05-17T04:16:09.021 INFO:teuthology.orchestra.run.smithi131.stdout: +attr_get: No data available 2024-05-17T04:16:09.021 INFO:teuthology.orchestra.run.smithi131.stdout: +Could not get "long_attr" for 2024-05-17T04:16:09.021 INFO:teuthology.orchestra.run.smithi131.stdout: +0000000 2024-05-17T04:16:09.021 INFO:teuthology.orchestra.run.smithi131.stdout: +attr_remove: No data available 2024-05-17T04:16:09.021 INFO:teuthology.orchestra.run.smithi131.stdout: +Could not remove "long_attr" for 2024-05-17T04:16:09.021 INFO:teuthology.orchestra.run.smithi131.stdout: *** set/get/remove really long names (expect failure) 2024-05-17T04:16:09.021 INFO:teuthology.orchestra.run.smithi131.stdout: attr_set: Invalid argument 2024-05-17T04:16:09.021 INFO:teuthology.orchestra.run.smithi131.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2024-05-17T04:16:09.026 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/020 2024-05-17T04:16:09.026 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/020 2024-05-17T04:16:09.026 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T04:16:09.029 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:09.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T04:16:09.047 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T04:16:09.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T04:16:09.047 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-05-17T04:16:09.404 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:09.411 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:09.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:10.956 INFO:teuthology.orchestra.run.smithi131.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-17T04:16:10.961 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/021 2024-05-17T04:16:10.961 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/021 2024-05-17T04:16:10.961 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:10.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:10.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:10.988 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-05-17T04:16:11.357 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:11.363 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:11.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:12.876 INFO:teuthology.orchestra.run.smithi131.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-17T04:16:12.881 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/022 2024-05-17T04:16:12.881 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/022 2024-05-17T04:16:12.881 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:12.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:12.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:12.905 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-05-17T04:16:13.263 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:13.270 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:13.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:15.187 INFO:teuthology.orchestra.run.smithi131.stdout:generic/023 2s 2024-05-17T04:16:15.196 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/023 2024-05-17T04:16:15.197 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:15.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:15.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:15.214 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-05-17T04:16:15.596 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:15.602 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:15.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:15.830 INFO:teuthology.orchestra.run.smithi131.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-05-17T04:16:15.836 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/024 2024-05-17T04:16:15.837 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/024 2024-05-17T04:16:15.837 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:15.839 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:15.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:15.855 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-05-17T04:16:16.232 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:16.239 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:16.464 INFO:teuthology.orchestra.run.smithi131.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-05-17T04:16:16.469 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/025 2024-05-17T04:16:16.469 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/025 2024-05-17T04:16:16.469 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:16.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:16.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:16.487 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-05-17T04:16:16.855 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:16.862 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:16.863 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:17.099 INFO:teuthology.orchestra.run.smithi131.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-17T04:16:17.104 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/026 2024-05-17T04:16:17.105 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/026 2024-05-17T04:16:17.105 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:17.110 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:17.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:17.128 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-05-17T04:16:17.425 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:17.433 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:17.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:17.603 INFO:teuthology.orchestra.run.smithi131.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:17.608 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/027 2024-05-17T04:16:17.608 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/027 2024-05-17T04:16:17.609 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:17.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:17.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:17.626 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-05-17T04:16:17.917 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:17.924 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:17.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:23.134 INFO:teuthology.orchestra.run.smithi131.stdout:generic/028 6s 2024-05-17T04:16:23.142 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/028 2024-05-17T04:16:23.142 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:23.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:23.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:23.161 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-05-17T04:16:23.442 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:23.448 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:23.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:23.634 INFO:teuthology.orchestra.run.smithi131.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:23.639 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/029 2024-05-17T04:16:23.639 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/029 2024-05-17T04:16:23.639 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:23.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:23.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:23.655 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-05-17T04:16:23.949 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:23.954 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:24.138 INFO:teuthology.orchestra.run.smithi131.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:24.143 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/030 2024-05-17T04:16:24.143 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/030 2024-05-17T04:16:24.144 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:24.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:24.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:24.160 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-05-17T04:16:24.458 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:24.463 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:24.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:24.649 INFO:teuthology.orchestra.run.smithi131.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:24.654 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/031 2024-05-17T04:16:24.654 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/031 2024-05-17T04:16:24.655 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:24.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:24.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:24.674 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-05-17T04:16:24.974 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:24.982 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:24.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:25.173 INFO:teuthology.orchestra.run.smithi131.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:25.179 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/032 2024-05-17T04:16:25.179 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/032 2024-05-17T04:16:25.179 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:25.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:25.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:25.198 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-05-17T04:16:25.482 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:25.488 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:25.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:25.667 INFO:teuthology.orchestra.run.smithi131.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:25.673 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/033 2024-05-17T04:16:25.673 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/033 2024-05-17T04:16:25.673 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:25.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:25.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:25.692 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-05-17T04:16:25.982 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:25.990 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:25.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:26.190 INFO:teuthology.orchestra.run.smithi131.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:26.196 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/034 2024-05-17T04:16:26.196 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/034 2024-05-17T04:16:26.196 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:26.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:26.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:26.214 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-05-17T04:16:26.491 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:26.498 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:26.498 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:26.787 INFO:teuthology.orchestra.run.smithi131.stdout:generic/035 0s 2024-05-17T04:16:26.795 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/035 2024-05-17T04:16:26.795 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:26.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:26.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:26.813 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-05-17T04:16:27.177 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:27.182 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:27.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:37.516 INFO:teuthology.orchestra.run.smithi131.stdout:generic/036 10s 2024-05-17T04:16:37.707 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/036 2024-05-17T04:16:37.708 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:37.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:37.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:37.724 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-05-17T04:16:38.081 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:38.088 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:38.088 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:38.266 INFO:teuthology.orchestra.run.smithi131.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:38.271 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/037 2024-05-17T04:16:38.271 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/037 2024-05-17T04:16:38.271 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:38.275 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:38.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:38.291 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-05-17T04:16:38.574 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:38.582 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:38.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:38.770 INFO:teuthology.orchestra.run.smithi131.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:38.774 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/038 2024-05-17T04:16:38.774 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/038 2024-05-17T04:16:38.775 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:38.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:38.790 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-05-17T04:16:39.133 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:39.139 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:39.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:39.336 INFO:teuthology.orchestra.run.smithi131.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:39.344 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/039 2024-05-17T04:16:39.344 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/039 2024-05-17T04:16:39.344 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:39.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:39.362 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-05-17T04:16:39.661 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:39.667 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:39.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:39.860 INFO:teuthology.orchestra.run.smithi131.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:39.865 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/040 2024-05-17T04:16:39.865 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/040 2024-05-17T04:16:39.865 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:39.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:39.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:39.880 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-05-17T04:16:40.174 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:40.179 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:40.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:40.368 INFO:teuthology.orchestra.run.smithi131.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:40.373 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/041 2024-05-17T04:16:40.373 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/041 2024-05-17T04:16:40.373 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:40.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:40.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:40.388 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-05-17T04:16:40.668 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:40.674 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:40.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:40.853 INFO:teuthology.orchestra.run.smithi131.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:40.858 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/042 2024-05-17T04:16:40.858 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/042 2024-05-17T04:16:40.858 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:40.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:40.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:40.875 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-05-17T04:16:41.174 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:41.181 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:41.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:41.356 INFO:teuthology.orchestra.run.smithi131.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:41.361 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/043 2024-05-17T04:16:41.361 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/043 2024-05-17T04:16:41.361 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:41.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:41.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:41.385 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-05-17T04:16:41.686 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:41.689 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:41.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:41.874 INFO:teuthology.orchestra.run.smithi131.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:41.879 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/044 2024-05-17T04:16:41.880 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/044 2024-05-17T04:16:41.880 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:41.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:41.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:41.899 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-05-17T04:16:42.182 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:42.188 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:42.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:42.378 INFO:teuthology.orchestra.run.smithi131.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:42.383 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/045 2024-05-17T04:16:42.383 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/045 2024-05-17T04:16:42.383 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:42.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:42.400 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-05-17T04:16:42.689 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:42.695 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:42.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:42.882 INFO:teuthology.orchestra.run.smithi131.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:42.887 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/046 2024-05-17T04:16:42.887 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/046 2024-05-17T04:16:42.887 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:42.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:42.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:42.907 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-05-17T04:16:43.199 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:43.205 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:43.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:43.387 INFO:teuthology.orchestra.run.smithi131.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:43.393 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/047 2024-05-17T04:16:43.393 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/047 2024-05-17T04:16:43.394 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:43.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:43.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:43.410 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-05-17T04:16:43.708 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:43.714 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:43.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:43.894 INFO:teuthology.orchestra.run.smithi131.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:43.900 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/048 2024-05-17T04:16:43.900 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/048 2024-05-17T04:16:43.900 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:43.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:43.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:43.922 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-05-17T04:16:44.203 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:44.209 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:44.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:44.387 INFO:teuthology.orchestra.run.smithi131.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:44.392 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/049 2024-05-17T04:16:44.392 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/049 2024-05-17T04:16:44.392 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:44.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:44.409 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-05-17T04:16:44.698 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:44.703 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:44.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:44.900 INFO:teuthology.orchestra.run.smithi131.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:44.904 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/050 2024-05-17T04:16:44.905 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/050 2024-05-17T04:16:44.905 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:44.908 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:44.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:44.920 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-05-17T04:16:45.210 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:45.216 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:45.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:45.403 INFO:teuthology.orchestra.run.smithi131.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:45.410 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/051 2024-05-17T04:16:45.410 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/051 2024-05-17T04:16:45.410 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:45.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:45.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:45.427 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-05-17T04:16:45.724 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:45.729 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:45.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:45.915 INFO:teuthology.orchestra.run.smithi131.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:45.920 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/052 2024-05-17T04:16:45.920 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/052 2024-05-17T04:16:45.921 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:45.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:45.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:45.938 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-05-17T04:16:46.235 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:46.242 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:46.242 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:46.422 INFO:teuthology.orchestra.run.smithi131.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:46.427 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/053 2024-05-17T04:16:46.427 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/053 2024-05-17T04:16:46.427 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:46.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:46.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:46.443 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-05-17T04:16:46.734 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:46.741 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:46.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:46.927 INFO:teuthology.orchestra.run.smithi131.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:46.932 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/054 2024-05-17T04:16:46.933 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/054 2024-05-17T04:16:46.933 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:46.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:46.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:46.951 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-05-17T04:16:47.222 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:47.223 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:47.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:47.401 INFO:teuthology.orchestra.run.smithi131.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:47.406 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/055 2024-05-17T04:16:47.406 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/055 2024-05-17T04:16:47.406 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:47.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:47.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:47.425 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-05-17T04:16:47.712 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:47.717 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:47.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:47.920 INFO:teuthology.orchestra.run.smithi131.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:47.926 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/056 2024-05-17T04:16:47.926 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/056 2024-05-17T04:16:47.926 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:47.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:47.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:47.944 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-05-17T04:16:48.241 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:48.248 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:48.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:48.448 INFO:teuthology.orchestra.run.smithi131.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:48.454 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/057 2024-05-17T04:16:48.455 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/057 2024-05-17T04:16:48.455 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:48.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:48.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:48.469 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-05-17T04:16:48.766 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:48.771 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:48.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:50.262 INFO:teuthology.orchestra.run.smithi131.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-17T04:16:50.268 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/058 2024-05-17T04:16:50.268 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/058 2024-05-17T04:16:50.268 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:50.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:50.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:50.284 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-05-17T04:16:50.671 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:50.677 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:50.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:50.861 INFO:teuthology.orchestra.run.smithi131.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:50.868 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/059 2024-05-17T04:16:50.868 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/059 2024-05-17T04:16:50.868 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:50.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:50.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:50.884 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-05-17T04:16:51.182 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:51.187 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:51.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:52.662 INFO:teuthology.orchestra.run.smithi131.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-17T04:16:52.668 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/060 2024-05-17T04:16:52.668 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/060 2024-05-17T04:16:52.668 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:52.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:52.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:52.686 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-05-17T04:16:53.041 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:53.047 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:53.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:54.522 INFO:teuthology.orchestra.run.smithi131.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-17T04:16:54.527 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/061 2024-05-17T04:16:54.527 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/061 2024-05-17T04:16:54.527 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:54.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:54.544 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-05-17T04:16:54.912 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:54.917 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:54.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:55.099 INFO:teuthology.orchestra.run.smithi131.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:55.105 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/062 2024-05-17T04:16:55.105 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/062 2024-05-17T04:16:55.105 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:55.108 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:55.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:55.123 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-05-17T04:16:55.401 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:55.406 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:55.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:56.892 INFO:teuthology.orchestra.run.smithi131.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-17T04:16:56.897 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/063 2024-05-17T04:16:56.897 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/063 2024-05-17T04:16:56.897 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:56.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:56.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:56.951 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-05-17T04:16:57.324 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:57.330 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:57.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:57.512 INFO:teuthology.orchestra.run.smithi131.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:57.517 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/064 2024-05-17T04:16:57.517 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/064 2024-05-17T04:16:57.517 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:57.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:57.537 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-05-17T04:16:57.812 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:57.821 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:57.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:58.017 INFO:teuthology.orchestra.run.smithi131.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:58.021 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/065 2024-05-17T04:16:58.021 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/065 2024-05-17T04:16:58.021 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:58.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:58.039 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-05-17T04:16:58.325 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:58.330 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:58.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:58.525 INFO:teuthology.orchestra.run.smithi131.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:58.531 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/066 2024-05-17T04:16:58.531 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/066 2024-05-17T04:16:58.531 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:58.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:58.551 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-05-17T04:16:58.848 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:58.854 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:59.071 INFO:teuthology.orchestra.run.smithi131.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:16:59.075 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/067 2024-05-17T04:16:59.076 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/067 2024-05-17T04:16:59.076 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:16:59.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:16:59.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:16:59.091 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-05-17T04:16:59.384 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:16:59.389 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:16:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:17:00.206 INFO:teuthology.orchestra.run.smithi131.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:17:00.210 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/068 2024-05-17T04:17:00.210 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/068 2024-05-17T04:17:00.211 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:17:00.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:17:00.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:17:00.226 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-05-17T04:17:00.529 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:17:00.536 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:17:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:17:00.714 INFO:teuthology.orchestra.run.smithi131.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:17:00.719 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/069 2024-05-17T04:17:00.719 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/069 2024-05-17T04:17:00.719 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:17:00.722 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:17:00.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:17:00.736 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-05-17T04:17:01.030 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:17:01.036 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:17:01.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:18:42.113 INFO:teuthology.orchestra.run.smithi131.stdout:generic/070 101s 2024-05-17T04:18:42.128 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/070 2024-05-17T04:18:42.128 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:18:42.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:18:42.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:18:42.143 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-05-17T04:18:42.693 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:18:42.698 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:18:42.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:18:42.880 INFO:teuthology.orchestra.run.smithi131.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:18:42.884 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/071 2024-05-17T04:18:42.885 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/071 2024-05-17T04:18:42.885 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:18:42.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:18:42.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:18:42.902 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-05-17T04:18:43.150 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:18:43.154 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:18:43.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:18:44.463 INFO:teuthology.orchestra.run.smithi131.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-05-17T04:18:44.467 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/072 2024-05-17T04:18:44.467 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/072 2024-05-17T04:18:44.467 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:18:44.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:18:44.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:18:44.481 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-05-17T04:18:44.752 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:18:44.756 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:18:44.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:18:44.933 INFO:teuthology.orchestra.run.smithi131.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:18:44.937 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/073 2024-05-17T04:18:44.938 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/073 2024-05-17T04:18:44.938 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:18:44.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:18:44.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:18:44.953 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-05-17T04:18:45.211 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:18:45.216 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:18:45.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:18:51.973 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:18:51.976 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:19:22.100 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:19:22.103 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:19:52.431 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:19:52.435 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:20:22.739 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:20:22.742 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:20:53.038 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:20:53.041 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:21:23.296 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:21:23.301 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:21:53.414 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:21:53.418 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:22:23.560 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:22:23.564 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:22:53.719 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:22:53.722 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:23:24.002 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:23:24.006 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:23:54.125 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:23:54.129 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:24:24.298 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:24:24.302 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:24:54.372 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:24:54.376 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:25:24.497 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:25:24.501 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:25:54.740 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:25:54.744 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:26:25.201 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:26:25.204 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:26:55.402 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:26:55.405 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:27:25.489 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:27:25.492 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:27:55.565 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:27:55.568 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:27:55.724 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T04:27:55.723+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45002) UID: 0 2024-05-17T04:27:55.724 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T04:27:55.724+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45002) UID: 0 2024-05-17T04:27:55.724 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T04:27:55.724+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45002) UID: 0 2024-05-17T04:27:55.725 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T04:27:55.725+0000 7f5bb346e640 -1 Fail to open '/proc/45002/cmdline' error = (2) No such file or directory 2024-05-17T04:27:55.725 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T04:27:55.725+0000 7f5bb346e640 -1 received signal: Hangup from (PID: 45002) UID: 0 2024-05-17T04:31:58.881 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:31:58.884 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:31:58.925 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T04:31:58.924+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45129) UID: 0 2024-05-17T04:31:58.926 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T04:31:58.925+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45129) UID: 0 2024-05-17T04:31:58.926 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T04:31:58.924+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45129) UID: 0 2024-05-17T04:31:58.926 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T04:31:58.925+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45129) UID: 0 2024-05-17T04:36:23.702 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:36:23.705 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:36:23.759 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T04:36:23.760+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145081) UID: 0 2024-05-17T04:36:23.759 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T04:36:23.760+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145081) UID: 0 2024-05-17T04:36:23.760 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T04:36:23.760+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145081) UID: 0 2024-05-17T04:36:23.760 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T04:36:23.760+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145081) UID: 0 2024-05-17T04:36:23.829 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T04:36:23.829+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45199) UID: 0 2024-05-17T04:36:23.829 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T04:36:23.829+0000 7fdfebbc4640 -1 received signal: Hangup from (PID: 45199) UID: 0 2024-05-17T04:36:23.830 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T04:36:23.830+0000 7fac92a7c640 -1 received signal: Hangup from (PID: 45199) UID: 0 2024-05-17T04:36:23.830 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T04:36:23.830+0000 7f5bb346e640 -1 received signal: Hangup from (PID: 45199) UID: 0 2024-05-17T04:44:43.945 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:44:43.950 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:44:43.984 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T04:44:43.984+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45357) UID: 0 2024-05-17T04:44:43.989 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T04:44:43.984+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45357) UID: 0 2024-05-17T04:44:43.989 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T04:44:43.984+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45357) UID: 0 2024-05-17T04:44:43.989 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T04:44:43.984+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45357) UID: 0 2024-05-17T04:44:44.006 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T04:44:44.006+0000 7f94de04d640 -1 Fail to open '/proc/145182/cmdline' error = (2) No such file or directory 2024-05-17T04:44:44.007 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T04:44:44.006+0000 7f27cf310640 -1 Fail to open '/proc/145182/cmdline' error = (2) No such file or directory 2024-05-17T04:44:44.007 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T04:44:44.006+0000 7f27cf310640 -1 received signal: Hangup from (PID: 145182) UID: 0 2024-05-17T04:44:44.007 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T04:44:44.006+0000 7fd16636b640 -1 Fail to open '/proc/145182/cmdline' error = (2) No such file or directory 2024-05-17T04:44:44.007 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T04:44:44.006+0000 7fd16636b640 -1 received signal: Hangup from (PID: 145182) UID: 0 2024-05-17T04:44:44.007 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T04:44:44.006+0000 7f94de04d640 -1 received signal: Hangup from (PID: 145182) UID: 0 2024-05-17T04:44:44.010 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T04:44:44.006+0000 7f5ebbb4c640 -1 Fail to open '/proc/145182/cmdline' error = (2) No such file or directory 2024-05-17T04:44:44.010 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T04:44:44.006+0000 7f5ebbb4c640 -1 received signal: Hangup from (PID: 145182) UID: 0 2024-05-17T04:57:20.579 INFO:teuthology.orchestra.run.smithi131.stdout:generic/074 2315s 2024-05-17T04:57:20.730 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/074 2024-05-17T04:57:20.731 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:57:20.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:57:20.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:57:20.753 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-05-17T04:57:21.238 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:57:21.242 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:57:21.242 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:57:47.214 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:57:47.217 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T04:57:47.250 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T04:57:47.251+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45641) UID: 0 2024-05-17T04:57:47.251 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T04:57:47.251+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45641) UID: 0 2024-05-17T04:57:47.251 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T04:57:47.251+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45641) UID: 0 2024-05-17T04:57:47.251 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T04:57:47.251+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45641) UID: 0 2024-05-17T04:58:00.091 INFO:teuthology.orchestra.run.smithi131.stdout:generic/075 39s 2024-05-17T04:58:00.096 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/075 2024-05-17T04:58:00.097 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:58:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:00.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:58:00.108 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-05-17T04:58:00.541 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:58:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:58:00.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:00.671 INFO:teuthology.orchestra.run.smithi131.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:58:00.675 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/076 2024-05-17T04:58:00.675 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/076 2024-05-17T04:58:00.675 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:58:00.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:00.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:58:00.687 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-05-17T04:58:00.871 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:58:00.875 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:58:00.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:01.648 INFO:teuthology.orchestra.run.smithi131.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:58:01.652 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/077 2024-05-17T04:58:01.652 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/077 2024-05-17T04:58:01.652 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:58:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:01.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:58:01.664 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-05-17T04:58:01.854 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:58:01.858 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:58:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:02.027 INFO:teuthology.orchestra.run.smithi131.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-05-17T04:58:02.031 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/078 2024-05-17T04:58:02.031 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/078 2024-05-17T04:58:02.031 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:58:02.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:02.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:58:02.042 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-05-17T04:58:02.468 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:58:02.473 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:58:02.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:02.645 INFO:teuthology.orchestra.run.smithi131.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-05-17T04:58:02.649 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/079 2024-05-17T04:58:02.649 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/079 2024-05-17T04:58:02.649 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:58:02.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:02.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:58:02.661 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-05-17T04:58:02.863 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:58:02.867 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:58:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:05.062 INFO:teuthology.orchestra.run.smithi131.stdout:generic/080 3s 2024-05-17T04:58:05.068 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/080 2024-05-17T04:58:05.069 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:58:05.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:05.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:58:05.082 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-05-17T04:58:05.284 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:58:05.288 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:58:05.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:05.419 INFO:teuthology.orchestra.run.smithi131.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:58:05.422 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/081 2024-05-17T04:58:05.422 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/081 2024-05-17T04:58:05.422 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:58:05.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:05.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:58:05.434 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-05-17T04:58:05.624 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:58:05.629 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:58:05.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:05.774 INFO:teuthology.orchestra.run.smithi131.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:58:05.777 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/082 2024-05-17T04:58:05.777 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/082 2024-05-17T04:58:05.777 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:58:05.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:05.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:58:05.789 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-05-17T04:58:05.978 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:58:05.982 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:58:05.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:06.105 INFO:teuthology.orchestra.run.smithi131.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:58:06.108 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/083 2024-05-17T04:58:06.108 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/083 2024-05-17T04:58:06.109 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:58:06.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:06.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:58:06.131 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-05-17T04:58:06.320 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:58:06.324 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:58:06.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:06.449 INFO:teuthology.orchestra.run.smithi131.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:58:06.452 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/084 2024-05-17T04:58:06.452 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/084 2024-05-17T04:58:06.453 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:58:06.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:06.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:58:06.464 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-05-17T04:58:06.650 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:58:06.654 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:58:06.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:06.795 INFO:teuthology.orchestra.run.smithi131.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T04:58:06.798 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/085 2024-05-17T04:58:06.798 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/085 2024-05-17T04:58:06.798 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:58:06.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:06.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:58:06.809 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-05-17T04:58:06.999 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:58:07.003 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:58:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:11.013 INFO:teuthology.orchestra.run.smithi131.stdout:generic/086 3s 2024-05-17T04:58:11.067 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/086 2024-05-17T04:58:11.067 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:58:11.069 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:11.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:58:11.213 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-05-17T04:58:12.618 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:58:12.621 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:58:12.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:13.071 INFO:teuthology.orchestra.run.smithi131.stdout:generic/087 1s 2024-05-17T04:58:13.076 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/087 2024-05-17T04:58:13.076 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:58:13.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:13.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:58:13.088 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-05-17T04:58:13.579 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:58:13.583 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:58:13.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:13.778 INFO:teuthology.orchestra.run.smithi131.stdout:generic/088 0s 2024-05-17T04:58:13.783 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/088 2024-05-17T04:58:13.783 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T04:58:13.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T04:58:13.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T04:58:13.795 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-05-17T04:58:14.258 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T04:58:14.263 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T04:58:14.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:01:33.625 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:01:33.630 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:01:33.660 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T05:01:33.660+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45674) UID: 0 2024-05-17T05:01:33.660 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T05:01:33.660+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45674) UID: 0 2024-05-17T05:01:33.661 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T05:01:33.660+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45674) UID: 0 2024-05-17T05:01:33.661 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T05:01:33.660+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45674) UID: 0 2024-05-17T05:01:34.118 INFO:tasks.ceph.mds.c.smithi131.stderr:2024-05-17T05:01:34.119+0000 7fbe21f5f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 153261) UID: 0 2024-05-17T05:01:34.119 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-05-17T05:01:34.119+0000 7f7e80ea2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 153261) UID: 0 2024-05-17T05:04:16.079 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T05:04:16.080+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 153475) UID: 0 2024-05-17T05:04:16.080 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T05:04:16.080+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 153475) UID: 0 2024-05-17T05:04:16.080 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T05:04:16.080+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 153475) UID: 0 2024-05-17T05:04:16.081 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T05:04:16.080+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 153475) UID: 0 2024-05-17T05:09:12.831 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:09:12.834 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:09:12.864 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T05:09:12.864+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45702) UID: 0 2024-05-17T05:09:12.864 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T05:09:12.864+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45702) UID: 0 2024-05-17T05:09:12.865 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T05:09:12.864+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45702) UID: 0 2024-05-17T05:09:12.865 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T05:09:12.864+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45702) UID: 0 2024-05-17T05:09:12.900 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-05-17T05:09:12.901+0000 7f7e80ea2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 155510) UID: 0 2024-05-17T05:09:12.900 INFO:tasks.ceph.mds.c.smithi131.stderr:2024-05-17T05:09:12.901+0000 7fbe21f5f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 155510) UID: 0 2024-05-17T05:13:12.280 INFO:teuthology.orchestra.run.smithi131.stdout:generic/089 898s 2024-05-17T05:13:12.380 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/089 2024-05-17T05:13:12.380 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:13:12.382 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:13:12.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:13:12.394 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-05-17T05:13:12.986 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:13:12.990 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:13:12.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:13:13.451 INFO:teuthology.orchestra.run.smithi131.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:13:13.455 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/090 2024-05-17T05:13:13.455 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/090 2024-05-17T05:13:13.455 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:13:13.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:13:13.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:13:13.467 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-05-17T05:13:13.654 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:13:13.658 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:13:13.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:32.056 INFO:teuthology.orchestra.run.smithi131.stdout:generic/091 139s 2024-05-17T05:15:32.062 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/091 2024-05-17T05:15:32.062 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:15:32.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:32.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:15:32.075 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-05-17T05:15:32.543 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:15:32.547 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:15:32.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:32.735 INFO:teuthology.orchestra.run.smithi131.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-17T05:15:32.738 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/092 2024-05-17T05:15:32.738 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/092 2024-05-17T05:15:32.738 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:15:32.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:32.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:15:32.793 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-05-17T05:15:33.228 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:15:33.233 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:15:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:34.123 INFO:teuthology.orchestra.run.smithi131.stdout:generic/093 1s 2024-05-17T05:15:34.128 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/093 2024-05-17T05:15:34.128 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:15:34.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:34.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:15:34.140 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-05-17T05:15:34.626 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:15:34.630 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:15:34.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:34.760 INFO:teuthology.orchestra.run.smithi131.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:15:34.763 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/094 2024-05-17T05:15:34.763 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/094 2024-05-17T05:15:34.764 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:15:34.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:34.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:15:34.775 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-05-17T05:15:34.967 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:15:34.971 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:15:34.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:35.101 INFO:teuthology.orchestra.run.smithi131.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:15:35.105 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/095 2024-05-17T05:15:35.106 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/095 2024-05-17T05:15:35.106 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:15:35.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:35.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:15:35.116 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-05-17T05:15:35.309 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:15:35.313 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:15:35.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:35.446 INFO:teuthology.orchestra.run.smithi131.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:15:35.450 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/096 2024-05-17T05:15:35.450 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/096 2024-05-17T05:15:35.450 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:15:35.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:35.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:15:35.461 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-05-17T05:15:35.653 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:15:35.657 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:15:35.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:36.332 INFO:teuthology.orchestra.run.smithi131.stdout:generic/097 1s 2024-05-17T05:15:36.337 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/097 2024-05-17T05:15:36.337 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:15:36.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:36.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:15:36.348 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-05-17T05:15:36.532 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:15:36.536 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:15:36.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:36.661 INFO:teuthology.orchestra.run.smithi131.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:15:36.664 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/098 2024-05-17T05:15:36.664 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/098 2024-05-17T05:15:36.664 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:15:36.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:36.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:15:36.675 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-05-17T05:15:36.879 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:15:36.884 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:15:36.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:37.055 INFO:teuthology.orchestra.run.smithi131.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-17T05:15:37.059 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/099 2024-05-17T05:15:37.059 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/099 2024-05-17T05:15:37.059 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:15:37.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:15:37.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:15:37.070 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-05-17T05:15:37.261 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:15:37.265 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:15:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:01.447 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:16:01.451 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:16:01.486 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-05-17T05:16:01.483+0000 7f7e80ea2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 174469) UID: 0 2024-05-17T05:16:01.487 INFO:tasks.ceph.mds.c.smithi131.stderr:2024-05-17T05:16:01.483+0000 7fbe21f5f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 174469) UID: 0 2024-05-17T05:16:03.302 INFO:teuthology.orchestra.run.smithi131.stdout:generic/100 26s 2024-05-17T05:16:03.307 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/100 2024-05-17T05:16:03.307 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:16:03.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:03.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:16:03.331 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-05-17T05:16:03.936 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:16:03.944 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:16:03.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:04.121 INFO:teuthology.orchestra.run.smithi131.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:16:04.125 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/101 2024-05-17T05:16:04.125 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/101 2024-05-17T05:16:04.125 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:16:04.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:04.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:16:04.137 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-05-17T05:16:04.328 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:16:04.332 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:16:04.332 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:04.453 INFO:teuthology.orchestra.run.smithi131.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:16:04.457 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/102 2024-05-17T05:16:04.457 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/102 2024-05-17T05:16:04.457 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:16:04.459 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:04.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:16:04.478 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-05-17T05:16:04.671 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:16:04.675 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:16:04.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:04.799 INFO:teuthology.orchestra.run.smithi131.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:16:04.802 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/103 2024-05-17T05:16:04.802 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/103 2024-05-17T05:16:04.802 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:16:04.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:04.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:16:04.814 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-05-17T05:16:04.997 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:16:05.002 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:16:05.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:05.134 INFO:teuthology.orchestra.run.smithi131.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:16:05.137 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/104 2024-05-17T05:16:05.137 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/104 2024-05-17T05:16:05.137 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:16:05.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:05.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:16:05.149 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-05-17T05:16:05.349 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:16:05.353 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:16:05.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:05.472 INFO:teuthology.orchestra.run.smithi131.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:16:05.476 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/105 2024-05-17T05:16:05.476 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/105 2024-05-17T05:16:05.476 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:16:05.478 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:05.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:16:05.489 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-05-17T05:16:05.681 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:16:05.685 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:16:05.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:05.828 INFO:teuthology.orchestra.run.smithi131.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:16:05.832 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/106 2024-05-17T05:16:05.832 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/106 2024-05-17T05:16:05.832 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:16:05.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:05.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:16:05.843 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-05-17T05:16:06.029 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:16:06.033 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:16:06.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:06.166 INFO:teuthology.orchestra.run.smithi131.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:16:06.170 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/107 2024-05-17T05:16:06.170 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/107 2024-05-17T05:16:06.170 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:16:06.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:06.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:16:06.182 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-05-17T05:16:06.372 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:16:06.376 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:16:06.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:06.874 INFO:teuthology.orchestra.run.smithi131.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:16:06.877 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/108 2024-05-17T05:16:06.878 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/108 2024-05-17T05:16:06.878 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:16:06.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:06.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:16:06.889 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-05-17T05:16:07.077 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:16:07.081 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:16:07.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:07.199 INFO:teuthology.orchestra.run.smithi131.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:16:07.202 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/109 2024-05-17T05:16:07.203 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/109 2024-05-17T05:16:07.203 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:16:07.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:07.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:16:07.214 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-05-17T05:16:07.402 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:16:07.406 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:16:07.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:07.575 INFO:teuthology.orchestra.run.smithi131.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:16:07.579 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/110 2024-05-17T05:16:07.579 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/110 2024-05-17T05:16:07.579 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:16:07.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:07.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:16:07.591 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-05-17T05:16:08.057 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:16:08.061 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:16:08.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:08.242 INFO:teuthology.orchestra.run.smithi131.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:16:08.246 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/111 2024-05-17T05:16:08.246 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/111 2024-05-17T05:16:08.246 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:16:08.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:08.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:16:08.260 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-05-17T05:16:08.802 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:16:08.807 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:16:08.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:53.395 INFO:teuthology.orchestra.run.smithi131.stdout:generic/112 45s 2024-05-17T05:16:53.400 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/112 2024-05-17T05:16:53.400 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:16:53.402 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:16:53.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:16:53.413 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-05-17T05:16:53.969 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:16:53.976 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:16:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:35.830 INFO:teuthology.orchestra.run.smithi131.stdout:generic/113 42s 2024-05-17T05:17:35.835 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/113 2024-05-17T05:17:35.835 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:17:35.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:35.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:17:35.850 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-05-17T05:17:36.435 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:17:36.439 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:17:36.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:36.602 INFO:teuthology.orchestra.run.smithi131.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-05-17T05:17:36.606 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/114 2024-05-17T05:17:36.606 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/114 2024-05-17T05:17:36.606 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:17:36.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:36.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:17:36.618 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-05-17T05:17:36.819 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:17:36.823 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:17:36.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:36.987 INFO:teuthology.orchestra.run.smithi131.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:17:36.991 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/115 2024-05-17T05:17:36.991 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/115 2024-05-17T05:17:36.991 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:17:36.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:37.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:17:37.002 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-05-17T05:17:37.502 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:17:37.507 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:17:37.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:37.689 INFO:teuthology.orchestra.run.smithi131.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:17:37.692 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/116 2024-05-17T05:17:37.692 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/116 2024-05-17T05:17:37.692 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:17:37.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:37.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:17:37.704 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-05-17T05:17:38.234 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:17:38.239 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:17:38.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:38.367 INFO:teuthology.orchestra.run.smithi131.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:17:38.371 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/117 2024-05-17T05:17:38.371 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/117 2024-05-17T05:17:38.371 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:17:38.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:38.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:17:38.382 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-05-17T05:17:38.585 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:17:38.589 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:17:38.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:38.751 INFO:teuthology.orchestra.run.smithi131.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:17:38.755 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/118 2024-05-17T05:17:38.755 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/118 2024-05-17T05:17:38.755 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:17:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:38.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:17:38.766 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-05-17T05:17:39.316 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:17:39.320 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:17:39.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:39.672 INFO:teuthology.orchestra.run.smithi131.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:17:39.676 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/119 2024-05-17T05:17:39.676 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/119 2024-05-17T05:17:39.676 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:17:39.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:39.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:17:39.688 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-05-17T05:17:40.197 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:17:40.203 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:17:40.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:40.335 INFO:teuthology.orchestra.run.smithi131.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:17:40.338 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/120 2024-05-17T05:17:40.339 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/120 2024-05-17T05:17:40.339 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:17:40.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:40.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:17:40.350 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-05-17T05:17:40.543 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:17:40.547 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:17:40.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:40.724 INFO:teuthology.orchestra.run.smithi131.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-17T05:17:40.727 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/121 2024-05-17T05:17:40.727 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/121 2024-05-17T05:17:40.727 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:17:40.730 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:40.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:17:40.739 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-05-17T05:17:41.268 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:17:41.273 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:17:41.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:41.448 INFO:teuthology.orchestra.run.smithi131.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-17T05:17:41.451 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/122 2024-05-17T05:17:41.451 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/122 2024-05-17T05:17:41.452 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:17:41.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:41.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:17:41.463 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-05-17T05:17:41.984 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:17:41.988 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:17:41.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:42.497 INFO:teuthology.orchestra.run.smithi131.stdout:generic/123 1s 2024-05-17T05:17:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/123 2024-05-17T05:17:42.503 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:17:42.505 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:42.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:17:42.515 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-05-17T05:17:43.055 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:17:43.059 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:17:43.059 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:43.184 INFO:teuthology.orchestra.run.smithi131.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:17:43.188 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/124 2024-05-17T05:17:43.188 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/124 2024-05-17T05:17:43.188 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:17:43.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:17:43.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:17:43.200 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-05-17T05:17:43.412 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:17:43.416 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:17:43.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:18:44.912 INFO:teuthology.orchestra.run.smithi131.stdout:generic/125 61s 2024-05-17T05:18:44.919 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/125 2024-05-17T05:18:44.919 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:18:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:18:44.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:18:44.949 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-05-17T05:18:45.408 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:18:45.412 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:18:45.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:18:46.029 INFO:teuthology.orchestra.run.smithi131.stdout:generic/126 - output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/126.out.bad) 2024-05-17T05:18:46.031 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/126.out 2024-05-17 04:10:05.103702108 +0000 2024-05-17T05:18:46.031 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/126.out.bad 2024-05-17 05:18:46.027760923 +0000 2024-05-17T05:18:46.031 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -1,7 +1,7 @@ 2024-05-17T05:18:46.031 INFO:teuthology.orchestra.run.smithi131.stdout: QA output created by 126 2024-05-17T05:18:46.031 INFO:teuthology.orchestra.run.smithi131.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2024-05-17T05:18:46.031 INFO:teuthology.orchestra.run.smithi131.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2024-05-17T05:18:46.031 INFO:teuthology.orchestra.run.smithi131.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2024-05-17T05:18:46.031 INFO:teuthology.orchestra.run.smithi131.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2024-05-17T05:18:46.031 INFO:teuthology.orchestra.run.smithi131.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2024-05-17T05:18:46.032 INFO:teuthology.orchestra.run.smithi131.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2024-05-17T05:18:46.032 INFO:teuthology.orchestra.run.smithi131.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2024-05-17T05:18:46.032 INFO:teuthology.orchestra.run.smithi131.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2024-05-17T05:18:46.032 INFO:teuthology.orchestra.run.smithi131.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2024-05-17T05:18:46.033 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/126 2024-05-17T05:18:46.033 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/126 2024-05-17T05:18:46.033 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T05:18:46.036 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:18:46.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T05:18:46.045 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T05:18:46.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T05:18:46.045 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-05-17T05:18:46.540 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:18:46.544 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:18:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:19:00.684 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:19:00.688 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:19:30.762 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:19:30.766 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:20:00.860 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:20:00.864 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:20:30.978 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:20:30.981 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:21:01.101 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:21:01.104 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:21:31.258 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:21:31.261 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:22:01.363 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:22:01.366 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:22:31.426 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:22:31.431 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:23:01.701 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:23:01.704 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:23:31.763 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:23:31.767 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:24:02.112 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:24:02.115 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:24:32.194 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:24:32.198 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:25:02.292 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:25:02.295 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:25:32.414 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:25:32.417 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:26:02.555 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:26:02.558 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:26:32.611 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:26:32.615 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:27:03.001 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:27:03.004 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:27:33.099 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:27:33.102 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:28:03.189 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:28:03.193 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:28:33.278 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:28:33.282 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:29:03.334 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:29:03.338 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:29:33.467 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:29:33.471 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:30:03.530 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:30:03.533 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:30:33.645 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:30:33.649 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:31:03.809 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:31:03.812 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:31:33.965 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:31:33.969 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:32:04.313 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:32:04.316 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:32:19.573 INFO:teuthology.orchestra.run.smithi131.stdout:generic/127 813s 2024-05-17T05:32:19.578 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/127 2024-05-17T05:32:19.578 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:32:19.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:32:19.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:32:19.591 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-05-17T05:32:20.060 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:32:20.064 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:32:20.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:32:20.192 INFO:teuthology.orchestra.run.smithi131.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:32:20.195 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/128 2024-05-17T05:32:20.196 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/128 2024-05-17T05:32:20.196 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:32:20.198 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:32:20.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:32:20.208 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-05-17T05:32:20.396 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:32:20.400 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:32:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:32:20.530 INFO:teuthology.orchestra.run.smithi131.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:32:20.533 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/129 2024-05-17T05:32:20.533 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/129 2024-05-17T05:32:20.533 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:32:20.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:32:20.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:32:20.545 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-05-17T05:32:20.736 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:32:20.740 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:32:20.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:32:20.859 INFO:teuthology.orchestra.run.smithi131.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:32:20.863 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/130 2024-05-17T05:32:20.863 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/130 2024-05-17T05:32:20.863 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:32:20.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:32:20.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:32:20.875 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-05-17T05:32:21.067 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:32:21.071 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:32:21.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:32:22.379 INFO:teuthology.orchestra.run.smithi131.stdout:generic/131 1s 2024-05-17T05:32:22.384 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/131 2024-05-17T05:32:22.384 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:32:22.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:32:22.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:32:22.396 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-05-17T05:32:22.865 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:32:22.869 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:32:22.869 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:32:22.991 INFO:teuthology.orchestra.run.smithi131.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:32:22.995 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/132 2024-05-17T05:32:22.995 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/132 2024-05-17T05:32:22.995 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:32:22.997 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:32:23.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:32:23.006 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-05-17T05:32:23.196 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:32:23.200 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:32:23.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:32:34.372 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:32:34.376 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:33:04.580 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:33:04.583 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:33:34.641 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:33:34.645 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:34:04.699 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:34:04.703 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:34:34.840 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:34:34.844 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:35:04.979 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:35:04.982 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:35:35.041 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:35:35.045 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:36:05.150 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:36:05.153 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:36:35.240 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:36:35.243 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout:generic/133 270s 2024-05-17T05:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/133 2024-05-17T05:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:54.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:36:54.082 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-05-17T05:36:54.530 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:54.712 INFO:teuthology.orchestra.run.smithi131.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/134 2024-05-17T05:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/134 2024-05-17T05:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:54.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:36:54.726 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-05-17T05:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:36:55.260 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:36:55.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:55.469 INFO:teuthology.orchestra.run.smithi131.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/135 2024-05-17T05:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/135 2024-05-17T05:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:36:55.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:55.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:36:55.484 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-05-17T05:36:55.670 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:36:55.674 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:36:55.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:55.881 INFO:teuthology.orchestra.run.smithi131.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-17T05:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/136 2024-05-17T05:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/136 2024-05-17T05:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:36:55.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:55.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:36:55.896 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-05-17T05:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:56.545 INFO:teuthology.orchestra.run.smithi131.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:36:56.548 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/137 2024-05-17T05:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/137 2024-05-17T05:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:56.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:36:56.561 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-05-17T05:36:57.022 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:36:57.026 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:57.192 INFO:teuthology.orchestra.run.smithi131.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/138 2024-05-17T05:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/138 2024-05-17T05:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:36:57.198 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:57.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:36:57.207 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-05-17T05:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/139 2024-05-17T05:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/139 2024-05-17T05:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:57.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:36:57.869 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-05-17T05:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/140 2024-05-17T05:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/140 2024-05-17T05:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:58.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:36:58.534 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-05-17T05:36:58.992 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/141 2024-05-17T05:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/141 2024-05-17T05:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:59.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:36:59.139 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-05-17T05:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/142 2024-05-17T05:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/142 2024-05-17T05:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:36:59.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:36:59.509 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-05-17T05:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/143 2024-05-17T05:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/143 2024-05-17T05:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:00.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:00.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:00.148 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-05-17T05:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:00.627 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:00.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:00.795 INFO:teuthology.orchestra.run.smithi131.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/144 2024-05-17T05:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/144 2024-05-17T05:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:00.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:00.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:00.811 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-05-17T05:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:01.451 INFO:teuthology.orchestra.run.smithi131.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/145 2024-05-17T05:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/145 2024-05-17T05:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:01.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:01.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:01.467 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-05-17T05:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:02.121 INFO:teuthology.orchestra.run.smithi131.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/146 2024-05-17T05:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/146 2024-05-17T05:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:02.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:02.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:02.136 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-05-17T05:37:02.604 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:02.608 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:02.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:02.768 INFO:teuthology.orchestra.run.smithi131.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:02.772 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/147 2024-05-17T05:37:02.773 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/147 2024-05-17T05:37:02.773 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:02.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:02.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:02.784 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-05-17T05:37:03.261 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:03.265 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:03.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:03.449 INFO:teuthology.orchestra.run.smithi131.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:03.452 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/148 2024-05-17T05:37:03.452 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/148 2024-05-17T05:37:03.452 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:03.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:03.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:03.464 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-05-17T05:37:03.928 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:03.932 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:03.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:04.095 INFO:teuthology.orchestra.run.smithi131.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:04.098 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/149 2024-05-17T05:37:04.098 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/149 2024-05-17T05:37:04.099 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:04.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:04.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:04.110 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-05-17T05:37:04.584 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:04.588 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:04.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:04.752 INFO:teuthology.orchestra.run.smithi131.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:04.756 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/150 2024-05-17T05:37:04.756 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/150 2024-05-17T05:37:04.756 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:04.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:04.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:04.768 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-05-17T05:37:05.243 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:05.247 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:05.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:05.379 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:37:05.383 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:37:05.412 INFO:teuthology.orchestra.run.smithi131.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:05.416 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/151 2024-05-17T05:37:05.416 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/151 2024-05-17T05:37:05.416 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:05.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:05.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:05.428 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-05-17T05:37:05.909 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:05.913 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:05.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:06.080 INFO:teuthology.orchestra.run.smithi131.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:06.084 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/152 2024-05-17T05:37:06.084 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/152 2024-05-17T05:37:06.084 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:06.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:06.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:06.130 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-05-17T05:37:06.578 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:06.581 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:06.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:06.749 INFO:teuthology.orchestra.run.smithi131.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:06.753 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/153 2024-05-17T05:37:06.753 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/153 2024-05-17T05:37:06.753 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:06.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:06.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:06.764 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-05-17T05:37:07.223 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:07.228 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:07.228 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:07.388 INFO:teuthology.orchestra.run.smithi131.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:07.392 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/154 2024-05-17T05:37:07.392 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/154 2024-05-17T05:37:07.392 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:07.394 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:07.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:07.404 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-05-17T05:37:07.890 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:07.894 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:07.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:08.084 INFO:teuthology.orchestra.run.smithi131.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:08.088 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/155 2024-05-17T05:37:08.088 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/155 2024-05-17T05:37:08.088 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:08.090 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:08.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:08.138 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-05-17T05:37:08.586 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:08.590 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:08.591 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:08.761 INFO:teuthology.orchestra.run.smithi131.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:08.764 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/156 2024-05-17T05:37:08.764 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/156 2024-05-17T05:37:08.765 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:08.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:08.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:08.776 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-05-17T05:37:09.253 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:09.257 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:09.257 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:09.422 INFO:teuthology.orchestra.run.smithi131.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:09.426 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/157 2024-05-17T05:37:09.426 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/157 2024-05-17T05:37:09.426 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:09.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:09.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:09.438 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-05-17T05:37:09.898 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:09.902 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:09.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:10.065 INFO:teuthology.orchestra.run.smithi131.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:10.069 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/158 2024-05-17T05:37:10.069 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/158 2024-05-17T05:37:10.069 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:10.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:10.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:10.117 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-05-17T05:37:10.556 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:10.560 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:10.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:10.739 INFO:teuthology.orchestra.run.smithi131.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-05-17T05:37:10.743 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/159 2024-05-17T05:37:10.743 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/159 2024-05-17T05:37:10.743 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:10.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:10.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:10.764 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-05-17T05:37:10.956 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:10.960 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:10.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:11.111 INFO:teuthology.orchestra.run.smithi131.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-05-17T05:37:11.114 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/160 2024-05-17T05:37:11.115 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/160 2024-05-17T05:37:11.115 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:11.117 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:11.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:11.136 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-05-17T05:37:11.325 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:11.329 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:11.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:11.457 INFO:teuthology.orchestra.run.smithi131.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:11.461 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/161 2024-05-17T05:37:11.461 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/161 2024-05-17T05:37:11.461 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:11.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:11.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:11.472 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-05-17T05:37:11.663 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:11.667 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:11.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:11.797 INFO:teuthology.orchestra.run.smithi131.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:11.801 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/162 2024-05-17T05:37:11.801 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/162 2024-05-17T05:37:11.801 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:11.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:11.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:11.812 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-05-17T05:37:11.997 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:12.001 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:12.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:12.135 INFO:teuthology.orchestra.run.smithi131.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:12.139 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/163 2024-05-17T05:37:12.139 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/163 2024-05-17T05:37:12.139 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:12.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:12.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:12.159 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-05-17T05:37:12.357 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:12.361 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:12.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:12.493 INFO:teuthology.orchestra.run.smithi131.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:12.497 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/164 2024-05-17T05:37:12.497 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/164 2024-05-17T05:37:12.497 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:12.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:12.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:12.509 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-05-17T05:37:12.706 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:12.710 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:12.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:12.837 INFO:teuthology.orchestra.run.smithi131.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:12.840 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/165 2024-05-17T05:37:12.840 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/165 2024-05-17T05:37:12.841 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:12.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:12.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:12.851 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-05-17T05:37:13.041 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:13.045 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:13.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:13.173 INFO:teuthology.orchestra.run.smithi131.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:13.177 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/166 2024-05-17T05:37:13.177 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/166 2024-05-17T05:37:13.177 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:13.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:13.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:13.199 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-05-17T05:37:13.396 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:13.400 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:13.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:13.524 INFO:teuthology.orchestra.run.smithi131.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:13.528 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/167 2024-05-17T05:37:13.528 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/167 2024-05-17T05:37:13.528 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:13.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:13.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:13.539 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-05-17T05:37:13.728 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:13.732 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:13.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:13.852 INFO:teuthology.orchestra.run.smithi131.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:13.855 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/168 2024-05-17T05:37:13.855 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/168 2024-05-17T05:37:13.855 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:13.857 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:13.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:13.866 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-05-17T05:37:14.054 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:14.058 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:14.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:14.183 INFO:teuthology.orchestra.run.smithi131.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:14.187 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/169 2024-05-17T05:37:14.187 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/169 2024-05-17T05:37:14.187 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:14.189 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:14.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:14.209 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-05-17T05:37:14.405 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:14.409 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:14.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:14.532 INFO:teuthology.orchestra.run.smithi131.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:14.536 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/170 2024-05-17T05:37:14.536 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/170 2024-05-17T05:37:14.536 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:14.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:14.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:14.547 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-05-17T05:37:14.746 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:14.750 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:14.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:14.909 INFO:teuthology.orchestra.run.smithi131.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:14.913 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/171 2024-05-17T05:37:14.913 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/171 2024-05-17T05:37:14.913 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:14.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:14.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:14.924 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-05-17T05:37:15.113 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:15.118 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:15.118 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:15.251 INFO:teuthology.orchestra.run.smithi131.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:15.255 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/172 2024-05-17T05:37:15.255 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/172 2024-05-17T05:37:15.255 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:15.257 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:15.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:15.277 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-05-17T05:37:15.473 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:15.477 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:15.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:15.604 INFO:teuthology.orchestra.run.smithi131.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:15.608 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/173 2024-05-17T05:37:15.608 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/173 2024-05-17T05:37:15.608 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:15.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:15.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:15.619 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-05-17T05:37:15.810 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:15.812 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:15.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:15.946 INFO:teuthology.orchestra.run.smithi131.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:15.950 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/174 2024-05-17T05:37:15.950 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/174 2024-05-17T05:37:15.950 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:15.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:15.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:15.961 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-05-17T05:37:16.152 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:16.156 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:16.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:16.279 INFO:teuthology.orchestra.run.smithi131.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:16.283 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/175 2024-05-17T05:37:16.283 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/175 2024-05-17T05:37:16.283 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:16.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:16.304 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-05-17T05:37:16.497 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:16.501 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:16.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:16.620 INFO:teuthology.orchestra.run.smithi131.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:16.624 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/176 2024-05-17T05:37:16.624 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/176 2024-05-17T05:37:16.624 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:16.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:16.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:16.635 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-05-17T05:37:16.823 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:16.827 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:16.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:16.970 INFO:teuthology.orchestra.run.smithi131.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:16.974 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/177 2024-05-17T05:37:16.974 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/177 2024-05-17T05:37:16.974 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:16.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:16.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:16.985 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-05-17T05:37:17.187 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:17.191 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:17.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:17.366 INFO:teuthology.orchestra.run.smithi131.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:17.370 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/178 2024-05-17T05:37:17.370 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/178 2024-05-17T05:37:17.370 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:17.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:17.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:17.429 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-05-17T05:37:17.874 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:17.878 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:17.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:18.041 INFO:teuthology.orchestra.run.smithi131.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:18.045 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/179 2024-05-17T05:37:18.045 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/179 2024-05-17T05:37:18.045 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:18.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:18.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:18.056 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-05-17T05:37:18.535 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:18.539 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:18.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:18.705 INFO:teuthology.orchestra.run.smithi131.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:18.708 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/180 2024-05-17T05:37:18.708 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/180 2024-05-17T05:37:18.709 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:18.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:18.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:18.720 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-05-17T05:37:19.209 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:19.213 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:19.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:19.377 INFO:teuthology.orchestra.run.smithi131.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:19.380 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/181 2024-05-17T05:37:19.381 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/181 2024-05-17T05:37:19.381 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:19.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:19.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:19.428 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-05-17T05:37:19.872 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:19.876 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:19.876 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:20.042 INFO:teuthology.orchestra.run.smithi131.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-17T05:37:20.046 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/182 2024-05-17T05:37:20.046 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/182 2024-05-17T05:37:20.046 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:20.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:20.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:20.058 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-05-17T05:37:20.503 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:20.508 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:20.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:20.643 INFO:teuthology.orchestra.run.smithi131.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:20.647 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/183 2024-05-17T05:37:20.647 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/183 2024-05-17T05:37:20.647 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:20.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:20.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:20.658 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-05-17T05:37:20.855 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:20.859 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:20.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:21.030 INFO:teuthology.orchestra.run.smithi131.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/184.out.bad) 2024-05-17T05:37:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/184.out 2024-05-17 04:10:05.106702047 +0000 2024-05-17T05:37:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/184.out.bad 2024-05-17 05:37:21.029052970 +0000 2024-05-17T05:37:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -1 +1,2 @@ 2024-05-17T05:37:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: QA output created by 184 2024-05-17T05:37:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: +/tmp/tmp.bj85EVPhOZxfstests-dev/tests/generic/184: line 23: /tmp/tmp.2OgBg7y0wTtest/null: Permission denied 2024-05-17T05:37:21.034 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/184 2024-05-17T05:37:21.034 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/184 2024-05-17T05:37:21.034 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T05:37:21.036 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:21.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T05:37:21.045 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T05:37:21.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T05:37:21.045 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-05-17T05:37:21.241 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:21.245 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:21.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:21.380 INFO:teuthology.orchestra.run.smithi131.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:21.384 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/185 2024-05-17T05:37:21.384 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/185 2024-05-17T05:37:21.384 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:21.386 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:21.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:21.409 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-05-17T05:37:21.606 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:21.610 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:21.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:21.735 INFO:teuthology.orchestra.run.smithi131.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:21.738 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/186 2024-05-17T05:37:21.738 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/186 2024-05-17T05:37:21.738 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:21.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:21.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:21.749 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-05-17T05:37:21.938 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:21.942 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:21.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:22.072 INFO:teuthology.orchestra.run.smithi131.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:22.075 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/187 2024-05-17T05:37:22.076 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/187 2024-05-17T05:37:22.076 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:22.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:22.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:22.086 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-05-17T05:37:22.277 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:22.281 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:22.282 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:22.409 INFO:teuthology.orchestra.run.smithi131.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:22.413 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/188 2024-05-17T05:37:22.413 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/188 2024-05-17T05:37:22.414 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:22.415 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:22.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:22.436 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-05-17T05:37:22.632 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:22.636 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:22.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:22.775 INFO:teuthology.orchestra.run.smithi131.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:22.779 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/189 2024-05-17T05:37:22.779 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/189 2024-05-17T05:37:22.779 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:22.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:22.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:22.791 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-05-17T05:37:22.976 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:22.980 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:22.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:23.097 INFO:teuthology.orchestra.run.smithi131.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:23.101 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/190 2024-05-17T05:37:23.101 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/190 2024-05-17T05:37:23.101 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:23.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:23.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:23.112 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-05-17T05:37:23.303 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:23.307 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:23.307 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:23.433 INFO:teuthology.orchestra.run.smithi131.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:23.436 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/191 2024-05-17T05:37:23.437 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/191 2024-05-17T05:37:23.437 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:23.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:23.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:23.448 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-05-17T05:37:23.637 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:23.641 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:23.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:23.790 INFO:teuthology.orchestra.run.smithi131.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2024-05-17T05:37:23.794 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/192 2024-05-17T05:37:23.794 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/192 2024-05-17T05:37:23.794 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:23.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:23.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:23.805 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-05-17T05:37:23.992 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:23.997 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:23.997 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:24.841 INFO:teuthology.orchestra.run.smithi131.stdout:generic/193 - output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/193.out.bad) 2024-05-17T05:37:24.843 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/193.out 2024-05-17 04:10:05.107702026 +0000 2024-05-17T05:37:24.843 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/193.out.bad 2024-05-17 05:37:24.839975123 +0000 2024-05-17T05:37:24.843 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -24,7 +24,6 @@ 2024-05-17T05:37:24.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:24.843 INFO:teuthology.orchestra.run.smithi131.stdout: user: chmod a+r on qa_user owned file (should succeed) 2024-05-17T05:37:24.843 INFO:teuthology.orchestra.run.smithi131.stdout: user: chmod a+r on root owned file (should fail) 2024-05-17T05:37:24.843 INFO:teuthology.orchestra.run.smithi131.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2024-05-17T05:37:24.843 INFO:teuthology.orchestra.run.smithi131.stdout: check that the sgid bit is cleared 2024-05-17T05:37:24.843 INFO:teuthology.orchestra.run.smithi131.stdout: -rw-rw-rw- 2024-05-17T05:37:24.843 INFO:teuthology.orchestra.run.smithi131.stdout: check that suid bit is not cleared 2024-05-17T05:37:24.845 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/193 2024-05-17T05:37:24.845 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/193 2024-05-17T05:37:24.845 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T05:37:24.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:24.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T05:37:24.857 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T05:37:24.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T05:37:24.857 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-05-17T05:37:25.325 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:25.329 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:25.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:25.453 INFO:teuthology.orchestra.run.smithi131.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:25.457 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/194 2024-05-17T05:37:25.457 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/194 2024-05-17T05:37:25.457 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:25.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:25.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:25.480 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-05-17T05:37:25.678 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:25.683 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:25.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:25.828 INFO:teuthology.orchestra.run.smithi131.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:25.831 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/195 2024-05-17T05:37:25.831 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/195 2024-05-17T05:37:25.831 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:25.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:25.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:25.843 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-05-17T05:37:26.039 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:26.043 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:26.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:26.165 INFO:teuthology.orchestra.run.smithi131.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:26.168 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/196 2024-05-17T05:37:26.169 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/196 2024-05-17T05:37:26.169 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:26.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:26.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:26.180 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-05-17T05:37:26.373 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:26.377 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:26.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:26.496 INFO:teuthology.orchestra.run.smithi131.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:26.500 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/197 2024-05-17T05:37:26.500 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/197 2024-05-17T05:37:26.500 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:26.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:26.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:26.511 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-05-17T05:37:26.702 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:26.706 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:26.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:27.392 INFO:teuthology.orchestra.run.smithi131.stdout:generic/198 1s 2024-05-17T05:37:27.398 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/198 2024-05-17T05:37:27.398 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:27.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:27.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:27.410 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-05-17T05:37:27.930 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:27.935 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:27.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:28.073 INFO:teuthology.orchestra.run.smithi131.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:28.076 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/199 2024-05-17T05:37:28.077 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/199 2024-05-17T05:37:28.077 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:28.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:28.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:28.100 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-05-17T05:37:28.289 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:28.293 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:28.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:28.418 INFO:teuthology.orchestra.run.smithi131.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:28.422 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/200 2024-05-17T05:37:28.422 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/200 2024-05-17T05:37:28.423 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:28.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:28.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:28.434 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-05-17T05:37:28.624 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:28.628 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:28.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:28.768 INFO:teuthology.orchestra.run.smithi131.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:28.772 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/201 2024-05-17T05:37:28.772 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/201 2024-05-17T05:37:28.772 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:28.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:28.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:28.783 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-05-17T05:37:28.971 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:28.975 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:28.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:29.099 INFO:teuthology.orchestra.run.smithi131.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:29.102 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/202 2024-05-17T05:37:29.103 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/202 2024-05-17T05:37:29.103 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:29.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:29.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:29.126 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-05-17T05:37:29.317 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:29.321 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:29.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:29.443 INFO:teuthology.orchestra.run.smithi131.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:29.446 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/203 2024-05-17T05:37:29.447 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/203 2024-05-17T05:37:29.447 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:29.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:29.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:29.458 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-05-17T05:37:29.644 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:29.648 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:29.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:31.403 INFO:teuthology.orchestra.run.smithi131.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:31.407 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/204 2024-05-17T05:37:31.408 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/204 2024-05-17T05:37:31.408 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:31.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:31.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:31.432 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-05-17T05:37:31.635 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:31.639 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:31.639 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:31.768 INFO:teuthology.orchestra.run.smithi131.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:31.772 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/205 2024-05-17T05:37:31.772 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/205 2024-05-17T05:37:31.772 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:31.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:31.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:31.783 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-05-17T05:37:31.972 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:31.976 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:31.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:32.109 INFO:teuthology.orchestra.run.smithi131.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:37:32.113 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/206 2024-05-17T05:37:32.113 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/206 2024-05-17T05:37:32.113 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:32.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:32.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:32.125 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-05-17T05:37:32.317 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:32.322 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:32.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:35.512 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:37:35.515 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:37:53.545 INFO:teuthology.orchestra.run.smithi131.stdout:generic/207 21s 2024-05-17T05:37:53.550 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/207 2024-05-17T05:37:53.550 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:37:53.553 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:37:53.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:37:53.564 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-05-17T05:37:54.041 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:37:54.045 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:37:54.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:38:05.876 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:38:05.879 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:38:35.981 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:38:35.985 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:39:06.277 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:39:06.281 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:39:36.353 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:39:36.356 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:40:06.655 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:40:06.658 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:40:36.732 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:40:36.735 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:41:06.880 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:41:06.885 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:41:14.350 INFO:teuthology.orchestra.run.smithi131.stdout:generic/208 200s 2024-05-17T05:41:14.355 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/208 2024-05-17T05:41:14.356 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:14.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:14.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:14.368 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-05-17T05:41:14.812 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:14.817 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:14.817 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:25.236 INFO:teuthology.orchestra.run.smithi131.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/209.out.bad) 2024-05-17T05:41:25.241 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/209.out 2024-05-17 04:10:05.108702005 +0000 2024-05-17T05:41:25.241 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/209.out.bad 2024-05-17 05:41:25.206067881 +0000 2024-05-17T05:41:25.241 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -1,2 +1,2 @@ 2024-05-17T05:41:25.241 INFO:teuthology.orchestra.run.smithi131.stdout: QA output created by 209 2024-05-17T05:41:25.241 INFO:teuthology.orchestra.run.smithi131.stdout: -test ran for 30 seconds without error 2024-05-17T05:41:25.241 INFO:teuthology.orchestra.run.smithi131.stdout: +reader found old byte at pos 4096 2024-05-17T05:41:25.242 INFO:teuthology.orchestra.run.smithi131.stdout: \ No newline at end of file 2024-05-17T05:41:25.244 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/209 2024-05-17T05:41:25.244 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/209 2024-05-17T05:41:25.245 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T05:41:25.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:25.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T05:41:25.261 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T05:41:25.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T05:41:25.262 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-05-17T05:41:25.654 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:25.658 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:25.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:25.899 INFO:teuthology.orchestra.run.smithi131.stdout:generic/210 0s 2024-05-17T05:41:25.905 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/210 2024-05-17T05:41:25.905 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:25.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:25.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:25.944 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-05-17T05:41:26.388 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:26.392 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:26.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:26.736 INFO:teuthology.orchestra.run.smithi131.stdout:generic/211 0s 2024-05-17T05:41:26.742 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/211 2024-05-17T05:41:26.742 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:26.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:26.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:26.753 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-05-17T05:41:26.945 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:26.950 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:26.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:27.166 INFO:teuthology.orchestra.run.smithi131.stdout:generic/212 1s 2024-05-17T05:41:27.171 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/212 2024-05-17T05:41:27.172 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:27.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:27.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:27.183 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-05-17T05:41:27.370 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:27.374 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:27.374 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:27.778 INFO:teuthology.orchestra.run.smithi131.stdout:generic/213 - output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/213.out.bad) 2024-05-17T05:41:27.779 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/213.out 2024-05-17 04:10:05.108702005 +0000 2024-05-17T05:41:27.779 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/213.out.bad 2024-05-17 05:41:27.777015489 +0000 2024-05-17T05:41:27.780 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -1,4 +1,3 @@ 2024-05-17T05:41:27.780 INFO:teuthology.orchestra.run.smithi131.stdout: QA output created by 213 2024-05-17T05:41:27.780 INFO:teuthology.orchestra.run.smithi131.stdout: We should get: fallocate: No space left on device 2024-05-17T05:41:27.780 INFO:teuthology.orchestra.run.smithi131.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2024-05-17T05:41:27.780 INFO:teuthology.orchestra.run.smithi131.stdout: -fallocate: No space left on device 2024-05-17T05:41:27.782 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/213 2024-05-17T05:41:27.782 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/213 2024-05-17T05:41:27.782 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T05:41:27.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:27.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T05:41:27.794 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T05:41:27.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T05:41:27.794 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-05-17T05:41:28.298 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:28.302 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:28.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:28.823 INFO:teuthology.orchestra.run.smithi131.stdout:generic/214 0s 2024-05-17T05:41:28.830 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/214 2024-05-17T05:41:28.831 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:28.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:28.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:28.854 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-05-17T05:41:29.342 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:29.347 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:32.366 INFO:teuthology.orchestra.run.smithi131.stdout:generic/215 3s 2024-05-17T05:41:32.373 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/215 2024-05-17T05:41:32.373 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:32.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:32.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:32.390 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-05-17T05:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:32.663 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:32.827 INFO:teuthology.orchestra.run.smithi131.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:32.831 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/216 2024-05-17T05:41:32.831 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/216 2024-05-17T05:41:32.831 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:32.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:32.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:32.844 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-05-17T05:41:33.126 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:33.130 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:33.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:33.282 INFO:teuthology.orchestra.run.smithi131.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/217 2024-05-17T05:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/217 2024-05-17T05:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:33.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:33.301 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-05-17T05:41:33.550 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:33.556 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:33.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:33.709 INFO:teuthology.orchestra.run.smithi131.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:33.713 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/218 2024-05-17T05:41:33.713 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/218 2024-05-17T05:41:33.713 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:33.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:33.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:33.728 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-05-17T05:41:33.993 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:33.999 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:33.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:34.170 INFO:teuthology.orchestra.run.smithi131.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:34.174 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/219 2024-05-17T05:41:34.174 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/219 2024-05-17T05:41:34.174 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:34.176 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:34.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:34.187 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-05-17T05:41:34.454 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:34.458 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:34.458 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:34.609 INFO:teuthology.orchestra.run.smithi131.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:34.613 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/220 2024-05-17T05:41:34.613 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/220 2024-05-17T05:41:34.613 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:34.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:34.626 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-05-17T05:41:34.876 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:34.881 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:34.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:36.077 INFO:teuthology.orchestra.run.smithi131.stdout:generic/221 2s 2024-05-17T05:41:36.082 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/221 2024-05-17T05:41:36.082 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:36.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:36.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:36.094 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-05-17T05:41:36.363 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:36.367 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:36.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:36.524 INFO:teuthology.orchestra.run.smithi131.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:36.528 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/222 2024-05-17T05:41:36.528 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/222 2024-05-17T05:41:36.528 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:36.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:36.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:36.545 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-05-17T05:41:36.813 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:36.818 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:36.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:36.936 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:41:36.939 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:41:36.985 INFO:teuthology.orchestra.run.smithi131.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:36.990 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/223 2024-05-17T05:41:36.990 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/223 2024-05-17T05:41:36.990 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:36.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:37.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:37.007 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-05-17T05:41:37.305 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:37.310 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:37.490 INFO:teuthology.orchestra.run.smithi131.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:37.494 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/224 2024-05-17T05:41:37.495 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/224 2024-05-17T05:41:37.495 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:37.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:37.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:37.508 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-05-17T05:41:37.753 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:37.758 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:37.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:37.911 INFO:teuthology.orchestra.run.smithi131.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:37.915 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/225 2024-05-17T05:41:37.915 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/225 2024-05-17T05:41:37.915 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:37.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:37.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:37.938 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-05-17T05:41:38.196 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:38.202 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:38.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:38.362 INFO:teuthology.orchestra.run.smithi131.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:38.367 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/226 2024-05-17T05:41:38.368 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/226 2024-05-17T05:41:38.368 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:38.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:38.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:38.394 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-05-17T05:41:38.640 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:38.644 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:38.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:38.804 INFO:teuthology.orchestra.run.smithi131.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:38.809 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/227 2024-05-17T05:41:38.810 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/227 2024-05-17T05:41:38.810 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:38.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:38.822 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-05-17T05:41:39.076 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:39.360 INFO:teuthology.orchestra.run.smithi131.stdout:generic/228 0s 2024-05-17T05:41:39.367 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/228 2024-05-17T05:41:39.367 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:39.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:39.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:39.385 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-05-17T05:41:39.869 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:39.877 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:39.877 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:40.032 INFO:teuthology.orchestra.run.smithi131.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:40.036 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/229 2024-05-17T05:41:40.036 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/229 2024-05-17T05:41:40.036 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:40.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:40.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:40.064 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-05-17T05:41:40.314 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:40.320 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:40.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:40.483 INFO:teuthology.orchestra.run.smithi131.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:40.487 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/230 2024-05-17T05:41:40.487 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/230 2024-05-17T05:41:40.487 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:40.490 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:40.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:40.502 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-05-17T05:41:40.762 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:40.768 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:40.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:40.939 INFO:teuthology.orchestra.run.smithi131.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:40.943 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/231 2024-05-17T05:41:40.943 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/231 2024-05-17T05:41:40.943 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:40.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:40.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:40.958 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-05-17T05:41:41.203 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:41.208 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:41.208 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:41.380 INFO:teuthology.orchestra.run.smithi131.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:41.384 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/232 2024-05-17T05:41:41.384 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/232 2024-05-17T05:41:41.385 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:41.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:41.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:41.403 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-05-17T05:41:41.665 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:41.671 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:41.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:41.822 INFO:teuthology.orchestra.run.smithi131.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:41.827 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/233 2024-05-17T05:41:41.827 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/233 2024-05-17T05:41:41.828 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:41.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:41.845 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-05-17T05:41:42.095 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:42.100 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:42.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:42.256 INFO:teuthology.orchestra.run.smithi131.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:42.261 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/234 2024-05-17T05:41:42.261 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/234 2024-05-17T05:41:42.261 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:42.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:42.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:42.278 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-05-17T05:41:42.530 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:42.536 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:42.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:42.703 INFO:teuthology.orchestra.run.smithi131.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:42.707 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/235 2024-05-17T05:41:42.707 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/235 2024-05-17T05:41:42.707 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:42.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:42.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:42.725 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-05-17T05:41:42.982 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:42.987 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:42.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:44.263 INFO:teuthology.orchestra.run.smithi131.stdout:generic/236 2s 2024-05-17T05:41:44.271 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/236 2024-05-17T05:41:44.271 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:44.274 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:44.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:44.286 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-05-17T05:41:44.764 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:44.770 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:44.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:44.987 INFO:teuthology.orchestra.run.smithi131.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-17T05:41:44.992 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/237 2024-05-17T05:41:44.992 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/237 2024-05-17T05:41:44.992 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:45.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:45.007 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-05-17T05:41:45.264 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:45.269 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:45.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:45.422 INFO:teuthology.orchestra.run.smithi131.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:41:45.427 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/238 2024-05-17T05:41:45.427 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/238 2024-05-17T05:41:45.427 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:45.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:45.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:45.442 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-05-17T05:41:45.699 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:45.705 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:45.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:45.900 INFO:teuthology.orchestra.run.smithi131.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-05-17T05:41:45.904 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/239 2024-05-17T05:41:45.904 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/239 2024-05-17T05:41:45.905 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:45.908 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:45.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:45.921 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-05-17T05:41:46.192 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:46.197 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:46.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:46.409 INFO:teuthology.orchestra.run.smithi131.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-05-17T05:41:46.414 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/240 2024-05-17T05:41:46.414 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/240 2024-05-17T05:41:46.414 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:41:46.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:41:46.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:41:46.431 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-05-17T05:41:46.682 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:41:46.687 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:41:46.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:42:07.061 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:42:07.065 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:42:37.222 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:42:37.227 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:43:00.565 INFO:teuthology.orchestra.run.smithi131.stdout:generic/241 74s 2024-05-17T05:43:00.570 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/241 2024-05-17T05:43:00.570 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:43:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:43:00.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:43:00.586 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-05-17T05:43:01.065 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:43:01.070 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:43:01.070 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:43:01.236 INFO:teuthology.orchestra.run.smithi131.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:43:01.240 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/242 2024-05-17T05:43:01.240 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/242 2024-05-17T05:43:01.240 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:43:01.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:43:01.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:43:01.261 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-05-17T05:43:01.505 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:43:01.510 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:43:01.510 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:43:01.658 INFO:teuthology.orchestra.run.smithi131.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:43:01.663 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/243 2024-05-17T05:43:01.663 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/243 2024-05-17T05:43:01.663 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:43:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:43:01.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:43:01.678 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-05-17T05:43:01.923 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:43:01.927 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:43:01.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:43:02.082 INFO:teuthology.orchestra.run.smithi131.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-17T05:43:02.086 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/244 2024-05-17T05:43:02.086 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/244 2024-05-17T05:43:02.086 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:43:02.089 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:43:02.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:43:02.101 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-05-17T05:43:02.390 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:43:02.394 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:43:02.394 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:43:02.693 INFO:teuthology.orchestra.run.smithi131.stdout:generic/245 0s 2024-05-17T05:43:02.700 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/245 2024-05-17T05:43:02.700 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:43:02.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:43:02.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:43:02.728 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-05-17T05:43:03.373 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:43:03.381 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:43:03.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:43:04.010 INFO:teuthology.orchestra.run.smithi131.stdout:generic/246 0s 2024-05-17T05:43:04.051 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/246 2024-05-17T05:43:04.051 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:43:04.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:43:04.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:43:04.071 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-05-17T05:43:04.572 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:43:04.577 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:43:04.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:43:07.296 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:43:07.299 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:43:37.689 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:43:37.692 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:43:57.578 INFO:teuthology.orchestra.run.smithi131.stdout:generic/247 53s 2024-05-17T05:43:57.585 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/247 2024-05-17T05:43:57.585 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:43:57.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:43:57.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:43:57.599 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-05-17T05:43:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:43:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:43:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:43:58.124 INFO:teuthology.orchestra.run.smithi131.stdout:generic/248 1s 2024-05-17T05:43:58.131 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/248 2024-05-17T05:43:58.131 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:43:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:43:58.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:43:58.148 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-05-17T05:43:58.400 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:43:58.405 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:43:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:00.610 INFO:teuthology.orchestra.run.smithi131.stdout:generic/249 2s 2024-05-17T05:44:00.618 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/249 2024-05-17T05:44:00.618 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:44:00.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:00.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:44:00.638 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-05-17T05:44:01.121 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:44:01.128 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:44:01.128 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:01.359 INFO:teuthology.orchestra.run.smithi131.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:44:01.364 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/250 2024-05-17T05:44:01.364 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/250 2024-05-17T05:44:01.364 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:44:01.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:01.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:44:01.380 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-05-17T05:44:01.625 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:44:01.631 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:44:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:01.812 INFO:teuthology.orchestra.run.smithi131.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:44:01.817 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/251 2024-05-17T05:44:01.817 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/251 2024-05-17T05:44:01.817 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:44:01.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:01.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:44:01.831 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-05-17T05:44:02.069 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:44:02.076 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:44:02.076 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:02.249 INFO:teuthology.orchestra.run.smithi131.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:44:02.254 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/252 2024-05-17T05:44:02.254 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/252 2024-05-17T05:44:02.254 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:44:02.256 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:02.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:44:02.268 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-05-17T05:44:02.538 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:44:02.542 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:44:02.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:02.700 INFO:teuthology.orchestra.run.smithi131.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:44:02.705 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/253 2024-05-17T05:44:02.705 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/253 2024-05-17T05:44:02.705 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:44:02.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:02.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:44:02.719 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-05-17T05:44:02.974 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:44:02.982 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:44:02.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:03.149 INFO:teuthology.orchestra.run.smithi131.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:44:03.155 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/254 2024-05-17T05:44:03.155 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/254 2024-05-17T05:44:03.155 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:44:03.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:03.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:44:03.170 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-05-17T05:44:03.431 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:44:03.436 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:44:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:04.809 INFO:teuthology.orchestra.run.smithi131.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-17T05:44:04.813 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/255 2024-05-17T05:44:04.813 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/255 2024-05-17T05:44:04.813 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:44:04.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:04.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:44:04.845 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-05-17T05:44:05.300 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:44:05.310 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:44:05.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:06.608 INFO:teuthology.orchestra.run.smithi131.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:44:06.612 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/256 2024-05-17T05:44:06.612 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/256 2024-05-17T05:44:06.612 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:44:06.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:06.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:44:06.627 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-05-17T05:44:06.885 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:44:06.891 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:44:06.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:07.788 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:44:07.791 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:44:09.128 INFO:teuthology.orchestra.run.smithi131.stdout:generic/257 3s 2024-05-17T05:44:09.135 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/257 2024-05-17T05:44:09.135 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:44:09.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:09.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:44:09.160 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-05-17T05:44:09.668 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:44:09.675 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:44:09.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:09.891 INFO:teuthology.orchestra.run.smithi131.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/258.out.bad) 2024-05-17T05:44:09.894 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/258.out 2024-05-17 04:10:05.111701944 +0000 2024-05-17T05:44:09.894 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/258.out.bad 2024-05-17 05:44:09.890711198 +0000 2024-05-17T05:44:09.894 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -1,5 +1,6 @@ 2024-05-17T05:44:09.894 INFO:teuthology.orchestra.run.smithi131.stdout: QA output created by 258 2024-05-17T05:44:09.894 INFO:teuthology.orchestra.run.smithi131.stdout: Creating file with timestamp of Jan 1, 1960 2024-05-17T05:44:09.895 INFO:teuthology.orchestra.run.smithi131.stdout: Testing for negative seconds since epoch 2024-05-17T05:44:09.895 INFO:teuthology.orchestra.run.smithi131.stdout: -Remounting to flush cache 2024-05-17T05:44:09.895 INFO:teuthology.orchestra.run.smithi131.stdout: -Testing for negative seconds since epoch 2024-05-17T05:44:09.895 INFO:teuthology.orchestra.run.smithi131.stdout: +Timestamp wrapped: 3979351756 2024-05-17T05:44:09.895 INFO:teuthology.orchestra.run.smithi131.stdout: +Timestamp wrapped 2024-05-17T05:44:09.895 INFO:teuthology.orchestra.run.smithi131.stdout: +(see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/258.full for details) 2024-05-17T05:44:09.897 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/258 2024-05-17T05:44:09.897 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/258 2024-05-17T05:44:09.897 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T05:44:09.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:09.910 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T05:44:09.910 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T05:44:09.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T05:44:09.911 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-05-17T05:44:10.166 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:44:10.171 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:44:10.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:10.332 INFO:teuthology.orchestra.run.smithi131.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:44:10.336 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/259 2024-05-17T05:44:10.336 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/259 2024-05-17T05:44:10.336 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:44:10.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:10.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:44:10.353 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-05-17T05:44:10.622 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:44:10.629 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:44:10.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:10.780 INFO:teuthology.orchestra.run.smithi131.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:44:10.785 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/260 2024-05-17T05:44:10.785 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/260 2024-05-17T05:44:10.785 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:44:10.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:10.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:44:10.806 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-05-17T05:44:11.083 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:44:11.089 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:44:11.089 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:11.245 INFO:teuthology.orchestra.run.smithi131.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:44:11.250 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/261 2024-05-17T05:44:11.250 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/261 2024-05-17T05:44:11.250 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:44:11.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:11.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:44:11.268 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-05-17T05:44:11.514 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:44:11.519 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:44:11.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:11.680 INFO:teuthology.orchestra.run.smithi131.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:44:11.686 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/262 2024-05-17T05:44:11.686 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/262 2024-05-17T05:44:11.686 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:44:11.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:11.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:44:11.702 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-05-17T05:44:11.981 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:44:11.987 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:44:11.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:44:37.885 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:44:37.888 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:45:08.184 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:45:08.188 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:45:38.473 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:45:38.476 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:45:38.512 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T05:45:38.512+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 249540) UID: 0 2024-05-17T05:45:38.512 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T05:45:38.512+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 249540) UID: 0 2024-05-17T05:45:38.513 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T05:45:38.512+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 249540) UID: 0 2024-05-17T05:45:38.513 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T05:45:38.512+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 249540) UID: 0 2024-05-17T05:45:43.163 INFO:teuthology.orchestra.run.smithi131.stdout:generic/263 92s 2024-05-17T05:45:43.166 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/263 2024-05-17T05:45:43.166 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:43.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:43.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:43.179 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-05-17T05:45:43.749 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:43.753 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:43.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:43.927 INFO:teuthology.orchestra.run.smithi131.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:43.931 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/264 2024-05-17T05:45:43.931 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/264 2024-05-17T05:45:43.931 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:43.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:43.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:43.943 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-05-17T05:45:44.135 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:44.139 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:44.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:44.333 INFO:teuthology.orchestra.run.smithi131.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:44.337 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/265 2024-05-17T05:45:44.337 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/265 2024-05-17T05:45:44.337 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:44.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:44.349 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-05-17T05:45:44.538 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:44.542 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:44.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:44.677 INFO:teuthology.orchestra.run.smithi131.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:44.680 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/266 2024-05-17T05:45:44.681 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/266 2024-05-17T05:45:44.681 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:44.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:44.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:44.692 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-05-17T05:45:44.892 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:44.896 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:45.037 INFO:teuthology.orchestra.run.smithi131.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:45.040 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/267 2024-05-17T05:45:45.041 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/267 2024-05-17T05:45:45.041 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:45.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:45.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:45.052 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-05-17T05:45:45.246 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:45.250 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:45.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:45.394 INFO:teuthology.orchestra.run.smithi131.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:45.397 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/268 2024-05-17T05:45:45.397 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/268 2024-05-17T05:45:45.397 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:45.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:45.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:45.409 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-05-17T05:45:45.606 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:45.610 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:45.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:45.759 INFO:teuthology.orchestra.run.smithi131.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:45.762 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/269 2024-05-17T05:45:45.762 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/269 2024-05-17T05:45:45.762 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:45.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:45.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:45.775 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-05-17T05:45:45.966 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:45.970 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:45.970 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:46.104 INFO:teuthology.orchestra.run.smithi131.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-17T05:45:46.107 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/270 2024-05-17T05:45:46.108 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/270 2024-05-17T05:45:46.108 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:46.110 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:46.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:46.119 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-05-17T05:45:46.316 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:46.320 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:46.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:46.456 INFO:teuthology.orchestra.run.smithi131.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:46.460 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/271 2024-05-17T05:45:46.460 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/271 2024-05-17T05:45:46.460 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:46.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:46.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:46.472 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-05-17T05:45:46.673 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:46.677 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:46.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:46.817 INFO:teuthology.orchestra.run.smithi131.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:46.820 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/272 2024-05-17T05:45:46.821 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/272 2024-05-17T05:45:46.821 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:46.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:46.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:46.831 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-05-17T05:45:47.023 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:47.028 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:47.028 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:47.149 INFO:teuthology.orchestra.run.smithi131.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:47.152 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/273 2024-05-17T05:45:47.152 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/273 2024-05-17T05:45:47.153 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:47.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:47.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:47.164 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-05-17T05:45:47.367 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:47.371 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:47.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:47.498 INFO:teuthology.orchestra.run.smithi131.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:47.501 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/274 2024-05-17T05:45:47.502 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/274 2024-05-17T05:45:47.502 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:47.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:47.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:47.513 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-05-17T05:45:47.708 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:47.712 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:47.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:47.830 INFO:teuthology.orchestra.run.smithi131.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:47.834 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/275 2024-05-17T05:45:47.834 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/275 2024-05-17T05:45:47.834 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:47.836 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:47.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:47.845 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-05-17T05:45:48.037 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:48.041 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:48.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:48.182 INFO:teuthology.orchestra.run.smithi131.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:48.186 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/276 2024-05-17T05:45:48.186 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/276 2024-05-17T05:45:48.186 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:48.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:48.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:48.197 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-05-17T05:45:48.391 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:48.395 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:48.530 INFO:teuthology.orchestra.run.smithi131.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:48.533 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/277 2024-05-17T05:45:48.533 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/277 2024-05-17T05:45:48.533 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:48.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:48.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:48.544 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-05-17T05:45:48.735 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:48.739 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:48.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:48.877 INFO:teuthology.orchestra.run.smithi131.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:48.880 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/278 2024-05-17T05:45:48.881 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/278 2024-05-17T05:45:48.881 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:48.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:48.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:48.892 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-05-17T05:45:49.082 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:49.087 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:49.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:49.233 INFO:teuthology.orchestra.run.smithi131.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:49.237 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/279 2024-05-17T05:45:49.237 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/279 2024-05-17T05:45:49.237 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:49.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:49.260 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-05-17T05:45:49.454 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:49.458 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:49.458 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:49.638 INFO:teuthology.orchestra.run.smithi131.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:49.642 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/280 2024-05-17T05:45:49.642 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/280 2024-05-17T05:45:49.642 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:49.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:49.654 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-05-17T05:45:49.843 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:49.847 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:49.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:49.995 INFO:teuthology.orchestra.run.smithi131.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:49.999 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/281 2024-05-17T05:45:49.999 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/281 2024-05-17T05:45:49.999 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:50.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:50.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:50.011 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-05-17T05:45:50.206 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:50.210 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:50.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:50.348 INFO:teuthology.orchestra.run.smithi131.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:50.352 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/282 2024-05-17T05:45:50.352 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/282 2024-05-17T05:45:50.352 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:50.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:50.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:50.373 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-05-17T05:45:50.567 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:50.570 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:50.571 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:50.711 INFO:teuthology.orchestra.run.smithi131.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:50.718 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/283 2024-05-17T05:45:50.718 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/283 2024-05-17T05:45:50.718 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:50.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:50.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:50.727 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-05-17T05:45:50.929 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:50.933 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:50.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:51.062 INFO:teuthology.orchestra.run.smithi131.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:45:51.065 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/284 2024-05-17T05:45:51.065 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/284 2024-05-17T05:45:51.065 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:51.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:51.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:51.076 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-05-17T05:45:51.280 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:51.284 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:51.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:53.221 INFO:teuthology.orchestra.run.smithi131.stdout:generic/285 2s 2024-05-17T05:45:53.227 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/285 2024-05-17T05:45:53.227 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:45:53.229 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:45:53.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:45:53.240 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-05-17T05:45:53.879 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:45:53.885 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:45:53.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:25.897 INFO:teuthology.orchestra.run.smithi131.stdout:generic/286 32s 2024-05-17T05:46:25.905 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/286 2024-05-17T05:46:25.905 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:25.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:25.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:25.917 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-05-17T05:46:26.548 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:26.553 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:26.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:26.746 INFO:teuthology.orchestra.run.smithi131.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:26.750 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/287 2024-05-17T05:46:26.750 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/287 2024-05-17T05:46:26.750 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:26.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:26.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:26.762 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-05-17T05:46:26.953 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:26.957 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:26.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:27.134 INFO:teuthology.orchestra.run.smithi131.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:27.138 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/288 2024-05-17T05:46:27.138 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/288 2024-05-17T05:46:27.138 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:27.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:27.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:27.149 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-05-17T05:46:27.336 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:27.340 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:27.479 INFO:teuthology.orchestra.run.smithi131.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:27.482 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/289 2024-05-17T05:46:27.483 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/289 2024-05-17T05:46:27.483 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:27.485 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:27.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:27.495 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-05-17T05:46:27.689 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:27.693 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:27.694 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:27.825 INFO:teuthology.orchestra.run.smithi131.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:27.829 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/290 2024-05-17T05:46:27.829 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/290 2024-05-17T05:46:27.829 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:27.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:27.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:27.840 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-05-17T05:46:28.033 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:28.037 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:28.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:28.362 INFO:teuthology.orchestra.run.smithi131.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:28.366 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/291 2024-05-17T05:46:28.366 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/291 2024-05-17T05:46:28.367 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:28.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:28.378 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-05-17T05:46:28.572 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:28.576 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:28.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:28.744 INFO:teuthology.orchestra.run.smithi131.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:28.747 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/292 2024-05-17T05:46:28.748 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/292 2024-05-17T05:46:28.748 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:28.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:28.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:28.759 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-05-17T05:46:28.948 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:28.952 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:28.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:29.274 INFO:teuthology.orchestra.run.smithi131.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:29.278 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/293 2024-05-17T05:46:29.278 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/293 2024-05-17T05:46:29.278 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:29.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:29.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:29.290 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-05-17T05:46:29.480 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:29.484 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:29.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:29.657 INFO:teuthology.orchestra.run.smithi131.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:29.660 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/294 2024-05-17T05:46:29.661 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/294 2024-05-17T05:46:29.661 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:29.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:29.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:29.672 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-05-17T05:46:29.867 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:29.870 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:29.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:30.007 INFO:teuthology.orchestra.run.smithi131.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:30.011 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/295 2024-05-17T05:46:30.011 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/295 2024-05-17T05:46:30.011 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:30.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:30.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:30.022 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-05-17T05:46:30.214 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:30.218 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:30.218 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:30.341 INFO:teuthology.orchestra.run.smithi131.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:30.345 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/296 2024-05-17T05:46:30.345 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/296 2024-05-17T05:46:30.345 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:30.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:30.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:30.356 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-05-17T05:46:30.546 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:30.550 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:30.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:30.799 INFO:teuthology.orchestra.run.smithi131.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:30.803 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/297 2024-05-17T05:46:30.803 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/297 2024-05-17T05:46:30.803 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:30.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:30.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:30.814 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-05-17T05:46:31.003 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:31.007 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:31.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:31.144 INFO:teuthology.orchestra.run.smithi131.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:31.148 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/298 2024-05-17T05:46:31.148 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/298 2024-05-17T05:46:31.148 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:31.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:31.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:31.160 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-05-17T05:46:31.357 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:31.361 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:31.362 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:31.603 INFO:teuthology.orchestra.run.smithi131.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:31.607 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/299 2024-05-17T05:46:31.607 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/299 2024-05-17T05:46:31.607 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:31.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:31.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:31.618 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-05-17T05:46:31.823 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:31.827 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:31.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:31.982 INFO:teuthology.orchestra.run.smithi131.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:31.985 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/300 2024-05-17T05:46:31.986 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/300 2024-05-17T05:46:31.986 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:31.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:31.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:31.998 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-05-17T05:46:32.192 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:32.198 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:32.198 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:32.317 INFO:teuthology.orchestra.run.smithi131.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:32.320 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/301 2024-05-17T05:46:32.321 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/301 2024-05-17T05:46:32.321 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:32.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:32.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:32.341 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-05-17T05:46:32.546 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:32.550 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:32.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:32.687 INFO:teuthology.orchestra.run.smithi131.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:32.690 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/302 2024-05-17T05:46:32.691 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/302 2024-05-17T05:46:32.691 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:32.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:32.702 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-05-17T05:46:32.901 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:32.905 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:32.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:33.085 INFO:teuthology.orchestra.run.smithi131.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:46:33.089 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/303 2024-05-17T05:46:33.089 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/303 2024-05-17T05:46:33.089 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:33.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:33.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:33.101 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-05-17T05:46:33.670 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:33.674 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:33.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:33.847 INFO:teuthology.orchestra.run.smithi131.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-17T05:46:33.850 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/304 2024-05-17T05:46:33.850 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/304 2024-05-17T05:46:33.850 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:33.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:33.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:33.889 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-05-17T05:46:34.420 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:34.424 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:34.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:34.566 INFO:teuthology.orchestra.run.smithi131.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:34.570 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/305 2024-05-17T05:46:34.570 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/305 2024-05-17T05:46:34.570 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:34.573 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:34.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:34.582 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-05-17T05:46:34.784 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:34.787 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:34.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:34.936 INFO:teuthology.orchestra.run.smithi131.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:34.939 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/306 2024-05-17T05:46:34.939 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/306 2024-05-17T05:46:34.939 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:34.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:34.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:34.962 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-05-17T05:46:35.160 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:35.164 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:35.306 INFO:teuthology.orchestra.run.smithi131.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:46:35.309 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/307 2024-05-17T05:46:35.309 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/307 2024-05-17T05:46:35.309 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:35.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:35.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:35.335 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-05-17T05:46:35.538 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:35.542 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:35.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:35.698 INFO:teuthology.orchestra.run.smithi131.stdout:generic/308 0s 2024-05-17T05:46:35.703 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/308 2024-05-17T05:46:35.703 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:35.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:35.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:35.716 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-05-17T05:46:35.907 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:35.911 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:35.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:37.120 INFO:teuthology.orchestra.run.smithi131.stdout:generic/309 2s 2024-05-17T05:46:37.125 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/309 2024-05-17T05:46:37.126 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:46:37.128 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:46:37.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:46:37.137 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-05-17T05:46:37.717 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:46:37.721 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:46:37.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:00.092 INFO:teuthology.orchestra.run.smithi131.stdout:generic/310 83s 2024-05-17T05:48:00.114 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/310 2024-05-17T05:48:00.115 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:48:00.117 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:00.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:48:00.133 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-05-17T05:48:00.343 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:48:00.347 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:48:00.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:00.779 INFO:teuthology.orchestra.run.smithi131.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:48:00.784 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/311 2024-05-17T05:48:00.785 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/311 2024-05-17T05:48:00.785 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:48:00.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:00.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:48:00.802 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-05-17T05:48:01.185 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:48:01.190 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:48:01.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:01.385 INFO:teuthology.orchestra.run.smithi131.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:48:01.389 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/312 2024-05-17T05:48:01.389 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/312 2024-05-17T05:48:01.389 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:48:01.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:01.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:48:01.401 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-05-17T05:48:01.780 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:48:01.784 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:48:01.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:06.374 INFO:teuthology.orchestra.run.smithi131.stdout:generic/313 5s 2024-05-17T05:48:06.395 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/313 2024-05-17T05:48:06.395 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:48:06.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:06.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:48:06.409 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-05-17T05:48:06.613 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:48:06.617 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:48:06.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:10.731 INFO:teuthology.orchestra.run.smithi131.stdout:generic/314 4s 2024-05-17T05:48:10.768 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/314 2024-05-17T05:48:10.768 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:48:10.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:10.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:48:10.783 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-05-17T05:48:10.982 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:48:10.986 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:48:10.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:17.530 INFO:teuthology.orchestra.run.smithi131.stdout:generic/315 7s 2024-05-17T05:48:17.535 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/315 2024-05-17T05:48:17.536 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:48:17.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:17.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:48:17.548 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-05-17T05:48:17.913 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:48:17.923 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:48:17.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:18.988 INFO:teuthology.orchestra.run.smithi131.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-17T05:48:18.992 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/316 2024-05-17T05:48:18.992 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/316 2024-05-17T05:48:18.992 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:48:18.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:19.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:48:19.004 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-05-17T05:48:19.526 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:48:19.531 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:48:19.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:19.672 INFO:teuthology.orchestra.run.smithi131.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:48:19.675 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/317 2024-05-17T05:48:19.676 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/317 2024-05-17T05:48:19.676 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:48:19.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:19.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:48:19.687 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-05-17T05:48:19.906 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:48:19.910 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:48:19.910 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:20.027 INFO:teuthology.orchestra.run.smithi131.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:48:20.031 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/318 2024-05-17T05:48:20.031 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/318 2024-05-17T05:48:20.031 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:48:20.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:20.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:48:20.043 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-05-17T05:48:20.247 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:48:20.251 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:48:20.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:20.433 INFO:teuthology.orchestra.run.smithi131.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-17T05:48:20.437 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/319 2024-05-17T05:48:20.437 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/319 2024-05-17T05:48:20.437 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:48:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:20.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:48:20.448 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-05-17T05:48:20.670 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:48:20.674 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:48:20.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:20.795 INFO:teuthology.orchestra.run.smithi131.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:48:20.799 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/320 2024-05-17T05:48:20.799 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/320 2024-05-17T05:48:20.799 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:48:20.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:20.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:48:20.811 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-05-17T05:48:21.014 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:48:21.018 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:48:21.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:21.156 INFO:teuthology.orchestra.run.smithi131.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:48:21.160 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/321 2024-05-17T05:48:21.160 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/321 2024-05-17T05:48:21.160 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:48:21.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:21.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:48:21.172 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-05-17T05:48:21.387 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:48:21.391 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:48:21.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:21.531 INFO:teuthology.orchestra.run.smithi131.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:48:21.535 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/322 2024-05-17T05:48:21.535 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/322 2024-05-17T05:48:21.535 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:48:21.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:48:21.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:48:21.546 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-05-17T05:48:21.750 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:48:21.754 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:48:21.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:22.644 INFO:teuthology.orchestra.run.smithi131.stdout:generic/323 121s 2024-05-17T05:50:22.680 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/323 2024-05-17T05:50:22.680 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:22.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:22.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:22.693 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-05-17T05:50:23.187 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:23.192 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:23.192 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:23.469 INFO:teuthology.orchestra.run.smithi131.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:23.472 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/324 2024-05-17T05:50:23.472 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/324 2024-05-17T05:50:23.472 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:23.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:23.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:23.483 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-05-17T05:50:23.677 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:23.681 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:23.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:24.122 INFO:teuthology.orchestra.run.smithi131.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:24.125 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/325 2024-05-17T05:50:24.125 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/325 2024-05-17T05:50:24.125 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:24.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:24.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:24.137 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-05-17T05:50:24.329 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:24.334 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:24.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:24.723 INFO:teuthology.orchestra.run.smithi131.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:24.727 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/326 2024-05-17T05:50:24.727 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/326 2024-05-17T05:50:24.727 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:24.730 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:24.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:24.740 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-05-17T05:50:24.945 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:24.949 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:25.091 INFO:teuthology.orchestra.run.smithi131.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:25.095 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/327 2024-05-17T05:50:25.095 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/327 2024-05-17T05:50:25.095 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:25.097 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:25.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:25.106 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-05-17T05:50:25.297 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:25.301 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:25.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:25.450 INFO:teuthology.orchestra.run.smithi131.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:25.454 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/328 2024-05-17T05:50:25.454 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/328 2024-05-17T05:50:25.454 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:25.458 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:25.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:25.465 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-05-17T05:50:25.655 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:25.659 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:25.659 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:25.794 INFO:teuthology.orchestra.run.smithi131.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:25.798 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/329 2024-05-17T05:50:25.798 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/329 2024-05-17T05:50:25.798 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:25.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:25.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:25.809 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-05-17T05:50:25.998 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:26.002 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:26.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:26.159 INFO:teuthology.orchestra.run.smithi131.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:26.162 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/330 2024-05-17T05:50:26.162 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/330 2024-05-17T05:50:26.162 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:26.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:26.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:26.174 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-05-17T05:50:26.360 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:26.364 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:26.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:26.645 INFO:teuthology.orchestra.run.smithi131.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:26.649 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/331 2024-05-17T05:50:26.649 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/331 2024-05-17T05:50:26.649 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:26.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:26.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:26.660 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-05-17T05:50:26.848 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:26.852 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:26.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:26.978 INFO:teuthology.orchestra.run.smithi131.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:26.982 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/332 2024-05-17T05:50:26.982 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/332 2024-05-17T05:50:26.982 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:26.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:26.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:26.994 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-05-17T05:50:27.190 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:27.194 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:27.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:27.328 INFO:teuthology.orchestra.run.smithi131.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:27.332 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/333 2024-05-17T05:50:27.332 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/333 2024-05-17T05:50:27.332 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:27.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:27.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:27.343 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-05-17T05:50:27.538 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:27.542 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:27.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:27.665 INFO:teuthology.orchestra.run.smithi131.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:27.669 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/334 2024-05-17T05:50:27.669 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/334 2024-05-17T05:50:27.669 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:27.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:27.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:27.681 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-05-17T05:50:27.875 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:27.879 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:27.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:28.013 INFO:teuthology.orchestra.run.smithi131.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:28.016 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/335 2024-05-17T05:50:28.017 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/335 2024-05-17T05:50:28.017 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:28.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:28.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:28.028 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-05-17T05:50:28.226 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:28.231 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:28.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:28.377 INFO:teuthology.orchestra.run.smithi131.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:28.381 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/336 2024-05-17T05:50:28.381 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/336 2024-05-17T05:50:28.381 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:28.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:28.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:28.393 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-05-17T05:50:28.580 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:28.584 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:28.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:28.718 INFO:teuthology.orchestra.run.smithi131.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:28.721 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/337 2024-05-17T05:50:28.721 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/337 2024-05-17T05:50:28.721 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:28.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:28.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:28.733 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-05-17T05:50:28.933 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:28.937 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:28.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:29.069 INFO:teuthology.orchestra.run.smithi131.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:29.073 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/338 2024-05-17T05:50:29.073 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/338 2024-05-17T05:50:29.073 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:29.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:29.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:29.085 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-05-17T05:50:29.277 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:29.281 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:29.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:29.403 INFO:teuthology.orchestra.run.smithi131.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:29.406 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/339 2024-05-17T05:50:29.406 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/339 2024-05-17T05:50:29.406 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:29.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:29.433 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-05-17T05:50:29.624 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:29.628 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:29.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:29.749 INFO:teuthology.orchestra.run.smithi131.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:29.753 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/340 2024-05-17T05:50:29.753 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/340 2024-05-17T05:50:29.753 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:29.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:29.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:29.764 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-05-17T05:50:29.957 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:29.962 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:29.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:30.134 INFO:teuthology.orchestra.run.smithi131.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:30.137 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/341 2024-05-17T05:50:30.137 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/341 2024-05-17T05:50:30.137 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:30.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:30.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:30.149 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-05-17T05:50:30.351 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:30.356 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:30.356 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:30.509 INFO:teuthology.orchestra.run.smithi131.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:30.512 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/342 2024-05-17T05:50:30.512 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/342 2024-05-17T05:50:30.513 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:30.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:30.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:30.524 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-05-17T05:50:30.719 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:30.724 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:30.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:30.874 INFO:teuthology.orchestra.run.smithi131.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:30.877 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/343 2024-05-17T05:50:30.877 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/343 2024-05-17T05:50:30.877 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:30.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:30.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:30.906 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-05-17T05:50:31.103 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:31.107 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:31.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:31.230 INFO:teuthology.orchestra.run.smithi131.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:31.233 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/344 2024-05-17T05:50:31.233 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/344 2024-05-17T05:50:31.233 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:31.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:31.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:31.244 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-05-17T05:50:31.441 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:31.446 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:31.446 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:31.780 INFO:teuthology.orchestra.run.smithi131.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:31.784 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/345 2024-05-17T05:50:31.784 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/345 2024-05-17T05:50:31.784 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:31.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:31.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:31.797 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-05-17T05:50:31.992 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:31.996 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:31.996 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:32.116 INFO:teuthology.orchestra.run.smithi131.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:32.119 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/346 2024-05-17T05:50:32.119 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/346 2024-05-17T05:50:32.119 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:32.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:32.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:32.131 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-05-17T05:50:32.323 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:32.327 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:32.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:32.782 INFO:teuthology.orchestra.run.smithi131.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:32.785 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/347 2024-05-17T05:50:32.786 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/347 2024-05-17T05:50:32.786 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:32.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:32.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:32.810 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-05-17T05:50:33.000 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:33.004 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:33.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:33.191 INFO:teuthology.orchestra.run.smithi131.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:33.195 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/348 2024-05-17T05:50:33.195 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/348 2024-05-17T05:50:33.195 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:33.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:33.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:33.206 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-05-17T05:50:33.391 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:33.395 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:33.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:34.608 INFO:teuthology.orchestra.run.smithi131.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-17T05:50:34.611 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/349 2024-05-17T05:50:34.611 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/349 2024-05-17T05:50:34.611 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:34.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:34.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:34.634 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-05-17T05:50:34.822 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:34.826 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:34.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:36.149 INFO:teuthology.orchestra.run.smithi131.stdout:generic/350 2s 2024-05-17T05:50:36.154 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/350 2024-05-17T05:50:36.155 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:36.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:36.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:36.166 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-05-17T05:50:36.365 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:36.369 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:36.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:37.247 INFO:teuthology.orchestra.run.smithi131.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-05-17T05:50:37.251 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/351 2024-05-17T05:50:37.251 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/351 2024-05-17T05:50:37.251 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:37.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:37.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:37.294 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-05-17T05:50:37.747 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:37.751 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:37.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:37.880 INFO:teuthology.orchestra.run.smithi131.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:37.884 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/352 2024-05-17T05:50:37.884 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/352 2024-05-17T05:50:37.884 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:37.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:37.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:37.895 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-05-17T05:50:38.089 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:38.093 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:38.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:38.217 INFO:teuthology.orchestra.run.smithi131.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:38.220 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/353 2024-05-17T05:50:38.220 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/353 2024-05-17T05:50:38.220 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:38.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:38.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:38.231 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-05-17T05:50:38.423 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:38.427 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:38.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:38.550 INFO:teuthology.orchestra.run.smithi131.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:38.554 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/354 2024-05-17T05:50:38.554 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/354 2024-05-17T05:50:38.554 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:38.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:38.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:38.575 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-05-17T05:50:38.766 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:38.769 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:38.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:39.444 INFO:teuthology.orchestra.run.smithi131.stdout:generic/355 1s 2024-05-17T05:50:39.449 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/355 2024-05-17T05:50:39.450 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:39.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:39.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:39.462 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-05-17T05:50:39.929 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:39.934 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:39.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:40.057 INFO:teuthology.orchestra.run.smithi131.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:40.061 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/356 2024-05-17T05:50:40.061 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/356 2024-05-17T05:50:40.061 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:40.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:40.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:40.081 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-05-17T05:50:40.279 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:40.283 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:40.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:40.415 INFO:teuthology.orchestra.run.smithi131.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:40.419 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/357 2024-05-17T05:50:40.419 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/357 2024-05-17T05:50:40.419 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:40.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:40.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:40.431 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-05-17T05:50:40.624 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:40.628 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:40.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:40.765 INFO:teuthology.orchestra.run.smithi131.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:40.769 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/358 2024-05-17T05:50:40.769 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/358 2024-05-17T05:50:40.769 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:40.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:40.780 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-05-17T05:50:40.969 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:40.973 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:40.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:41.108 INFO:teuthology.orchestra.run.smithi131.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:41.112 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/359 2024-05-17T05:50:41.112 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/359 2024-05-17T05:50:41.112 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:41.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:41.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:41.123 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-05-17T05:50:41.312 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:41.316 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:41.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:41.502 INFO:teuthology.orchestra.run.smithi131.stdout:generic/360 0s 2024-05-17T05:50:41.507 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/360 2024-05-17T05:50:41.508 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:41.510 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:41.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:41.519 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-05-17T05:50:41.708 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:41.712 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:41.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:41.867 INFO:teuthology.orchestra.run.smithi131.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:41.871 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/361 2024-05-17T05:50:41.871 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/361 2024-05-17T05:50:41.871 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:41.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:41.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:41.882 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-05-17T05:50:42.069 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:42.073 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:42.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:42.199 INFO:teuthology.orchestra.run.smithi131.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:42.202 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/362 2024-05-17T05:50:42.202 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/362 2024-05-17T05:50:42.202 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:42.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:42.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:42.215 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-05-17T05:50:42.412 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:42.415 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:42.539 INFO:teuthology.orchestra.run.smithi131.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:42.542 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/363 2024-05-17T05:50:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/363 2024-05-17T05:50:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:42.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:42.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:42.554 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-05-17T05:50:42.744 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:42.748 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:42.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:42.874 INFO:teuthology.orchestra.run.smithi131.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:42.878 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/364 2024-05-17T05:50:42.878 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/364 2024-05-17T05:50:42.878 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:42.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:42.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:42.889 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-05-17T05:50:43.082 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:43.086 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:43.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:43.207 INFO:teuthology.orchestra.run.smithi131.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:43.210 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/365 2024-05-17T05:50:43.211 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/365 2024-05-17T05:50:43.211 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:43.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:43.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:43.222 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-05-17T05:50:43.414 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:43.418 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:43.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:43.540 INFO:teuthology.orchestra.run.smithi131.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:43.544 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/366 2024-05-17T05:50:43.544 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/366 2024-05-17T05:50:43.544 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:43.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:43.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:43.555 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-05-17T05:50:43.752 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:43.756 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:43.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:43.878 INFO:teuthology.orchestra.run.smithi131.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:43.882 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/367 2024-05-17T05:50:43.882 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/367 2024-05-17T05:50:43.882 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:43.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:43.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:43.893 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-05-17T05:50:44.086 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:44.091 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:44.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:44.212 INFO:teuthology.orchestra.run.smithi131.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:44.215 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/368 2024-05-17T05:50:44.215 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/368 2024-05-17T05:50:44.216 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:44.218 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:44.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:44.228 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-05-17T05:50:44.429 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:44.433 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:44.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:44.556 INFO:teuthology.orchestra.run.smithi131.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:44.559 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/369 2024-05-17T05:50:44.559 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/369 2024-05-17T05:50:44.559 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:44.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:44.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:44.570 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-05-17T05:50:44.757 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:44.761 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:44.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:44.884 INFO:teuthology.orchestra.run.smithi131.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:44.888 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/370 2024-05-17T05:50:44.888 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/370 2024-05-17T05:50:44.888 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:44.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:44.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:44.899 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-05-17T05:50:45.091 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:45.095 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:45.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:45.214 INFO:teuthology.orchestra.run.smithi131.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:45.217 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/371 2024-05-17T05:50:45.218 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/371 2024-05-17T05:50:45.218 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:45.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:45.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:45.241 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-05-17T05:50:45.435 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:45.439 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:45.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:45.563 INFO:teuthology.orchestra.run.smithi131.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:45.566 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/372 2024-05-17T05:50:45.566 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/372 2024-05-17T05:50:45.566 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:45.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:45.578 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-05-17T05:50:45.768 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:45.772 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:45.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:45.899 INFO:teuthology.orchestra.run.smithi131.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:45.903 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/373 2024-05-17T05:50:45.903 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/373 2024-05-17T05:50:45.903 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:45.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:45.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:45.915 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-05-17T05:50:46.105 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:46.109 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:46.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:46.228 INFO:teuthology.orchestra.run.smithi131.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:46.232 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/374 2024-05-17T05:50:46.232 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/374 2024-05-17T05:50:46.232 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:46.235 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:46.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:46.254 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-05-17T05:50:46.448 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:46.452 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:46.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:46.618 INFO:teuthology.orchestra.run.smithi131.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-17T05:50:46.622 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/375 2024-05-17T05:50:46.622 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/375 2024-05-17T05:50:46.622 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:46.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:46.633 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-05-17T05:50:46.824 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:46.828 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:46.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:46.966 INFO:teuthology.orchestra.run.smithi131.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:46.970 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/376 2024-05-17T05:50:46.970 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/376 2024-05-17T05:50:46.970 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:46.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:46.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:46.981 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-05-17T05:50:47.174 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:47.176 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:47.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:47.298 INFO:teuthology.orchestra.run.smithi131.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:47.302 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/377 2024-05-17T05:50:47.302 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/377 2024-05-17T05:50:47.302 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:47.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:47.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:47.326 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-05-17T05:50:47.516 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:47.519 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:47.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:47.774 INFO:teuthology.orchestra.run.smithi131.stdout:generic/378 0s 2024-05-17T05:50:47.779 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/378 2024-05-17T05:50:47.779 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:47.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:47.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:47.791 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-05-17T05:50:48.246 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:48.251 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:48.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:48.383 INFO:teuthology.orchestra.run.smithi131.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:48.387 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/379 2024-05-17T05:50:48.387 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/379 2024-05-17T05:50:48.387 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:48.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:48.398 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-05-17T05:50:48.597 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:48.601 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:48.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:48.729 INFO:teuthology.orchestra.run.smithi131.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:48.732 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/380 2024-05-17T05:50:48.733 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/380 2024-05-17T05:50:48.733 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:48.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:48.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:48.744 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-05-17T05:50:48.938 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:48.942 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:48.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:49.061 INFO:teuthology.orchestra.run.smithi131.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:49.065 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/381 2024-05-17T05:50:49.065 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/381 2024-05-17T05:50:49.065 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:49.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:49.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:49.076 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-05-17T05:50:49.270 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:49.274 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:49.274 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:49.399 INFO:teuthology.orchestra.run.smithi131.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:49.402 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/382 2024-05-17T05:50:49.403 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/382 2024-05-17T05:50:49.403 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:49.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:49.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:49.414 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-05-17T05:50:49.604 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:49.609 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:49.734 INFO:teuthology.orchestra.run.smithi131.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:49.737 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/383 2024-05-17T05:50:49.737 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/383 2024-05-17T05:50:49.737 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:49.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:49.749 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-05-17T05:50:49.945 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:49.949 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:49.949 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:50.075 INFO:teuthology.orchestra.run.smithi131.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-17T05:50:50.079 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/384 2024-05-17T05:50:50.080 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/384 2024-05-17T05:50:50.080 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:50.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:50.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:50.090 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-05-17T05:50:50.281 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:50.286 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:50.286 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:50.414 INFO:teuthology.orchestra.run.smithi131.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:50.418 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/385 2024-05-17T05:50:50.418 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/385 2024-05-17T05:50:50.418 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:50.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:50.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:50.429 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-05-17T05:50:50.624 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:50.628 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:50.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:50.750 INFO:teuthology.orchestra.run.smithi131.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-17T05:50:50.754 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/386 2024-05-17T05:50:50.754 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/386 2024-05-17T05:50:50.754 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:50.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:50.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:50.766 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-05-17T05:50:50.954 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:50.958 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:50.959 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:51.084 INFO:teuthology.orchestra.run.smithi131.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:51.087 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/387 2024-05-17T05:50:51.087 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/387 2024-05-17T05:50:51.087 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:51.090 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:51.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:51.099 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-05-17T05:50:51.290 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:51.294 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:51.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:51.420 INFO:teuthology.orchestra.run.smithi131.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:51.424 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/388 2024-05-17T05:50:51.424 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/388 2024-05-17T05:50:51.424 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:51.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:51.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:51.435 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-05-17T05:50:51.628 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:51.632 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:51.633 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:51.781 INFO:teuthology.orchestra.run.smithi131.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-05-17T05:50:51.785 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/389 2024-05-17T05:50:51.785 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/389 2024-05-17T05:50:51.785 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:51.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:51.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:51.796 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-05-17T05:50:51.981 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:51.985 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:51.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:52.128 INFO:teuthology.orchestra.run.smithi131.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:50:52.131 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/390 2024-05-17T05:50:52.131 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/390 2024-05-17T05:50:52.131 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:50:52.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:50:52.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:50:52.143 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-05-17T05:50:52.334 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:50:52.339 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:50:52.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:02.685 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:51:02.688 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:51:03.279 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T05:51:03.278+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382053) UID: 0 2024-05-17T05:51:03.279 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T05:51:03.278+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382053) UID: 0 2024-05-17T05:51:03.279 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T05:51:03.278+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382053) UID: 0 2024-05-17T05:51:03.280 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T05:51:03.278+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382053) UID: 0 2024-05-17T05:51:12.381 INFO:teuthology.orchestra.run.smithi131.stdout:generic/391 20s 2024-05-17T05:51:12.510 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/391 2024-05-17T05:51:12.510 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:12.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:12.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:12.624 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-05-17T05:51:13.816 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:13.821 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:13.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:14.041 INFO:teuthology.orchestra.run.smithi131.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:14.046 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/392 2024-05-17T05:51:14.047 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/392 2024-05-17T05:51:14.047 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:14.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:14.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:14.063 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-05-17T05:51:14.381 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:14.387 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:14.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:14.576 INFO:teuthology.orchestra.run.smithi131.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:14.581 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/393 2024-05-17T05:51:14.581 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/393 2024-05-17T05:51:14.581 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:14.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:14.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:14.597 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-05-17T05:51:14.888 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:14.892 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:14.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:15.172 INFO:teuthology.orchestra.run.smithi131.stdout:generic/394 1s 2024-05-17T05:51:15.180 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/394 2024-05-17T05:51:15.180 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:15.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:15.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:15.195 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-05-17T05:51:15.700 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:15.706 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:15.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:15.942 INFO:teuthology.orchestra.run.smithi131.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:15.946 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/395 2024-05-17T05:51:15.946 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/395 2024-05-17T05:51:15.946 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:15.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:15.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:15.963 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-05-17T05:51:16.253 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:16.259 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:16.477 INFO:teuthology.orchestra.run.smithi131.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:16.483 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/396 2024-05-17T05:51:16.483 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/396 2024-05-17T05:51:16.483 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:16.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:16.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:16.500 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-05-17T05:51:16.810 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:16.814 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:16.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:17.059 INFO:teuthology.orchestra.run.smithi131.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:17.063 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/397 2024-05-17T05:51:17.063 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/397 2024-05-17T05:51:17.064 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:17.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:17.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:17.079 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-05-17T05:51:17.371 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:17.376 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:17.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:17.606 INFO:teuthology.orchestra.run.smithi131.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:17.610 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/398 2024-05-17T05:51:17.610 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/398 2024-05-17T05:51:17.610 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:17.613 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:17.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:17.625 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-05-17T05:51:17.918 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:17.926 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:17.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:18.152 INFO:teuthology.orchestra.run.smithi131.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:18.156 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/399 2024-05-17T05:51:18.156 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/399 2024-05-17T05:51:18.156 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:18.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:18.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:18.173 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-05-17T05:51:18.480 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:18.490 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:18.490 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:18.672 INFO:teuthology.orchestra.run.smithi131.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-17T05:51:18.682 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/400 2024-05-17T05:51:18.683 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/400 2024-05-17T05:51:18.683 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:18.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:18.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:18.700 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-05-17T05:51:18.996 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:19.004 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:19.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:19.183 INFO:teuthology.orchestra.run.smithi131.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:19.186 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/401 2024-05-17T05:51:19.187 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/401 2024-05-17T05:51:19.187 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:19.189 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:19.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:19.198 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-05-17T05:51:19.395 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:19.399 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:19.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:19.552 INFO:teuthology.orchestra.run.smithi131.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:19.555 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/402 2024-05-17T05:51:19.555 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/402 2024-05-17T05:51:19.555 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:19.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:19.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:19.580 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-05-17T05:51:19.766 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:19.770 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:19.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:19.891 INFO:teuthology.orchestra.run.smithi131.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:19.894 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/403 2024-05-17T05:51:19.895 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/403 2024-05-17T05:51:19.895 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:19.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:19.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:19.906 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-05-17T05:51:20.099 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:20.103 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:20.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:21.006 INFO:teuthology.orchestra.run.smithi131.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-05-17T05:51:21.010 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/404 2024-05-17T05:51:21.010 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/404 2024-05-17T05:51:21.010 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:21.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:21.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:21.063 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-05-17T05:51:21.533 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:21.540 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:21.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:21.866 INFO:teuthology.orchestra.run.smithi131.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:21.870 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/405 2024-05-17T05:51:21.870 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/405 2024-05-17T05:51:21.870 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:21.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:21.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:21.882 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-05-17T05:51:22.081 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:22.085 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:22.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:22.222 INFO:teuthology.orchestra.run.smithi131.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:22.226 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/406 2024-05-17T05:51:22.226 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/406 2024-05-17T05:51:22.226 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:22.228 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:22.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:22.237 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-05-17T05:51:22.432 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:22.436 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:22.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:22.630 INFO:teuthology.orchestra.run.smithi131.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:51:22.633 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/407 2024-05-17T05:51:22.634 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/407 2024-05-17T05:51:22.634 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:22.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:22.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:22.644 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-05-17T05:51:23.118 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:23.122 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:23.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:23.313 INFO:teuthology.orchestra.run.smithi131.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-17T05:51:23.317 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/408 2024-05-17T05:51:23.317 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/408 2024-05-17T05:51:23.317 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:23.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:23.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:23.329 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-05-17T05:51:23.817 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:23.821 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:23.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:23.963 INFO:teuthology.orchestra.run.smithi131.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:23.967 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/409 2024-05-17T05:51:23.967 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/409 2024-05-17T05:51:23.967 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:23.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:23.978 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-05-17T05:51:24.176 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:24.180 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:24.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:24.315 INFO:teuthology.orchestra.run.smithi131.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:24.319 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/410 2024-05-17T05:51:24.319 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/410 2024-05-17T05:51:24.319 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:24.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:24.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:24.330 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-05-17T05:51:24.519 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:24.523 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:24.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:24.679 INFO:teuthology.orchestra.run.smithi131.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:24.683 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/411 2024-05-17T05:51:24.683 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/411 2024-05-17T05:51:24.683 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:24.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:24.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:24.702 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-05-17T05:51:24.899 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:24.903 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:24.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:25.035 INFO:teuthology.orchestra.run.smithi131.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:25.039 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/412 2024-05-17T05:51:25.039 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/412 2024-05-17T05:51:25.039 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:25.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:25.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:25.051 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-05-17T05:51:25.241 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:25.245 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:25.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:25.652 INFO:teuthology.orchestra.run.smithi131.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:25.655 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/413 2024-05-17T05:51:25.655 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/413 2024-05-17T05:51:25.655 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:25.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:25.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:25.677 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-05-17T05:51:25.867 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:25.871 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:25.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:26.000 INFO:teuthology.orchestra.run.smithi131.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:26.006 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/414 2024-05-17T05:51:26.006 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/414 2024-05-17T05:51:26.006 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:26.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:26.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:26.015 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-05-17T05:51:26.203 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:26.210 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:26.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:26.333 INFO:teuthology.orchestra.run.smithi131.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:26.337 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/415 2024-05-17T05:51:26.337 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/415 2024-05-17T05:51:26.337 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:26.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:26.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:26.348 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-05-17T05:51:26.546 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:26.551 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:26.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:26.672 INFO:teuthology.orchestra.run.smithi131.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:26.676 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/416 2024-05-17T05:51:26.676 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/416 2024-05-17T05:51:26.676 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:26.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:26.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:26.705 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-05-17T05:51:26.896 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:26.901 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:26.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:27.020 INFO:teuthology.orchestra.run.smithi131.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:27.027 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/417 2024-05-17T05:51:27.027 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/417 2024-05-17T05:51:27.027 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:27.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:27.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:27.035 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-05-17T05:51:27.231 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:27.236 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:27.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:27.405 INFO:teuthology.orchestra.run.smithi131.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2024-05-17T05:51:27.408 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/418 2024-05-17T05:51:27.408 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/418 2024-05-17T05:51:27.408 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:27.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:27.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:27.419 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-05-17T05:51:27.616 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:27.620 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:27.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:27.765 INFO:teuthology.orchestra.run.smithi131.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:27.768 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/419 2024-05-17T05:51:27.768 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/419 2024-05-17T05:51:27.768 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:27.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:27.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:27.790 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-05-17T05:51:27.983 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:27.987 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:27.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:28.938 INFO:teuthology.orchestra.run.smithi131.stdout:generic/420 1s 2024-05-17T05:51:28.946 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/420 2024-05-17T05:51:28.946 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:28.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:28.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:28.958 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-05-17T05:51:29.430 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:29.435 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:29.624 INFO:teuthology.orchestra.run.smithi131.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:29.628 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/421 2024-05-17T05:51:29.628 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/421 2024-05-17T05:51:29.628 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:29.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:29.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:29.640 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-05-17T05:51:29.836 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:29.840 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:29.840 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:30.062 INFO:teuthology.orchestra.run.smithi131.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:30.066 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/422 2024-05-17T05:51:30.066 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/422 2024-05-17T05:51:30.066 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:30.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:30.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:30.077 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-05-17T05:51:30.271 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:30.275 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:30.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:30.904 INFO:teuthology.orchestra.run.smithi131.stdout:generic/423 0s 2024-05-17T05:51:30.911 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/423 2024-05-17T05:51:30.911 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:30.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:30.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:30.922 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-05-17T05:51:31.393 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:31.398 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:31.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:31.761 INFO:teuthology.orchestra.run.smithi131.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-05-17T05:51:31.765 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/424 2024-05-17T05:51:31.765 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/424 2024-05-17T05:51:31.765 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:31.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:31.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:31.789 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-05-17T05:51:32.059 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:32.063 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:32.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:32.490 INFO:teuthology.orchestra.run.smithi131.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:51:32.494 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/425 2024-05-17T05:51:32.494 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/425 2024-05-17T05:51:32.494 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:51:32.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:51:32.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:51:32.514 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-05-17T05:51:32.705 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:51:32.709 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:51:32.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:16.177 INFO:teuthology.orchestra.run.smithi131.stdout:generic/426 - output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/426.out.bad) 2024-05-17T05:52:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/426.out 2024-05-17 04:10:05.122701717 +0000 2024-05-17T05:52:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/426.out.bad 2024-05-17 05:52:16.115921858 +0000 2024-05-17T05:52:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -1,5 +1,243 @@ 2024-05-17T05:52:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: QA output created by 426 2024-05-17T05:52:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: test_file_handles TEST_DIR/426-dir -d 2024-05-17T05:52:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000193) opened an unlinked file! 2024-05-17T05:52:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000194) opened an unlinked file! 2024-05-17T05:52:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000195) opened an unlinked file! 2024-05-17T05:52:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000196) opened an unlinked file! 2024-05-17T05:52:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000197) opened an unlinked file! 2024-05-17T05:52:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000198) opened an unlinked file! 2024-05-17T05:52:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000199) opened an unlinked file! 2024-05-17T05:52:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000200) opened an unlinked file! 2024-05-17T05:52:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000201) opened an unlinked file! 2024-05-17T05:52:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000202) opened an unlinked file! 2024-05-17T05:52:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000203) opened an unlinked file! 2024-05-17T05:52:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000204) opened an unlinked file! 2024-05-17T05:52:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000205) opened an unlinked file! 2024-05-17T05:52:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000206) opened an unlinked file! 2024-05-17T05:52:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000207) opened an unlinked file! 2024-05-17T05:52:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000208) opened an unlinked file! 2024-05-17T05:52:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000209) opened an unlinked file! 2024-05-17T05:52:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000210) opened an unlinked file! 2024-05-17T05:52:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000211) opened an unlinked file! 2024-05-17T05:52:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000212) opened an unlinked file! 2024-05-17T05:52:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000213) opened an unlinked file! 2024-05-17T05:52:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000214) opened an unlinked file! 2024-05-17T05:52:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000215) opened an unlinked file! 2024-05-17T05:52:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000216) opened an unlinked file! 2024-05-17T05:52:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000217) opened an unlinked file! 2024-05-17T05:52:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000218) opened an unlinked file! 2024-05-17T05:52:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000219) opened an unlinked file! 2024-05-17T05:52:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000220) opened an unlinked file! 2024-05-17T05:52:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000221) opened an unlinked file! 2024-05-17T05:52:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000222) opened an unlinked file! 2024-05-17T05:52:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000223) opened an unlinked file! 2024-05-17T05:52:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000224) opened an unlinked file! 2024-05-17T05:52:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000225) opened an unlinked file! 2024-05-17T05:52:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000226) opened an unlinked file! 2024-05-17T05:52:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000227) opened an unlinked file! 2024-05-17T05:52:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000228) opened an unlinked file! 2024-05-17T05:52:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000229) opened an unlinked file! 2024-05-17T05:52:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000230) opened an unlinked file! 2024-05-17T05:52:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000231) opened an unlinked file! 2024-05-17T05:52:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000232) opened an unlinked file! 2024-05-17T05:52:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000233) opened an unlinked file! 2024-05-17T05:52:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000234) opened an unlinked file! 2024-05-17T05:52:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000235) opened an unlinked file! 2024-05-17T05:52:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000236) opened an unlinked file! 2024-05-17T05:52:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000237) opened an unlinked file! 2024-05-17T05:52:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000238) opened an unlinked file! 2024-05-17T05:52:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000239) opened an unlinked file! 2024-05-17T05:52:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000240) opened an unlinked file! 2024-05-17T05:52:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000241) opened an unlinked file! 2024-05-17T05:52:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000242) opened an unlinked file! 2024-05-17T05:52:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000243) opened an unlinked file! 2024-05-17T05:52:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000244) opened an unlinked file! 2024-05-17T05:52:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000245) opened an unlinked file! 2024-05-17T05:52:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000246) opened an unlinked file! 2024-05-17T05:52:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000247) opened an unlinked file! 2024-05-17T05:52:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000248) opened an unlinked file! 2024-05-17T05:52:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000249) opened an unlinked file! 2024-05-17T05:52:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000250) opened an unlinked file! 2024-05-17T05:52:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000251) opened an unlinked file! 2024-05-17T05:52:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000252) opened an unlinked file! 2024-05-17T05:52:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000253) opened an unlinked file! 2024-05-17T05:52:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000254) opened an unlinked file! 2024-05-17T05:52:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000255) opened an unlinked file! 2024-05-17T05:52:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000256) opened an unlinked file! 2024-05-17T05:52:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000257) opened an unlinked file! 2024-05-17T05:52:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000258) opened an unlinked file! 2024-05-17T05:52:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000259) opened an unlinked file! 2024-05-17T05:52:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000260) opened an unlinked file! 2024-05-17T05:52:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000261) opened an unlinked file! 2024-05-17T05:52:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000262) opened an unlinked file! 2024-05-17T05:52:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000263) opened an unlinked file! 2024-05-17T05:52:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000264) opened an unlinked file! 2024-05-17T05:52:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000265) opened an unlinked file! 2024-05-17T05:52:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000266) opened an unlinked file! 2024-05-17T05:52:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000267) opened an unlinked file! 2024-05-17T05:52:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000268) opened an unlinked file! 2024-05-17T05:52:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000269) opened an unlinked file! 2024-05-17T05:52:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000270) opened an unlinked file! 2024-05-17T05:52:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000271) opened an unlinked file! 2024-05-17T05:52:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000272) opened an unlinked file! 2024-05-17T05:52:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000273) opened an unlinked file! 2024-05-17T05:52:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000274) opened an unlinked file! 2024-05-17T05:52:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000275) opened an unlinked file! 2024-05-17T05:52:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000276) opened an unlinked file! 2024-05-17T05:52:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000277) opened an unlinked file! 2024-05-17T05:52:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000278) opened an unlinked file! 2024-05-17T05:52:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000279) opened an unlinked file! 2024-05-17T05:52:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000280) opened an unlinked file! 2024-05-17T05:52:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000281) opened an unlinked file! 2024-05-17T05:52:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000282) opened an unlinked file! 2024-05-17T05:52:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000283) opened an unlinked file! 2024-05-17T05:52:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000284) opened an unlinked file! 2024-05-17T05:52:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000285) opened an unlinked file! 2024-05-17T05:52:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000286) opened an unlinked file! 2024-05-17T05:52:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000287) opened an unlinked file! 2024-05-17T05:52:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000288) opened an unlinked file! 2024-05-17T05:52:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000289) opened an unlinked file! 2024-05-17T05:52:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000290) opened an unlinked file! 2024-05-17T05:52:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000291) opened an unlinked file! 2024-05-17T05:52:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000292) opened an unlinked file! 2024-05-17T05:52:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000293) opened an unlinked file! 2024-05-17T05:52:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000294) opened an unlinked file! 2024-05-17T05:52:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000295) opened an unlinked file! 2024-05-17T05:52:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000296) opened an unlinked file! 2024-05-17T05:52:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000297) opened an unlinked file! 2024-05-17T05:52:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000298) opened an unlinked file! 2024-05-17T05:52:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000299) opened an unlinked file! 2024-05-17T05:52:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000300) opened an unlinked file! 2024-05-17T05:52:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000301) opened an unlinked file! 2024-05-17T05:52:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000302) opened an unlinked file! 2024-05-17T05:52:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000303) opened an unlinked file! 2024-05-17T05:52:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000304) opened an unlinked file! 2024-05-17T05:52:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000305) opened an unlinked file! 2024-05-17T05:52:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000306) opened an unlinked file! 2024-05-17T05:52:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000307) opened an unlinked file! 2024-05-17T05:52:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000308) opened an unlinked file! 2024-05-17T05:52:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000309) opened an unlinked file! 2024-05-17T05:52:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000310) opened an unlinked file! 2024-05-17T05:52:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000311) opened an unlinked file! 2024-05-17T05:52:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000312) opened an unlinked file! 2024-05-17T05:52:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000313) opened an unlinked file! 2024-05-17T05:52:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000314) opened an unlinked file! 2024-05-17T05:52:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000315) opened an unlinked file! 2024-05-17T05:52:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000316) opened an unlinked file! 2024-05-17T05:52:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000317) opened an unlinked file! 2024-05-17T05:52:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000318) opened an unlinked file! 2024-05-17T05:52:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000319) opened an unlinked file! 2024-05-17T05:52:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000320) opened an unlinked file! 2024-05-17T05:52:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000321) opened an unlinked file! 2024-05-17T05:52:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000322) opened an unlinked file! 2024-05-17T05:52:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000323) opened an unlinked file! 2024-05-17T05:52:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000324) opened an unlinked file! 2024-05-17T05:52:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000325) opened an unlinked file! 2024-05-17T05:52:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000326) opened an unlinked file! 2024-05-17T05:52:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000327) opened an unlinked file! 2024-05-17T05:52:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000328) opened an unlinked file! 2024-05-17T05:52:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000329) opened an unlinked file! 2024-05-17T05:52:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000330) opened an unlinked file! 2024-05-17T05:52:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000331) opened an unlinked file! 2024-05-17T05:52:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000332) opened an unlinked file! 2024-05-17T05:52:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000333) opened an unlinked file! 2024-05-17T05:52:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000334) opened an unlinked file! 2024-05-17T05:52:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000335) opened an unlinked file! 2024-05-17T05:52:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000336) opened an unlinked file! 2024-05-17T05:52:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000337) opened an unlinked file! 2024-05-17T05:52:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000338) opened an unlinked file! 2024-05-17T05:52:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000339) opened an unlinked file! 2024-05-17T05:52:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000340) opened an unlinked file! 2024-05-17T05:52:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000341) opened an unlinked file! 2024-05-17T05:52:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000342) opened an unlinked file! 2024-05-17T05:52:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000343) opened an unlinked file! 2024-05-17T05:52:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000344) opened an unlinked file! 2024-05-17T05:52:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000345) opened an unlinked file! 2024-05-17T05:52:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000346) opened an unlinked file! 2024-05-17T05:52:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000347) opened an unlinked file! 2024-05-17T05:52:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000348) opened an unlinked file! 2024-05-17T05:52:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000349) opened an unlinked file! 2024-05-17T05:52:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000350) opened an unlinked file! 2024-05-17T05:52:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000351) opened an unlinked file! 2024-05-17T05:52:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000352) opened an unlinked file! 2024-05-17T05:52:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000353) opened an unlinked file! 2024-05-17T05:52:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000354) opened an unlinked file! 2024-05-17T05:52:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000355) opened an unlinked file! 2024-05-17T05:52:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000356) opened an unlinked file! 2024-05-17T05:52:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000357) opened an unlinked file! 2024-05-17T05:52:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000358) opened an unlinked file! 2024-05-17T05:52:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000359) opened an unlinked file! 2024-05-17T05:52:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000360) opened an unlinked file! 2024-05-17T05:52:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000361) opened an unlinked file! 2024-05-17T05:52:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000362) opened an unlinked file! 2024-05-17T05:52:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000363) opened an unlinked file! 2024-05-17T05:52:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000364) opened an unlinked file! 2024-05-17T05:52:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000365) opened an unlinked file! 2024-05-17T05:52:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000366) opened an unlinked file! 2024-05-17T05:52:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000367) opened an unlinked file! 2024-05-17T05:52:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000368) opened an unlinked file! 2024-05-17T05:52:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000369) opened an unlinked file! 2024-05-17T05:52:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000370) opened an unlinked file! 2024-05-17T05:52:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000371) opened an unlinked file! 2024-05-17T05:52:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000372) opened an unlinked file! 2024-05-17T05:52:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000373) opened an unlinked file! 2024-05-17T05:52:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000374) opened an unlinked file! 2024-05-17T05:52:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000375) opened an unlinked file! 2024-05-17T05:52:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000376) opened an unlinked file! 2024-05-17T05:52:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000377) opened an unlinked file! 2024-05-17T05:52:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000378) opened an unlinked file! 2024-05-17T05:52:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000379) opened an unlinked file! 2024-05-17T05:52:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000380) opened an unlinked file! 2024-05-17T05:52:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000381) opened an unlinked file! 2024-05-17T05:52:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000382) opened an unlinked file! 2024-05-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000383) opened an unlinked file! 2024-05-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000384) opened an unlinked file! 2024-05-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000385) opened an unlinked file! 2024-05-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000386) opened an unlinked file! 2024-05-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000387) opened an unlinked file! 2024-05-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000388) opened an unlinked file! 2024-05-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000389) opened an unlinked file! 2024-05-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000390) opened an unlinked file! 2024-05-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000391) opened an unlinked file! 2024-05-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000392) opened an unlinked file! 2024-05-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000393) opened an unlinked file! 2024-05-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000394) opened an unlinked file! 2024-05-17T05:52:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000395) opened an unlinked file! 2024-05-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000396) opened an unlinked file! 2024-05-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000397) opened an unlinked file! 2024-05-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000398) opened an unlinked file! 2024-05-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000399) opened an unlinked file! 2024-05-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000400) opened an unlinked file! 2024-05-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000401) opened an unlinked file! 2024-05-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000402) opened an unlinked file! 2024-05-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000403) opened an unlinked file! 2024-05-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000404) opened an unlinked file! 2024-05-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000405) opened an unlinked file! 2024-05-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000406) opened an unlinked file! 2024-05-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000407) opened an unlinked file! 2024-05-17T05:52:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000408) opened an unlinked file! 2024-05-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000409) opened an unlinked file! 2024-05-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000410) opened an unlinked file! 2024-05-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000411) opened an unlinked file! 2024-05-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000412) opened an unlinked file! 2024-05-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000413) opened an unlinked file! 2024-05-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000414) opened an unlinked file! 2024-05-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000415) opened an unlinked file! 2024-05-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000416) opened an unlinked file! 2024-05-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000417) opened an unlinked file! 2024-05-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000418) opened an unlinked file! 2024-05-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000419) opened an unlinked file! 2024-05-17T05:52:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000420) opened an unlinked file! 2024-05-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000421) opened an unlinked file! 2024-05-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000422) opened an unlinked file! 2024-05-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000423) opened an unlinked file! 2024-05-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000424) opened an unlinked file! 2024-05-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000425) opened an unlinked file! 2024-05-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000426) opened an unlinked file! 2024-05-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000427) opened an unlinked file! 2024-05-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000428) opened an unlinked file! 2024-05-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000429) opened an unlinked file! 2024-05-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/426-dir/file000430) opened an unlinked file! 2024-05-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: test_file_handles TEST_DIR/426-dir 2024-05-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: test_file_handles TEST_DIR/426-dir -l 2024-05-17T05:52:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: test_file_handles TEST_DIR/426-dir -u 2024-05-17T05:52:16.270 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/426 2024-05-17T05:52:16.270 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/426 2024-05-17T05:52:16.271 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T05:52:16.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:16.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T05:52:16.680 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T05:52:16.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T05:52:16.681 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-05-17T05:52:18.887 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:52:18.891 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:52:18.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:19.103 INFO:teuthology.orchestra.run.smithi131.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:52:19.106 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/427 2024-05-17T05:52:19.106 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/427 2024-05-17T05:52:19.106 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:52:19.108 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:19.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:52:19.118 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-05-17T05:52:19.317 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:52:19.321 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:52:19.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:19.589 INFO:teuthology.orchestra.run.smithi131.stdout:generic/428 0s 2024-05-17T05:52:19.595 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/428 2024-05-17T05:52:19.595 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:52:19.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:19.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:52:19.606 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-05-17T05:52:19.805 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:52:19.809 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:52:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:19.959 INFO:teuthology.orchestra.run.smithi131.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:52:19.962 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/429 2024-05-17T05:52:19.962 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/429 2024-05-17T05:52:19.962 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:52:19.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:19.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:52:19.975 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-05-17T05:52:20.166 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:52:20.170 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:52:20.170 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:20.456 INFO:teuthology.orchestra.run.smithi131.stdout:generic/430 0s 2024-05-17T05:52:20.461 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/430 2024-05-17T05:52:20.461 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:52:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:20.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:52:20.473 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-05-17T05:52:20.994 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:52:20.996 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:52:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:21.253 INFO:teuthology.orchestra.run.smithi131.stdout:generic/431 0s 2024-05-17T05:52:21.258 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/431 2024-05-17T05:52:21.258 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:52:21.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:21.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:52:21.271 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-05-17T05:52:21.873 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:52:21.877 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:52:21.877 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:22.157 INFO:teuthology.orchestra.run.smithi131.stdout:generic/432 1s 2024-05-17T05:52:22.162 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/432 2024-05-17T05:52:22.162 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:52:22.165 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:22.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:52:22.174 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-05-17T05:52:22.769 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:52:22.773 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:52:22.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:23.009 INFO:teuthology.orchestra.run.smithi131.stdout:generic/433 1s 2024-05-17T05:52:23.015 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/433 2024-05-17T05:52:23.015 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:52:23.016 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:23.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:52:23.027 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-05-17T05:52:23.616 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:52:23.620 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:52:23.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:23.873 INFO:teuthology.orchestra.run.smithi131.stdout:generic/434 - output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/434.out.bad) 2024-05-17T05:52:23.874 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/434.out 2024-05-17 04:10:05.122701717 +0000 2024-05-17T05:52:23.875 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/434.out.bad 2024-05-17 05:52:23.871766224 +0000 2024-05-17T05:52:23.875 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -9,6 +9,6 @@ 2024-05-17T05:52:23.875 INFO:teuthology.orchestra.run.smithi131.stdout: copy_range: Bad file descriptor 2024-05-17T05:52:23.875 INFO:teuthology.orchestra.run.smithi131.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2024-05-17T05:52:23.875 INFO:teuthology.orchestra.run.smithi131.stdout: Try to copy to a device 2024-05-17T05:52:23.875 INFO:teuthology.orchestra.run.smithi131.stdout: -copy_range: Invalid argument 2024-05-17T05:52:23.875 INFO:teuthology.orchestra.run.smithi131.stdout: +/tmp/tmp.2OgBg7y0wTtest/test-434/dev1: Permission denied 2024-05-17T05:52:23.875 INFO:teuthology.orchestra.run.smithi131.stdout: Try to copy to a fifo 2024-05-17T05:52:23.875 INFO:teuthology.orchestra.run.smithi131.stdout: copy_range: Invalid argument 2024-05-17T05:52:23.877 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/434 2024-05-17T05:52:23.877 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/434 2024-05-17T05:52:23.877 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T05:52:23.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:23.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T05:52:23.889 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T05:52:23.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T05:52:23.889 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-05-17T05:52:24.491 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:52:24.495 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:52:24.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:24.644 INFO:teuthology.orchestra.run.smithi131.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:52:24.648 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/435 2024-05-17T05:52:24.648 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/435 2024-05-17T05:52:24.648 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:52:24.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:24.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:52:24.661 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-05-17T05:52:24.857 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:52:24.861 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:52:24.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:25.991 INFO:teuthology.orchestra.run.smithi131.stdout:generic/436 1s 2024-05-17T05:52:26.000 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/436 2024-05-17T05:52:26.000 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:52:26.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:26.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:52:26.012 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-05-17T05:52:26.624 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:52:26.628 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:52:26.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:27.419 INFO:teuthology.orchestra.run.smithi131.stdout:generic/437 1s 2024-05-17T05:52:27.425 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/437 2024-05-17T05:52:27.425 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:52:27.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:52:27.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:52:27.437 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-05-17T05:52:27.642 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:52:27.646 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:52:27.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:24.287 INFO:teuthology.orchestra.run.smithi131.stdout:generic/438 57s 2024-05-17T05:53:24.292 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/438 2024-05-17T05:53:24.292 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:24.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:24.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:24.305 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-05-17T05:53:24.523 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:24.527 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:24.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:24.653 INFO:teuthology.orchestra.run.smithi131.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:24.656 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/439 2024-05-17T05:53:24.656 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/439 2024-05-17T05:53:24.656 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:24.659 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:24.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:24.668 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-05-17T05:53:24.857 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:24.861 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:24.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:25.010 INFO:teuthology.orchestra.run.smithi131.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:25.014 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/440 2024-05-17T05:53:25.014 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/440 2024-05-17T05:53:25.014 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:25.016 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:25.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:25.025 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-05-17T05:53:25.223 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:25.227 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:25.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:25.539 INFO:teuthology.orchestra.run.smithi131.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:25.543 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/441 2024-05-17T05:53:25.543 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/441 2024-05-17T05:53:25.543 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:25.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:25.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:25.555 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-05-17T05:53:25.771 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:25.775 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:25.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:25.918 INFO:teuthology.orchestra.run.smithi131.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:25.922 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/442 2024-05-17T05:53:25.922 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/442 2024-05-17T05:53:25.922 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:25.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:25.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:25.933 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-05-17T05:53:26.126 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:26.130 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:26.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:26.320 INFO:teuthology.orchestra.run.smithi131.stdout:generic/443 0s 2024-05-17T05:53:26.325 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/443 2024-05-17T05:53:26.325 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:26.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:26.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:26.337 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-05-17T05:53:26.538 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:26.542 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:26.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:26.711 INFO:teuthology.orchestra.run.smithi131.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-17T05:53:26.715 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/444 2024-05-17T05:53:26.715 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/444 2024-05-17T05:53:26.715 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:26.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:26.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:26.726 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-05-17T05:53:26.929 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:26.933 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:26.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:27.967 INFO:teuthology.orchestra.run.smithi131.stdout:generic/445 1s 2024-05-17T05:53:27.973 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/445 2024-05-17T05:53:27.973 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:27.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:27.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:27.987 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-05-17T05:53:28.500 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:28.504 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:28.505 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:28.634 INFO:teuthology.orchestra.run.smithi131.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:28.638 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/446 2024-05-17T05:53:28.638 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/446 2024-05-17T05:53:28.638 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:28.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:28.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:28.649 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-05-17T05:53:28.840 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:28.844 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:28.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:28.975 INFO:teuthology.orchestra.run.smithi131.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:28.978 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/447 2024-05-17T05:53:28.978 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/447 2024-05-17T05:53:28.978 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:28.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:28.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:28.990 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-05-17T05:53:29.180 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:29.184 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:29.184 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:30.244 INFO:teuthology.orchestra.run.smithi131.stdout:generic/448 1s 2024-05-17T05:53:30.296 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/448 2024-05-17T05:53:30.296 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:30.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:30.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:30.308 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-05-17T05:53:30.772 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:30.776 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:30.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:30.984 INFO:teuthology.orchestra.run.smithi131.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:30.987 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/449 2024-05-17T05:53:30.987 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/449 2024-05-17T05:53:30.987 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:30.989 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:30.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:30.999 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-05-17T05:53:31.193 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:31.198 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:31.198 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:32.586 INFO:teuthology.orchestra.run.smithi131.stdout:generic/450 1s 2024-05-17T05:53:32.600 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/450 2024-05-17T05:53:32.600 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:32.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:32.611 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-05-17T05:53:33.078 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:33.083 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:33.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:33.457 INFO:teuthology.orchestra.run.smithi131.stdout:generic/451 - output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/451.out.bad) 2024-05-17T05:53:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/451.out 2024-05-17 04:10:05.123701696 +0000 2024-05-17T05:53:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/451.out.bad 2024-05-17 05:53:33.455369595 +0000 2024-05-17T05:53:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -1,2 +1,5 @@ 2024-05-17T05:53:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: QA output created by 451 2024-05-17T05:53:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: +get stale data from buffer read 2024-05-17T05:53:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: +00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 2024-05-17T05:53:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: +000a0000 2024-05-17T05:53:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: Silence is golden 2024-05-17T05:53:33.462 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/451 2024-05-17T05:53:33.462 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/451 2024-05-17T05:53:33.462 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T05:53:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:33.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T05:53:33.474 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T05:53:33.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T05:53:33.474 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-05-17T05:53:33.833 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:33.843 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:33.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:34.071 INFO:teuthology.orchestra.run.smithi131.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:34.076 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/452 2024-05-17T05:53:34.076 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/452 2024-05-17T05:53:34.077 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:34.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:34.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:34.099 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-05-17T05:53:34.305 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:34.309 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:34.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:34.430 INFO:teuthology.orchestra.run.smithi131.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:34.435 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/453 2024-05-17T05:53:34.435 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/453 2024-05-17T05:53:34.436 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:34.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:34.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:34.447 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-05-17T05:53:34.653 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:34.658 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:34.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:34.781 INFO:teuthology.orchestra.run.smithi131.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:34.783 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/454 2024-05-17T05:53:34.783 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/454 2024-05-17T05:53:34.783 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:34.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:34.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:34.795 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-05-17T05:53:35.005 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:35.009 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:35.009 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:35.217 INFO:teuthology.orchestra.run.smithi131.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:35.221 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/455 2024-05-17T05:53:35.221 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/455 2024-05-17T05:53:35.221 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:35.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:35.233 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-05-17T05:53:35.437 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:35.441 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:35.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:35.590 INFO:teuthology.orchestra.run.smithi131.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:35.594 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/456 2024-05-17T05:53:35.594 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/456 2024-05-17T05:53:35.594 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:35.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:35.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:35.605 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-05-17T05:53:35.796 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:35.800 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:35.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:36.023 INFO:teuthology.orchestra.run.smithi131.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:36.027 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/457 2024-05-17T05:53:36.027 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/457 2024-05-17T05:53:36.027 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:36.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:36.038 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-05-17T05:53:36.232 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:36.236 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:36.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:36.370 INFO:teuthology.orchestra.run.smithi131.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:36.374 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/458 2024-05-17T05:53:36.374 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/458 2024-05-17T05:53:36.374 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:36.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:36.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:36.386 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-05-17T05:53:36.576 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:36.580 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:36.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:37.086 INFO:teuthology.orchestra.run.smithi131.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:37.089 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/459 2024-05-17T05:53:37.089 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/459 2024-05-17T05:53:37.089 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:37.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:37.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:37.101 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-05-17T05:53:37.297 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:37.301 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:37.419 INFO:teuthology.orchestra.run.smithi131.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:37.422 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/460 2024-05-17T05:53:37.423 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/460 2024-05-17T05:53:37.423 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:37.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:37.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:37.435 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-05-17T05:53:37.638 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:37.641 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:37.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:37.772 INFO:teuthology.orchestra.run.smithi131.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:37.775 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/461 2024-05-17T05:53:37.776 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/461 2024-05-17T05:53:37.776 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:37.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:37.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:37.791 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-05-17T05:53:37.986 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:37.995 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:37.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:38.130 INFO:teuthology.orchestra.run.smithi131.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:38.134 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/462 2024-05-17T05:53:38.134 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/462 2024-05-17T05:53:38.134 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:38.136 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:38.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:38.146 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-05-17T05:53:38.340 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:38.344 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:38.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:38.533 INFO:teuthology.orchestra.run.smithi131.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T05:53:38.537 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/463 2024-05-17T05:53:38.537 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/463 2024-05-17T05:53:38.537 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:38.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:38.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:38.549 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-05-17T05:53:39.037 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:39.042 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:39.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:39.177 INFO:teuthology.orchestra.run.smithi131.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:39.180 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/464 2024-05-17T05:53:39.180 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/464 2024-05-17T05:53:39.180 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:39.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:39.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:39.192 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-05-17T05:53:39.394 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:39.398 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:55.159 INFO:teuthology.orchestra.run.smithi131.stdout:generic/465 16s 2024-05-17T05:53:55.185 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/465 2024-05-17T05:53:55.185 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:55.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:55.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:55.200 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-05-17T05:53:55.575 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:55.579 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:55.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:55.763 INFO:teuthology.orchestra.run.smithi131.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:53:55.766 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/466 2024-05-17T05:53:55.766 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/466 2024-05-17T05:53:55.767 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:53:55.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:53:55.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:53:55.778 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-05-17T05:53:55.968 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:53:55.972 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:53:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:54:04.548 INFO:teuthology.orchestra.run.smithi131.stdout:generic/467 - output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/467.out.bad) 2024-05-17T05:54:04.567 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/467.out 2024-05-17 04:10:05.124701676 +0000 2024-05-17T05:54:04.567 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/467.out.bad 2024-05-17 05:54:04.472746945 +0000 2024-05-17T05:54:04.567 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -1,5 +1,15 @@ 2024-05-17T05:54:04.567 INFO:teuthology.orchestra.run.smithi131.stdout: QA output created by 467 2024-05-17T05:54:04.567 INFO:teuthology.orchestra.run.smithi131.stdout: test_file_handles TEST_DIR/467-dir -dp 2024-05-17T05:54:04.567 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/467-dir/file000000) opened an unlinked file! 2024-05-17T05:54:04.567 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/467-dir/file000001) opened an unlinked file! 2024-05-17T05:54:04.568 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/467-dir/file000002) opened an unlinked file! 2024-05-17T05:54:04.568 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/467-dir/file000003) opened an unlinked file! 2024-05-17T05:54:04.568 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/467-dir/file000004) opened an unlinked file! 2024-05-17T05:54:04.568 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/467-dir/file000005) opened an unlinked file! 2024-05-17T05:54:04.568 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/467-dir/file000006) opened an unlinked file! 2024-05-17T05:54:04.568 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/467-dir/file000007) opened an unlinked file! 2024-05-17T05:54:04.568 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/467-dir/file000008) opened an unlinked file! 2024-05-17T05:54:04.568 INFO:teuthology.orchestra.run.smithi131.stdout: +open_by_handle(/tmp/tmp.2OgBg7y0wTtest/467-dir/file000009) opened an unlinked file! 2024-05-17T05:54:04.568 INFO:teuthology.orchestra.run.smithi131.stdout: test_file_handles TEST_DIR/467-dir -rp 2024-05-17T05:54:04.568 INFO:teuthology.orchestra.run.smithi131.stdout: test_file_handles TEST_DIR/467-dir -dkr 2024-05-17T05:54:04.568 INFO:teuthology.orchestra.run.smithi131.stdout: test_file_handles TEST_DIR/467-dir -lr 2024-05-17T05:54:04.600 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/467 2024-05-17T05:54:04.601 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/467 2024-05-17T05:54:04.601 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T05:54:04.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:54:04.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T05:54:04.955 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T05:54:04.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T05:54:04.955 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-05-17T05:54:07.101 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:54:07.105 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:54:07.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:54:07.390 INFO:teuthology.orchestra.run.smithi131.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:54:07.394 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/468 2024-05-17T05:54:07.394 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/468 2024-05-17T05:54:07.394 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:54:07.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:54:07.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:54:07.405 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-05-17T05:54:07.601 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:54:07.604 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:54:07.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:54:09.242 INFO:teuthology.orchestra.run.smithi131.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-17T05:54:09.246 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/469 2024-05-17T05:54:09.246 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/469 2024-05-17T05:54:09.246 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:54:09.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:54:09.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:54:09.258 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-05-17T05:54:09.811 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:54:09.815 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:54:09.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:54:10.080 INFO:teuthology.orchestra.run.smithi131.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:54:10.083 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/470 2024-05-17T05:54:10.083 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/470 2024-05-17T05:54:10.083 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:54:10.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:54:10.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:54:10.095 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-05-17T05:54:10.293 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:54:10.297 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:54:10.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:14.888 INFO:teuthology.orchestra.run.smithi131.stdout:generic/471 64s 2024-05-17T05:55:14.892 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/471 2024-05-17T05:55:14.892 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:14.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:14.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:14.905 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-05-17T05:55:15.505 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:15.518 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:15.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:15.768 INFO:teuthology.orchestra.run.smithi131.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:15.773 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/472 2024-05-17T05:55:15.773 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/472 2024-05-17T05:55:15.773 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:15.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:15.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:15.801 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-05-17T05:55:16.245 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:16.256 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:16.537 INFO:teuthology.orchestra.run.smithi131.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-17T05:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/473 2024-05-17T05:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/473 2024-05-17T05:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:16.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:16.552 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-05-17T05:55:16.739 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:16.743 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:16.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:16.874 INFO:teuthology.orchestra.run.smithi131.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:16.877 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/474 2024-05-17T05:55:16.877 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/474 2024-05-17T05:55:16.878 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:16.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:16.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:16.889 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-05-17T05:55:17.088 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:17.092 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:17.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:17.256 INFO:teuthology.orchestra.run.smithi131.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:17.260 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/475 2024-05-17T05:55:17.260 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/475 2024-05-17T05:55:17.260 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:17.262 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:17.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:17.272 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-05-17T05:55:17.465 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:17.469 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:17.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:17.592 INFO:teuthology.orchestra.run.smithi131.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:17.595 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/476 2024-05-17T05:55:17.595 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/476 2024-05-17T05:55:17.595 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:17.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:17.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:17.607 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-05-17T05:55:17.802 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:17.806 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:17.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:31.090 INFO:teuthology.orchestra.run.smithi131.stdout:generic/477 14s 2024-05-17T05:55:31.195 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/477 2024-05-17T05:55:31.196 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:31.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:31.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:31.258 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-05-17T05:55:32.214 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:32.218 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:32.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:42.164 INFO:teuthology.orchestra.run.smithi131.stdout:generic/478 - output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/478.out.bad) 2024-05-17T05:55:42.166 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/478.out 2024-05-17 04:10:05.125701655 +0000 2024-05-17T05:55:42.166 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/478.out.bad 2024-05-17 05:55:42.162786748 +0000 2024-05-17T05:55:42.166 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -10,7 +10,7 @@ 2024-05-17T05:55:42.166 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.166 INFO:teuthology.orchestra.run.smithi131.stdout: get wrlck 2024-05-17T05:55:42.167 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.167 INFO:teuthology.orchestra.run.smithi131.stdout: -lock could be placed 2024-05-17T05:55:42.167 INFO:teuthology.orchestra.run.smithi131.stdout: +get wrlck 2024-05-17T05:55:42.167 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.167 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.167 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.167 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -25,7 +25,7 @@ 2024-05-17T05:55:42.167 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.167 INFO:teuthology.orchestra.run.smithi131.stdout: get wrlck 2024-05-17T05:55:42.167 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.167 INFO:teuthology.orchestra.run.smithi131.stdout: -lock could be placed 2024-05-17T05:55:42.167 INFO:teuthology.orchestra.run.smithi131.stdout: +get wrlck 2024-05-17T05:55:42.168 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.168 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.168 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.168 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -37,7 +37,7 @@ 2024-05-17T05:55:42.168 INFO:teuthology.orchestra.run.smithi131.stdout: get rdlck 2024-05-17T05:55:42.168 INFO:teuthology.orchestra.run.smithi131.stdout: get rdlck 2024-05-17T05:55:42.168 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.168 INFO:teuthology.orchestra.run.smithi131.stdout: -lock could be placed 2024-05-17T05:55:42.168 INFO:teuthology.orchestra.run.smithi131.stdout: +get rdlck 2024-05-17T05:55:42.168 INFO:teuthology.orchestra.run.smithi131.stdout: get rdlck 2024-05-17T05:55:42.168 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.168 INFO:teuthology.orchestra.run.smithi131.stdout: get rdlck 2024-05-17T05:55:42.168 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -46,7 +46,7 @@ 2024-05-17T05:55:42.169 INFO:teuthology.orchestra.run.smithi131.stdout: get rdlck 2024-05-17T05:55:42.169 INFO:teuthology.orchestra.run.smithi131.stdout: get rdlck 2024-05-17T05:55:42.169 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.169 INFO:teuthology.orchestra.run.smithi131.stdout: -lock could be placed 2024-05-17T05:55:42.169 INFO:teuthology.orchestra.run.smithi131.stdout: +get rdlck 2024-05-17T05:55:42.169 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.169 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.169 INFO:teuthology.orchestra.run.smithi131.stdout: lock could be placed 2024-05-17T05:55:42.169 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/478 2024-05-17T05:55:42.170 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/478 2024-05-17T05:55:42.170 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T05:55:42.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:42.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T05:55:42.183 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T05:55:42.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T05:55:42.183 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-05-17T05:55:42.384 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:42.387 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:42.579 INFO:teuthology.orchestra.run.smithi131.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:42.583 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/479 2024-05-17T05:55:42.583 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/479 2024-05-17T05:55:42.583 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:42.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:42.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:42.594 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-05-17T05:55:42.789 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:42.793 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:42.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:42.930 INFO:teuthology.orchestra.run.smithi131.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:42.934 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/480 2024-05-17T05:55:42.934 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/480 2024-05-17T05:55:42.934 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:42.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:42.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:42.945 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-05-17T05:55:43.142 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:43.146 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:43.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:43.283 INFO:teuthology.orchestra.run.smithi131.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:43.287 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/481 2024-05-17T05:55:43.287 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/481 2024-05-17T05:55:43.287 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:43.289 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:43.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:43.298 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-05-17T05:55:43.497 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:43.501 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:43.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:43.680 INFO:teuthology.orchestra.run.smithi131.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:43.683 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/482 2024-05-17T05:55:43.683 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/482 2024-05-17T05:55:43.683 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:43.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:43.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:43.694 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-05-17T05:55:43.889 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:43.892 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:43.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:44.032 INFO:teuthology.orchestra.run.smithi131.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:44.036 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/483 2024-05-17T05:55:44.036 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/483 2024-05-17T05:55:44.036 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:44.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:44.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:44.047 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-05-17T05:55:44.245 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:44.249 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:44.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:44.395 INFO:teuthology.orchestra.run.smithi131.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:44.399 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/484 2024-05-17T05:55:44.399 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/484 2024-05-17T05:55:44.399 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:44.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:44.411 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-05-17T05:55:44.617 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:44.621 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:44.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:45.226 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:55:45.228 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:55:45.291 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-05-17T05:55:45.291+0000 7f7e80ea2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 435142) UID: 0 2024-05-17T05:55:45.291 INFO:tasks.ceph.mds.c.smithi131.stderr:2024-05-17T05:55:45.291+0000 7fbe21f5f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 435142) UID: 0 2024-05-17T05:55:45.509 INFO:teuthology.orchestra.run.smithi131.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-05-17T05:55:45.513 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/485 2024-05-17T05:55:45.513 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/485 2024-05-17T05:55:45.513 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:45.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:45.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:45.524 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-05-17T05:55:46.034 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:46.039 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:46.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:46.218 INFO:teuthology.orchestra.run.smithi131.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:46.221 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/486 2024-05-17T05:55:46.221 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/486 2024-05-17T05:55:46.221 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:46.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:46.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:46.233 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-05-17T05:55:46.421 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:46.425 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:46.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:46.555 INFO:teuthology.orchestra.run.smithi131.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:46.558 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/487 2024-05-17T05:55:46.559 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/487 2024-05-17T05:55:46.559 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:46.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:46.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:46.570 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-05-17T05:55:46.763 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:46.767 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:46.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:46.889 INFO:teuthology.orchestra.run.smithi131.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:46.892 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/488 2024-05-17T05:55:46.892 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/488 2024-05-17T05:55:46.892 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:46.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:46.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:46.903 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-05-17T05:55:47.095 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:47.099 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:47.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:47.241 INFO:teuthology.orchestra.run.smithi131.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:47.245 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/489 2024-05-17T05:55:47.245 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/489 2024-05-17T05:55:47.245 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:47.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:47.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:47.256 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-05-17T05:55:47.452 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:47.458 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:47.458 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:48.478 INFO:teuthology.orchestra.run.smithi131.stdout:generic/490 1s 2024-05-17T05:55:48.484 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/490 2024-05-17T05:55:48.484 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:48.486 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:48.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:48.495 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-05-17T05:55:48.987 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:48.993 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:48.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:49.150 INFO:teuthology.orchestra.run.smithi131.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:49.154 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/491 2024-05-17T05:55:49.154 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/491 2024-05-17T05:55:49.154 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:49.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:49.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:49.166 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-05-17T05:55:49.375 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:49.379 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:49.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:49.502 INFO:teuthology.orchestra.run.smithi131.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:49.506 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/492 2024-05-17T05:55:49.506 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/492 2024-05-17T05:55:49.506 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:49.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:49.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:49.517 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-05-17T05:55:49.706 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:49.709 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:49.836 INFO:teuthology.orchestra.run.smithi131.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:49.839 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/493 2024-05-17T05:55:49.839 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/493 2024-05-17T05:55:49.839 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:49.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:49.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:49.868 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-05-17T05:55:50.058 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:50.062 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:50.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:50.181 INFO:teuthology.orchestra.run.smithi131.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:50.184 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/494 2024-05-17T05:55:50.184 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/494 2024-05-17T05:55:50.184 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:50.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:50.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:50.195 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-05-17T05:55:50.388 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:50.392 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:50.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:50.513 INFO:teuthology.orchestra.run.smithi131.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:50.516 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/495 2024-05-17T05:55:50.517 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/495 2024-05-17T05:55:50.517 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:50.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:50.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:50.528 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-05-17T05:55:50.723 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:50.727 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:50.727 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:50.871 INFO:teuthology.orchestra.run.smithi131.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:50.874 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/496 2024-05-17T05:55:50.874 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/496 2024-05-17T05:55:50.874 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:50.877 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:50.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:50.886 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-05-17T05:55:51.078 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:51.082 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:51.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:51.215 INFO:teuthology.orchestra.run.smithi131.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:51.219 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/497 2024-05-17T05:55:51.219 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/497 2024-05-17T05:55:51.219 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:51.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:51.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:51.230 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-05-17T05:55:51.424 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:51.428 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:51.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:51.566 INFO:teuthology.orchestra.run.smithi131.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:51.569 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/498 2024-05-17T05:55:51.569 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/498 2024-05-17T05:55:51.569 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:51.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:51.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:51.581 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-05-17T05:55:51.780 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:51.784 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:51.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:51.910 INFO:teuthology.orchestra.run.smithi131.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:51.914 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/499 2024-05-17T05:55:51.914 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/499 2024-05-17T05:55:51.914 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:51.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:51.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:51.936 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-05-17T05:55:52.123 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:52.128 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:52.128 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:52.289 INFO:teuthology.orchestra.run.smithi131.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:52.293 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/500 2024-05-17T05:55:52.293 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/500 2024-05-17T05:55:52.293 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:52.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:52.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:52.304 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-05-17T05:55:52.500 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:52.504 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:52.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:52.641 INFO:teuthology.orchestra.run.smithi131.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:52.645 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/501 2024-05-17T05:55:52.645 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/501 2024-05-17T05:55:52.645 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:52.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:52.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:52.656 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-05-17T05:55:52.849 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:52.853 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:52.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:52.985 INFO:teuthology.orchestra.run.smithi131.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:52.989 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/502 2024-05-17T05:55:52.990 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/502 2024-05-17T05:55:52.990 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:52.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:53.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:53.014 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-05-17T05:55:53.208 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:53.212 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:53.342 INFO:teuthology.orchestra.run.smithi131.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:53.346 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/503 2024-05-17T05:55:53.346 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/503 2024-05-17T05:55:53.346 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:53.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:53.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:53.357 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-05-17T05:55:53.559 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:53.563 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:53.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:53.749 INFO:teuthology.orchestra.run.smithi131.stdout:generic/504 - output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/504.out.bad) 2024-05-17T05:55:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/504.out 2024-05-17 04:10:05.126701634 +0000 2024-05-17T05:55:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/504.out.bad 2024-05-17 05:55:53.747554414 +0000 2024-05-17T05:55:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -1,2 +1,3 @@ 2024-05-17T05:55:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: QA output created by 504 2024-05-17T05:55:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: +lock info not found 2024-05-17T05:55:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: Silence is golden 2024-05-17T05:55:53.754 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/504 2024-05-17T05:55:53.754 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/504 2024-05-17T05:55:53.754 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T05:55:53.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:53.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T05:55:53.765 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T05:55:53.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T05:55:53.766 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-05-17T05:55:53.962 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:53.966 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:53.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:54.100 INFO:teuthology.orchestra.run.smithi131.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:54.103 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/505 2024-05-17T05:55:54.103 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/505 2024-05-17T05:55:54.103 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:54.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:54.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:54.114 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-05-17T05:55:54.306 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:54.310 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:54.434 INFO:teuthology.orchestra.run.smithi131.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:54.437 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/506 2024-05-17T05:55:54.437 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/506 2024-05-17T05:55:54.437 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:54.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:54.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:54.462 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-05-17T05:55:54.658 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:54.662 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:54.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:54.848 INFO:teuthology.orchestra.run.smithi131.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-05-17T05:55:54.851 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/507 2024-05-17T05:55:54.852 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/507 2024-05-17T05:55:54.852 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:54.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:54.863 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-05-17T05:55:55.060 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:55.064 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:55.197 INFO:teuthology.orchestra.run.smithi131.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2024-05-17T05:55:55.201 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/508 2024-05-17T05:55:55.201 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/508 2024-05-17T05:55:55.201 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:55.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:55.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:55.212 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-05-17T05:55:55.407 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:55.411 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:55.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:55.550 INFO:teuthology.orchestra.run.smithi131.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:55.554 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/509 2024-05-17T05:55:55.554 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/509 2024-05-17T05:55:55.554 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:55.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:55.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:55.579 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-05-17T05:55:55.775 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:55.779 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:55.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:55.924 INFO:teuthology.orchestra.run.smithi131.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:55.928 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/510 2024-05-17T05:55:55.928 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/510 2024-05-17T05:55:55.928 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:55.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:55.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:55.940 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-05-17T05:55:56.134 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:56.138 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:56.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:56.257 INFO:teuthology.orchestra.run.smithi131.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:56.261 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/511 2024-05-17T05:55:56.261 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/511 2024-05-17T05:55:56.261 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:56.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:56.271 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-05-17T05:55:56.470 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:56.474 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:56.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:56.615 INFO:teuthology.orchestra.run.smithi131.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:56.619 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/512 2024-05-17T05:55:56.619 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/512 2024-05-17T05:55:56.619 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:56.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:56.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:56.630 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-05-17T05:55:56.828 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:56.832 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:56.969 INFO:teuthology.orchestra.run.smithi131.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:56.973 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/513 2024-05-17T05:55:56.973 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/513 2024-05-17T05:55:56.973 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:56.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:56.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:56.984 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-05-17T05:55:57.178 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:57.182 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:57.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:57.312 INFO:teuthology.orchestra.run.smithi131.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:57.316 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/514 2024-05-17T05:55:57.316 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/514 2024-05-17T05:55:57.316 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:57.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:57.327 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-05-17T05:55:57.527 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:57.531 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:57.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:57.652 INFO:teuthology.orchestra.run.smithi131.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:57.656 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/515 2024-05-17T05:55:57.656 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/515 2024-05-17T05:55:57.656 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:57.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:57.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:57.668 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-05-17T05:55:57.861 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:57.865 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:58.042 INFO:teuthology.orchestra.run.smithi131.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-17T05:55:58.046 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/516 2024-05-17T05:55:58.046 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/516 2024-05-17T05:55:58.046 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:58.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:58.088 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-05-17T05:55:58.556 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:58.560 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:58.688 INFO:teuthology.orchestra.run.smithi131.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:58.692 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/517 2024-05-17T05:55:58.692 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/517 2024-05-17T05:55:58.692 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:58.694 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:58.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:58.704 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-05-17T05:55:58.900 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:58.904 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:59.032 INFO:teuthology.orchestra.run.smithi131.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:59.035 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/518 2024-05-17T05:55:59.036 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/518 2024-05-17T05:55:59.036 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:59.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:59.047 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-05-17T05:55:59.241 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:59.245 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:59.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:59.374 INFO:teuthology.orchestra.run.smithi131.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:59.378 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/519 2024-05-17T05:55:59.378 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/519 2024-05-17T05:55:59.378 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:59.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:59.390 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-05-17T05:55:59.586 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:59.590 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:59.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:59.730 INFO:teuthology.orchestra.run.smithi131.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T05:55:59.734 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/520 2024-05-17T05:55:59.734 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/520 2024-05-17T05:55:59.734 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T05:55:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:55:59.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T05:55:59.746 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-05-17T05:55:59.937 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T05:55:59.941 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T05:55:59.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T05:58:57.632 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:58:57.635 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:59:27.799 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:59:27.802 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T05:59:27.831 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T05:59:27.832+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 450627) UID: 0 2024-05-17T05:59:27.831 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T05:59:27.832+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 450627) UID: 0 2024-05-17T05:59:27.832 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T05:59:27.832+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 450627) UID: 0 2024-05-17T05:59:27.832 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T05:59:27.832+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 450627) UID: 0 2024-05-17T06:02:49.922 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:02:49.926 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:03:20.080 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:03:20.083 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:03:50.278 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:03:50.282 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:04:20.426 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:04:20.429 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:04:50.478 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:04:50.481 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:05:20.609 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:05:20.614 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:05:50.792 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:05:50.795 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:06:20.953 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:06:20.957 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:06:51.155 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:06:51.159 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:07:21.219 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:07:21.222 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:07:51.351 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:07:51.417 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:08:21.668 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:08:21.672 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:08:51.728 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:08:51.732 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:09:21.823 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:09:21.826 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:09:51.888 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:09:51.891 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:10:22.208 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:10:22.211 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:10:52.270 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:10:52.273 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:11:22.408 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:11:22.413 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:11:52.507 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:11:52.510 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:12:22.657 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:12:22.661 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:12:52.794 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:12:52.797 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:13:22.943 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:13:22.947 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:13:53.082 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:13:53.085 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:14:23.415 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:14:23.418 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:14:53.538 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:14:53.546 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:15:23.643 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:15:23.646 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:15:53.725 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:15:53.728 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:16:23.830 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:16:23.833 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:16:53.920 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:16:53.924 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:17:24.084 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:17:24.087 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:17:54.234 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:17:54.238 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:18:24.583 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:18:24.587 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:18:54.654 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:18:54.658 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:19:24.885 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:19:24.889 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:19:54.943 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:19:54.947 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:20:25.107 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:20:25.110 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:20:55.173 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:20:55.176 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:20:55.207 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T06:20:55.207+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451337) UID: 0 2024-05-17T06:20:55.207 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T06:20:55.207+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451337) UID: 0 2024-05-17T06:20:55.208 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T06:20:55.207+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451337) UID: 0 2024-05-17T06:20:55.208 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T06:20:55.207+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451337) UID: 0 2024-05-17T06:24:03.329 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:24:03.332 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:24:03.486 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T06:24:03.485+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451365) UID: 0 2024-05-17T06:24:03.487 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T06:24:03.485+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451365) UID: 0 2024-05-17T06:24:03.487 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T06:24:03.486+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451365) UID: 0 2024-05-17T06:24:03.487 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T06:24:03.486+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451365) UID: 0 2024-05-17T06:27:11.976 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:27:11.980 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:27:42.047 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:27:42.050 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:28:12.170 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:28:12.174 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:28:42.285 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:28:42.289 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:29:12.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:29:12.403 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:29:42.531 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:29:42.534 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:30:12.621 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:30:12.624 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:30:42.744 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:30:42.777 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:31:13.026 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:31:13.029 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:31:43.123 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:31:43.126 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:32:13.197 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:32:13.201 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:32:43.455 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:32:43.458 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:33:13.585 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:33:13.589 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:33:43.706 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:33:43.710 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:34:13.821 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:34:13.824 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:34:43.957 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:34:43.960 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:35:14.343 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:35:14.346 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:35:44.474 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:35:44.478 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:36:14.555 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:36:14.558 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:36:44.677 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:36:44.681 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:37:14.744 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:37:14.747 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:37:44.832 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:37:44.835 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:38:14.888 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:38:14.892 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:38:45.019 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:38:45.022 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:39:15.153 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:39:15.155 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:39:45.275 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:39:45.279 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:40:15.398 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:40:15.401 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:40:45.503 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:40:45.506 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:41:15.576 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:41:15.579 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:41:45.708 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:41:45.712 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:42:16.016 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:42:16.019 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:42:46.095 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:42:46.099 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:43:16.168 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:43:16.171 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:43:46.325 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:43:46.328 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:44:16.466 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:44:16.469 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:44:46.621 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:44:46.624 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:45:16.761 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:45:16.764 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:45:46.926 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:45:46.931 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:46:17.065 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:46:17.068 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:46:29.475 INFO:teuthology.orchestra.run.smithi131.stdout:generic/521 3030s 2024-05-17T06:46:29.485 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/521 2024-05-17T06:46:29.486 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T06:46:29.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T06:46:29.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T06:46:29.498 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-05-17T06:46:30.007 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T06:46:30.011 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T06:46:30.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T06:46:47.238 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:46:47.242 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:47:17.303 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:47:17.306 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:47:47.593 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:47:47.596 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:48:17.757 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:48:17.760 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:48:47.808 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:48:47.812 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:49:17.938 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:49:17.941 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:49:48.021 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:49:48.024 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:50:18.537 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:50:18.551 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:50:18.596 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T06:50:18.595+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 452716) UID: 0 2024-05-17T06:50:18.596 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T06:50:18.595+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 452716) UID: 0 2024-05-17T06:50:18.597 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T06:50:18.595+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 452716) UID: 0 2024-05-17T06:50:18.597 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T06:50:18.596+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 452716) UID: 0 2024-05-17T06:53:10.078 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:53:10.082 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:53:40.201 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:53:40.204 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:53:40.233 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T06:53:40.232+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48646) UID: 0 2024-05-17T06:53:40.233 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T06:53:40.232+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48646) UID: 0 2024-05-17T06:53:40.233 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T06:53:40.232+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48646) UID: 0 2024-05-17T06:53:40.234 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T06:53:40.232+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48646) UID: 0 2024-05-17T06:56:37.528 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:56:37.532 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:57:07.639 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:57:07.644 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:57:37.896 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:57:37.903 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:58:08.362 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:58:08.365 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:58:38.426 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:58:38.430 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:59:08.533 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:59:08.536 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:59:38.880 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:59:38.884 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T06:59:38.913 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T06:59:38.912+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48792) UID: 0 2024-05-17T06:59:38.913 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T06:59:38.913+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48792) UID: 0 2024-05-17T06:59:38.913 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T06:59:38.913+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48792) UID: 0 2024-05-17T06:59:38.914 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T06:59:38.913+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48792) UID: 0 2024-05-17T07:02:37.258 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:02:37.262 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:02:37.292 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-05-17T07:02:37.291+0000 7f7e80ea2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 452930) UID: 0 2024-05-17T07:02:37.292 INFO:tasks.ceph.mds.c.smithi131.stderr:2024-05-17T07:02:37.291+0000 7fbe21f5f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 452930) UID: 0 2024-05-17T07:05:29.648 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:05:29.651 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:05:59.894 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:05:59.898 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:06:30.016 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:06:30.022 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:07:00.078 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:07:00.081 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:07:30.237 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:07:30.240 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:08:00.517 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:08:00.520 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:08:30.582 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:08:30.586 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:09:00.955 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:09:00.959 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:09:31.011 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:09:31.014 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:10:01.133 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:10:01.137 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:10:31.290 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:10:31.293 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:11:01.360 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:11:01.363 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:11:31.469 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:11:31.472 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:12:01.575 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:12:01.579 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:12:31.657 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:12:31.660 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:13:01.756 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:13:01.759 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:13:01.787 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T07:13:01.788+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 453238) UID: 0 2024-05-17T07:13:01.787 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T07:13:01.788+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 453238) UID: 0 2024-05-17T07:13:01.788 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T07:13:01.788+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 453238) UID: 0 2024-05-17T07:13:01.788 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T07:13:01.788+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 453238) UID: 0 2024-05-17T07:16:10.451 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:16:10.454 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:16:40.545 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:16:40.548 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:17:10.637 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:17:10.640 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:17:40.760 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:17:40.763 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:18:10.891 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:18:10.894 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:18:41.220 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:18:41.223 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:19:11.295 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:19:11.299 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:19:41.426 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:19:41.428 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:20:11.484 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:20:11.487 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:20:11.517 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T07:20:11.517+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49301) UID: 0 2024-05-17T07:20:11.517 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T07:20:11.517+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49301) UID: 0 2024-05-17T07:20:11.518 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T07:20:11.517+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49301) UID: 0 2024-05-17T07:20:11.518 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T07:20:11.517+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49301) UID: 0 2024-05-17T07:20:16.196 INFO:teuthology.orchestra.run.smithi131.stdout:generic/522 2026s 2024-05-17T07:20:16.213 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/522 2024-05-17T07:20:16.213 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:16.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:16.226 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-05-17T07:20:16.416 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:16.420 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:16.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:16.554 INFO:teuthology.orchestra.run.smithi131.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T07:20:16.558 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/523 2024-05-17T07:20:16.559 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/523 2024-05-17T07:20:16.559 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:16.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:16.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:16.569 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-05-17T07:20:16.761 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:16.765 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:16.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:16.881 INFO:teuthology.orchestra.run.smithi131.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T07:20:16.885 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/524 2024-05-17T07:20:16.885 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/524 2024-05-17T07:20:16.885 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:16.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:16.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:16.896 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-05-17T07:20:17.095 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:17.099 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:17.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:17.231 INFO:teuthology.orchestra.run.smithi131.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T07:20:17.235 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/525 2024-05-17T07:20:17.235 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/525 2024-05-17T07:20:17.235 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:17.237 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:17.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:17.246 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-05-17T07:20:17.444 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:17.448 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:17.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:17.588 INFO:teuthology.orchestra.run.smithi131.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T07:20:17.591 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/526 2024-05-17T07:20:17.591 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/526 2024-05-17T07:20:17.591 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:17.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:17.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:17.603 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-05-17T07:20:17.800 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:17.804 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:17.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:17.947 INFO:teuthology.orchestra.run.smithi131.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T07:20:17.951 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/527 2024-05-17T07:20:17.951 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/527 2024-05-17T07:20:17.951 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:17.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:17.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:17.962 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-05-17T07:20:18.156 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:18.160 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:18.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:18.311 INFO:teuthology.orchestra.run.smithi131.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2024-05-17T07:20:18.315 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/528 2024-05-17T07:20:18.315 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/528 2024-05-17T07:20:18.315 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:18.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:18.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:18.326 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-05-17T07:20:18.519 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:18.523 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:18.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:18.672 INFO:teuthology.orchestra.run.smithi131.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-17T07:20:18.675 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/529 2024-05-17T07:20:18.675 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/529 2024-05-17T07:20:18.676 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:18.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:18.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:18.687 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-05-17T07:20:18.879 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:18.883 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:18.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:19.003 INFO:teuthology.orchestra.run.smithi131.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T07:20:19.007 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/530 2024-05-17T07:20:19.007 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/530 2024-05-17T07:20:19.007 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:19.010 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:19.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:19.018 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-05-17T07:20:19.208 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:19.212 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:19.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:19.341 INFO:teuthology.orchestra.run.smithi131.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T07:20:19.344 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/531 2024-05-17T07:20:19.345 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/531 2024-05-17T07:20:19.345 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:19.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:19.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:19.355 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-05-17T07:20:19.550 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:19.554 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:19.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:19.730 INFO:teuthology.orchestra.run.smithi131.stdout:generic/532 0s 2024-05-17T07:20:19.735 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/532 2024-05-17T07:20:19.736 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:19.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:19.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:19.747 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-05-17T07:20:19.937 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:19.941 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:19.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:20.344 INFO:teuthology.orchestra.run.smithi131.stdout:generic/533 1s 2024-05-17T07:20:20.349 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/533 2024-05-17T07:20:20.349 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:20.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:20.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:20.360 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-05-17T07:20:20.556 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:20.560 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:20.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:20.695 INFO:teuthology.orchestra.run.smithi131.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T07:20:20.699 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/534 2024-05-17T07:20:20.699 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/534 2024-05-17T07:20:20.699 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:20.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:20.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:20.711 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-05-17T07:20:20.903 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:20.907 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:20.908 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:21.050 INFO:teuthology.orchestra.run.smithi131.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T07:20:21.053 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/535 2024-05-17T07:20:21.053 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/535 2024-05-17T07:20:21.053 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:21.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:21.064 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-05-17T07:20:21.257 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:21.261 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:21.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:21.381 INFO:teuthology.orchestra.run.smithi131.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T07:20:21.384 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/536 2024-05-17T07:20:21.384 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/536 2024-05-17T07:20:21.384 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:21.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:21.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:21.396 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-05-17T07:20:21.592 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:21.596 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:21.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:21.726 INFO:teuthology.orchestra.run.smithi131.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T07:20:21.730 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/537 2024-05-17T07:20:21.730 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/537 2024-05-17T07:20:21.730 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T07:20:21.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:20:21.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T07:20:21.756 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-05-17T07:20:21.943 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T07:20:21.947 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T07:20:21.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T07:22:53.740 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:22:53.743 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:22:53.772 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T07:22:53.772+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49323) UID: 0 2024-05-17T07:22:53.772 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T07:22:53.772+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49323) UID: 0 2024-05-17T07:22:53.773 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T07:22:53.772+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49323) UID: 0 2024-05-17T07:22:53.773 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T07:22:53.772+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49323) UID: 0 2024-05-17T07:25:50.775 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:25:50.779 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:26:20.838 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:26:20.841 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:26:50.954 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:26:50.957 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:27:21.011 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:27:21.014 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:27:51.133 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:27:51.136 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:28:21.290 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:28:21.294 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:28:51.390 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:28:51.394 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:29:21.757 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:29:21.760 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:29:51.839 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:29:51.842 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:30:21.961 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:30:21.964 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:30:52.127 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:30:52.130 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:31:22.174 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:31:22.177 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:31:52.298 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:31:52.302 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:32:22.412 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:32:22.416 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:32:52.703 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:32:52.707 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:33:23.117 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:33:23.120 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:33:53.174 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:33:53.178 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:34:23.556 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:34:23.559 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:34:53.612 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:34:53.615 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:35:23.735 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:35:23.739 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:35:53.866 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:35:53.870 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:36:24.013 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:36:24.016 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:36:54.111 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:36:54.114 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:37:24.352 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:37:24.356 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:37:54.409 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:37:54.413 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:38:24.549 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:38:24.552 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:38:54.614 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:38:54.619 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:39:24.712 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:39:24.715 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:39:24.746 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T07:39:24.745+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463897) UID: 0 2024-05-17T07:39:24.746 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T07:39:24.745+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463897) UID: 0 2024-05-17T07:39:24.747 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T07:39:24.745+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463897) UID: 0 2024-05-17T07:39:24.747 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T07:39:24.745+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463897) UID: 0 2024-05-17T07:42:20.332 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:42:20.336 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:42:50.437 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:42:50.440 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:43:20.561 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:43:20.564 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:43:50.887 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:43:50.890 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:44:20.950 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:44:20.954 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:44:51.038 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:44:51.042 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:45:21.170 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:45:21.177 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:45:51.319 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:45:51.322 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:46:21.426 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:46:21.430 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:46:51.757 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:46:51.760 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:47:21.856 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:47:21.859 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:47:51.929 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:47:51.932 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:48:22.086 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:48:22.089 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:48:52.143 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:48:52.146 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:49:22.273 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:49:22.277 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:49:52.331 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:49:52.334 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:50:22.496 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:50:22.499 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:50:52.602 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:50:52.605 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:51:22.674 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:51:22.678 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:51:52.732 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:51:52.735 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:52:22.862 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:52:22.866 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:52:53.236 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:52:53.239 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:53:23.377 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:53:23.380 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:53:53.464 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:53:53.467 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:53:53.496 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T07:53:53.495+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50296) UID: 0 2024-05-17T07:53:53.496 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T07:53:53.495+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50296) UID: 0 2024-05-17T07:53:53.497 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T07:53:53.495+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50296) UID: 0 2024-05-17T07:53:53.497 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T07:53:53.495+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50296) UID: 0 2024-05-17T07:56:49.178 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:56:49.182 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:57:19.234 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:57:19.238 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:57:49.615 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:57:49.618 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:58:19.679 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:58:19.682 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:58:49.804 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:58:49.808 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:59:20.010 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:59:20.013 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:59:50.383 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T07:59:50.386 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:00:20.472 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:00:20.475 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:00:50.629 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:00:50.633 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:01:20.796 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:01:20.800 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:01:50.920 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:01:50.923 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:02:21.135 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:02:21.138 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:02:44.558 INFO:teuthology.orchestra.run.smithi131.stdout:generic/538 2543s 2024-05-17T08:02:44.563 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/538 2024-05-17T08:02:44.563 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:44.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:44.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:44.574 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-05-17T08:02:45.068 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:45.072 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:45.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:46.793 INFO:teuthology.orchestra.run.smithi131.stdout:generic/539 1s 2024-05-17T08:02:46.798 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/539 2024-05-17T08:02:46.798 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:46.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:46.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:46.810 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-05-17T08:02:47.305 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:47.309 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:47.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:47.438 INFO:teuthology.orchestra.run.smithi131.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:47.442 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/540 2024-05-17T08:02:47.442 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/540 2024-05-17T08:02:47.442 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:47.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:47.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:47.454 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-05-17T08:02:47.650 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:47.654 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:47.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:47.779 INFO:teuthology.orchestra.run.smithi131.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:47.782 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/541 2024-05-17T08:02:47.782 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/541 2024-05-17T08:02:47.783 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:47.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:47.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:47.794 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-05-17T08:02:47.983 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:47.987 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:47.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:48.121 INFO:teuthology.orchestra.run.smithi131.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:48.125 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/542 2024-05-17T08:02:48.125 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/542 2024-05-17T08:02:48.125 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:48.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:48.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:48.137 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-05-17T08:02:48.330 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:48.334 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:48.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:48.789 INFO:teuthology.orchestra.run.smithi131.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:48.793 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/543 2024-05-17T08:02:48.793 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/543 2024-05-17T08:02:48.794 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:48.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:48.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:48.806 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-05-17T08:02:49.002 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:49.006 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:49.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:49.127 INFO:teuthology.orchestra.run.smithi131.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:49.130 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/544 2024-05-17T08:02:49.130 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/544 2024-05-17T08:02:49.131 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:49.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:49.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:49.141 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-05-17T08:02:49.343 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:49.345 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:49.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:49.543 INFO:teuthology.orchestra.run.smithi131.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-05-17T08:02:49.547 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/545 2024-05-17T08:02:49.547 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/545 2024-05-17T08:02:49.547 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:49.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:49.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:49.559 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-05-17T08:02:49.759 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:49.763 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:49.763 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:49.927 INFO:teuthology.orchestra.run.smithi131.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:49.930 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/546 2024-05-17T08:02:49.930 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/546 2024-05-17T08:02:49.930 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:49.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:49.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:49.942 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-05-17T08:02:50.152 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:50.156 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:50.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:50.302 INFO:teuthology.orchestra.run.smithi131.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:50.305 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/547 2024-05-17T08:02:50.305 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/547 2024-05-17T08:02:50.305 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:50.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:50.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:50.316 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-05-17T08:02:50.511 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:50.515 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:50.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:50.668 INFO:teuthology.orchestra.run.smithi131.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:50.671 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/548 2024-05-17T08:02:50.671 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/548 2024-05-17T08:02:50.671 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:50.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:50.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:50.683 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-05-17T08:02:50.871 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:50.875 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:50.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:51.047 INFO:teuthology.orchestra.run.smithi131.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:51.050 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/549 2024-05-17T08:02:51.050 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/549 2024-05-17T08:02:51.051 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:51.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:51.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:51.062 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-05-17T08:02:51.257 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:51.261 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:51.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:51.266 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:02:51.268 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:02:51.416 INFO:teuthology.orchestra.run.smithi131.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:51.421 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/550 2024-05-17T08:02:51.421 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/550 2024-05-17T08:02:51.422 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:51.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:51.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:51.449 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-05-17T08:02:51.661 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:51.665 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:51.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:51.785 INFO:teuthology.orchestra.run.smithi131.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:51.789 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/551 2024-05-17T08:02:51.789 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/551 2024-05-17T08:02:51.789 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:51.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:51.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:51.800 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-05-17T08:02:51.998 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:52.001 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:52.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:52.149 INFO:teuthology.orchestra.run.smithi131.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:52.153 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/552 2024-05-17T08:02:52.153 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/552 2024-05-17T08:02:52.153 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:52.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:52.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:52.164 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2024-05-17T08:02:52.361 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:52.365 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:52.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:52.555 INFO:teuthology.orchestra.run.smithi131.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2024-05-17T08:02:52.558 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/553 2024-05-17T08:02:52.559 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/553 2024-05-17T08:02:52.559 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:52.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:52.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:52.578 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2024-05-17T08:02:53.070 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:53.072 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:53.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:53.194 INFO:teuthology.orchestra.run.smithi131.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:53.198 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/554 2024-05-17T08:02:53.198 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/554 2024-05-17T08:02:53.198 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:53.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:53.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:53.209 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2024-05-17T08:02:53.410 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:53.414 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:53.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:53.583 INFO:teuthology.orchestra.run.smithi131.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2024-05-17T08:02:53.586 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/555 2024-05-17T08:02:53.587 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/555 2024-05-17T08:02:53.587 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:53.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:53.598 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2024-05-17T08:02:54.084 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:54.088 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:54.088 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:54.215 INFO:teuthology.orchestra.run.smithi131.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:54.219 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/556 2024-05-17T08:02:54.219 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/556 2024-05-17T08:02:54.219 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:54.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:54.230 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2024-05-17T08:02:54.428 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:54.432 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:54.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:54.569 INFO:teuthology.orchestra.run.smithi131.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:54.573 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/557 2024-05-17T08:02:54.573 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/557 2024-05-17T08:02:54.573 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:54.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:54.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:54.594 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2024-05-17T08:02:54.784 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:54.788 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:54.935 INFO:teuthology.orchestra.run.smithi131.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:54.938 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/558 2024-05-17T08:02:54.938 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/558 2024-05-17T08:02:54.939 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:54.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:54.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:54.949 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2024-05-17T08:02:55.145 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:55.150 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:55.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:55.281 INFO:teuthology.orchestra.run.smithi131.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:55.285 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/559 2024-05-17T08:02:55.285 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/559 2024-05-17T08:02:55.285 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:55.287 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:55.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:55.296 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2024-05-17T08:02:55.485 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:55.489 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:55.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:55.621 INFO:teuthology.orchestra.run.smithi131.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:55.624 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/560 2024-05-17T08:02:55.625 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/560 2024-05-17T08:02:55.625 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:55.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:55.648 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2024-05-17T08:02:55.845 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:55.849 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:55.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:55.973 INFO:teuthology.orchestra.run.smithi131.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:55.977 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/561 2024-05-17T08:02:55.977 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/561 2024-05-17T08:02:55.977 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:55.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:55.988 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2024-05-17T08:02:56.184 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:56.188 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:56.189 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:56.332 INFO:teuthology.orchestra.run.smithi131.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:56.335 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/562 2024-05-17T08:02:56.335 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/562 2024-05-17T08:02:56.335 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:56.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:56.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:56.347 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2024-05-17T08:02:56.539 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:56.543 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:56.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:56.698 INFO:teuthology.orchestra.run.smithi131.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:56.701 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/563 2024-05-17T08:02:56.702 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/563 2024-05-17T08:02:56.702 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:56.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:56.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:56.729 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2024-05-17T08:02:56.922 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:56.927 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:56.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:57.365 INFO:teuthology.orchestra.run.smithi131.stdout:generic/564 1s 2024-05-17T08:02:57.371 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/564 2024-05-17T08:02:57.371 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:57.374 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:57.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:57.382 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2024-05-17T08:02:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:58.024 INFO:teuthology.orchestra.run.smithi131.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:58.028 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/565 2024-05-17T08:02:58.028 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/565 2024-05-17T08:02:58.028 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:58.030 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:58.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:58.039 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2024-05-17T08:02:58.228 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:58.232 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:58.356 INFO:teuthology.orchestra.run.smithi131.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:58.360 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/566 2024-05-17T08:02:58.360 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/566 2024-05-17T08:02:58.360 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:58.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:58.371 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2024-05-17T08:02:58.567 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:58.569 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:58.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:58.692 INFO:teuthology.orchestra.run.smithi131.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:58.696 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/567 2024-05-17T08:02:58.696 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/567 2024-05-17T08:02:58.696 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:58.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:58.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:58.707 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2024-05-17T08:02:58.895 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:58.899 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:58.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:59.089 INFO:teuthology.orchestra.run.smithi131.stdout:generic/568 1s 2024-05-17T08:02:59.099 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/568 2024-05-17T08:02:59.099 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:59.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:59.126 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2024-05-17T08:02:59.580 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:59.584 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:59.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:59.745 INFO:teuthology.orchestra.run.smithi131.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:02:59.748 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/569 2024-05-17T08:02:59.748 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/569 2024-05-17T08:02:59.748 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:02:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:02:59.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:02:59.772 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2024-05-17T08:02:59.975 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:02:59.979 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:02:59.979 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:00.107 INFO:teuthology.orchestra.run.smithi131.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:00.111 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/570 2024-05-17T08:03:00.111 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/570 2024-05-17T08:03:00.111 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:00.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:00.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:00.123 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2024-05-17T08:03:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:00.323 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:06.558 INFO:teuthology.orchestra.run.smithi131.stdout:generic/571 6s 2024-05-17T08:03:06.564 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/571 2024-05-17T08:03:06.564 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:06.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:06.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:06.577 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2024-05-17T08:03:07.043 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:07.047 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:07.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:07.180 INFO:teuthology.orchestra.run.smithi131.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:07.184 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/572 2024-05-17T08:03:07.184 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/572 2024-05-17T08:03:07.184 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:07.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:07.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:07.195 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2024-05-17T08:03:07.395 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:07.399 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:07.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:07.525 INFO:teuthology.orchestra.run.smithi131.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:07.529 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/573 2024-05-17T08:03:07.529 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/573 2024-05-17T08:03:07.529 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:07.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:07.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:07.541 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2024-05-17T08:03:07.740 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:07.744 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:07.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:07.872 INFO:teuthology.orchestra.run.smithi131.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:07.876 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/574 2024-05-17T08:03:07.876 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/574 2024-05-17T08:03:07.876 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:07.878 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:07.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:07.888 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2024-05-17T08:03:08.090 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:08.094 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:08.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:08.222 INFO:teuthology.orchestra.run.smithi131.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:08.226 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/575 2024-05-17T08:03:08.226 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/575 2024-05-17T08:03:08.226 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:08.228 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:08.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:08.237 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2024-05-17T08:03:08.429 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:08.433 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:08.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:08.585 INFO:teuthology.orchestra.run.smithi131.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:08.588 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/576 2024-05-17T08:03:08.588 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/576 2024-05-17T08:03:08.588 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:08.591 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:08.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:08.600 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2024-05-17T08:03:08.796 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:08.800 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:08.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:08.928 INFO:teuthology.orchestra.run.smithi131.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:08.931 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/577 2024-05-17T08:03:08.931 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/577 2024-05-17T08:03:08.932 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:08.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:08.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:08.943 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2024-05-17T08:03:09.140 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:09.144 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:09.144 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:09.305 INFO:teuthology.orchestra.run.smithi131.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-17T08:03:09.308 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/578 2024-05-17T08:03:09.308 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/578 2024-05-17T08:03:09.309 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:09.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:09.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:09.319 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2024-05-17T08:03:09.507 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:09.511 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:09.511 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:09.639 INFO:teuthology.orchestra.run.smithi131.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:09.643 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/579 2024-05-17T08:03:09.643 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/579 2024-05-17T08:03:09.643 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:09.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:09.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:09.654 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2024-05-17T08:03:09.847 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:09.851 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:09.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:10.012 INFO:teuthology.orchestra.run.smithi131.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:10.015 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/580 2024-05-17T08:03:10.015 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/580 2024-05-17T08:03:10.015 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:10.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:10.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:10.027 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2024-05-17T08:03:10.220 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:10.224 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:10.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:10.923 INFO:teuthology.orchestra.run.smithi131.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:10.927 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/581 2024-05-17T08:03:10.927 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/581 2024-05-17T08:03:10.927 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:10.929 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:10.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:10.939 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2024-05-17T08:03:11.135 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:11.139 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:11.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:11.291 INFO:teuthology.orchestra.run.smithi131.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:11.295 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/582 2024-05-17T08:03:11.295 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/582 2024-05-17T08:03:11.295 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:11.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:11.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:11.306 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2024-05-17T08:03:11.511 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:11.515 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:11.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:11.681 INFO:teuthology.orchestra.run.smithi131.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:11.684 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/583 2024-05-17T08:03:11.684 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/583 2024-05-17T08:03:11.685 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:11.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:11.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:11.696 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2024-05-17T08:03:11.889 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:11.893 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:11.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:12.042 INFO:teuthology.orchestra.run.smithi131.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:12.046 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/584 2024-05-17T08:03:12.046 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/584 2024-05-17T08:03:12.046 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:12.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:12.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:12.057 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2024-05-17T08:03:12.256 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:12.260 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:12.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:12.396 INFO:teuthology.orchestra.run.smithi131.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:12.400 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/585 2024-05-17T08:03:12.400 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/585 2024-05-17T08:03:12.400 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:12.402 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:12.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:12.411 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2024-05-17T08:03:12.617 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:12.621 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:12.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:21.608 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:03:21.611 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:03:34.635 INFO:teuthology.orchestra.run.smithi131.stdout:generic/586 22s 2024-05-17T08:03:34.641 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/586 2024-05-17T08:03:34.641 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:34.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:34.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:34.653 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2024-05-17T08:03:35.148 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:35.152 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:35.152 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:35.577 INFO:teuthology.orchestra.run.smithi131.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-17T08:03:35.580 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/587 2024-05-17T08:03:35.580 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/587 2024-05-17T08:03:35.581 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:35.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:35.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:35.592 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2024-05-17T08:03:35.783 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:35.788 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:35.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:35.925 INFO:teuthology.orchestra.run.smithi131.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:35.928 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/588 2024-05-17T08:03:35.928 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/588 2024-05-17T08:03:35.929 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:35.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:35.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:35.940 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2024-05-17T08:03:36.135 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:36.139 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:36.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:36.270 INFO:teuthology.orchestra.run.smithi131.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:36.274 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/589 2024-05-17T08:03:36.274 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/589 2024-05-17T08:03:36.274 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:36.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:36.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:36.285 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2024-05-17T08:03:36.476 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:36.480 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:36.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:36.605 INFO:teuthology.orchestra.run.smithi131.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:36.609 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/590 2024-05-17T08:03:36.609 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/590 2024-05-17T08:03:36.609 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:36.611 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:36.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:36.620 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2024-05-17T08:03:36.818 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:36.822 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:36.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:37.190 INFO:teuthology.orchestra.run.smithi131.stdout:generic/591 1s 2024-05-17T08:03:37.198 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/591 2024-05-17T08:03:37.198 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:37.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:37.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:37.210 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2024-05-17T08:03:37.715 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:37.718 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:37.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:37.869 INFO:teuthology.orchestra.run.smithi131.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:37.872 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/592 2024-05-17T08:03:37.873 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/592 2024-05-17T08:03:37.873 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:37.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:37.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:37.884 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2024-05-17T08:03:38.073 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:38.077 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:38.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:38.230 INFO:teuthology.orchestra.run.smithi131.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:38.233 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/593 2024-05-17T08:03:38.234 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/593 2024-05-17T08:03:38.234 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:38.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:38.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:38.245 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2024-05-17T08:03:38.437 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:38.442 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:38.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:38.566 INFO:teuthology.orchestra.run.smithi131.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:38.569 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/594 2024-05-17T08:03:38.569 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/594 2024-05-17T08:03:38.569 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:38.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:38.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:38.581 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2024-05-17T08:03:38.775 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:38.779 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:38.930 INFO:teuthology.orchestra.run.smithi131.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:38.934 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/595 2024-05-17T08:03:38.934 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/595 2024-05-17T08:03:38.934 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:38.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:38.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:38.946 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2024-05-17T08:03:39.144 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:39.148 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:39.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:39.350 INFO:teuthology.orchestra.run.smithi131.stdout:generic/596 [not run] file system doesn't support chattr +S 2024-05-17T08:03:39.354 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/596 2024-05-17T08:03:39.354 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/596 2024-05-17T08:03:39.354 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:39.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:39.365 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2024-05-17T08:03:39.561 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:39.565 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:39.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:40.242 INFO:teuthology.orchestra.run.smithi131.stdout:generic/597 - output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/597.out.bad) 2024-05-17T08:03:40.244 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/597.out 2024-05-17 04:10:05.133701490 +0000 2024-05-17T08:03:40.244 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/597.out.bad 2024-05-17 08:03:40.240498049 +0000 2024-05-17T08:03:40.244 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -4,11 +4,11 @@ 2024-05-17T08:03:40.244 INFO:teuthology.orchestra.run.smithi131.stdout: fs.protected_symlinks = 0 2024-05-17T08:03:40.244 INFO:teuthology.orchestra.run.smithi131.stdout: successfully followed symlink 2024-05-17T08:03:40.244 INFO:teuthology.orchestra.run.smithi131.stdout: fs.protected_symlinks = 1 2024-05-17T08:03:40.245 INFO:teuthology.orchestra.run.smithi131.stdout: -Permission denied 2024-05-17T08:03:40.245 INFO:teuthology.orchestra.run.smithi131.stdout: +successfully followed symlink 2024-05-17T08:03:40.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:40.245 INFO:teuthology.orchestra.run.smithi131.stdout: == Test hardlink create protection when 2024-05-17T08:03:40.245 INFO:teuthology.orchestra.run.smithi131.stdout: == process != target owner and process cannot read target 2024-05-17T08:03:40.245 INFO:teuthology.orchestra.run.smithi131.stdout: fs.protected_hardlinks = 0 2024-05-17T08:03:40.245 INFO:teuthology.orchestra.run.smithi131.stdout: -successfully created hardlink 2024-05-17T08:03:40.245 INFO:teuthology.orchestra.run.smithi131.stdout: +Permission denied 2024-05-17T08:03:40.245 INFO:teuthology.orchestra.run.smithi131.stdout: fs.protected_hardlinks = 1 2024-05-17T08:03:40.245 INFO:teuthology.orchestra.run.smithi131.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2024-05-17T08:03:40.245 INFO:teuthology.orchestra.run.smithi131.stdout: +Permission denied 2024-05-17T08:03:40.246 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/597 2024-05-17T08:03:40.247 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/597 2024-05-17T08:03:40.247 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T08:03:40.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:40.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T08:03:40.259 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T08:03:40.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T08:03:40.259 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2024-05-17T08:03:40.800 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:40.804 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:40.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:41.488 INFO:teuthology.orchestra.run.smithi131.stdout:generic/598 - output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/598.out.bad) 2024-05-17T08:03:41.490 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/598.out 2024-05-17 04:10:05.133701490 +0000 2024-05-17T08:03:41.490 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/598.out.bad 2024-05-17 08:03:41.486472184 +0000 2024-05-17T08:03:41.490 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -5,13 +5,10 @@ 2024-05-17T08:03:41.490 INFO:teuthology.orchestra.run.smithi131.stdout: = only group writable dir 2024-05-17T08:03:41.490 INFO:teuthology.orchestra.run.smithi131.stdout: fs.protected_regular = 1 2024-05-17T08:03:41.490 INFO:teuthology.orchestra.run.smithi131.stdout: = group & world writable dir 2024-05-17T08:03:41.490 INFO:teuthology.orchestra.run.smithi131.stdout: -Permission denied 2024-05-17T08:03:41.490 INFO:teuthology.orchestra.run.smithi131.stdout: = only group writable dir 2024-05-17T08:03:41.491 INFO:teuthology.orchestra.run.smithi131.stdout: fs.protected_regular = 2 2024-05-17T08:03:41.491 INFO:teuthology.orchestra.run.smithi131.stdout: = group & world writable dir 2024-05-17T08:03:41.491 INFO:teuthology.orchestra.run.smithi131.stdout: -Permission denied 2024-05-17T08:03:41.491 INFO:teuthology.orchestra.run.smithi131.stdout: = only group writable dir 2024-05-17T08:03:41.491 INFO:teuthology.orchestra.run.smithi131.stdout: -Permission denied 2024-05-17T08:03:41.491 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:41.491 INFO:teuthology.orchestra.run.smithi131.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2024-05-17T08:03:41.491 INFO:teuthology.orchestra.run.smithi131.stdout: fs.protected_fifos = 0 2024-05-17T08:03:41.491 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -19,10 +16,7 @@ 2024-05-17T08:03:41.491 INFO:teuthology.orchestra.run.smithi131.stdout: = only group writable dir 2024-05-17T08:03:41.491 INFO:teuthology.orchestra.run.smithi131.stdout: fs.protected_fifos = 1 2024-05-17T08:03:41.491 INFO:teuthology.orchestra.run.smithi131.stdout: = group & world writable dir 2024-05-17T08:03:41.491 INFO:teuthology.orchestra.run.smithi131.stdout: -Permission denied 2024-05-17T08:03:41.492 INFO:teuthology.orchestra.run.smithi131.stdout: = only group writable dir 2024-05-17T08:03:41.492 INFO:teuthology.orchestra.run.smithi131.stdout: fs.protected_fifos = 2 2024-05-17T08:03:41.492 INFO:teuthology.orchestra.run.smithi131.stdout: = group & world writable dir 2024-05-17T08:03:41.492 INFO:teuthology.orchestra.run.smithi131.stdout: -Permission denied 2024-05-17T08:03:41.492 INFO:teuthology.orchestra.run.smithi131.stdout: = only group writable dir 2024-05-17T08:03:41.492 INFO:teuthology.orchestra.run.smithi131.stdout: -Permission denied 2024-05-17T08:03:41.493 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/598 2024-05-17T08:03:41.493 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/598 2024-05-17T08:03:41.493 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T08:03:41.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:41.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T08:03:41.504 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T08:03:41.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T08:03:41.505 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2024-05-17T08:03:42.014 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:42.018 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:42.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:42.143 INFO:teuthology.orchestra.run.smithi131.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:42.147 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/599 2024-05-17T08:03:42.147 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/599 2024-05-17T08:03:42.147 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:42.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:42.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:42.159 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2024-05-17T08:03:42.352 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:42.356 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:42.356 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:42.484 INFO:teuthology.orchestra.run.smithi131.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/600 2024-05-17T08:03:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/600 2024-05-17T08:03:42.488 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:42.491 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:42.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:42.500 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2024-05-17T08:03:42.695 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:42.699 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:42.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:42.837 INFO:teuthology.orchestra.run.smithi131.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:42.840 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/601 2024-05-17T08:03:42.840 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/601 2024-05-17T08:03:42.840 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:42.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:42.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:42.852 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2024-05-17T08:03:43.051 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:43.055 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:43.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:43.206 INFO:teuthology.orchestra.run.smithi131.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:43.210 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/602 2024-05-17T08:03:43.210 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/602 2024-05-17T08:03:43.210 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:43.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:43.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:43.233 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2024-05-17T08:03:43.433 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:43.437 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:43.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:43.560 INFO:teuthology.orchestra.run.smithi131.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:43.564 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/603 2024-05-17T08:03:43.564 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/603 2024-05-17T08:03:43.564 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:43.566 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:43.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:43.575 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2024-05-17T08:03:43.775 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:43.779 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:43.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:43.903 INFO:teuthology.orchestra.run.smithi131.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:43.907 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/604 2024-05-17T08:03:43.907 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/604 2024-05-17T08:03:43.907 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:43.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:43.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:43.919 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2024-05-17T08:03:44.112 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:44.117 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:44.117 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:44.236 INFO:teuthology.orchestra.run.smithi131.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:44.240 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/605 2024-05-17T08:03:44.240 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/605 2024-05-17T08:03:44.240 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:44.242 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:44.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:44.268 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2024-05-17T08:03:44.459 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:44.463 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:44.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:44.589 INFO:teuthology.orchestra.run.smithi131.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:44.593 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/606 2024-05-17T08:03:44.593 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/606 2024-05-17T08:03:44.593 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:44.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:44.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:44.604 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2024-05-17T08:03:44.795 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:44.799 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:44.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:44.925 INFO:teuthology.orchestra.run.smithi131.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:44.928 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/607 2024-05-17T08:03:44.928 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/607 2024-05-17T08:03:44.928 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:44.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:44.940 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2024-05-17T08:03:45.131 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:45.135 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:45.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:45.252 INFO:teuthology.orchestra.run.smithi131.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:45.256 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/608 2024-05-17T08:03:45.256 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/608 2024-05-17T08:03:45.256 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:45.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:45.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:45.267 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2024-05-17T08:03:45.457 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:45.461 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:45.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:45.867 INFO:teuthology.orchestra.run.smithi131.stdout:generic/609 0s 2024-05-17T08:03:45.873 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/609 2024-05-17T08:03:45.873 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:45.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:45.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:45.884 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2024-05-17T08:03:46.374 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:46.376 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:46.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:46.500 INFO:teuthology.orchestra.run.smithi131.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:46.506 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/610 2024-05-17T08:03:46.506 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/610 2024-05-17T08:03:46.506 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:46.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:46.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:46.515 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2024-05-17T08:03:46.714 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:46.718 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:46.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:46.842 INFO:teuthology.orchestra.run.smithi131.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:46.846 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/611 2024-05-17T08:03:46.846 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/611 2024-05-17T08:03:46.846 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:46.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:46.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:46.858 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2024-05-17T08:03:47.048 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:47.052 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:47.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:47.225 INFO:teuthology.orchestra.run.smithi131.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T08:03:47.228 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/612 2024-05-17T08:03:47.228 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/612 2024-05-17T08:03:47.228 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:47.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:47.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:47.278 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2024-05-17T08:03:47.732 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:47.736 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:47.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:47.882 INFO:teuthology.orchestra.run.smithi131.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:47.886 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/613 2024-05-17T08:03:47.886 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/613 2024-05-17T08:03:47.886 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:47.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:47.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:47.907 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2024-05-17T08:03:48.100 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:48.104 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:48.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:48.224 INFO:teuthology.orchestra.run.smithi131.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:48.227 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/614 2024-05-17T08:03:48.227 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/614 2024-05-17T08:03:48.227 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:48.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:48.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:48.238 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2024-05-17T08:03:48.442 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:48.446 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:48.446 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:48.596 INFO:teuthology.orchestra.run.smithi131.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:48.600 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/615 2024-05-17T08:03:48.600 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/615 2024-05-17T08:03:48.600 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:48.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:48.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:48.612 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2024-05-17T08:03:48.802 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:48.806 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:48.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:48.935 INFO:teuthology.orchestra.run.smithi131.stdout:generic/616 [not run] kernel does not support IO_URING 2024-05-17T08:03:48.939 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/616 2024-05-17T08:03:48.939 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/616 2024-05-17T08:03:48.939 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:48.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:48.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:48.951 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2024-05-17T08:03:49.155 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:49.159 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:49.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:49.348 INFO:teuthology.orchestra.run.smithi131.stdout:generic/617 [not run] kernel does not support IO_URING 2024-05-17T08:03:49.351 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/617 2024-05-17T08:03:49.351 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/617 2024-05-17T08:03:49.351 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:49.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:49.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:49.375 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2024-05-17T08:03:49.574 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:49.578 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:49.705 INFO:teuthology.orchestra.run.smithi131.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:49.709 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/618 2024-05-17T08:03:49.709 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/618 2024-05-17T08:03:49.709 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:49.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:49.721 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2024-05-17T08:03:49.922 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:49.927 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:49.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:50.053 INFO:teuthology.orchestra.run.smithi131.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:50.056 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/619 2024-05-17T08:03:50.056 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/619 2024-05-17T08:03:50.057 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:50.059 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:50.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:50.068 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2024-05-17T08:03:50.259 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:50.264 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:50.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:50.412 INFO:teuthology.orchestra.run.smithi131.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:50.415 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/620 2024-05-17T08:03:50.415 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/620 2024-05-17T08:03:50.415 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:50.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:50.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:50.437 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2024-05-17T08:03:50.637 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:50.642 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:50.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:50.790 INFO:teuthology.orchestra.run.smithi131.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:50.794 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/621 2024-05-17T08:03:50.794 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/621 2024-05-17T08:03:50.794 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:50.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:50.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:50.806 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2024-05-17T08:03:51.017 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:51.021 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:51.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:51.148 INFO:teuthology.orchestra.run.smithi131.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:51.152 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/622 2024-05-17T08:03:51.152 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/622 2024-05-17T08:03:51.152 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:51.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:51.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:51.164 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2024-05-17T08:03:51.361 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:51.365 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:51.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:51.492 INFO:teuthology.orchestra.run.smithi131.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:51.496 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/623 2024-05-17T08:03:51.496 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/623 2024-05-17T08:03:51.496 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:51.498 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:51.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:51.507 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2024-05-17T08:03:51.712 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:51.716 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:51.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:51.722 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:03:51.724 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:03:51.840 INFO:teuthology.orchestra.run.smithi131.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:51.843 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/624 2024-05-17T08:03:51.844 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/624 2024-05-17T08:03:51.844 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:51.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:51.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:51.866 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2024-05-17T08:03:52.063 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:52.067 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:52.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:52.203 INFO:teuthology.orchestra.run.smithi131.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:52.207 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/625 2024-05-17T08:03:52.207 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/625 2024-05-17T08:03:52.207 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:52.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:52.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:52.219 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2024-05-17T08:03:52.409 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:52.413 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:52.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:52.546 INFO:teuthology.orchestra.run.smithi131.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:52.549 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/626 2024-05-17T08:03:52.550 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/626 2024-05-17T08:03:52.550 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:52.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:52.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:52.561 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2024-05-17T08:03:52.760 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:52.785 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:52.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:52.890 INFO:teuthology.orchestra.run.smithi131.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:52.894 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/627 2024-05-17T08:03:52.894 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/627 2024-05-17T08:03:52.894 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:52.896 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:52.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:52.915 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2024-05-17T08:03:53.118 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:53.122 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:53.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:53.271 INFO:teuthology.orchestra.run.smithi131.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:53.274 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/628 2024-05-17T08:03:53.275 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/628 2024-05-17T08:03:53.275 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:53.277 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:53.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:53.286 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2024-05-17T08:03:53.476 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:53.481 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:53.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:53.615 INFO:teuthology.orchestra.run.smithi131.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:53.618 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/629 2024-05-17T08:03:53.619 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/629 2024-05-17T08:03:53.619 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:53.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:53.630 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2024-05-17T08:03:53.825 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:53.829 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:53.947 INFO:teuthology.orchestra.run.smithi131.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:53.950 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/630 2024-05-17T08:03:53.950 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/630 2024-05-17T08:03:53.950 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:53.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:53.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:53.972 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2024-05-17T08:03:54.166 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:54.170 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:54.298 INFO:teuthology.orchestra.run.smithi131.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:54.298 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/631 2024-05-17T08:03:54.299 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/631 2024-05-17T08:03:54.299 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:54.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:54.309 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2024-05-17T08:03:54.496 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:54.502 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:54.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:57.034 INFO:teuthology.orchestra.run.smithi131.stdout:generic/632 3s 2024-05-17T08:03:57.039 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/632 2024-05-17T08:03:57.040 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:57.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:57.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:57.052 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2024-05-17T08:03:57.247 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:57.251 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:57.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:57.569 INFO:teuthology.orchestra.run.smithi131.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/633.out.bad) 2024-05-17T08:03:57.571 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/633.out 2024-05-17 04:10:05.135701449 +0000 2024-05-17T08:03:57.571 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/633.out.bad 2024-05-17 08:03:57.568138355 +0000 2024-05-17T08:03:57.571 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -1,2 +1,5 @@ 2024-05-17T08:03:57.571 INFO:teuthology.orchestra.run.smithi131.stdout: QA output created by 633 2024-05-17T08:03:57.571 INFO:teuthology.orchestra.run.smithi131.stdout: Silence is golden 2024-05-17T08:03:57.571 INFO:teuthology.orchestra.run.smithi131.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2024-05-17T08:03:57.571 INFO:teuthology.orchestra.run.smithi131.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2024-05-17T08:03:57.571 INFO:teuthology.orchestra.run.smithi131.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2024-05-17T08:03:57.586 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/633 2024-05-17T08:03:57.589 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/633 2024-05-17T08:03:57.590 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T08:03:57.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:57.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T08:03:57.617 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T08:03:57.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T08:03:57.617 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2024-05-17T08:03:58.055 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:58.059 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:58.174 INFO:teuthology.orchestra.run.smithi131.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:58.177 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/634 2024-05-17T08:03:58.177 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/634 2024-05-17T08:03:58.177 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:58.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:58.192 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2024-05-17T08:03:58.387 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:58.391 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:58.514 INFO:teuthology.orchestra.run.smithi131.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:58.518 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/635 2024-05-17T08:03:58.518 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/635 2024-05-17T08:03:58.518 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:58.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:58.539 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2024-05-17T08:03:58.739 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:58.743 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:58.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:58.868 INFO:teuthology.orchestra.run.smithi131.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:03:58.871 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/636 2024-05-17T08:03:58.871 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/636 2024-05-17T08:03:58.872 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:03:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:03:58.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:03:58.883 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2024-05-17T08:03:59.072 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:03:59.076 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:03:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:00.204 INFO:teuthology.orchestra.run.smithi131.stdout:generic/637 1s 2024-05-17T08:04:00.209 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/637 2024-05-17T08:04:00.210 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:04:00.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:00.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:04:00.222 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2024-05-17T08:04:00.747 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:04:00.751 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:04:00.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:00.930 INFO:teuthology.orchestra.run.smithi131.stdout:generic/638 0s 2024-05-17T08:04:00.936 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/638 2024-05-17T08:04:00.936 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:04:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:00.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:04:00.947 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2024-05-17T08:04:01.144 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:04:01.149 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:04:01.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:05.495 INFO:teuthology.orchestra.run.smithi131.stdout:generic/639 4s 2024-05-17T08:04:05.501 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/639 2024-05-17T08:04:05.502 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:04:05.505 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:05.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:04:05.515 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2024-05-17T08:04:05.713 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:04:05.717 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:04:05.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:05.855 INFO:teuthology.orchestra.run.smithi131.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:04:05.858 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/640 2024-05-17T08:04:05.859 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/640 2024-05-17T08:04:05.859 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:04:05.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:05.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:04:05.870 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2024-05-17T08:04:06.062 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:04:06.066 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:04:06.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:06.190 INFO:teuthology.orchestra.run.smithi131.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:04:06.193 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/641 2024-05-17T08:04:06.193 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/641 2024-05-17T08:04:06.194 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:04:06.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:06.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:04:06.204 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2024-05-17T08:04:06.408 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:04:06.412 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:04:06.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:06.545 INFO:teuthology.orchestra.run.smithi131.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:04:06.548 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/642 2024-05-17T08:04:06.548 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/642 2024-05-17T08:04:06.548 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:04:06.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:06.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:04:06.560 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2024-05-17T08:04:06.754 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:04:06.759 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:04:06.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:06.890 INFO:teuthology.orchestra.run.smithi131.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:04:06.893 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/643 2024-05-17T08:04:06.893 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/643 2024-05-17T08:04:06.893 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:04:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:06.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:04:06.904 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2024-05-17T08:04:07.102 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:04:07.106 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:04:07.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:07.231 INFO:teuthology.orchestra.run.smithi131.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2024-05-17T08:04:07.234 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/644 2024-05-17T08:04:07.234 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/644 2024-05-17T08:04:07.234 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:04:07.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:07.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:04:07.245 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2024-05-17T08:04:07.435 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:04:07.439 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:04:07.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:07.578 INFO:teuthology.orchestra.run.smithi131.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2024-05-17T08:04:07.582 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/645 2024-05-17T08:04:07.582 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/645 2024-05-17T08:04:07.582 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:04:07.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:07.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:04:07.593 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2024-05-17T08:04:07.787 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:04:07.791 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:04:07.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:07.915 INFO:teuthology.orchestra.run.smithi131.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:04:07.918 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/646 2024-05-17T08:04:07.919 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/646 2024-05-17T08:04:07.919 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:04:07.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:07.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:04:07.930 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2024-05-17T08:04:08.126 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:04:08.130 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:04:08.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:08.432 INFO:teuthology.orchestra.run.smithi131.stdout:generic/647 0s 2024-05-17T08:04:08.437 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/647 2024-05-17T08:04:08.449 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:04:08.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:08.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:04:08.450 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2024-05-17T08:04:08.943 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:04:08.947 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:04:08.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:09.230 INFO:teuthology.orchestra.run.smithi131.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T08:04:09.234 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/648 2024-05-17T08:04:09.234 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/648 2024-05-17T08:04:09.234 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:04:09.237 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:09.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:04:09.246 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2024-05-17T08:04:09.437 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:04:09.441 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:04:09.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:09.616 INFO:teuthology.orchestra.run.smithi131.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T08:04:09.620 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/649 2024-05-17T08:04:09.620 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/649 2024-05-17T08:04:09.620 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T08:04:09.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:09.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T08:04:09.631 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2024-05-17T08:04:10.122 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T08:04:10.126 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T08:04:10.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T08:04:21.846 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:04:21.851 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:04:52.254 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:04:52.259 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:05:22.655 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:05:22.661 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:05:52.761 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:05:52.766 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:06:22.913 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:06:22.918 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:06:53.601 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:06:53.609 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:07:23.711 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:07:23.715 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:07:53.817 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:07:53.821 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:08:23.986 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:08:23.990 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:08:54.130 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:08:54.134 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:09:24.452 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:09:24.461 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:09:54.738 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:09:54.742 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:10:24.892 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:10:24.896 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:10:55.148 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:10:55.152 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:11:25.252 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:11:25.257 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:11:55.767 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:11:55.772 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:12:25.894 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:12:25.898 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:12:56.091 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:12:56.097 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:13:26.195 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:13:26.199 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:13:56.315 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:13:56.325 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:14:26.463 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:14:26.466 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:14:56.592 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:14:56.598 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:15:26.737 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:15:26.744 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:15:56.873 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:15:56.876 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:16:27.124 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:16:27.127 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:16:57.236 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:16:57.239 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:17:27.392 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:17:27.395 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:17:57.532 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:17:57.536 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:18:27.693 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:18:27.698 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:18:57.872 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:18:57.877 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:18:57.983 INFO:tasks.ceph.mds.c.smithi131.stderr:2024-05-17T08:18:57.981+0000 7fbe21f5f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 521081) UID: 0 2024-05-17T08:18:57.983 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-05-17T08:18:57.981+0000 7f7e80ea2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 521081) UID: 0 2024-05-17T08:23:12.566 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T08:23:12.565+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521763) UID: 0 2024-05-17T08:23:12.567 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T08:23:12.565+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521763) UID: 0 2024-05-17T08:23:12.567 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T08:23:12.565+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521763) UID: 0 2024-05-17T08:23:12.568 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T08:23:12.565+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521763) UID: 0 2024-05-17T08:28:11.442 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:28:11.445 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:28:11.481 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T08:28:11.479+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51213) UID: 0 2024-05-17T08:28:11.481 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T08:28:11.479+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51213) UID: 0 2024-05-17T08:28:11.481 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T08:28:11.480+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51213) UID: 0 2024-05-17T08:28:11.482 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T08:28:11.480+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51213) UID: 0 2024-05-17T08:34:06.967 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:34:06.978 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:34:37.114 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:34:37.118 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:35:07.618 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:35:07.624 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:35:38.098 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:35:38.101 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:36:08.383 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:36:08.387 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:36:38.508 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:36:38.513 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:37:08.611 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:37:08.614 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:37:38.712 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:37:38.716 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:38:08.862 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:38:08.866 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:38:39.421 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:38:39.425 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:38:39.530 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T08:38:39.529+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 524459) UID: 0 2024-05-17T08:38:39.530 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T08:38:39.529+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 524459) UID: 0 2024-05-17T08:38:39.531 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T08:38:39.529+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 524459) UID: 0 2024-05-17T08:38:39.533 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T08:38:39.529+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 524459) UID: 0 2024-05-17T08:43:59.784 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:43:59.813 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:43:59.841 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T08:43:59.842+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51448) UID: 0 2024-05-17T08:43:59.842 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T08:43:59.842+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51448) UID: 0 2024-05-17T08:43:59.842 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T08:43:59.842+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51448) UID: 0 2024-05-17T08:43:59.842 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T08:43:59.842+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51448) UID: 0 2024-05-17T08:43:59.877 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T08:43:59.877+0000 7f27cf310640 -1 received signal: Hangup from (PID: 525293) UID: 0 2024-05-17T08:43:59.877 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T08:43:59.877+0000 7fd16636b640 -1 received signal: Hangup from (PID: 525293) UID: 0 2024-05-17T08:43:59.878 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T08:43:59.877+0000 7f5ebbb4c640 -1 received signal: Hangup from (PID: 525293) UID: 0 2024-05-17T08:43:59.878 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T08:43:59.878+0000 7f94de04d640 -1 Fail to open '/proc/525293/cmdline' error = (2) No such file or directory 2024-05-17T08:43:59.878 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T08:43:59.878+0000 7f94de04d640 -1 received signal: Hangup from (PID: 525293) UID: 0 2024-05-17T08:49:54.418 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:49:54.424 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:49:54.508 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-05-17T08:49:54.508+0000 7f7e80ea2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 526306) UID: 0 2024-05-17T08:49:54.509 INFO:tasks.ceph.mds.c.smithi131.stderr:2024-05-17T08:49:54.508+0000 7fbe21f5f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 526306) UID: 0 2024-05-17T08:55:12.320 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:55:12.323 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:55:42.562 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:55:42.566 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:56:12.669 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:56:12.698 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:56:42.853 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:56:42.857 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:57:12.977 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:57:12.981 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:57:43.071 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:57:43.081 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:58:13.537 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:58:13.543 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:58:43.712 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:58:43.720 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:59:13.897 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:59:13.902 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:59:44.254 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T08:59:44.257 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:00:14.428 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:00:14.434 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:00:44.564 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:00:44.568 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:01:15.114 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:01:15.117 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:01:45.247 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:01:45.252 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:02:15.519 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:02:15.524 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:02:45.760 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:02:45.765 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:03:15.906 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:03:15.910 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:03:46.101 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:03:46.105 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:04:16.314 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:04:16.321 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:04:46.496 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:04:46.500 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:05:16.638 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:05:16.642 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:05:46.740 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:05:46.746 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:06:16.838 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:06:16.843 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:06:47.499 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:06:47.503 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:07:17.619 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:07:17.624 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:07:47.780 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:07:47.785 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:08:17.884 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:08:17.888 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:08:17.972 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T09:08:17.972+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 529758) UID: 0 2024-05-17T09:08:17.973 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T09:08:17.972+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 529758) UID: 0 2024-05-17T09:08:17.973 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T09:08:17.972+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 529758) UID: 0 2024-05-17T09:08:17.981 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T09:08:17.973+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 529758) UID: 0 2024-05-17T09:14:13.138 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:14:13.145 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:14:43.329 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:14:43.333 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:15:13.405 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:15:13.410 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:15:13.438 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T09:15:13.438+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52081) UID: 0 2024-05-17T09:15:13.439 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T09:15:13.438+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52081) UID: 0 2024-05-17T09:15:13.439 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T09:15:13.438+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52081) UID: 0 2024-05-17T09:15:13.439 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T09:15:13.438+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52081) UID: 0 2024-05-17T09:18:26.393 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:18:26.400 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:18:26.548 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-05-17T09:18:26.548+0000 7f7e80ea2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 531444) UID: 0 2024-05-17T09:18:26.548 INFO:tasks.ceph.mds.c.smithi131.stderr:2024-05-17T09:18:26.549+0000 7fbe21f5f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 531444) UID: 0 2024-05-17T09:23:10.526 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:23:10.531 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:23:10.563 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T09:23:10.563+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52139) UID: 0 2024-05-17T09:23:10.563 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T09:23:10.563+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52139) UID: 0 2024-05-17T09:23:10.563 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T09:23:10.563+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52139) UID: 0 2024-05-17T09:23:10.564 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T09:23:10.563+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52139) UID: 0 2024-05-17T09:26:19.610 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:26:19.620 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:26:19.750 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T09:26:19.750+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 532755) UID: 0 2024-05-17T09:26:19.752 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T09:26:19.751+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 532755) UID: 0 2024-05-17T09:26:19.761 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T09:26:19.751+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 532755) UID: 0 2024-05-17T09:26:19.764 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T09:26:19.753+0000 7fd16636b640 -1 Fail to open '/proc/532755/cmdline' error = (2) No such file or directory 2024-05-17T09:26:19.764 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T09:26:19.753+0000 7fd16636b640 -1 received signal: Hangup from (PID: 532755) UID: 0 2024-05-17T09:31:51.781 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:31:51.786 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:31:51.817 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T09:31:51.818+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52194) UID: 0 2024-05-17T09:31:51.817 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T09:31:51.818+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52194) UID: 0 2024-05-17T09:31:51.817 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T09:31:51.818+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52194) UID: 0 2024-05-17T09:31:51.818 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T09:31:51.818+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52194) UID: 0 2024-05-17T09:34:57.550 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:34:57.556 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:35:27.759 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:35:27.777 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:35:58.259 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:35:58.264 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:36:28.371 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:36:28.376 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:36:58.542 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:36:58.548 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:37:28.668 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:37:28.673 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:37:58.759 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:37:58.764 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:38:28.943 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:38:28.947 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:38:59.096 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:38:59.106 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:38:59.218 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-05-17T09:38:59.218+0000 7f7e80ea2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 534296) UID: 0 2024-05-17T09:38:59.218 INFO:tasks.ceph.mds.c.smithi131.stderr:2024-05-17T09:38:59.218+0000 7fbe21f5f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 534296) UID: 0 2024-05-17T09:40:10.738 INFO:teuthology.orchestra.run.smithi131.stdout:generic/650 5760s 2024-05-17T09:40:10.881 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/650 2024-05-17T09:40:10.881 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:10.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:10.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:10.915 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2024-05-17T09:40:11.529 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:11.544 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:11.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:11.906 INFO:teuthology.orchestra.run.smithi131.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:11.917 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/651 2024-05-17T09:40:11.918 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/651 2024-05-17T09:40:11.918 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:11.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:11.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:11.957 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2024-05-17T09:40:12.470 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:12.486 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:12.486 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:12.902 INFO:teuthology.orchestra.run.smithi131.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:12.909 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/652 2024-05-17T09:40:12.910 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/652 2024-05-17T09:40:12.910 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:12.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:12.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:12.948 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2024-05-17T09:40:13.560 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:13.572 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:14.029 INFO:teuthology.orchestra.run.smithi131.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:14.037 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/653 2024-05-17T09:40:14.037 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/653 2024-05-17T09:40:14.038 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:14.059 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:14.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:14.094 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2024-05-17T09:40:14.751 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:14.759 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:14.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:15.281 INFO:teuthology.orchestra.run.smithi131.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:15.294 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/654 2024-05-17T09:40:15.294 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/654 2024-05-17T09:40:15.294 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:15.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:15.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:15.336 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2024-05-17T09:40:16.134 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:16.143 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:16.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:16.741 INFO:teuthology.orchestra.run.smithi131.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:16.755 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/655 2024-05-17T09:40:16.756 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/655 2024-05-17T09:40:16.756 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:16.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:16.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:16.804 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2024-05-17T09:40:17.552 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:17.569 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:17.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:18.011 INFO:teuthology.orchestra.run.smithi131.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2024-05-17T09:40:18.021 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/656 2024-05-17T09:40:18.022 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/656 2024-05-17T09:40:18.022 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:18.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:18.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:18.078 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2024-05-17T09:40:18.856 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:18.866 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:18.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:19.205 INFO:teuthology.orchestra.run.smithi131.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:19.217 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/657 2024-05-17T09:40:19.217 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/657 2024-05-17T09:40:19.217 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:19.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:19.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:19.267 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2024-05-17T09:40:19.877 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:19.884 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:19.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:20.236 INFO:teuthology.orchestra.run.smithi131.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:20.248 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/658 2024-05-17T09:40:20.249 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/658 2024-05-17T09:40:20.249 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:20.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:20.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:20.272 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2024-05-17T09:40:20.853 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:20.866 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:20.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:21.294 INFO:teuthology.orchestra.run.smithi131.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:21.299 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/659 2024-05-17T09:40:21.299 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/659 2024-05-17T09:40:21.299 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:21.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:21.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:21.319 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2024-05-17T09:40:21.854 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:21.862 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:21.863 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:22.277 INFO:teuthology.orchestra.run.smithi131.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:22.288 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/660 2024-05-17T09:40:22.289 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/660 2024-05-17T09:40:22.289 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:22.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:22.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:22.335 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2024-05-17T09:40:23.005 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:23.016 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:23.016 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:23.369 INFO:teuthology.orchestra.run.smithi131.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:23.375 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/661 2024-05-17T09:40:23.375 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/661 2024-05-17T09:40:23.375 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:23.382 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:23.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:23.407 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2024-05-17T09:40:24.029 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:24.044 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:24.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:24.384 INFO:teuthology.orchestra.run.smithi131.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:24.397 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/662 2024-05-17T09:40:24.397 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/662 2024-05-17T09:40:24.397 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:24.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:24.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:24.438 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2024-05-17T09:40:25.235 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:25.247 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:25.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:25.653 INFO:teuthology.orchestra.run.smithi131.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:25.656 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/663 2024-05-17T09:40:25.657 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/663 2024-05-17T09:40:25.657 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:25.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:25.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:25.704 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2024-05-17T09:40:26.220 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:26.238 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:26.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:26.646 INFO:teuthology.orchestra.run.smithi131.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:26.660 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/664 2024-05-17T09:40:26.660 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/664 2024-05-17T09:40:26.660 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:26.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:26.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:26.691 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2024-05-17T09:40:27.335 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:27.347 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:27.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:27.781 INFO:teuthology.orchestra.run.smithi131.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:27.792 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/665 2024-05-17T09:40:27.792 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/665 2024-05-17T09:40:27.793 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:27.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:27.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:27.859 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2024-05-17T09:40:28.636 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:28.651 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:28.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:29.121 INFO:teuthology.orchestra.run.smithi131.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:29.126 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/666 2024-05-17T09:40:29.126 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/666 2024-05-17T09:40:29.126 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:29.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:29.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:29.162 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2024-05-17T09:40:29.844 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:29.850 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:30.217 INFO:teuthology.orchestra.run.smithi131.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:30.222 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/667 2024-05-17T09:40:30.222 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/667 2024-05-17T09:40:30.222 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:30.229 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:30.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:30.261 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2024-05-17T09:40:30.870 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:30.890 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:30.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:31.341 INFO:teuthology.orchestra.run.smithi131.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:31.349 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/668 2024-05-17T09:40:31.349 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/668 2024-05-17T09:40:31.349 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:31.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:31.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:31.376 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2024-05-17T09:40:32.056 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:32.072 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:32.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:32.416 INFO:teuthology.orchestra.run.smithi131.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:32.429 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/669 2024-05-17T09:40:32.429 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/669 2024-05-17T09:40:32.429 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:32.438 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:32.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:32.466 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2024-05-17T09:40:33.229 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:33.246 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:33.651 INFO:teuthology.orchestra.run.smithi131.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:33.661 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/670 2024-05-17T09:40:33.662 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/670 2024-05-17T09:40:33.662 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:33.670 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:33.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:33.698 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2024-05-17T09:40:34.416 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:34.430 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:34.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:34.905 INFO:teuthology.orchestra.run.smithi131.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:34.916 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/671 2024-05-17T09:40:34.916 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/671 2024-05-17T09:40:34.916 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:34.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:34.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:34.946 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2024-05-17T09:40:35.554 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:35.572 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:35.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:35.881 INFO:teuthology.orchestra.run.smithi131.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:35.889 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/672 2024-05-17T09:40:35.889 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/672 2024-05-17T09:40:35.890 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:35.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:35.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:35.924 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2024-05-17T09:40:36.487 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:36.500 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:36.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:37.525 INFO:teuthology.orchestra.run.smithi131.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:37.537 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/673 2024-05-17T09:40:37.538 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/673 2024-05-17T09:40:37.538 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:37.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:37.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:37.594 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2024-05-17T09:40:38.266 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:38.283 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:38.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:38.732 INFO:teuthology.orchestra.run.smithi131.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:38.742 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/674 2024-05-17T09:40:38.742 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/674 2024-05-17T09:40:38.742 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:38.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:38.775 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2024-05-17T09:40:39.373 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:39.384 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:39.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:39.798 INFO:teuthology.orchestra.run.smithi131.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T09:40:39.808 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/675 2024-05-17T09:40:39.808 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/675 2024-05-17T09:40:39.808 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T09:40:39.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:40:39.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T09:40:39.838 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2024-05-17T09:40:40.469 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T09:40:40.482 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T09:40:40.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T09:46:38.721 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:46:38.725 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:47:09.032 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:47:09.038 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:47:39.171 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:47:39.175 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:48:09.497 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:48:09.503 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:48:39.603 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:48:39.609 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:49:09.987 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:49:09.991 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:49:40.109 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:49:40.114 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:49:40.213 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T09:49:40.215+0000 7f5ebbb4c640 -1 received signal: Hangup from (PID: 545553) UID: 0 2024-05-17T09:49:40.214 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T09:49:40.215+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 545553) UID: 0 2024-05-17T09:49:40.216 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T09:49:40.215+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 545553) UID: 0 2024-05-17T09:49:40.224 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T09:49:40.216+0000 7f94de04d640 -1 Fail to open '/proc/545553/cmdline' error = (2) No such file or directory 2024-05-17T09:49:40.225 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T09:49:40.216+0000 7f94de04d640 -1 received signal: Hangup from (PID: 545553) UID: 0 2024-05-17T09:58:44.189 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:58:44.225 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T09:58:44.254 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T09:58:44.255+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52524) UID: 0 2024-05-17T09:58:44.254 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T09:58:44.255+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52524) UID: 0 2024-05-17T09:58:44.255 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T09:58:44.255+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52524) UID: 0 2024-05-17T09:58:44.255 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T09:58:44.255+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52524) UID: 0 2024-05-17T09:58:44.298 INFO:tasks.ceph.mds.c.smithi131.stderr:2024-05-17T09:58:44.299+0000 7fbe21f5f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 545592) UID: 0 2024-05-17T09:58:44.299 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-05-17T09:58:44.299+0000 7f7e80ea2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 545592) UID: 0 2024-05-17T10:08:51.780 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T10:08:51.781+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 545622) UID: 0 2024-05-17T10:08:51.781 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T10:08:51.780+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 545622) UID: 0 2024-05-17T10:08:51.781 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T10:08:51.781+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 545622) UID: 0 2024-05-17T10:08:51.782 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T10:08:51.780+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 545622) UID: 0 2024-05-17T10:19:06.391 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T10:19:06.425 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T10:19:06.458 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T10:19:06.460+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52578) UID: 0 2024-05-17T10:19:06.459 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T10:19:06.460+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52578) UID: 0 2024-05-17T10:19:06.459 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T10:19:06.460+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52578) UID: 0 2024-05-17T10:19:06.459 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T10:19:06.460+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52578) UID: 0 2024-05-17T10:19:06.500 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-05-17T10:19:06.502+0000 7f7e80ea2640 -1 Fail to open '/proc/545648/cmdline' error = (2) No such file or directory 2024-05-17T10:19:06.500 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-05-17T10:19:06.502+0000 7f7e80ea2640 -1 received signal: Hangup from (PID: 545648) UID: 0 2024-05-17T10:19:06.501 INFO:tasks.ceph.mds.c.smithi131.stderr:2024-05-17T10:19:06.500+0000 7fbe21f5f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 545648) UID: 0 2024-05-17T10:29:12.703 INFO:teuthology.orchestra.run.smithi131.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.a.log.1: 2024-05-17T10:29:12.704 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: stdin: file size changed while zipping 2024-05-17T10:29:15.458 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T10:29:15.458+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 545670) UID: 0 2024-05-17T10:29:15.458 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T10:29:15.458+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 545670) UID: 0 2024-05-17T10:29:15.459 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T10:29:15.458+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 545670) UID: 0 2024-05-17T10:29:15.463 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T10:29:15.458+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 545670) UID: 0 2024-05-17T10:41:48.979 INFO:teuthology.orchestra.run.smithi131.stdout:generic/676 3668s 2024-05-17T10:41:49.008 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/676 2024-05-17T10:41:49.008 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:41:49.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:41:49.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:41:49.054 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2024-05-17T10:41:50.323 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:41:50.333 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:41:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:41:50.857 INFO:teuthology.orchestra.run.smithi131.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:41:50.869 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/677 2024-05-17T10:41:50.869 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/677 2024-05-17T10:41:50.869 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:41:50.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:41:50.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:41:50.908 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2024-05-17T10:41:51.674 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:41:51.687 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:41:51.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:41:52.318 INFO:teuthology.orchestra.run.smithi131.stdout:generic/678 [not run] kernel does not support IO_URING 2024-05-17T10:41:52.326 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/678 2024-05-17T10:41:52.327 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/678 2024-05-17T10:41:52.327 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:41:52.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:41:52.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:41:52.373 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2024-05-17T10:41:53.154 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:41:53.161 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:41:53.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:41:53.513 INFO:teuthology.orchestra.run.smithi131.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:41:53.520 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/679 2024-05-17T10:41:53.520 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/679 2024-05-17T10:41:53.520 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:41:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:41:53.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:41:53.542 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2024-05-17T10:41:54.115 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:41:54.133 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:41:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:41:55.658 INFO:teuthology.orchestra.run.smithi131.stdout:generic/680 1s 2024-05-17T10:41:55.672 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/680 2024-05-17T10:41:55.672 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:41:55.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:41:55.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:41:55.729 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2024-05-17T10:41:56.938 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:41:56.945 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:41:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:41:57.456 INFO:teuthology.orchestra.run.smithi131.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-17T10:41:57.466 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/681 2024-05-17T10:41:57.466 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/681 2024-05-17T10:41:57.466 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:41:57.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:41:57.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:41:57.520 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2024-05-17T10:41:58.163 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:41:58.175 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:41:58.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:41:59.117 INFO:teuthology.orchestra.run.smithi131.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-17T10:41:59.126 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/682 2024-05-17T10:41:59.127 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/682 2024-05-17T10:41:59.127 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:41:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:41:59.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:41:59.158 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2024-05-17T10:41:59.818 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:41:59.829 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:41:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:00.686 INFO:teuthology.orchestra.run.smithi131.stdout:generic/683 [not run] /tmp/tmp.2OgBg7y0wTtest: file alloc unit 4194304 larger than op length 65536 2024-05-17T10:42:00.697 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/683 2024-05-17T10:42:00.698 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/683 2024-05-17T10:42:00.698 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:00.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:00.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:00.736 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2024-05-17T10:42:01.250 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:01.262 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:01.262 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:03.730 INFO:teuthology.orchestra.run.smithi131.stdout:generic/684 [not run] /tmp/tmp.2OgBg7y0wTtest: file alloc unit 4194304 larger than op length 65536 2024-05-17T10:42:03.743 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/684 2024-05-17T10:42:03.743 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/684 2024-05-17T10:42:03.744 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:03.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:03.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:03.796 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2024-05-17T10:42:04.428 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:04.439 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:04.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:07.349 INFO:teuthology.orchestra.run.smithi131.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-17T10:42:07.360 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/685 2024-05-17T10:42:07.360 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/685 2024-05-17T10:42:07.360 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:07.369 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:07.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:07.401 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2024-05-17T10:42:08.104 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:08.125 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:08.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:10.764 INFO:teuthology.orchestra.run.smithi131.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-05-17T10:42:10.775 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/686 2024-05-17T10:42:10.776 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/686 2024-05-17T10:42:10.776 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:10.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:10.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:10.811 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2024-05-17T10:42:11.568 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:11.582 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:11.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:14.108 INFO:teuthology.orchestra.run.smithi131.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-05-17T10:42:14.123 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/687 2024-05-17T10:42:14.123 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/687 2024-05-17T10:42:14.124 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:14.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:14.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:14.178 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2024-05-17T10:42:14.770 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:14.790 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:14.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:15.395 INFO:teuthology.orchestra.run.smithi131.stdout:generic/688 [not run] /tmp/tmp.2OgBg7y0wTtest: file alloc unit 4194304 larger than op length 65536 2024-05-17T10:42:15.408 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/688 2024-05-17T10:42:15.409 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/688 2024-05-17T10:42:15.409 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:15.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:15.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:15.445 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2024-05-17T10:42:16.166 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:16.180 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:16.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:16.603 INFO:teuthology.orchestra.run.smithi131.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2024-05-17T10:42:16.610 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/689 2024-05-17T10:42:16.610 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/689 2024-05-17T10:42:16.611 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:16.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:16.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:16.643 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2024-05-17T10:42:17.123 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:17.130 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:17.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:17.557 INFO:teuthology.orchestra.run.smithi131.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:42:17.568 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/690 2024-05-17T10:42:17.569 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/690 2024-05-17T10:42:17.569 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:17.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:17.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:17.616 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2024-05-17T10:42:18.381 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:18.408 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:18.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:18.731 INFO:teuthology.orchestra.run.smithi131.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:42:18.738 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/691 2024-05-17T10:42:18.738 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/691 2024-05-17T10:42:18.738 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:18.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:18.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:18.762 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2024-05-17T10:42:19.411 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:19.424 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:19.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:20.048 INFO:teuthology.orchestra.run.smithi131.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:42:20.062 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/692 2024-05-17T10:42:20.062 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/692 2024-05-17T10:42:20.062 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:20.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:20.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:20.104 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2024-05-17T10:42:20.874 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:20.885 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:20.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:21.517 INFO:teuthology.orchestra.run.smithi131.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:42:21.529 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/693 2024-05-17T10:42:21.529 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/693 2024-05-17T10:42:21.530 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:21.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:21.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:21.562 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2024-05-17T10:42:22.303 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:22.318 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:22.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:23.844 INFO:teuthology.orchestra.run.smithi131.stdout:generic/694 1s 2024-05-17T10:42:23.878 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/694 2024-05-17T10:42:23.878 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:23.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:23.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:23.921 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2024-05-17T10:42:24.593 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:24.603 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:24.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:24.924 INFO:teuthology.orchestra.run.smithi131.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:42:24.931 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/695 2024-05-17T10:42:24.932 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/695 2024-05-17T10:42:24.932 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:24.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:24.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:24.954 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2024-05-17T10:42:25.610 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:25.617 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:25.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:26.022 INFO:teuthology.orchestra.run.smithi131.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:42:26.027 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/696 2024-05-17T10:42:26.027 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/696 2024-05-17T10:42:26.027 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:26.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:26.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:26.073 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2024-05-17T10:42:26.712 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:26.725 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:26.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:27.158 INFO:teuthology.orchestra.run.smithi131.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-17T10:42:27.163 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/697 2024-05-17T10:42:27.163 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/697 2024-05-17T10:42:27.163 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:27.165 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:27.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:27.187 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2024-05-17T10:42:27.944 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:27.952 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:27.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:28.377 INFO:teuthology.orchestra.run.smithi131.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:42:28.386 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/698 2024-05-17T10:42:28.386 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/698 2024-05-17T10:42:28.386 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:28.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:28.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:28.433 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2024-05-17T10:42:29.109 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:29.121 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:29.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:29.732 INFO:teuthology.orchestra.run.smithi131.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:42:29.751 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/699 2024-05-17T10:42:29.752 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/699 2024-05-17T10:42:29.752 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:29.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:29.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:29.796 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2024-05-17T10:42:30.432 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:30.445 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:30.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:30.833 INFO:teuthology.orchestra.run.smithi131.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:42:30.841 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/700 2024-05-17T10:42:30.841 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/700 2024-05-17T10:42:30.842 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:30.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:30.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:30.865 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2024-05-17T10:42:31.517 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:31.530 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:31.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:32.581 INFO:teuthology.orchestra.run.smithi131.stdout:generic/701 1s 2024-05-17T10:42:32.614 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/701 2024-05-17T10:42:32.614 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:32.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:32.660 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2024-05-17T10:42:33.902 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:33.923 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:33.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:34.354 INFO:teuthology.orchestra.run.smithi131.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:42:34.363 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/702 2024-05-17T10:42:34.363 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/702 2024-05-17T10:42:34.363 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:34.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:34.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:34.382 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2024-05-17T10:42:34.877 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:34.885 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:34.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:35.239 INFO:teuthology.orchestra.run.smithi131.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:42:35.249 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/703 2024-05-17T10:42:35.249 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/703 2024-05-17T10:42:35.250 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:35.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:35.265 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2024-05-17T10:42:35.840 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:35.853 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:35.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:36.678 INFO:teuthology.orchestra.run.smithi131.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2024-05-17T10:42:36.684 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/704 2024-05-17T10:42:36.684 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/704 2024-05-17T10:42:36.684 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:36.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:36.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:36.727 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2024-05-17T10:42:37.297 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:37.310 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:37.902 INFO:teuthology.orchestra.run.smithi131.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:42:37.908 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/705 2024-05-17T10:42:37.908 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/705 2024-05-17T10:42:37.908 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:37.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:37.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:37.934 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2024-05-17T10:42:38.471 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:38.486 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:38.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:42.024 INFO:teuthology.orchestra.run.smithi131.stdout:generic/706 4s 2024-05-17T10:42:42.041 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/706 2024-05-17T10:42:42.041 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:42.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:42.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:42.070 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2024-05-17T10:42:43.121 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:43.132 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:43.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:43.445 INFO:teuthology.orchestra.run.smithi131.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:42:43.454 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/707 2024-05-17T10:42:43.454 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/707 2024-05-17T10:42:43.455 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:43.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:43.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:43.487 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2024-05-17T10:42:44.156 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:44.163 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:44.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:45.319 INFO:teuthology.orchestra.run.smithi131.stdout:generic/708 1s 2024-05-17T10:42:45.336 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/708 2024-05-17T10:42:45.336 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:45.349 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:45.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:45.378 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2024-05-17T10:42:46.199 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:46.227 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:46.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:46.912 INFO:teuthology.orchestra.run.smithi131.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-17T10:42:46.925 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/709 2024-05-17T10:42:46.925 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/709 2024-05-17T10:42:46.925 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:46.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:46.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:46.965 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2024-05-17T10:42:48.029 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:48.045 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:48.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:48.609 INFO:teuthology.orchestra.run.smithi131.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-17T10:42:48.619 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/710 2024-05-17T10:42:48.620 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/710 2024-05-17T10:42:48.620 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:48.633 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:48.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:48.675 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2024-05-17T10:42:49.879 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:49.895 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:49.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:50.573 INFO:teuthology.orchestra.run.smithi131.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-17T10:42:50.578 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/711 2024-05-17T10:42:50.578 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/711 2024-05-17T10:42:50.578 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:50.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:50.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:50.613 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2024-05-17T10:42:51.659 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:51.677 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:51.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:52.355 INFO:teuthology.orchestra.run.smithi131.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-17T10:42:52.366 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/712 2024-05-17T10:42:52.366 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/712 2024-05-17T10:42:52.367 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:52.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:52.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:52.420 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2024-05-17T10:42:53.583 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:53.603 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:54.176 INFO:teuthology.orchestra.run.smithi131.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-05-17T10:42:54.189 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/713 2024-05-17T10:42:54.189 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/713 2024-05-17T10:42:54.189 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:54.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:54.225 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2024-05-17T10:42:55.262 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:55.278 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:55.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:55.925 INFO:teuthology.orchestra.run.smithi131.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-17T10:42:55.937 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/714 2024-05-17T10:42:55.938 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/714 2024-05-17T10:42:55.938 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:55.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:55.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:55.964 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2024-05-17T10:42:56.870 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:56.886 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:56.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:57.470 INFO:teuthology.orchestra.run.smithi131.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-05-17T10:42:57.481 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/715 2024-05-17T10:42:57.481 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/715 2024-05-17T10:42:57.481 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:57.491 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:57.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:57.517 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2024-05-17T10:42:58.383 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:42:58.399 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:42:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:58.928 INFO:teuthology.orchestra.run.smithi131.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-17T10:42:58.940 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/716 2024-05-17T10:42:58.941 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/716 2024-05-17T10:42:58.941 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:42:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:42:58.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:42:58.976 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2024-05-17T10:43:00.081 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:00.098 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:00.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:00.617 INFO:teuthology.orchestra.run.smithi131.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-17T10:43:00.622 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/717 2024-05-17T10:43:00.622 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/717 2024-05-17T10:43:00.622 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:00.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:00.664 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2024-05-17T10:43:01.703 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:01.709 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:01.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:02.267 INFO:teuthology.orchestra.run.smithi131.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-17T10:43:02.279 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/718 2024-05-17T10:43:02.280 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/718 2024-05-17T10:43:02.280 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:02.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:02.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:02.327 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2024-05-17T10:43:03.460 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:03.475 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:04.056 INFO:teuthology.orchestra.run.smithi131.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-17T10:43:04.067 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/719 2024-05-17T10:43:04.067 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/719 2024-05-17T10:43:04.067 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:04.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:04.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:04.099 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2024-05-17T10:43:05.164 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:05.172 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:05.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:05.677 INFO:teuthology.orchestra.run.smithi131.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-17T10:43:05.681 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/720 2024-05-17T10:43:05.681 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/720 2024-05-17T10:43:05.681 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:05.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:05.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:05.711 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2024-05-17T10:43:06.751 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:06.768 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:06.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:07.257 INFO:teuthology.orchestra.run.smithi131.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-05-17T10:43:07.269 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/721 2024-05-17T10:43:07.269 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/721 2024-05-17T10:43:07.269 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:07.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:07.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:07.299 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2024-05-17T10:43:07.981 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:07.990 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:07.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:08.482 INFO:teuthology.orchestra.run.smithi131.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-05-17T10:43:08.492 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/722 2024-05-17T10:43:08.492 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/722 2024-05-17T10:43:08.493 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:08.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:08.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:08.529 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2024-05-17T10:43:09.595 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:09.610 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:09.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:10.080 INFO:teuthology.orchestra.run.smithi131.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-17T10:43:10.085 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/723 2024-05-17T10:43:10.085 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/723 2024-05-17T10:43:10.086 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:10.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:10.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:10.105 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2024-05-17T10:43:11.060 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:11.071 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:11.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:11.602 INFO:teuthology.orchestra.run.smithi131.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-05-17T10:43:11.614 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/724 2024-05-17T10:43:11.614 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/724 2024-05-17T10:43:11.615 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:11.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:11.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:11.643 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2024-05-17T10:43:12.633 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:12.645 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:12.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:13.314 INFO:teuthology.orchestra.run.smithi131.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-05-17T10:43:13.323 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/725 2024-05-17T10:43:13.323 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/725 2024-05-17T10:43:13.324 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:13.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:13.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:13.351 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2024-05-17T10:43:14.320 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:14.328 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:14.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:15.518 INFO:teuthology.orchestra.run.smithi131.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-05-17T10:43:15.529 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/726 2024-05-17T10:43:15.529 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/726 2024-05-17T10:43:15.529 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:15.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:15.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:15.569 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2024-05-17T10:43:16.796 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:16.815 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:16.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:17.478 INFO:teuthology.orchestra.run.smithi131.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-05-17T10:43:17.485 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/727 2024-05-17T10:43:17.486 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/727 2024-05-17T10:43:17.486 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:17.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:17.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:17.540 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2024-05-17T10:43:18.634 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:18.647 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:18.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:23.386 INFO:teuthology.orchestra.run.smithi131.stdout:generic/728 5s 2024-05-17T10:43:23.410 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/728 2024-05-17T10:43:23.410 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:23.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:23.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:23.437 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2024-05-17T10:43:24.111 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:24.135 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:24.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:25.497 INFO:teuthology.orchestra.run.smithi131.stdout:generic/729 1s 2024-05-17T10:43:25.520 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/729 2024-05-17T10:43:25.521 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:25.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:25.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:25.566 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2024-05-17T10:43:26.782 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:26.795 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:26.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:27.349 INFO:teuthology.orchestra.run.smithi131.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2024-05-17T10:43:27.360 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/730 2024-05-17T10:43:27.360 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/730 2024-05-17T10:43:27.360 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:27.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:27.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:27.408 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2024-05-17T10:43:27.944 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:27.957 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:27.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:28.355 INFO:teuthology.orchestra.run.smithi131.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2024-05-17T10:43:28.365 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/731 2024-05-17T10:43:28.365 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/731 2024-05-17T10:43:28.365 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:28.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:28.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:28.410 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2024-05-17T10:43:29.022 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:29.038 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:29.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:29.517 INFO:teuthology.orchestra.run.smithi131.stdout:generic/732 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:43:29.523 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/732 2024-05-17T10:43:29.523 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/732 2024-05-17T10:43:29.523 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:29.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:29.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:29.568 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/733) 2024-05-17T10:43:30.277 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:30.291 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:30.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:30.687 INFO:teuthology.orchestra.run.smithi131.stdout:generic/733 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:43:30.703 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/733 2024-05-17T10:43:30.703 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/733 2024-05-17T10:43:30.703 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:30.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:30.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:30.743 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/734) 2024-05-17T10:43:31.335 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:31.351 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:31.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:31.876 INFO:teuthology.orchestra.run.smithi131.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-17T10:43:31.880 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/734 2024-05-17T10:43:31.880 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/734 2024-05-17T10:43:31.880 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:31.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:31.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:31.917 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/735) 2024-05-17T10:43:33.023 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:33.040 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:33.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:36.027 INFO:teuthology.orchestra.run.smithi131.stdout:generic/735 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-05-17T10:43:36.042 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/735 2024-05-17T10:43:36.042 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/735 2024-05-17T10:43:36.042 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:43:36.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:43:36.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:43:36.083 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/736) 2024-05-17T10:43:37.258 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:43:37.273 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:43:37.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:46:50.173 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T10:46:50.178 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T10:46:50.210 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T10:46:50.209+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52631) UID: 0 2024-05-17T10:46:50.210 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T10:46:50.209+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52631) UID: 0 2024-05-17T10:46:50.210 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T10:46:50.209+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52631) UID: 0 2024-05-17T10:46:50.211 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T10:46:50.209+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52631) UID: 0 2024-05-17T10:46:50.269 INFO:tasks.ceph.mds.c.smithi131.stderr:2024-05-17T10:46:50.270+0000 7fbe21f5f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 572472) UID: 0 2024-05-17T10:46:50.271 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-05-17T10:46:50.270+0000 7f7e80ea2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 572472) UID: 0 2024-05-17T10:49:33.786 INFO:teuthology.orchestra.run.smithi131.stdout:generic/736 356s 2024-05-17T10:49:33.800 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/736 2024-05-17T10:49:33.800 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:49:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:49:33.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:49:33.834 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/737) 2024-05-17T10:49:34.947 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:49:34.963 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:49:34.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:49:35.277 INFO:teuthology.orchestra.run.smithi131.stdout:generic/737 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:49:35.285 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/737 2024-05-17T10:49:35.286 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/737 2024-05-17T10:49:35.286 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:49:35.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:49:35.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:49:35.322 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/738) 2024-05-17T10:49:36.012 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:49:36.027 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:49:36.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:49:36.848 INFO:teuthology.orchestra.run.smithi131.stdout:generic/738 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:49:36.861 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/738 2024-05-17T10:49:36.861 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/738 2024-05-17T10:49:36.861 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:49:36.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:49:36.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:49:36.907 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/739) 2024-05-17T10:49:37.677 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:49:37.701 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:49:37.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:49:38.277 INFO:teuthology.orchestra.run.smithi131.stdout:generic/739 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:49:38.289 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/739 2024-05-17T10:49:38.290 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/739 2024-05-17T10:49:38.290 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:49:38.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:49:38.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:49:38.327 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/741) 2024-05-17T10:49:39.039 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:49:39.051 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:49:39.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:49:39.589 INFO:teuthology.orchestra.run.smithi131.stdout:generic/741 [not run] this test requires a valid $SCRATCH_DEV 2024-05-17T10:49:39.602 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/741 2024-05-17T10:49:39.603 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/741 2024-05-17T10:49:39.603 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T10:49:39.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:49:39.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T10:49:39.657 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/742) 2024-05-17T10:49:40.292 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T10:49:40.307 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T10:49:40.307 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T10:57:10.119 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T10:57:10.118+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 574897) UID: 0 2024-05-17T10:57:10.120 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T10:57:10.118+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 574897) UID: 0 2024-05-17T10:57:10.120 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T10:57:10.118+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 574897) UID: 0 2024-05-17T10:57:10.120 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T10:57:10.118+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 574897) UID: 0 2024-05-17T11:05:17.547 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:05:17.553 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:05:17.586 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T11:05:17.585+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53029) UID: 0 2024-05-17T11:05:17.586 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T11:05:17.585+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53029) UID: 0 2024-05-17T11:05:17.587 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T11:05:17.585+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53029) UID: 0 2024-05-17T11:05:17.587 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T11:05:17.585+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53029) UID: 0 2024-05-17T11:08:29.310 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:08:29.316 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:08:29.346 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-05-17T11:08:29.346+0000 7f581e9ad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53141) UID: 0 2024-05-17T11:08:29.346 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-05-17T11:08:29.346+0000 7fdfebbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53141) UID: 0 2024-05-17T11:08:29.347 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-05-17T11:08:29.346+0000 7f5bb346e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53141) UID: 0 2024-05-17T11:08:29.347 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-05-17T11:08:29.347+0000 7fac92a7c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53141) UID: 0 2024-05-17T11:11:42.267 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:11:42.272 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:12:12.405 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:12:12.408 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:12:42.832 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:12:42.836 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:13:12.924 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:13:12.929 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:13:43.063 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:13:43.070 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:14:13.181 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:14:13.187 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:14:43.315 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:14:43.325 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:15:13.604 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:15:13.609 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:15:44.090 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:15:44.097 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:16:14.180 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:16:14.185 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:16:44.478 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:16:44.484 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:17:14.583 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:17:14.594 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:17:44.693 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:17:44.698 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:18:14.832 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:18:14.838 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:18:45.170 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:18:45.174 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:19:15.285 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:19:15.290 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:19:15.398 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T11:19:15.401+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 575385) UID: 0 2024-05-17T11:19:15.399 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T11:19:15.401+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 575385) UID: 0 2024-05-17T11:19:15.399 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T11:19:15.401+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 575385) UID: 0 2024-05-17T11:19:15.400 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T11:19:15.402+0000 7f5ebbb4c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 575385) UID: 0 2024-05-17T11:26:54.655 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:26:54.659 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:26:54.750 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-05-17T11:26:54.758+0000 7f94de04d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 575431) UID: 0 2024-05-17T11:26:54.751 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-05-17T11:26:54.759+0000 7f27cf310640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 575431) UID: 0 2024-05-17T11:26:54.752 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-05-17T11:26:54.759+0000 7fd16636b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 575431) UID: 0 2024-05-17T11:26:54.757 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T11:26:54.765+0000 7f5ebbb4c640 -1 Fail to open '/proc/575431/cmdline' error = (2) No such file or directory 2024-05-17T11:26:54.758 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-05-17T11:26:54.765+0000 7f5ebbb4c640 -1 received signal: Hangup from (PID: 575431) UID: 0 2024-05-17T11:33:10.528 INFO:teuthology.orchestra.run.smithi131.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.3.log.1: 2024-05-17T11:33:10.529 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: stdin: file size changed while zipping 2024-05-17T11:33:43.194 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:33:43.198 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:34:13.283 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:34:13.286 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:34:43.397 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:34:43.401 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:35:13.531 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:35:13.535 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:35:43.662 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:35:43.666 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:36:13.818 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:36:13.822 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:36:43.916 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:36:43.919 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:37:14.336 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:37:14.340 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:37:44.499 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:37:44.502 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:38:14.601 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:38:14.604 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:38:44.891 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:38:44.896 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:39:14.981 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:39:14.985 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:39:45.097 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:39:45.101 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:40:15.535 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:40:15.539 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:40:45.634 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:40:45.639 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:41:15.780 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:41:15.784 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:41:45.888 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:41:45.891 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:42:16.017 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:42:16.020 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:42:46.150 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:42:46.154 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:43:16.257 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:43:16.261 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:43:46.601 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:43:46.604 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:44:16.692 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:44:16.696 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:44:46.865 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:44:46.869 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:45:16.988 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:45:16.992 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:45:47.102 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:45:47.106 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:46:17.243 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:46:17.248 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:46:47.397 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:46:47.401 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:47:17.978 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:47:17.982 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:47:48.084 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:47:48.087 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:48:18.215 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:48:18.219 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:48:48.357 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:48:48.361 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:49:18.433 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:49:18.437 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:49:48.594 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:49:48.598 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:50:18.717 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:50:18.720 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:50:48.937 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:50:48.940 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:51:19.041 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:51:19.045 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:51:49.169 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:51:49.174 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:52:19.300 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:52:19.304 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:52:49.406 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:52:49.410 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:52:58.178 INFO:teuthology.orchestra.run.smithi131.stdout:generic/742 [failed, exit status 1]- output mismatch (see /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/742.out.bad) 2024-05-17T11:52:58.189 INFO:teuthology.orchestra.run.smithi131.stdout: --- tests/generic/742.out 2024-05-17 04:10:05.141701325 +0000 2024-05-17T11:52:58.190 INFO:teuthology.orchestra.run.smithi131.stdout: +++ /tmp/tmp.bj85EVPhOZxfstests-dev/results//generic/742.out.bad 2024-05-17 11:52:58.169626490 +0000 2024-05-17T11:52:58.190 INFO:teuthology.orchestra.run.smithi131.stdout: @@ -1,2 +1,3 @@ 2024-05-17T11:52:58.190 INFO:teuthology.orchestra.run.smithi131.stdout: QA output created by 742 2024-05-17T11:52:58.190 INFO:teuthology.orchestra.run.smithi131.stdout: Silence is golden 2024-05-17T11:52:58.190 INFO:teuthology.orchestra.run.smithi131.stdout: +fiemap-fault: fiemap failed 95: Operation not supported 2024-05-17T11:52:58.207 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/742 2024-05-17T11:52:58.208 INFO:teuthology.orchestra.run.smithi131.stdout:Failures: generic/742 2024-05-17T11:52:58.208 INFO:teuthology.orchestra.run.smithi131.stdout:Failed 1 of 1 tests 2024-05-17T11:52:58.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:52:58.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T11:52:58.268 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-17T11:52:58.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-17T11:52:58.268 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/743) 2024-05-17T11:52:58.882 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T11:52:58.893 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T11:52:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:52:59.379 INFO:teuthology.orchestra.run.smithi131.stdout:generic/743 [not run] xfs_io madvise doesn't support -R 2024-05-17T11:52:59.393 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/743 2024-05-17T11:52:59.393 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/743 2024-05-17T11:52:59.393 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T11:52:59.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:52:59.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T11:52:59.415 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.bj85EVPhOZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/744) 2024-05-17T11:53:00.007 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph-fuse 2024-05-17T11:53:00.015 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-17T11:53:00.015 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:53:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:generic/744 [not run] ceph-fuse does not support duplicate fsid 2024-05-17T11:53:00.429 INFO:teuthology.orchestra.run.smithi131.stdout:Ran: generic/744 2024-05-17T11:53:00.429 INFO:teuthology.orchestra.run.smithi131.stdout:Not run: generic/744 2024-05-17T11:53:00.430 INFO:teuthology.orchestra.run.smithi131.stdout:Passed all 1 tests 2024-05-17T11:53:00.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:53:00.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-17T11:53:00.464 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 17========================================================= 2024-05-17T11:53:00.464 DEBUG:teuthology.orchestra.run.smithi131:> sudo userdel --force --remove fsgqa 2024-05-17T11:53:01.433 DEBUG:teuthology.orchestra.run.smithi131:> sudo userdel --force --remove 123456-fsgqa 2024-05-17T11:53:02.114 DEBUG:teuthology.orchestra.run.smithi131:> sudo groupdel fsgqa 2024-05-17T11:53:02.176 INFO:teuthology.orchestra.run.smithi131.stderr:groupdel: group 'fsgqa' does not exist 2024-05-17T11:53:02.177 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-17T11:53:02.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T11:53:02.178 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.bj85EVPhOZxfstests-dev/results) 2024-05-17T11:53:02.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T11:53:02.222 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2024-05-17T11:53:02.222 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.bj85EVPhOZxfstests-dev 2024-05-17T11:53:02.223 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf /tmp/tmp.bj85EVPhOZxfstests-dev 2024-05-17T11:53:02.719 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-17T11:53:02.719 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-17T11:53:02.862 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-17T11:53:03.001 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-17T11:53:03.001 INFO:tasks.cephfs.mount:Terminating background process 2024-05-17T11:53:03.001 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T11:53:03.001 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T11:53:03.062 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056323,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=242 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-17T11:53:03.062 INFO:tasks.cephfs.mount:Terminating background process 2024-05-17T11:53:03.063 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T11:53:03.063 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T11:53:03.095 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056335,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14287 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-17T11:53:03.095 INFO:tasks.cephfs.mount:Terminating background process 2024-05-17T11:53:03.095 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T11:53:03.095 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T11:53:03.151 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056323,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=242 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-17T11:53:03.151 INFO:tasks.cephfs.mount:Terminating background process 2024-05-17T11:53:03.151 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T11:53:03.151 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T11:53:03.171 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056335,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14287 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-17T11:53:03.172 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T11:53:03.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.618+0000 7fd08a83d640 1 Processor -- start 2024-05-17T11:53:03.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.618+0000 7fd08a83d640 1 -- start start 2024-05-17T11:53:03.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.626+0000 7fd08a83d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0840d29b0 0x7fd0840b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:03.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.626+0000 7fd08a83d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd08415d330 0x7fd084161750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:03.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.627+0000 7fd08a83d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd08415d740 0x7fd0840b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:03.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.626+0000 7fd0837fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd08415d330 0x7fd084161750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:03.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.627+0000 7fd0837fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd08415d330 0x7fd084161750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50118/0 (socket says 172.21.15.131:50118) 2024-05-17T11:53:03.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.627+0000 7fd08a83d640 1 -- 172.21.15.131:0/2516272144 --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd0840b2ff0 con 0x7fd08415d330 2024-05-17T11:53:03.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.627+0000 7fd0837fe640 1 -- 172.21.15.131:0/2516272144 learned_addr learned my addr 172.21.15.131:0/2516272144 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:03.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.627+0000 7fd08a83d640 1 -- 172.21.15.131:0/2516272144 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd0840b3220 con 0x7fd08415d740 2024-05-17T11:53:03.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.627+0000 7fd08a83d640 1 -- 172.21.15.131:0/2516272144 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd0840b3500 con 0x7fd0840d29b0 2024-05-17T11:53:03.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.628+0000 7fd0837fe640 1 -- 172.21.15.131:0/2516272144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0840d29b0 msgr2=0x7fd0840b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:03.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.628+0000 7fd0837fe640 1 --2- 172.21.15.131:0/2516272144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0840d29b0 0x7fd0840b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:03.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.629+0000 7fd0837fe640 1 -- 172.21.15.131:0/2516272144 >> v2:172.21.15.150:3300/0 conn(0x7fd08415d740 msgr2=0x7fd0840b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:03.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.629+0000 7fd088dda640 1 --2- 172.21.15.131:0/2516272144 >> v2:172.21.15.150:3300/0 conn(0x7fd08415d740 0x7fd0840b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:03.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.629+0000 7fd0837fe640 1 --2- 172.21.15.131:0/2516272144 >> v2:172.21.15.150:3300/0 conn(0x7fd08415d740 0x7fd0840b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:03.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.629+0000 7fd0837fe640 1 -- 172.21.15.131:0/2516272144 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0840b37e0 con 0x7fd08415d330 2024-05-17T11:53:03.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.630+0000 7fd088dda640 1 --2- 172.21.15.131:0/2516272144 >> v2:172.21.15.150:3300/0 conn(0x7fd08415d740 0x7fd0840b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T11:53:03.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.632+0000 7fd0837fe640 1 --2- 172.21.15.131:0/2516272144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd08415d330 0x7fd084161750 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fd0840d0b10 tx=0x7fd07802a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a12c5e0a4b0b908 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:03.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.634+0000 7fd082ffd640 1 -- 172.21.15.131:0/2516272144 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078036070 con 0x7fd08415d330 2024-05-17T11:53:03.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.634+0000 7fd082ffd640 1 -- 172.21.15.131:0/2516272144 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd078031600 con 0x7fd08415d330 2024-05-17T11:53:03.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.634+0000 7fd082ffd640 1 -- 172.21.15.131:0/2516272144 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078036070 con 0x7fd08415d330 2024-05-17T11:53:03.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.638+0000 7fd08a83d640 1 -- 172.21.15.131:0/2516272144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd08415d330 msgr2=0x7fd084161750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:03.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.638+0000 7fd08a83d640 1 --2- 172.21.15.131:0/2516272144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd08415d330 0x7fd084161750 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fd0840d0b10 tx=0x7fd07802a430 comp rx=0 tx=0).stop 2024-05-17T11:53:03.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.638+0000 7fd08a83d640 1 -- 172.21.15.131:0/2516272144 shutdown_connections 2024-05-17T11:53:03.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.638+0000 7fd08a83d640 1 --2- 172.21.15.131:0/2516272144 >> v2:172.21.15.150:3300/0 conn(0x7fd08415d740 0x7fd0840b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:03.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.638+0000 7fd08a83d640 1 --2- 172.21.15.131:0/2516272144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd08415d330 0x7fd084161750 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:03.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.638+0000 7fd08a83d640 1 --2- 172.21.15.131:0/2516272144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0840d29b0 0x7fd0840b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:03.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.638+0000 7fd08a83d640 1 -- 172.21.15.131:0/2516272144 >> 172.21.15.131:0/2516272144 conn(0x7fd0840b4e40 msgr2=0x7fd0840b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:03.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.639+0000 7fd08a83d640 1 -- 172.21.15.131:0/2516272144 shutdown_connections 2024-05-17T11:53:03.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.639+0000 7fd08a83d640 1 -- 172.21.15.131:0/2516272144 wait complete. 2024-05-17T11:53:03.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.648+0000 7fd08a83d640 1 Processor -- start 2024-05-17T11:53:03.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.648+0000 7fd08a83d640 1 -- start start 2024-05-17T11:53:03.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.655+0000 7fd08a83d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0840d29b0 0x7fd0841598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:03.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.655+0000 7fd08a83d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd08415d330 0x7fd08415f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:03.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.655+0000 7fd08a83d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd08415d740 0x7fd08415f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:03.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.655+0000 7fd0837fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd08415d330 0x7fd08415f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:03.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.655+0000 7fd0837fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd08415d330 0x7fd08415f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:58156/0 (socket says 172.21.15.131:58156) 2024-05-17T11:53:03.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.655+0000 7fd083fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0840d29b0 0x7fd0841598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:03.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.655+0000 7fd083fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0840d29b0 0x7fd0841598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50122/0 (socket says 172.21.15.131:50122) 2024-05-17T11:53:03.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.656+0000 7fd0837fe640 1 -- 172.21.15.131:0/1288517950 learned_addr learned my addr 172.21.15.131:0/1288517950 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:03.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.656+0000 7fd088dda640 1 --2- 172.21.15.131:0/1288517950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd08415d740 0x7fd08415f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:03.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.656+0000 7fd08a83d640 1 -- 172.21.15.131:0/1288517950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd084161e10 con 0x7fd0840d29b0 2024-05-17T11:53:03.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.656+0000 7fd08a83d640 1 -- 172.21.15.131:0/1288517950 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd084161c90 con 0x7fd08415d740 2024-05-17T11:53:03.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.656+0000 7fd08a83d640 1 -- 172.21.15.131:0/1288517950 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd084161f90 con 0x7fd08415d330 2024-05-17T11:53:03.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.658+0000 7fd088dda640 1 -- 172.21.15.131:0/1288517950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd08415d330 msgr2=0x7fd08415f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:03.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.658+0000 7fd088dda640 1 --2- 172.21.15.131:0/1288517950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd08415d330 0x7fd08415f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:03.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.658+0000 7fd088dda640 1 -- 172.21.15.131:0/1288517950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0840d29b0 msgr2=0x7fd0841598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:03.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.658+0000 7fd088dda640 1 --2- 172.21.15.131:0/1288517950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0840d29b0 0x7fd0841598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:03.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.658+0000 7fd088dda640 1 -- 172.21.15.131:0/1288517950 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0841f90c0 con 0x7fd08415d740 2024-05-17T11:53:03.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.659+0000 7fd088dda640 1 --2- 172.21.15.131:0/1288517950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd08415d740 0x7fd08415f9c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd07400c590 tx=0x7fd07400ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:03.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.659+0000 7fd080ff9640 1 -- 172.21.15.131:0/1288517950 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd074015070 con 0x7fd08415d740 2024-05-17T11:53:03.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.660+0000 7fd080ff9640 1 -- 172.21.15.131:0/1288517950 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd074011820 con 0x7fd08415d740 2024-05-17T11:53:03.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.660+0000 7fd080ff9640 1 -- 172.21.15.131:0/1288517950 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd074011c10 con 0x7fd08415d740 2024-05-17T11:53:03.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.664+0000 7fd08a83d640 1 -- 172.21.15.131:0/1288517950 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0841f93a0 con 0x7fd08415d740 2024-05-17T11:53:03.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.664+0000 7fd08a83d640 1 -- 172.21.15.131:0/1288517950 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0841f9960 con 0x7fd08415d740 2024-05-17T11:53:03.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.668+0000 7fd08a83d640 1 -- 172.21.15.131:0/1288517950 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0840b2ab0 con 0x7fd08415d740 2024-05-17T11:53:03.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.678+0000 7fd080ff9640 1 -- 172.21.15.131:0/1288517950 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd074018070 con 0x7fd08415d740 2024-05-17T11:53:03.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.693+0000 7fd080ff9640 1 --2- 172.21.15.131:0/1288517950 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd070076300 0x7fd070078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:03.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.694+0000 7fd080ff9640 1 -- 172.21.15.131:0/1288517950 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6130+0+0 (secure 0 0 0) 0x7fd0740978f0 con 0x7fd08415d740 2024-05-17T11:53:03.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.694+0000 7fd083fff640 1 --2- 172.21.15.131:0/1288517950 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd070076300 0x7fd070078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:03.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.695+0000 7fd080ff9640 1 -- 172.21.15.131:0/1288517950 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd0740c6a50 con 0x7fd08415d740 2024-05-17T11:53:03.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:03.707+0000 7fd083fff640 1 --2- 172.21.15.131:0/1288517950 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd070076300 0x7fd070078810 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00a400 tx=0x7fd07c00d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:04.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:04.940+0000 7fd08a83d640 1 -- 172.21.15.131:0/1288517950 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0840cf930 con 0x7fd08415d740 2024-05-17T11:53:04.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:04.941+0000 7fd080ff9640 1 -- 172.21.15.131:0/1288517950 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5187 (secure 0 0 0) 0x7fd074060a50 con 0x7fd08415d740 2024-05-17T11:53:04.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:53:04.928 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/569182744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":569182744},{"type":"v1","addr":"172.21.15.150:6835","nonce":569182744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1749773301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1749773301},{"type":"v1","addr":"172.21.15.150:6834","nonce":1749773301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3795031678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3795031678},{"type":"v1","addr":"172.21.15.131:6837","nonce":3795031678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:56.173520+0000","modified":"2024-05-17T04:09:59.216262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4923":{"gid":4923,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/119325169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":119325169},{"type":"v1","addr":"172.21.15.131:6836","nonce":119325169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4923,"qdb_cluster":[4923]},"id":2}]} 2024-05-17T11:53:04.928 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 16 2024-05-17T11:53:04.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:04.948+0000 7fd08a83d640 1 -- 172.21.15.131:0/1288517950 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd070076300 msgr2=0x7fd070078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:04.948+0000 7fd08a83d640 1 --2- 172.21.15.131:0/1288517950 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd070076300 0x7fd070078810 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00a400 tx=0x7fd07c00d040 comp rx=0 tx=0).stop 2024-05-17T11:53:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:04.948+0000 7fd08a83d640 1 -- 172.21.15.131:0/1288517950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd08415d740 msgr2=0x7fd08415f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:04.948+0000 7fd08a83d640 1 --2- 172.21.15.131:0/1288517950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd08415d740 0x7fd08415f9c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd07400c590 tx=0x7fd07400ca50 comp rx=0 tx=0).stop 2024-05-17T11:53:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:04.949+0000 7fd08a83d640 1 -- 172.21.15.131:0/1288517950 shutdown_connections 2024-05-17T11:53:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:04.949+0000 7fd08a83d640 1 --2- 172.21.15.131:0/1288517950 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fd070076300 0x7fd070078810 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:04.949+0000 7fd08a83d640 1 --2- 172.21.15.131:0/1288517950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd08415d740 0x7fd08415f9c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:04.949+0000 7fd08a83d640 1 --2- 172.21.15.131:0/1288517950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd08415d330 0x7fd08415f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:04.949+0000 7fd08a83d640 1 --2- 172.21.15.131:0/1288517950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0840d29b0 0x7fd0841598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:04.949+0000 7fd08a83d640 1 -- 172.21.15.131:0/1288517950 >> 172.21.15.131:0/1288517950 conn(0x7fd0840b4e40 msgr2=0x7fd0840d2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:04.949+0000 7fd08a83d640 1 -- 172.21.15.131:0/1288517950 shutdown_connections 2024-05-17T11:53:04.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:04.950+0000 7fd08a83d640 1 -- 172.21.15.131:0/1288517950 wait complete. 2024-05-17T11:53:04.976 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T11:53:05.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.206+0000 7fc6cb554640 1 Processor -- start 2024-05-17T11:53:05.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.207+0000 7fc6cb554640 1 -- start start 2024-05-17T11:53:05.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.214+0000 7fc6cb554640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc6c40b5530 0x7fc6c4166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:05.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.214+0000 7fc6cb554640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6c4074120 con 0x7fc6c406d100 2024-05-17T11:53:05.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.214+0000 7fc6c92f0640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fc6c406d100 0x7fc6c4073300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:40484/0 (socket says 172.21.15.131:40484) 2024-05-17T11:53:05.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.214+0000 7fc6c92f0640 1 -- 172.21.15.131:0/537567356 learned_addr learned my addr 172.21.15.131:0/537567356 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:05.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.215+0000 7fc6c9af1640 1 --2- 172.21.15.131:0/537567356 >> v2:172.21.15.150:3300/0 conn(0x7fc6c40b5530 0x7fc6c4166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:05.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.215+0000 7fc6cb554640 1 -- 172.21.15.131:0/537567356 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6c406d830 con 0x7fc6c40cd500 2024-05-17T11:53:05.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.215+0000 7fc6bbfff640 1 -- 172.21.15.131:0/537567356 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1808933992 0 0) 0x7fc6c4074120 con 0x7fc6c406d100 2024-05-17T11:53:05.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.216+0000 7fc6cb554640 1 -- 172.21.15.131:0/537567356 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fc6c40b4090 con 0x7fc6c40b5530 2024-05-17T11:53:05.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.216+0000 7fc6c9af1640 1 -- 172.21.15.131:0/537567356 >> v1:172.21.15.150:6789/0 conn(0x7fc6c40cd500 legacy=0x7fc6c4073a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:05.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.216+0000 7fc6c9af1640 1 -- 172.21.15.131:0/537567356 >> v1:172.21.15.131:6789/0 conn(0x7fc6c406d100 legacy=0x7fc6c4073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:05.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.216+0000 7fc6c9af1640 1 -- 172.21.15.131:0/537567356 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c406db10 con 0x7fc6c40b5530 2024-05-17T11:53:05.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.217+0000 7fc6c9af1640 1 --2- 172.21.15.131:0/537567356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6c40b5530 0x7fc6c4166710 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00aea0 tx=0x7fc6bc02c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e213f9f492b21836 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:05.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.218+0000 7fc6bbfff640 1 -- 172.21.15.131:0/537567356 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc039070 con 0x7fc6c40b5530 2024-05-17T11:53:05.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.218+0000 7fc6bbfff640 1 -- 172.21.15.131:0/537567356 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6bc034680 con 0x7fc6c40b5530 2024-05-17T11:53:05.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.218+0000 7fc6bbfff640 1 -- 172.21.15.131:0/537567356 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc034a90 con 0x7fc6c40b5530 2024-05-17T11:53:05.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.221+0000 7fc6cb554640 1 -- 172.21.15.131:0/537567356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6c40b5530 msgr2=0x7fc6c4166710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:05.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.221+0000 7fc6cb554640 1 --2- 172.21.15.131:0/537567356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6c40b5530 0x7fc6c4166710 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00aea0 tx=0x7fc6bc02c8d0 comp rx=0 tx=0).stop 2024-05-17T11:53:05.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.222+0000 7fc6cb554640 1 -- 172.21.15.131:0/537567356 shutdown_connections 2024-05-17T11:53:05.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.222+0000 7fc6cb554640 1 --2- 172.21.15.131:0/537567356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6c40b5530 0x7fc6c4166710 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:05.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.222+0000 7fc6cb554640 1 -- 172.21.15.131:0/537567356 >> 172.21.15.131:0/537567356 conn(0x7fc6c40b36d0 msgr2=0x7fc6c40d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:05.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.223+0000 7fc6cb554640 1 -- 172.21.15.131:0/537567356 shutdown_connections 2024-05-17T11:53:05.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.223+0000 7fc6cb554640 1 -- 172.21.15.131:0/537567356 wait complete. 2024-05-17T11:53:05.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.226+0000 7fc6cb554640 1 Processor -- start 2024-05-17T11:53:05.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.226+0000 7fc6cb554640 1 -- start start 2024-05-17T11:53:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.228+0000 7fc6cb554640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6c406d100 0x7fc6c41f94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.228+0000 7fc6cb554640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c40b5530 0x7fc6c41421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.228+0000 7fc6cb554640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6c40cd500 0x7fc6c413fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.228+0000 7fc6cb554640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c40cd910 con 0x7fc6c40b5530 2024-05-17T11:53:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.228+0000 7fc6cb554640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c406d510 con 0x7fc6c406d100 2024-05-17T11:53:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.228+0000 7fc6cb554640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c40d14c0 con 0x7fc6c40cd500 2024-05-17T11:53:05.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.229+0000 7fc6c92f0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6c406d100 0x7fc6c41f94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.229+0000 7fc6c92f0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6c406d100 0x7fc6c41f94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:46598/0 (socket says 172.21.15.131:46598) 2024-05-17T11:53:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.229+0000 7fc6c92f0640 1 -- 172.21.15.131:0/4220011884 learned_addr learned my addr 172.21.15.131:0/4220011884 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.229+0000 7fc6c9af1640 1 --2- 172.21.15.131:0/4220011884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6c40cd500 0x7fc6c413fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.229+0000 7fc6c92f0640 1 -- 172.21.15.131:0/4220011884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6c40cd500 msgr2=0x7fc6c413fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.229+0000 7fc6c92f0640 1 --2- 172.21.15.131:0/4220011884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6c40cd500 0x7fc6c413fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.229+0000 7fc6c92f0640 1 -- 172.21.15.131:0/4220011884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c40b5530 msgr2=0x7fc6c41421a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-17T11:53:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.229+0000 7fc6c92f0640 1 --2- 172.21.15.131:0/4220011884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c40b5530 0x7fc6c41421a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.229+0000 7fc6c92f0640 1 -- 172.21.15.131:0/4220011884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c4142d90 con 0x7fc6c406d100 2024-05-17T11:53:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.229+0000 7fc6c9af1640 1 --2- 172.21.15.131:0/4220011884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6c40cd500 0x7fc6c413fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.230+0000 7fc6c92f0640 1 --2- 172.21.15.131:0/4220011884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6c406d100 0x7fc6c41f94c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400c3c0 tx=0x7fc6b400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:05.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.230+0000 7fc6b9ffb640 1 -- 172.21.15.131:0/4220011884 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b40074e0 con 0x7fc6c406d100 2024-05-17T11:53:05.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.230+0000 7fc6b9ffb640 1 -- 172.21.15.131:0/4220011884 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b4007680 con 0x7fc6c406d100 2024-05-17T11:53:05.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.230+0000 7fc6b9ffb640 1 -- 172.21.15.131:0/4220011884 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b40049e0 con 0x7fc6c406d100 2024-05-17T11:53:05.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.230+0000 7fc6cb554640 1 -- 172.21.15.131:0/4220011884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c4143070 con 0x7fc6c406d100 2024-05-17T11:53:05.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.231+0000 7fc6cb554640 1 -- 172.21.15.131:0/4220011884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c41426e0 con 0x7fc6c406d100 2024-05-17T11:53:05.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.233+0000 7fc6b9ffb640 1 -- 172.21.15.131:0/4220011884 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc6b4011070 con 0x7fc6c406d100 2024-05-17T11:53:05.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.233+0000 7fc6b9ffb640 1 --2- 172.21.15.131:0/4220011884 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc6a8076320 0x7fc6a8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:05.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.234+0000 7fc6b9ffb640 1 -- 172.21.15.131:0/4220011884 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6130+0+0 (secure 0 0 0) 0x7fc6b409b060 con 0x7fc6c406d100 2024-05-17T11:53:05.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.234+0000 7fc6c8aef640 1 --2- 172.21.15.131:0/4220011884 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc6a8076320 0x7fc6a8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:05.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.236+0000 7fc6cb554640 1 -- 172.21.15.131:0/4220011884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c40d18a0 con 0x7fc6c406d100 2024-05-17T11:53:05.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.236+0000 7fc6c8aef640 1 --2- 172.21.15.131:0/4220011884 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc6a8076320 0x7fc6a8078830 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4140f40 tx=0x7fc6c0006b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:05.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.244+0000 7fc6b9ffb640 1 -- 172.21.15.131:0/4220011884 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc6b405fdf0 con 0x7fc6c406d100 2024-05-17T11:53:05.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.648+0000 7fc6cb554640 1 -- 172.21.15.131:0/4220011884 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6c40cf2f0 con 0x7fc6c406d100 2024-05-17T11:53:05.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.698+0000 7fc6b9ffb640 1 -- 172.21.15.131:0/4220011884 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5187 (secure 0 0 0) 0x7fc6b405f6f0 con 0x7fc6c406d100 2024-05-17T11:53:05.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:53:05.686 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/569182744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":569182744},{"type":"v1","addr":"172.21.15.150:6835","nonce":569182744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1749773301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1749773301},{"type":"v1","addr":"172.21.15.150:6834","nonce":1749773301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3795031678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3795031678},{"type":"v1","addr":"172.21.15.131:6837","nonce":3795031678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:56.173520+0000","modified":"2024-05-17T04:09:59.216262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4923":{"gid":4923,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/119325169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":119325169},{"type":"v1","addr":"172.21.15.131:6836","nonce":119325169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4923,"qdb_cluster":[4923]},"id":2}]} 2024-05-17T11:53:05.686 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 16 2024-05-17T11:53:05.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.702+0000 7fc6cb554640 1 -- 172.21.15.131:0/4220011884 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc6a8076320 msgr2=0x7fc6a8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:05.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.702+0000 7fc6cb554640 1 --2- 172.21.15.131:0/4220011884 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc6a8076320 0x7fc6a8078830 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4140f40 tx=0x7fc6c0006b50 comp rx=0 tx=0).stop 2024-05-17T11:53:05.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.702+0000 7fc6cb554640 1 -- 172.21.15.131:0/4220011884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6c406d100 msgr2=0x7fc6c41f94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:05.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.702+0000 7fc6cb554640 1 --2- 172.21.15.131:0/4220011884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6c406d100 0x7fc6c41f94c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400c3c0 tx=0x7fc6b400c880 comp rx=0 tx=0).stop 2024-05-17T11:53:05.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.702+0000 7fc6cb554640 1 -- 172.21.15.131:0/4220011884 shutdown_connections 2024-05-17T11:53:05.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.702+0000 7fc6cb554640 1 --2- 172.21.15.131:0/4220011884 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc6a8076320 0x7fc6a8078830 secure :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4140f40 tx=0x7fc6c0006b50 comp rx=0 tx=0).stop 2024-05-17T11:53:05.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.702+0000 7fc6cb554640 1 --2- 172.21.15.131:0/4220011884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c40b5530 0x7fc6c41421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:05.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.702+0000 7fc6cb554640 1 --2- 172.21.15.131:0/4220011884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6c40cd500 0x7fc6c413fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:05.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.702+0000 7fc6cb554640 1 --2- 172.21.15.131:0/4220011884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6c406d100 0x7fc6c41f94c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:05.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.702+0000 7fc6cb554640 1 -- 172.21.15.131:0/4220011884 >> 172.21.15.131:0/4220011884 conn(0x7fc6c40b36d0 msgr2=0x7fc6c4143eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:05.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.705+0000 7fc6cb554640 1 -- 172.21.15.131:0/4220011884 shutdown_connections 2024-05-17T11:53:05.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:05.705+0000 7fc6cb554640 1 -- 172.21.15.131:0/4220011884 wait complete. 2024-05-17T11:53:05.738 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T11:53:06.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.132+0000 7f15b73d4640 1 Processor -- start 2024-05-17T11:53:06.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.133+0000 7f15b73d4640 1 -- start start 2024-05-17T11:53:06.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.138+0000 7f15b73d4640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f15b006ff50 0x7f15b015c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:06.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.138+0000 7f15b73d4640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f15b0073dd0 0x7f15b015fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:06.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.138+0000 7f15b73d4640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b006e870 con 0x7f15b00708c0 2024-05-17T11:53:06.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.139+0000 7f15b5170640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f15b006ff50 0x7f15b015c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:06.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.139+0000 7f15b5971640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f15b0073dd0 0x7f15b015fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:06.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.139+0000 7f15b5170640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f15b006ff50 0x7f15b015c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:58310/0 (socket says 172.21.15.131:58310) 2024-05-17T11:53:06.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.139+0000 7f15b5170640 1 -- 172.21.15.131:0/1828848953 learned_addr learned my addr 172.21.15.131:0/1828848953 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:06.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.139+0000 7f15b73d4640 1 -- 172.21.15.131:0/1828848953 --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f15b006e590 con 0x7f15b006ff50 2024-05-17T11:53:06.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.139+0000 7f15b73d4640 1 -- 172.21.15.131:0/1828848953 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f15b006f470 con 0x7f15b0073dd0 2024-05-17T11:53:06.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.140+0000 7f15b5170640 1 -- 172.21.15.131:0/1828848953 >> v2:172.21.15.150:3300/0 conn(0x7f15b0073dd0 msgr2=0x7f15b015fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:06.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.140+0000 7f15b5170640 1 --2- 172.21.15.131:0/1828848953 >> v2:172.21.15.150:3300/0 conn(0x7f15b0073dd0 0x7f15b015fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:06.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.140+0000 7f15b5170640 1 -- 172.21.15.131:0/1828848953 >> v1:172.21.15.131:6789/0 conn(0x7f15b00708c0 legacy=0x7f15b00736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:06.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.140+0000 7f15b5170640 1 -- 172.21.15.131:0/1828848953 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b006f750 con 0x7f15b006ff50 2024-05-17T11:53:06.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.142+0000 7f15b5170640 1 --2- 172.21.15.131:0/1828848953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15b006ff50 0x7f15b015c300 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f15b006cf50 tx=0x7f15ac02e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3201372f9397f8d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.143+0000 7f15a3fff640 1 -- 172.21.15.131:0/1828848953 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac03a070 con 0x7f15b006ff50 2024-05-17T11:53:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.143+0000 7f15a3fff640 1 -- 172.21.15.131:0/1828848953 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15ac00b650 con 0x7f15b006ff50 2024-05-17T11:53:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.143+0000 7f15a3fff640 1 -- 172.21.15.131:0/1828848953 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac00ba20 con 0x7f15b006ff50 2024-05-17T11:53:06.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.145+0000 7f15b73d4640 1 -- 172.21.15.131:0/1828848953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15b006ff50 msgr2=0x7f15b015c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:06.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.145+0000 7f15b73d4640 1 --2- 172.21.15.131:0/1828848953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15b006ff50 0x7f15b015c300 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f15b006cf50 tx=0x7f15ac02e570 comp rx=0 tx=0).stop 2024-05-17T11:53:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.146+0000 7f15b73d4640 1 -- 172.21.15.131:0/1828848953 shutdown_connections 2024-05-17T11:53:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.146+0000 7f15b73d4640 1 --2- 172.21.15.131:0/1828848953 >> v2:172.21.15.150:3300/0 conn(0x7f15b0073dd0 0x7f15b015fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.146+0000 7f15b73d4640 1 --2- 172.21.15.131:0/1828848953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15b006ff50 0x7f15b015c300 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.146+0000 7f15b73d4640 1 -- 172.21.15.131:0/1828848953 >> 172.21.15.131:0/1828848953 conn(0x7f15b00d2140 msgr2=0x7f15b0072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.147+0000 7f15b73d4640 1 -- 172.21.15.131:0/1828848953 shutdown_connections 2024-05-17T11:53:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.147+0000 7f15b73d4640 1 -- 172.21.15.131:0/1828848953 wait complete. 2024-05-17T11:53:06.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.149+0000 7f15b73d4640 1 Processor -- start 2024-05-17T11:53:06.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.150+0000 7f15b73d4640 1 -- start start 2024-05-17T11:53:06.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.155+0000 7f15b73d4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b006ff50 0x7f15b00b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:06.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.155+0000 7f15b73d4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b00708c0 0x7f15b015e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:06.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.155+0000 7f15b73d4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15b014ec50 0x7f15b015edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:06.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.155+0000 7f15b73d4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f15b00b10b0 con 0x7f15b014ec50 2024-05-17T11:53:06.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.155+0000 7f15b73d4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f15b006e220 con 0x7f15b00708c0 2024-05-17T11:53:06.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.155+0000 7f15b73d4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f15b00b1230 con 0x7f15b006ff50 2024-05-17T11:53:06.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.155+0000 7f15b5170640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b006ff50 0x7f15b00b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:06.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.155+0000 7f15b5170640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b006ff50 0x7f15b00b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:58764/0 (socket says 172.21.15.131:58764) 2024-05-17T11:53:06.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.156+0000 7f15b5170640 1 -- 172.21.15.131:0/1298320195 learned_addr learned my addr 172.21.15.131:0/1298320195 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:06.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.156+0000 7f15b496f640 1 --2- 172.21.15.131:0/1298320195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b00708c0 0x7f15b015e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:06.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.156+0000 7f15b5971640 1 --2- 172.21.15.131:0/1298320195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15b014ec50 0x7f15b015edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:06.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.156+0000 7f15b496f640 1 -- 172.21.15.131:0/1298320195 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b006ff50 msgr2=0x7f15b00b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:06.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.156+0000 7f15b496f640 1 --2- 172.21.15.131:0/1298320195 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b006ff50 0x7f15b00b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:06.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.156+0000 7f15b496f640 1 -- 172.21.15.131:0/1298320195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15b014ec50 msgr2=0x7f15b015edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:06.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.156+0000 7f15b496f640 1 --2- 172.21.15.131:0/1298320195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15b014ec50 0x7f15b015edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:06.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.156+0000 7f15b496f640 1 -- 172.21.15.131:0/1298320195 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b0150d30 con 0x7f15b00708c0 2024-05-17T11:53:06.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.156+0000 7f15b496f640 1 --2- 172.21.15.131:0/1298320195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b00708c0 0x7f15b015e880 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f15a400c420 tx=0x7f15a400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:06.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.157+0000 7f15a1ffb640 1 -- 172.21.15.131:0/1298320195 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4017070 con 0x7f15b00708c0 2024-05-17T11:53:06.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.157+0000 7f15a1ffb640 1 -- 172.21.15.131:0/1298320195 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a40052d0 con 0x7f15b00708c0 2024-05-17T11:53:06.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.157+0000 7f15a1ffb640 1 -- 172.21.15.131:0/1298320195 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4003830 con 0x7f15b00708c0 2024-05-17T11:53:06.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.157+0000 7f15b73d4640 1 -- 172.21.15.131:0/1298320195 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b0151010 con 0x7f15b00708c0 2024-05-17T11:53:06.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.158+0000 7f15b73d4640 1 -- 172.21.15.131:0/1298320195 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b00b4f00 con 0x7f15b00708c0 2024-05-17T11:53:06.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.160+0000 7f15a1ffb640 1 -- 172.21.15.131:0/1298320195 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f15a401a070 con 0x7f15b00708c0 2024-05-17T11:53:06.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.161+0000 7f15b73d4640 1 -- 172.21.15.131:0/1298320195 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b00cec00 con 0x7f15b00708c0 2024-05-17T11:53:06.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.161+0000 7f15a1ffb640 1 --2- 172.21.15.131:0/1298320195 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f15940762d0 0x7f15940787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:06.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.162+0000 7f15b5170640 1 --2- 172.21.15.131:0/1298320195 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f15940762d0 0x7f15940787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:06.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.162+0000 7f15a1ffb640 1 -- 172.21.15.131:0/1298320195 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6130+0+0 (secure 0 0 0) 0x7f15a4096970 con 0x7f15b00708c0 2024-05-17T11:53:06.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.162+0000 7f15b5170640 1 --2- 172.21.15.131:0/1298320195 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f15940762d0 0x7f15940787e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00dad0 tx=0x7f15ac008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:06.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:06.171+0000 7f15a1ffb640 1 -- 172.21.15.131:0/1298320195 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f15b00cec00 con 0x7f15b00708c0 2024-05-17T11:53:07.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.231+0000 7f15b73d4640 1 -- 172.21.15.131:0/1298320195 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15b015d350 con 0x7f15b00708c0 2024-05-17T11:53:07.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.233+0000 7f15a1ffb640 1 -- 172.21.15.131:0/1298320195 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+17015 (secure 0 0 0) 0x7f15a4068100 con 0x7f15b00708c0 2024-05-17T11:53:07.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:53:07.222 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":38,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:10:48.923903+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:54.201745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:55.131426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.3d","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T11:53:07.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.241+0000 7f15b73d4640 1 -- 172.21.15.131:0/1298320195 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f15940762d0 msgr2=0x7f15940787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:07.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.241+0000 7f15b73d4640 1 --2- 172.21.15.131:0/1298320195 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f15940762d0 0x7f15940787e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00dad0 tx=0x7f15ac008040 comp rx=0 tx=0).stop 2024-05-17T11:53:07.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.241+0000 7f15b73d4640 1 -- 172.21.15.131:0/1298320195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b00708c0 msgr2=0x7f15b015e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:07.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.241+0000 7f15b73d4640 1 --2- 172.21.15.131:0/1298320195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b00708c0 0x7f15b015e880 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f15a400c420 tx=0x7f15a400c8e0 comp rx=0 tx=0).stop 2024-05-17T11:53:07.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.241+0000 7f15b73d4640 1 -- 172.21.15.131:0/1298320195 shutdown_connections 2024-05-17T11:53:07.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.242+0000 7f15b73d4640 1 --2- 172.21.15.131:0/1298320195 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f15940762d0 0x7f15940787e0 secure :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00dad0 tx=0x7f15ac008040 comp rx=0 tx=0).stop 2024-05-17T11:53:07.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.242+0000 7f15b73d4640 1 --2- 172.21.15.131:0/1298320195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15b014ec50 0x7f15b015edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:07.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.242+0000 7f15b73d4640 1 --2- 172.21.15.131:0/1298320195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b00708c0 0x7f15b015e880 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:07.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.242+0000 7f15b73d4640 1 --2- 172.21.15.131:0/1298320195 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b006ff50 0x7f15b00b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:07.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.242+0000 7f15b73d4640 1 -- 172.21.15.131:0/1298320195 >> 172.21.15.131:0/1298320195 conn(0x7f15b00d2140 msgr2=0x7f15b015f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:07.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.242+0000 7f15b73d4640 1 -- 172.21.15.131:0/1298320195 shutdown_connections 2024-05-17T11:53:07.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.243+0000 7f15b73d4640 1 -- 172.21.15.131:0/1298320195 wait complete. 2024-05-17T11:53:07.264 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-17T11:53:07.264 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T11:53:07.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.539+0000 7fc5a711d640 1 Processor -- start 2024-05-17T11:53:07.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.540+0000 7fc5a711d640 1 -- start start 2024-05-17T11:53:07.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.552+0000 7fc5a711d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc5a015b2f0 0x7fc5a00ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:07.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.552+0000 7fc5a711d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a015f370 con 0x7fc5a00740b0 2024-05-17T11:53:07.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.552+0000 7fc5a711d640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a015f650 con 0x7fc5a00b6000 2024-05-17T11:53:07.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.552+0000 7fc5a711d640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a015f930 con 0x7fc5a015b2f0 2024-05-17T11:53:07.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.552+0000 7fc5a591a640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fc5a00740b0 0x7fc5a00b58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:40500/0 (socket says 172.21.15.131:40500) 2024-05-17T11:53:07.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.552+0000 7fc5a591a640 1 -- 172.21.15.131:0/3335745170 learned_addr learned my addr 172.21.15.131:0/3335745170 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:07.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a611b640 1 --2- 172.21.15.131:0/3335745170 >> v2:172.21.15.131:3300/0 conn(0x7fc5a015b2f0 0x7fc5a00ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:07.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a5119640 1 -- 172.21.15.131:0/3335745170 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999820980 0 0) 0x7fc5a015f370 con 0x7fc5a00740b0 2024-05-17T11:53:07.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a5119640 1 -- 172.21.15.131:0/3335745170 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc58c003520 con 0x7fc5a00740b0 2024-05-17T11:53:07.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a5119640 1 -- 172.21.15.131:0/3335745170 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3125334391 0 0) 0x7fc58c003520 con 0x7fc5a00740b0 2024-05-17T11:53:07.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a5119640 1 -- 172.21.15.131:0/3335745170 >> v2:172.21.15.131:3300/0 conn(0x7fc5a015b2f0 msgr2=0x7fc5a00ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:07.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a5119640 1 --2- 172.21.15.131:0/3335745170 >> v2:172.21.15.131:3300/0 conn(0x7fc5a015b2f0 0x7fc5a00ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:07.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a5119640 1 -- 172.21.15.131:0/3335745170 >> v1:172.21.15.150:6789/0 conn(0x7fc5a00b6000 legacy=0x7fc5a00b4160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-17T11:53:07.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a5119640 1 -- 172.21.15.131:0/3335745170 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a015fc10 con 0x7fc5a00740b0 2024-05-17T11:53:07.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a5119640 1 -- 172.21.15.131:0/3335745170 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 104700328 0 0) 0x7fc5900016f0 con 0x7fc5a00740b0 2024-05-17T11:53:07.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a5119640 1 -- 172.21.15.131:0/3335745170 >> v1:172.21.15.131:6789/0 conn(0x7fc5a00740b0 legacy=0x7fc5a00b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:07.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a5119640 1 --2- 172.21.15.131:0/3335745170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc58c003a50 0x7fc58c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:07.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a5119640 1 --2- 172.21.15.131:0/3335745170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c004800 0x7fc58c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:07.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a5119640 1 --2- 172.21.15.131:0/3335745170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc58c005350 0x7fc58c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:07.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a5119640 1 -- 172.21.15.131:0/3335745170 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a015f930 con 0x7fc58c004800 2024-05-17T11:53:07.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a5119640 1 -- 172.21.15.131:0/3335745170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c00c280 con 0x7fc58c005350 2024-05-17T11:53:07.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a5119640 1 -- 172.21.15.131:0/3335745170 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc58c00c480 con 0x7fc58c003a50 2024-05-17T11:53:07.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.553+0000 7fc5a591a640 1 --2- 172.21.15.131:0/3335745170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c004800 0x7fc58c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:07.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.554+0000 7fc5a591a640 1 -- 172.21.15.131:0/3335745170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc58c003a50 msgr2=0x7fc58c003ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-17T11:53:07.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.554+0000 7fc5a591a640 1 --2- 172.21.15.131:0/3335745170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc58c003a50 0x7fc58c003ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:07.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.554+0000 7fc5a591a640 1 -- 172.21.15.131:0/3335745170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc58c005350 msgr2=0x7fc58c00b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-17T11:53:07.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.554+0000 7fc5a591a640 1 --2- 172.21.15.131:0/3335745170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc58c005350 0x7fc58c00b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:07.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.554+0000 7fc5a591a640 1 -- 172.21.15.131:0/3335745170 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58c003520 con 0x7fc58c004800 2024-05-17T11:53:07.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.554+0000 7fc5a691c640 1 -- 172.21.15.131:0/3335745170 reap_dead start 2024-05-17T11:53:07.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.555+0000 7fc5a591a640 1 --2- 172.21.15.131:0/3335745170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c004800 0x7fc58c004c10 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fc59000c240 tx=0x7fc58c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901733d2863c11b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:07.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.555+0000 7fc5a5119640 1 -- 172.21.15.131:0/3335745170 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc590007cf0 con 0x7fc58c004800 2024-05-17T11:53:07.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.555+0000 7fc5a5119640 1 -- 172.21.15.131:0/3335745170 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc590005af0 con 0x7fc58c004800 2024-05-17T11:53:07.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.555+0000 7fc5a5119640 1 -- 172.21.15.131:0/3335745170 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc590007070 con 0x7fc58c004800 2024-05-17T11:53:07.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.556+0000 7fc5a711d640 1 -- 172.21.15.131:0/3335745170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c004800 msgr2=0x7fc58c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:07.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.556+0000 7fc5a711d640 1 --2- 172.21.15.131:0/3335745170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c004800 0x7fc58c004c10 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fc59000c240 tx=0x7fc58c005830 comp rx=0 tx=0).stop 2024-05-17T11:53:07.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.557+0000 7fc5a711d640 1 -- 172.21.15.131:0/3335745170 shutdown_connections 2024-05-17T11:53:07.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.557+0000 7fc5a711d640 1 --2- 172.21.15.131:0/3335745170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c004800 0x7fc58c004c10 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:07.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.557+0000 7fc5a711d640 1 -- 172.21.15.131:0/3335745170 >> 172.21.15.131:0/3335745170 conn(0x7fc5a006c6f0 msgr2=0x7fc5a006cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:07.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.557+0000 7fc5a711d640 1 -- 172.21.15.131:0/3335745170 shutdown_connections 2024-05-17T11:53:07.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.557+0000 7fc5a711d640 1 -- 172.21.15.131:0/3335745170 wait complete. 2024-05-17T11:53:07.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.560+0000 7fc5a711d640 1 Processor -- start 2024-05-17T11:53:07.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.560+0000 7fc5a711d640 1 -- start start 2024-05-17T11:53:07.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.562+0000 7fc5a711d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc58c004800 0x7fc5a014c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:07.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.562+0000 7fc5a711d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a01f9b70 0x7fc5a014f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:07.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.562+0000 7fc5a711d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5a014d660 0x7fc5a014da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:07.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.562+0000 7fc5a711d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a015f110 con 0x7fc5a014d660 2024-05-17T11:53:07.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.562+0000 7fc5a711d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a015ef90 con 0x7fc58c004800 2024-05-17T11:53:07.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.562+0000 7fc5a711d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a006e5f0 con 0x7fc5a01f9b70 2024-05-17T11:53:07.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.562+0000 7fc5a691c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5a014d660 0x7fc5a014da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:07.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.563+0000 7fc5a691c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5a014d660 0x7fc5a014da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:58330/0 (socket says 172.21.15.131:58330) 2024-05-17T11:53:07.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.563+0000 7fc5a691c640 1 -- 172.21.15.131:0/3016664680 learned_addr learned my addr 172.21.15.131:0/3016664680 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:07.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.563+0000 7fc5a611b640 1 --2- 172.21.15.131:0/3016664680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc58c004800 0x7fc5a014c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:07.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.563+0000 7fc5a591a640 1 --2- 172.21.15.131:0/3016664680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a01f9b70 0x7fc5a014f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:07.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.563+0000 7fc5a691c640 1 -- 172.21.15.131:0/3016664680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a01f9b70 msgr2=0x7fc5a014f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:07.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.563+0000 7fc5a691c640 1 --2- 172.21.15.131:0/3016664680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a01f9b70 0x7fc5a014f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:07.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.563+0000 7fc5a691c640 1 -- 172.21.15.131:0/3016664680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc58c004800 msgr2=0x7fc5a014c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:07.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.563+0000 7fc5a691c640 1 --2- 172.21.15.131:0/3016664680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc58c004800 0x7fc5a014c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:07.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.563+0000 7fc5a691c640 1 -- 172.21.15.131:0/3016664680 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a01fa220 con 0x7fc5a014d660 2024-05-17T11:53:07.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.563+0000 7fc5a691c640 1 --2- 172.21.15.131:0/3016664680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5a014d660 0x7fc5a014da70 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0057e0 tx=0x7fc59800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:07.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.564+0000 7fc5a611b640 1 --2- 172.21.15.131:0/3016664680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc58c004800 0x7fc5a014c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T11:53:07.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.565+0000 7fc596ffd640 1 -- 172.21.15.131:0/3016664680 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598003dd0 con 0x7fc5a014d660 2024-05-17T11:53:07.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.565+0000 7fc596ffd640 1 -- 172.21.15.131:0/3016664680 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc598005070 con 0x7fc5a014d660 2024-05-17T11:53:07.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.565+0000 7fc596ffd640 1 -- 172.21.15.131:0/3016664680 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598005460 con 0x7fc5a014d660 2024-05-17T11:53:07.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.565+0000 7fc5a711d640 1 -- 172.21.15.131:0/3016664680 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a01fa500 con 0x7fc5a014d660 2024-05-17T11:53:07.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.566+0000 7fc5a711d640 1 -- 172.21.15.131:0/3016664680 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a01faac0 con 0x7fc5a014d660 2024-05-17T11:53:07.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.569+0000 7fc5a711d640 1 -- 172.21.15.131:0/3016664680 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5a006e2c0 con 0x7fc5a014d660 2024-05-17T11:53:07.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.573+0000 7fc596ffd640 1 -- 172.21.15.131:0/3016664680 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc598005600 con 0x7fc5a014d660 2024-05-17T11:53:07.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.575+0000 7fc596ffd640 1 --2- 172.21.15.131:0/3016664680 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc584076350 0x7fc584078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:07.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.576+0000 7fc5a611b640 1 --2- 172.21.15.131:0/3016664680 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc584076350 0x7fc584078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:07.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.576+0000 7fc596ffd640 1 -- 172.21.15.131:0/3016664680 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6130+0+0 (secure 0 0 0) 0x7fc598098220 con 0x7fc5a014d660 2024-05-17T11:53:07.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.577+0000 7fc5a611b640 1 --2- 172.21.15.131:0/3016664680 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc584076350 0x7fc584078860 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc59c006fd0 tx=0x7fc59c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:07.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:07.591+0000 7fc596ffd640 1 -- 172.21.15.131:0/3016664680 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc598061b40 con 0x7fc5a014d660 2024-05-17T11:53:08.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:08.853+0000 7fc5a711d640 1 -- 172.21.15.131:0/3016664680 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5a01f9fb0 con 0x7fc5a014d660 2024-05-17T11:53:08.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:08.859+0000 7fc596ffd640 1 -- 172.21.15.131:0/3016664680 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5187 (secure 0 0 0) 0x7fc598061440 con 0x7fc5a014d660 2024-05-17T11:53:08.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:53:08.846 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/569182744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":569182744},{"type":"v1","addr":"172.21.15.150:6835","nonce":569182744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1749773301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1749773301},{"type":"v1","addr":"172.21.15.150:6834","nonce":1749773301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3795031678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3795031678},{"type":"v1","addr":"172.21.15.131:6837","nonce":3795031678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:56.173520+0000","modified":"2024-05-17T04:09:59.216262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4923":{"gid":4923,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/119325169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":119325169},{"type":"v1","addr":"172.21.15.131:6836","nonce":119325169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4923,"qdb_cluster":[4923]},"id":2}]} 2024-05-17T11:53:08.846 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 16 2024-05-17T11:53:08.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:08.866+0000 7fc5a711d640 1 -- 172.21.15.131:0/3016664680 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc584076350 msgr2=0x7fc584078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:08.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:08.866+0000 7fc5a711d640 1 --2- 172.21.15.131:0/3016664680 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc584076350 0x7fc584078860 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc59c006fd0 tx=0x7fc59c008040 comp rx=0 tx=0).stop 2024-05-17T11:53:08.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:08.866+0000 7fc5a711d640 1 -- 172.21.15.131:0/3016664680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5a014d660 msgr2=0x7fc5a014da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:08.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:08.866+0000 7fc5a711d640 1 --2- 172.21.15.131:0/3016664680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5a014d660 0x7fc5a014da70 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0057e0 tx=0x7fc59800be00 comp rx=0 tx=0).stop 2024-05-17T11:53:08.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:08.870+0000 7fc5a711d640 1 -- 172.21.15.131:0/3016664680 shutdown_connections 2024-05-17T11:53:08.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:08.870+0000 7fc5a711d640 1 --2- 172.21.15.131:0/3016664680 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc584076350 0x7fc584078860 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:08.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:08.870+0000 7fc5a711d640 1 --2- 172.21.15.131:0/3016664680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5a014d660 0x7fc5a014da70 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:08.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:08.870+0000 7fc5a711d640 1 --2- 172.21.15.131:0/3016664680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a01f9b70 0x7fc5a014f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:08.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:08.870+0000 7fc5a711d640 1 --2- 172.21.15.131:0/3016664680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc58c004800 0x7fc5a014c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:08.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:08.870+0000 7fc5a711d640 1 -- 172.21.15.131:0/3016664680 >> 172.21.15.131:0/3016664680 conn(0x7fc5a006c6f0 msgr2=0x7fc5a00cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:08.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:08.872+0000 7fc5a711d640 1 -- 172.21.15.131:0/3016664680 shutdown_connections 2024-05-17T11:53:08.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:08.872+0000 7fc5a711d640 1 -- 172.21.15.131:0/3016664680 wait complete. 2024-05-17T11:53:08.905 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T11:53:09.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.344+0000 7fce09111640 1 Processor -- start 2024-05-17T11:53:09.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.344+0000 7fce09111640 1 -- start start 2024-05-17T11:53:09.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.347+0000 7fce09111640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce0406dc20 0x7fce040736f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:09.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.347+0000 7fce09111640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce04073e50 con 0x7fce04164860 2024-05-17T11:53:09.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.347+0000 7fce09111640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce04074130 con 0x7fce040732e0 2024-05-17T11:53:09.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.347+0000 7fce09111640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fce04073c30 con 0x7fce0406dc20 2024-05-17T11:53:09.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.347+0000 7fce0259c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce0406dc20 0x7fce040736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:09.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.347+0000 7fce0259c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce0406dc20 0x7fce040736f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:58804/0 (socket says 172.21.15.131:58804) 2024-05-17T11:53:09.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.347+0000 7fce0259c640 1 -- 172.21.15.131:0/3522043621 learned_addr learned my addr 172.21.15.131:0/3522043621 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:09.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.348+0000 7fce0259c640 1 -- 172.21.15.131:0/3522043621 >> v1:172.21.15.150:6789/0 conn(0x7fce040732e0 legacy=0x7fce04164150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:09.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.348+0000 7fce0259c640 1 -- 172.21.15.131:0/3522043621 >> v1:172.21.15.131:6789/0 conn(0x7fce04164860 legacy=0x7fce041674f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:09.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.352+0000 7fce0259c640 1 -- 172.21.15.131:0/3522043621 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce04074410 con 0x7fce0406dc20 2024-05-17T11:53:09.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.353+0000 7fce0259c640 1 --2- 172.21.15.131:0/3522043621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce0406dc20 0x7fce040736f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcdf80098a0 tx=0x7fcdf802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f54e6a490911e1dc server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:09.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.354+0000 7fce01d9b640 1 -- 172.21.15.131:0/3522043621 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8037070 con 0x7fce0406dc20 2024-05-17T11:53:09.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.354+0000 7fce01d9b640 1 -- 172.21.15.131:0/3522043621 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf802ae50 con 0x7fce0406dc20 2024-05-17T11:53:09.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.354+0000 7fce01d9b640 1 -- 172.21.15.131:0/3522043621 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf80328a0 con 0x7fce0406dc20 2024-05-17T11:53:09.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.357+0000 7fce09111640 1 -- 172.21.15.131:0/3522043621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce0406dc20 msgr2=0x7fce040736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:09.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.357+0000 7fce09111640 1 --2- 172.21.15.131:0/3522043621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce0406dc20 0x7fce040736f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcdf80098a0 tx=0x7fcdf802a300 comp rx=0 tx=0).stop 2024-05-17T11:53:09.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.360+0000 7fce09111640 1 -- 172.21.15.131:0/3522043621 shutdown_connections 2024-05-17T11:53:09.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.360+0000 7fce09111640 1 --2- 172.21.15.131:0/3522043621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce0406dc20 0x7fce040736f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:09.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.361+0000 7fce09111640 1 -- 172.21.15.131:0/3522043621 >> 172.21.15.131:0/3522043621 conn(0x7fce0406e330 msgr2=0x7fce0406e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:09.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.362+0000 7fce09111640 1 -- 172.21.15.131:0/3522043621 shutdown_connections 2024-05-17T11:53:09.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.367+0000 7fce09111640 1 -- 172.21.15.131:0/3522043621 wait complete. 2024-05-17T11:53:09.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.377+0000 7fce09111640 1 Processor -- start 2024-05-17T11:53:09.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.377+0000 7fce09111640 1 -- start start 2024-05-17T11:53:09.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.383+0000 7fce09111640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce0406dc20 0x7fce04161620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:09.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.384+0000 7fce09111640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce040732e0 0x7fce040c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:09.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.384+0000 7fce0259c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce040732e0 0x7fce040c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:09.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.385+0000 7fce02d9d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce0406dc20 0x7fce04161620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:09.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.385+0000 7fce0259c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce040732e0 0x7fce040c5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:58332/0 (socket says 172.21.15.131:58332) 2024-05-17T11:53:09.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.385+0000 7fce02d9d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce0406dc20 0x7fce04161620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:58806/0 (socket says 172.21.15.131:58806) 2024-05-17T11:53:09.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.385+0000 7fce0259c640 1 -- 172.21.15.131:0/2177150268 learned_addr learned my addr 172.21.15.131:0/2177150268 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:09.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.385+0000 7fce09111640 1 --2- 172.21.15.131:0/2177150268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce04164860 0x7fce040c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:09.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.385+0000 7fce09111640 1 -- 172.21.15.131:0/2177150268 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fce040d0900 con 0x7fce040732e0 2024-05-17T11:53:09.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.385+0000 7fce09111640 1 -- 172.21.15.131:0/2177150268 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fce0406c780 con 0x7fce04164860 2024-05-17T11:53:09.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.385+0000 7fce09111640 1 -- 172.21.15.131:0/2177150268 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fce04164c70 con 0x7fce0406dc20 2024-05-17T11:53:09.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.386+0000 7fce0359e640 1 --2- 172.21.15.131:0/2177150268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce04164860 0x7fce040c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:09.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.387+0000 7fce0259c640 1 -- 172.21.15.131:0/2177150268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce0406dc20 msgr2=0x7fce04161620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:09.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.387+0000 7fce0259c640 1 --2- 172.21.15.131:0/2177150268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce0406dc20 0x7fce04161620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:09.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.387+0000 7fce0259c640 1 -- 172.21.15.131:0/2177150268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce04164860 msgr2=0x7fce040c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:09.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.387+0000 7fce0259c640 1 --2- 172.21.15.131:0/2177150268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce04164860 0x7fce040c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:09.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.387+0000 7fce0259c640 1 -- 172.21.15.131:0/2177150268 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce040b0370 con 0x7fce040732e0 2024-05-17T11:53:09.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.388+0000 7fce0259c640 1 --2- 172.21.15.131:0/2177150268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce040732e0 0x7fce040c5dd0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fcdf802a820 tx=0x7fcdf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:09.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.389+0000 7fcdeb7fe640 1 -- 172.21.15.131:0/2177150268 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8042020 con 0x7fce040732e0 2024-05-17T11:53:09.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.389+0000 7fcdeb7fe640 1 -- 172.21.15.131:0/2177150268 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf80308f0 con 0x7fce040732e0 2024-05-17T11:53:09.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.389+0000 7fcdeb7fe640 1 -- 172.21.15.131:0/2177150268 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8037040 con 0x7fce040732e0 2024-05-17T11:53:09.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.389+0000 7fce09111640 1 -- 172.21.15.131:0/2177150268 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce040ab5c0 con 0x7fce040732e0 2024-05-17T11:53:09.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.391+0000 7fce09111640 1 -- 172.21.15.131:0/2177150268 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce040abb80 con 0x7fce040732e0 2024-05-17T11:53:09.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.392+0000 7fce09111640 1 -- 172.21.15.131:0/2177150268 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce040736f0 con 0x7fce040732e0 2024-05-17T11:53:09.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.394+0000 7fcdeb7fe640 1 -- 172.21.15.131:0/2177150268 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcdf8045020 con 0x7fce040732e0 2024-05-17T11:53:09.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.396+0000 7fcdeb7fe640 1 --2- 172.21.15.131:0/2177150268 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fcdf0076320 0x7fcdf0078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:09.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.396+0000 7fce02d9d640 1 --2- 172.21.15.131:0/2177150268 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fcdf0076320 0x7fcdf0078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:09.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.397+0000 7fcdeb7fe640 1 -- 172.21.15.131:0/2177150268 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6130+0+0 (secure 0 0 0) 0x7fcdf80b8030 con 0x7fce040732e0 2024-05-17T11:53:09.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.397+0000 7fce02d9d640 1 --2- 172.21.15.131:0/2177150268 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fcdf0076320 0x7fcdf0078830 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4000f60 tx=0x7fcdf4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:09.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:09.413+0000 7fcdeb7fe640 1 -- 172.21.15.131:0/2177150268 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcdf804c070 con 0x7fce040732e0 2024-05-17T11:53:10.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:10.640+0000 7fce09111640 1 -- 172.21.15.131:0/2177150268 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce040b1860 con 0x7fce040732e0 2024-05-17T11:53:10.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:10.643+0000 7fcdeb7fe640 1 -- 172.21.15.131:0/2177150268 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5187 (secure 0 0 0) 0x7fcdf80818d0 con 0x7fce040732e0 2024-05-17T11:53:10.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:53:10.631 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/569182744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":569182744},{"type":"v1","addr":"172.21.15.150:6835","nonce":569182744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1749773301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1749773301},{"type":"v1","addr":"172.21.15.150:6834","nonce":1749773301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3795031678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3795031678},{"type":"v1","addr":"172.21.15.131:6837","nonce":3795031678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-17T04:09:56.173520+0000","modified":"2024-05-17T04:09:59.216262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4923":{"gid":4923,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/119325169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":119325169},{"type":"v1","addr":"172.21.15.131:6836","nonce":119325169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4923,"qdb_cluster":[4923]},"id":2}]} 2024-05-17T11:53:10.631 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 16 2024-05-17T11:53:10.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:10.655+0000 7fce09111640 1 -- 172.21.15.131:0/2177150268 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fcdf0076320 msgr2=0x7fcdf0078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:10.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:10.655+0000 7fce09111640 1 --2- 172.21.15.131:0/2177150268 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fcdf0076320 0x7fcdf0078830 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4000f60 tx=0x7fcdf4009040 comp rx=0 tx=0).stop 2024-05-17T11:53:10.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:10.655+0000 7fce09111640 1 -- 172.21.15.131:0/2177150268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce040732e0 msgr2=0x7fce040c5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:10.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:10.655+0000 7fce09111640 1 --2- 172.21.15.131:0/2177150268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce040732e0 0x7fce040c5dd0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fcdf802a820 tx=0x7fcdf80046c0 comp rx=0 tx=0).stop 2024-05-17T11:53:10.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:10.655+0000 7fce09111640 1 -- 172.21.15.131:0/2177150268 shutdown_connections 2024-05-17T11:53:10.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:10.655+0000 7fce09111640 1 --2- 172.21.15.131:0/2177150268 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fcdf0076320 0x7fcdf0078830 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:10.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:10.655+0000 7fce09111640 1 --2- 172.21.15.131:0/2177150268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce040732e0 0x7fce040c5dd0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:10.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:10.655+0000 7fce09111640 1 --2- 172.21.15.131:0/2177150268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce04164860 0x7fce040c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:10.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:10.655+0000 7fce09111640 1 --2- 172.21.15.131:0/2177150268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce0406dc20 0x7fce04161620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:10.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:10.655+0000 7fce09111640 1 -- 172.21.15.131:0/2177150268 >> 172.21.15.131:0/2177150268 conn(0x7fce0406e330 msgr2=0x7fce041632a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:10.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:10.656+0000 7fce09111640 1 -- 172.21.15.131:0/2177150268 shutdown_connections 2024-05-17T11:53:10.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:10.656+0000 7fce09111640 1 -- 172.21.15.131:0/2177150268 wait complete. 2024-05-17T11:53:10.664 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T11:53:11.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.104+0000 7f8f5cdba640 1 Processor -- start 2024-05-17T11:53:11.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.104+0000 7f8f5cdba640 1 -- start start 2024-05-17T11:53:11.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.106+0000 7f8f5cdba640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8f5815df40 0x7f8f58073d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:11.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.106+0000 7f8f5cdba640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f58074260 0x7f8f5806c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:11.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.106+0000 7f8f5cdba640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f58164cd0 con 0x7f8f5806cc30 2024-05-17T11:53:11.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.106+0000 7f8f5cdba640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f8f58072ff0 con 0x7f8f5815df40 2024-05-17T11:53:11.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.106+0000 7f8f5cdba640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8f5806d040 con 0x7f8f58074260 2024-05-17T11:53:11.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.107+0000 7f8f55d9b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f58074260 0x7f8f5806c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:11.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.107+0000 7f8f55d9b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f58074260 0x7f8f5806c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:58810/0 (socket says 172.21.15.131:58810) 2024-05-17T11:53:11.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.107+0000 7f8f55d9b640 1 -- 172.21.15.131:0/435618466 learned_addr learned my addr 172.21.15.131:0/435618466 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:11.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.107+0000 7f8f56d9d640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f8f5806cc30 0x7f8f580d0150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:40518/0 (socket says 172.21.15.131:40518) 2024-05-17T11:53:11.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.107+0000 7f8f5659c640 1 --2- 172.21.15.131:0/435618466 >> v2:172.21.15.150:3300/0 conn(0x7f8f5815df40 0x7f8f58073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:11.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.107+0000 7f8f55d9b640 1 -- 172.21.15.131:0/435618466 >> v2:172.21.15.150:3300/0 conn(0x7f8f5815df40 msgr2=0x7f8f58073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:11.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.107+0000 7f8f55d9b640 1 --2- 172.21.15.131:0/435618466 >> v2:172.21.15.150:3300/0 conn(0x7f8f5815df40 0x7f8f58073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:11.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.107+0000 7f8f55d9b640 1 -- 172.21.15.131:0/435618466 >> v1:172.21.15.131:6789/0 conn(0x7f8f5806cc30 legacy=0x7f8f580d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:11.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.107+0000 7f8f55d9b640 1 -- 172.21.15.131:0/435618466 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f58073240 con 0x7f8f58074260 2024-05-17T11:53:11.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.107+0000 7f8f5659c640 1 --2- 172.21.15.131:0/435618466 >> v2:172.21.15.150:3300/0 conn(0x7f8f5815df40 0x7f8f58073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T11:53:11.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.108+0000 7f8f55d9b640 1 --2- 172.21.15.131:0/435618466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f58074260 0x7f8f5806c6f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8f58073170 tx=0x7f8f4c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d078c0b20d971ca server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:11.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.109+0000 7f8f5559a640 1 -- 172.21.15.131:0/435618466 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c037070 con 0x7f8f58074260 2024-05-17T11:53:11.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.109+0000 7f8f5559a640 1 -- 172.21.15.131:0/435618466 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f4c032440 con 0x7f8f58074260 2024-05-17T11:53:11.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.109+0000 7f8f5559a640 1 -- 172.21.15.131:0/435618466 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c032810 con 0x7f8f58074260 2024-05-17T11:53:11.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.110+0000 7f8f5cdba640 1 -- 172.21.15.131:0/435618466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f58074260 msgr2=0x7f8f5806c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:11.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.110+0000 7f8f5cdba640 1 --2- 172.21.15.131:0/435618466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f58074260 0x7f8f5806c6f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8f58073170 tx=0x7f8f4c02a1a0 comp rx=0 tx=0).stop 2024-05-17T11:53:11.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.110+0000 7f8f5cdba640 1 -- 172.21.15.131:0/435618466 shutdown_connections 2024-05-17T11:53:11.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.110+0000 7f8f5cdba640 1 --2- 172.21.15.131:0/435618466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f58074260 0x7f8f5806c6f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:11.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.110+0000 7f8f5cdba640 1 --2- 172.21.15.131:0/435618466 >> v2:172.21.15.150:3300/0 conn(0x7f8f5815df40 0x7f8f58073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:11.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.110+0000 7f8f5cdba640 1 -- 172.21.15.131:0/435618466 >> 172.21.15.131:0/435618466 conn(0x7f8f580b36d0 msgr2=0x7f8f580d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:11.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.113+0000 7f8f5cdba640 1 -- 172.21.15.131:0/435618466 shutdown_connections 2024-05-17T11:53:11.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.113+0000 7f8f5cdba640 1 -- 172.21.15.131:0/435618466 wait complete. 2024-05-17T11:53:11.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.121+0000 7f8f5cdba640 1 Processor -- start 2024-05-17T11:53:11.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.122+0000 7f8f5cdba640 1 -- start start 2024-05-17T11:53:11.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.124+0000 7f8f5cdba640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f5806cc30 0x7f8f5815d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:11.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.124+0000 7f8f5cdba640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f58074260 0x7f8f5815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:11.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.124+0000 7f8f5cdba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5815df40 0x7f8f581636f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:11.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.125+0000 7f8f5cdba640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5815e350 con 0x7f8f58074260 2024-05-17T11:53:11.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.125+0000 7f8f5cdba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8f58073800 con 0x7f8f5815df40 2024-05-17T11:53:11.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.125+0000 7f8f5cdba640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8f580d0860 con 0x7f8f5806cc30 2024-05-17T11:53:11.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.125+0000 7f8f56d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5815df40 0x7f8f581636f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:11.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.125+0000 7f8f56d9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5815df40 0x7f8f581636f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:46640/0 (socket says 172.21.15.131:46640) 2024-05-17T11:53:11.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.125+0000 7f8f56d9d640 1 -- 172.21.15.131:0/1144967283 learned_addr learned my addr 172.21.15.131:0/1144967283 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:11.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.126+0000 7f8f56d9d640 1 -- 172.21.15.131:0/1144967283 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f5806cc30 msgr2=0x7f8f5815d190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-17T11:53:11.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.126+0000 7f8f56d9d640 1 --2- 172.21.15.131:0/1144967283 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f5806cc30 0x7f8f5815d190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:11.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.126+0000 7f8f56d9d640 1 -- 172.21.15.131:0/1144967283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f58074260 msgr2=0x7f8f5815eee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-17T11:53:11.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.126+0000 7f8f56d9d640 1 --2- 172.21.15.131:0/1144967283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f58074260 0x7f8f5815eee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:11.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.126+0000 7f8f56d9d640 1 -- 172.21.15.131:0/1144967283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f580b05d0 con 0x7f8f5815df40 2024-05-17T11:53:11.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.126+0000 7f8f56d9d640 1 --2- 172.21.15.131:0/1144967283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5815df40 0x7f8f581636f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f8f4802e420 tx=0x7f8f4802e8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:11.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.126+0000 7f8f46ffd640 1 -- 172.21.15.131:0/1144967283 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f48039070 con 0x7f8f5815df40 2024-05-17T11:53:11.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.127+0000 7f8f46ffd640 1 -- 172.21.15.131:0/1144967283 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f480072e0 con 0x7f8f5815df40 2024-05-17T11:53:11.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.127+0000 7f8f46ffd640 1 -- 172.21.15.131:0/1144967283 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f48005810 con 0x7f8f5815df40 2024-05-17T11:53:11.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.127+0000 7f8f5cdba640 1 -- 172.21.15.131:0/1144967283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f58160400 con 0x7f8f5815df40 2024-05-17T11:53:11.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.127+0000 7f8f5cdba640 1 -- 172.21.15.131:0/1144967283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f581609c0 con 0x7f8f5815df40 2024-05-17T11:53:11.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.129+0000 7f8f46ffd640 1 -- 172.21.15.131:0/1144967283 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8f4803c070 con 0x7f8f5815df40 2024-05-17T11:53:11.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.130+0000 7f8f46ffd640 1 --2- 172.21.15.131:0/1144967283 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8f380763a0 0x7f8f380788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:11.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.130+0000 7f8f46ffd640 1 -- 172.21.15.131:0/1144967283 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6130+0+0 (secure 0 0 0) 0x7f8f480b8780 con 0x7f8f5815df40 2024-05-17T11:53:11.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.131+0000 7f8f5659c640 1 --2- 172.21.15.131:0/1144967283 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8f380763a0 0x7f8f380788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:11.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.131+0000 7f8f5cdba640 1 -- 172.21.15.131:0/1144967283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f3c005290 con 0x7f8f5815df40 2024-05-17T11:53:11.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.134+0000 7f8f5659c640 1 --2- 172.21.15.131:0/1144967283 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8f380763a0 0x7f8f380788b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8f50007dd0 tx=0x7f8f50007300 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:11.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.139+0000 7f8f46ffd640 1 -- 172.21.15.131:0/1144967283 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8f48081830 con 0x7f8f5815df40 2024-05-17T11:53:11.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.539+0000 7f8f5cdba640 1 -- 172.21.15.131:0/1144967283 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f3c005580 con 0x7f8f5815df40 2024-05-17T11:53:11.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.541+0000 7f8f46ffd640 1 -- 172.21.15.131:0/1144967283 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+17015 (secure 0 0 0) 0x7f8f48085b30 con 0x7f8f5815df40 2024-05-17T11:53:11.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:53:11.536 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":38,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T04:10:48.923903+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-17T04:09:54.201745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-17T04:09:55.131426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.3d","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T11:53:11.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.553+0000 7f8f5cdba640 1 -- 172.21.15.131:0/1144967283 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8f380763a0 msgr2=0x7f8f380788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:11.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.553+0000 7f8f5cdba640 1 --2- 172.21.15.131:0/1144967283 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8f380763a0 0x7f8f380788b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8f50007dd0 tx=0x7f8f50007300 comp rx=0 tx=0).stop 2024-05-17T11:53:11.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.553+0000 7f8f5cdba640 1 -- 172.21.15.131:0/1144967283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5815df40 msgr2=0x7f8f581636f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:11.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.553+0000 7f8f5cdba640 1 --2- 172.21.15.131:0/1144967283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5815df40 0x7f8f581636f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f8f4802e420 tx=0x7f8f4802e8e0 comp rx=0 tx=0).stop 2024-05-17T11:53:11.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.554+0000 7f8f5cdba640 1 -- 172.21.15.131:0/1144967283 shutdown_connections 2024-05-17T11:53:11.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.554+0000 7f8f5cdba640 1 --2- 172.21.15.131:0/1144967283 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8f380763a0 0x7f8f380788b0 secure :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8f50007dd0 tx=0x7f8f50007300 comp rx=0 tx=0).stop 2024-05-17T11:53:11.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.554+0000 7f8f5cdba640 1 --2- 172.21.15.131:0/1144967283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f58074260 0x7f8f5815eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:11.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.554+0000 7f8f5cdba640 1 --2- 172.21.15.131:0/1144967283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f5815df40 0x7f8f581636f0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:11.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.554+0000 7f8f5cdba640 1 --2- 172.21.15.131:0/1144967283 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f5806cc30 0x7f8f5815d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:11.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.554+0000 7f8f5cdba640 1 -- 172.21.15.131:0/1144967283 >> 172.21.15.131:0/1144967283 conn(0x7f8f580b36d0 msgr2=0x7f8f58068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:11.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.556+0000 7f8f5cdba640 1 -- 172.21.15.131:0/1144967283 shutdown_connections 2024-05-17T11:53:11.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:11.556+0000 7f8f5cdba640 1 -- 172.21.15.131:0/1144967283 wait complete. 2024-05-17T11:53:11.562 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-17T11:53:12.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.016+0000 7f888cc02640 1 Processor -- start 2024-05-17T11:53:12.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.017+0000 7f888cc02640 1 -- start start 2024-05-17T11:53:12.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.023+0000 7f888cc02640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88800337b0 0x7f8880051820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:12.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.024+0000 7f888cc02640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8880006850 con 0x7f8880033d00 2024-05-17T11:53:12.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.024+0000 7f8887fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88800337b0 0x7f8880051820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:12.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.024+0000 7f8887fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88800337b0 0x7f8880051820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:58824/0 (socket says 172.21.15.131:58824) 2024-05-17T11:53:12.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.024+0000 7f8887fff640 1 -- 172.21.15.131:0/464886132 learned_addr learned my addr 172.21.15.131:0/464886132 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:12.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.025+0000 7f888cc02640 1 -- 172.21.15.131:0/464886132 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8880006b30 con 0x7f888000a7f0 2024-05-17T11:53:12.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.025+0000 7f888cc02640 1 -- 172.21.15.131:0/464886132 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8880006600 con 0x7f88800337b0 2024-05-17T11:53:12.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.027+0000 7f8887fff640 1 -- 172.21.15.131:0/464886132 >> v1:172.21.15.150:6789/0 conn(0x7f888000a7f0 legacy=0x7f8880052f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:12.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.027+0000 7f8887fff640 1 -- 172.21.15.131:0/464886132 >> v1:172.21.15.131:6789/0 conn(0x7f8880033d00 legacy=0x7f888000a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:12.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.027+0000 7f8887fff640 1 -- 172.21.15.131:0/464886132 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8880006e10 con 0x7f88800337b0 2024-05-17T11:53:12.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.028+0000 7f8887fff640 1 --2- 172.21.15.131:0/464886132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88800337b0 0x7f8880051820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8880006780 tx=0x7f88880a91b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bba35c60d58124b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:12.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.029+0000 7f88867fc640 1 -- 172.21.15.131:0/464886132 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88880af070 con 0x7f88800337b0 2024-05-17T11:53:12.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.029+0000 7f88867fc640 1 -- 172.21.15.131:0/464886132 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88880a9c90 con 0x7f88800337b0 2024-05-17T11:53:12.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.029+0000 7f88867fc640 1 -- 172.21.15.131:0/464886132 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88880b3620 con 0x7f88800337b0 2024-05-17T11:53:12.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.032+0000 7f888cc02640 1 -- 172.21.15.131:0/464886132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88800337b0 msgr2=0x7f8880051820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:12.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.032+0000 7f888cc02640 1 --2- 172.21.15.131:0/464886132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88800337b0 0x7f8880051820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8880006780 tx=0x7f88880a91b0 comp rx=0 tx=0).stop 2024-05-17T11:53:12.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.032+0000 7f888cc02640 1 -- 172.21.15.131:0/464886132 shutdown_connections 2024-05-17T11:53:12.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.032+0000 7f888cc02640 1 --2- 172.21.15.131:0/464886132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88800337b0 0x7f8880051820 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:12.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.032+0000 7f888cc02640 1 -- 172.21.15.131:0/464886132 >> 172.21.15.131:0/464886132 conn(0x7f888001db50 msgr2=0x7f88800395f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:12.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.032+0000 7f888cc02640 1 -- 172.21.15.131:0/464886132 shutdown_connections 2024-05-17T11:53:12.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.032+0000 7f888cc02640 1 -- 172.21.15.131:0/464886132 wait complete. 2024-05-17T11:53:12.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.040+0000 7f888cc02640 1 Processor -- start 2024-05-17T11:53:12.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.040+0000 7f888cc02640 1 -- start start 2024-05-17T11:53:12.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.047+0000 7f888cc02640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88800337b0 0x7f8880035f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:12.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.047+0000 7f888cc02640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8880033d00 0x7f888004ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:12.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.048+0000 7f8886ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8880033d00 0x7f888004ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:12.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.048+0000 7f8886ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8880033d00 0x7f888004ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:58344/0 (socket says 172.21.15.131:58344) 2024-05-17T11:53:12.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.048+0000 7f8886ffd640 1 -- 172.21.15.131:0/91594706 learned_addr learned my addr 172.21.15.131:0/91594706 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:12.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.048+0000 7f888cc02640 1 --2- 172.21.15.131:0/91594706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f888017d0c0 0x7f8880048260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:12.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.048+0000 7f888cc02640 1 -- 172.21.15.131:0/91594706 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8880039d00 con 0x7f8880033d00 2024-05-17T11:53:12.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.048+0000 7f888cc02640 1 -- 172.21.15.131:0/91594706 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8880052a80 con 0x7f888017d0c0 2024-05-17T11:53:12.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.048+0000 7f888cc02640 1 -- 172.21.15.131:0/91594706 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8880039e80 con 0x7f88800337b0 2024-05-17T11:53:12.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.052+0000 7f8887fff640 1 --2- 172.21.15.131:0/91594706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f888017d0c0 0x7f8880048260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:12.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.052+0000 7f88877fe640 1 --2- 172.21.15.131:0/91594706 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88800337b0 0x7f8880035f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:12.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.052+0000 7f8886ffd640 1 -- 172.21.15.131:0/91594706 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88800337b0 msgr2=0x7f8880035f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:12.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.052+0000 7f8886ffd640 1 --2- 172.21.15.131:0/91594706 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88800337b0 0x7f8880035f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:12.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.052+0000 7f8886ffd640 1 -- 172.21.15.131:0/91594706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f888017d0c0 msgr2=0x7f8880048260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:12.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.052+0000 7f8886ffd640 1 --2- 172.21.15.131:0/91594706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f888017d0c0 0x7f8880048260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:12.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.052+0000 7f8886ffd640 1 -- 172.21.15.131:0/91594706 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8880034e70 con 0x7f8880033d00 2024-05-17T11:53:12.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.053+0000 7f8886ffd640 1 --2- 172.21.15.131:0/91594706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8880033d00 0x7f888004ac00 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f887400c530 tx=0x7f887400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:12.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.054+0000 7f8873fff640 1 -- 172.21.15.131:0/91594706 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874017070 con 0x7f8880033d00 2024-05-17T11:53:12.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.054+0000 7f8873fff640 1 -- 172.21.15.131:0/91594706 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88740035f0 con 0x7f8880033d00 2024-05-17T11:53:12.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.054+0000 7f888cc02640 1 -- 172.21.15.131:0/91594706 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8880035150 con 0x7f8880033d00 2024-05-17T11:53:12.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.055+0000 7f8873fff640 1 -- 172.21.15.131:0/91594706 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88740039e0 con 0x7f8880033d00 2024-05-17T11:53:12.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.055+0000 7f888cc02640 1 -- 172.21.15.131:0/91594706 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8880035710 con 0x7f8880033d00 2024-05-17T11:53:12.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.061+0000 7f888cc02640 1 -- 172.21.15.131:0/91594706 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8880034be0 con 0x7f8880033d00 2024-05-17T11:53:12.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.063+0000 7f8873fff640 1 -- 172.21.15.131:0/91594706 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f887401a070 con 0x7f8880033d00 2024-05-17T11:53:12.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.065+0000 7f8873fff640 1 --2- 172.21.15.131:0/91594706 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f886c076300 0x7f886c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:12.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.066+0000 7f88877fe640 1 --2- 172.21.15.131:0/91594706 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f886c076300 0x7f886c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:12.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.066+0000 7f8873fff640 1 -- 172.21.15.131:0/91594706 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6130+0+0 (secure 0 0 0) 0x7f8874096a80 con 0x7f8880033d00 2024-05-17T11:53:12.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.067+0000 7f88877fe640 1 --2- 172.21.15.131:0/91594706 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f886c076300 0x7f886c078810 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f887c001790 tx=0x7f887c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:12.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.076+0000 7f8873fff640 1 -- 172.21.15.131:0/91594706 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f887405fbe0 con 0x7f8880033d00 2024-05-17T11:53:12.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.482+0000 7f888cc02640 1 -- 172.21.15.131:0/91594706 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8880051820 con 0x7f8880033d00 2024-05-17T11:53:12.472 INFO:tasks.ceph.mon.a.smithi131.stderr:2024-05-17T11:53:12.485+0000 7ff88d74d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-17T11:53:12.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.488+0000 7f8873fff640 1 -- 172.21.15.131:0/91594706 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7f8874068220 con 0x7f8880033d00 2024-05-17T11:53:12.476 INFO:teuthology.orchestra.run.smithi131.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-17T11:53:12.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.497+0000 7f888cc02640 1 -- 172.21.15.131:0/91594706 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f886c076300 msgr2=0x7f886c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:12.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.497+0000 7f888cc02640 1 --2- 172.21.15.131:0/91594706 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f886c076300 0x7f886c078810 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f887c001790 tx=0x7f887c009040 comp rx=0 tx=0).stop 2024-05-17T11:53:12.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.497+0000 7f888cc02640 1 -- 172.21.15.131:0/91594706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8880033d00 msgr2=0x7f888004ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:12.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.497+0000 7f888cc02640 1 --2- 172.21.15.131:0/91594706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8880033d00 0x7f888004ac00 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f887400c530 tx=0x7f887400c9f0 comp rx=0 tx=0).stop 2024-05-17T11:53:12.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.497+0000 7f888cc02640 1 -- 172.21.15.131:0/91594706 shutdown_connections 2024-05-17T11:53:12.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.497+0000 7f888cc02640 1 --2- 172.21.15.131:0/91594706 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f886c076300 0x7f886c078810 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:12.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.497+0000 7f888cc02640 1 --2- 172.21.15.131:0/91594706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8880033d00 0x7f888004ac00 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:12.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.497+0000 7f888cc02640 1 --2- 172.21.15.131:0/91594706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f888017d0c0 0x7f8880048260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:12.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.497+0000 7f888cc02640 1 --2- 172.21.15.131:0/91594706 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88800337b0 0x7f8880035f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:12.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.497+0000 7f888cc02640 1 -- 172.21.15.131:0/91594706 >> 172.21.15.131:0/91594706 conn(0x7f888001db50 msgr2=0x7f88800395f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:12.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.500+0000 7f888cc02640 1 -- 172.21.15.131:0/91594706 shutdown_connections 2024-05-17T11:53:12.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.502+0000 7f888cc02640 1 -- 172.21.15.131:0/91594706 wait complete. 2024-05-17T11:53:12.541 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-17T11:53:12.732 INFO:tasks.ceph.mds.a.smithi131.stdout:starting mds.a at 2024-05-17T11:53:12.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.848+0000 7fc365f63640 1 Processor -- start 2024-05-17T11:53:12.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.848+0000 7fc365f63640 1 -- start start 2024-05-17T11:53:12.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.852+0000 7fc365f63640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3600d05e0 0x7fc36015f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:12.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.852+0000 7fc365f63640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc3600d2a60 0x7fc3600af680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:12.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.852+0000 7fc365f63640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3600d14b0 con 0x7fc3600d0db0 2024-05-17T11:53:12.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.852+0000 7fc365f63640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc3600d09f0 con 0x7fc3600d2a60 2024-05-17T11:53:12.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.852+0000 7fc365f63640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc3600d1790 con 0x7fc3600d05e0 2024-05-17T11:53:12.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.852+0000 7fc35ffff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc3600d2a60 0x7fc3600af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:12.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.852+0000 7fc35ffff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc3600d2a60 0x7fc3600af680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:58358/0 (socket says 172.21.15.131:58358) 2024-05-17T11:53:12.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.852+0000 7fc35ffff640 1 -- 172.21.15.131:0/343613884 learned_addr learned my addr 172.21.15.131:0/343613884 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:12.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.853+0000 7fc35f7fe640 1 --2- 172.21.15.131:0/343613884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3600d05e0 0x7fc36015f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:12.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.853+0000 7fc35ffff640 1 -- 172.21.15.131:0/343613884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3600d05e0 msgr2=0x7fc36015f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:12.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.853+0000 7fc35ffff640 1 --2- 172.21.15.131:0/343613884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3600d05e0 0x7fc36015f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:12.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.853+0000 7fc35ffff640 1 -- 172.21.15.131:0/343613884 >> v1:172.21.15.150:6789/0 conn(0x7fc3600d0db0 legacy=0x7fc3600d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:12.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.853+0000 7fc35ffff640 1 -- 172.21.15.131:0/343613884 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3600d1a70 con 0x7fc3600d2a60 2024-05-17T11:53:12.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.854+0000 7fc35ffff640 1 --2- 172.21.15.131:0/343613884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3600d2a60 0x7fc3600af680 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fc358009870 tx=0x7fc35802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610bf0e529babeb server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:12.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.854+0000 7fc35effd640 1 -- 172.21.15.131:0/343613884 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358037070 con 0x7fc3600d2a60 2024-05-17T11:53:12.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.854+0000 7fc35effd640 1 -- 172.21.15.131:0/343613884 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc358032440 con 0x7fc3600d2a60 2024-05-17T11:53:12.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.854+0000 7fc35effd640 1 -- 172.21.15.131:0/343613884 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358032810 con 0x7fc3600d2a60 2024-05-17T11:53:12.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.856+0000 7fc365f63640 1 -- 172.21.15.131:0/343613884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3600d2a60 msgr2=0x7fc3600af680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:12.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.856+0000 7fc365f63640 1 --2- 172.21.15.131:0/343613884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3600d2a60 0x7fc3600af680 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fc358009870 tx=0x7fc35802a250 comp rx=0 tx=0).stop 2024-05-17T11:53:12.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.856+0000 7fc365f63640 1 -- 172.21.15.131:0/343613884 shutdown_connections 2024-05-17T11:53:12.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.856+0000 7fc365f63640 1 --2- 172.21.15.131:0/343613884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3600d2a60 0x7fc3600af680 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:12.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.856+0000 7fc365f63640 1 --2- 172.21.15.131:0/343613884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3600d05e0 0x7fc36015f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:12.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.856+0000 7fc365f63640 1 -- 172.21.15.131:0/343613884 >> 172.21.15.131:0/343613884 conn(0x7fc3600b4250 msgr2=0x7fc3600b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:12.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.856+0000 7fc365f63640 1 -- 172.21.15.131:0/343613884 shutdown_connections 2024-05-17T11:53:12.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.856+0000 7fc365f63640 1 -- 172.21.15.131:0/343613884 wait complete. 2024-05-17T11:53:12.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.861+0000 7fc365f63640 1 Processor -- start 2024-05-17T11:53:12.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.862+0000 7fc365f63640 1 -- start start 2024-05-17T11:53:12.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.866+0000 7fc365f63640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3600d05e0 0x7fc36015e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:12.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.866+0000 7fc365f63640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3600d0db0 0x7fc360153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:12.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.866+0000 7fc365f63640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3601f99b0 0x7fc3601f8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:12.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.866+0000 7fc365f63640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc3600af0f0 con 0x7fc3600d0db0 2024-05-17T11:53:12.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.866+0000 7fc365f63640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc3600d11c0 con 0x7fc3601f99b0 2024-05-17T11:53:12.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.866+0000 7fc365f63640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc3600afbc0 con 0x7fc3600d05e0 2024-05-17T11:53:12.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.866+0000 7fc35ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3601f99b0 0x7fc3601f8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:12.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.866+0000 7fc35f7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3600d05e0 0x7fc36015e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:12.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.866+0000 7fc356ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3600d0db0 0x7fc360153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:12.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.866+0000 7fc35f7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3600d05e0 0x7fc36015e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:58878/0 (socket says 172.21.15.131:58878) 2024-05-17T11:53:12.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.866+0000 7fc35ffff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3601f99b0 0x7fc3601f8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:46668/0 (socket says 172.21.15.131:46668) 2024-05-17T11:53:12.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.866+0000 7fc35f7fe640 1 -- 172.21.15.131:0/1567789493 learned_addr learned my addr 172.21.15.131:0/1567789493 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:12.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.867+0000 7fc35ffff640 1 -- 172.21.15.131:0/1567789493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3600d05e0 msgr2=0x7fc36015e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:12.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.867+0000 7fc35ffff640 1 --2- 172.21.15.131:0/1567789493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3600d05e0 0x7fc36015e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:12.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.867+0000 7fc35ffff640 1 -- 172.21.15.131:0/1567789493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3600d0db0 msgr2=0x7fc360153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:12.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.867+0000 7fc35ffff640 1 --2- 172.21.15.131:0/1567789493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3600d0db0 0x7fc360153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:12.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.867+0000 7fc35ffff640 1 -- 172.21.15.131:0/1567789493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36015da80 con 0x7fc3601f99b0 2024-05-17T11:53:12.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.867+0000 7fc35f7fe640 1 --2- 172.21.15.131:0/1567789493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3600d05e0 0x7fc36015e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:12.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.867+0000 7fc35ffff640 1 --2- 172.21.15.131:0/1567789493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3601f99b0 0x7fc3601f8da0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc358031000 tx=0x7fc3580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:12.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.867+0000 7fc35cff9640 1 -- 172.21.15.131:0/1567789493 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358041020 con 0x7fc3601f99b0 2024-05-17T11:53:12.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.867+0000 7fc35cff9640 1 -- 172.21.15.131:0/1567789493 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc35803d700 con 0x7fc3601f99b0 2024-05-17T11:53:12.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.867+0000 7fc365f63640 1 -- 172.21.15.131:0/1567789493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36015dd60 con 0x7fc3601f99b0 2024-05-17T11:53:12.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.867+0000 7fc35cff9640 1 -- 172.21.15.131:0/1567789493 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358037040 con 0x7fc3601f99b0 2024-05-17T11:53:12.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.868+0000 7fc365f63640 1 -- 172.21.15.131:0/1567789493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc36006e4f0 con 0x7fc3601f99b0 2024-05-17T11:53:12.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.869+0000 7fc35cff9640 1 -- 172.21.15.131:0/1567789493 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc358044020 con 0x7fc3601f99b0 2024-05-17T11:53:12.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.870+0000 7fc365f63640 1 -- 172.21.15.131:0/1567789493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3600ce4e0 con 0x7fc3601f99b0 2024-05-17T11:53:12.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.870+0000 7fc35cff9640 1 --2- 172.21.15.131:0/1567789493 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc3400762d0 0x7fc3400787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:12.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.871+0000 7fc35f7fe640 1 --2- 172.21.15.131:0/1567789493 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc3400762d0 0x7fc3400787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:12.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.871+0000 7fc35cff9640 1 -- 172.21.15.131:0/1567789493 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6216+0+0 (secure 0 0 0) 0x7fc3580b7df0 con 0x7fc3601f99b0 2024-05-17T11:53:12.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.872+0000 7fc35f7fe640 1 --2- 172.21.15.131:0/1567789493 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc3400762d0 0x7fc3400787e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc3500094c0 tx=0x7fc35000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:12.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:12.875+0000 7fc35cff9640 1 -- 172.21.15.131:0/1567789493 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc3600ce4e0 con 0x7fc3601f99b0 2024-05-17T11:53:13.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:13.563+0000 7fc365f63640 1 -- 172.21.15.131:0/1567789493 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc36015f5a0 con 0x7fc3601f99b0 2024-05-17T11:53:14.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.559+0000 7fc35cff9640 1 -- 172.21.15.131:0/1567789493 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7fc35804b030 con 0x7fc3601f99b0 2024-05-17T11:53:14.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.565+0000 7fc365f63640 1 -- 172.21.15.131:0/1567789493 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc3400762d0 msgr2=0x7fc3400787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:14.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.565+0000 7fc365f63640 1 --2- 172.21.15.131:0/1567789493 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc3400762d0 0x7fc3400787e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc3500094c0 tx=0x7fc35000b040 comp rx=0 tx=0).stop 2024-05-17T11:53:14.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.565+0000 7fc365f63640 1 -- 172.21.15.131:0/1567789493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3601f99b0 msgr2=0x7fc3601f8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:14.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.565+0000 7fc365f63640 1 --2- 172.21.15.131:0/1567789493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3601f99b0 0x7fc3601f8da0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc358031000 tx=0x7fc3580046c0 comp rx=0 tx=0).stop 2024-05-17T11:53:14.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.565+0000 7fc365f63640 1 -- 172.21.15.131:0/1567789493 shutdown_connections 2024-05-17T11:53:14.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.565+0000 7fc365f63640 1 --2- 172.21.15.131:0/1567789493 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc3400762d0 0x7fc3400787e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:14.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.565+0000 7fc365f63640 1 --2- 172.21.15.131:0/1567789493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3600d0db0 0x7fc360153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:14.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.565+0000 7fc365f63640 1 --2- 172.21.15.131:0/1567789493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3601f99b0 0x7fc3601f8da0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:14.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.565+0000 7fc365f63640 1 --2- 172.21.15.131:0/1567789493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3600d05e0 0x7fc36015e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:14.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.565+0000 7fc365f63640 1 -- 172.21.15.131:0/1567789493 >> 172.21.15.131:0/1567789493 conn(0x7fc3600b4250 msgr2=0x7fc3600b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:14.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.565+0000 7fc365f63640 1 -- 172.21.15.131:0/1567789493 shutdown_connections 2024-05-17T11:53:14.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.565+0000 7fc365f63640 1 -- 172.21.15.131:0/1567789493 wait complete. 2024-05-17T11:53:14.579 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-17T11:53:14.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.903+0000 7f212f674640 1 Processor -- start 2024-05-17T11:53:14.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.904+0000 7f212f674640 1 -- start start 2024-05-17T11:53:14.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.905+0000 7f212f674640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f212806dcb0 0x7f212815bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:14.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.905+0000 7f212f674640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f212806cf80 0x7f212806d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:14.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.905+0000 7f212f674640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212806d8d0 con 0x7f21280b3e60 2024-05-17T11:53:14.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.905+0000 7f212f674640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f212815c0c0 con 0x7f212806cf80 2024-05-17T11:53:14.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.905+0000 7f212f674640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f21280cbce0 con 0x7f212806dcb0 2024-05-17T11:53:14.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.905+0000 7f212dc11640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f212806cf80 0x7f212806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:14.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.905+0000 7f212dc11640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f212806cf80 0x7f212806d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54514/0 (socket says 172.21.15.131:54514) 2024-05-17T11:53:14.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.905+0000 7f212dc11640 1 -- 172.21.15.131:0/1487022685 learned_addr learned my addr 172.21.15.131:0/1487022685 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:14.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.906+0000 7f212cc0f640 1 --2- 172.21.15.131:0/1487022685 >> v2:172.21.15.150:3300/0 conn(0x7f212806dcb0 0x7f212815bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:14.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.906+0000 7f212dc11640 1 -- 172.21.15.131:0/1487022685 >> v2:172.21.15.150:3300/0 conn(0x7f212806dcb0 msgr2=0x7f212815bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:14.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.906+0000 7f212dc11640 1 --2- 172.21.15.131:0/1487022685 >> v2:172.21.15.150:3300/0 conn(0x7f212806dcb0 0x7f212815bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:14.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.906+0000 7f211bfff640 1 -- 172.21.15.131:0/1487022685 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529909960 0 0) 0x7f2124001110 con 0x7f21280b3e60 2024-05-17T11:53:14.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.906+0000 7f212dc11640 1 -- 172.21.15.131:0/1487022685 >> v1:172.21.15.150:6789/0 conn(0x7f21280b3e60 legacy=0x7f21280cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:14.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.906+0000 7f212dc11640 1 -- 172.21.15.131:0/1487022685 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21280cbfc0 con 0x7f212806cf80 2024-05-17T11:53:14.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.907+0000 7f212dc11640 1 --2- 172.21.15.131:0/1487022685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f212806cf80 0x7f212806d390 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f21280cbc10 tx=0x7f212002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ee0f17f48cfe67 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:14.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.907+0000 7f211bfff640 1 -- 172.21.15.131:0/1487022685 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2120037070 con 0x7f212806cf80 2024-05-17T11:53:14.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.907+0000 7f211bfff640 1 -- 172.21.15.131:0/1487022685 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2120032440 con 0x7f212806cf80 2024-05-17T11:53:14.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.907+0000 7f211bfff640 1 -- 172.21.15.131:0/1487022685 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2120032810 con 0x7f212806cf80 2024-05-17T11:53:14.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.909+0000 7f212f674640 1 -- 172.21.15.131:0/1487022685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f212806cf80 msgr2=0x7f212806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:14.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.909+0000 7f212f674640 1 --2- 172.21.15.131:0/1487022685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f212806cf80 0x7f212806d390 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f21280cbc10 tx=0x7f212002a1e0 comp rx=0 tx=0).stop 2024-05-17T11:53:14.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.909+0000 7f212f674640 1 -- 172.21.15.131:0/1487022685 shutdown_connections 2024-05-17T11:53:14.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.909+0000 7f212f674640 1 --2- 172.21.15.131:0/1487022685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f212806cf80 0x7f212806d390 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:14.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.909+0000 7f212f674640 1 --2- 172.21.15.131:0/1487022685 >> v2:172.21.15.150:3300/0 conn(0x7f212806dcb0 0x7f212815bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:14.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.909+0000 7f212f674640 1 -- 172.21.15.131:0/1487022685 >> 172.21.15.131:0/1487022685 conn(0x7f21280cd930 msgr2=0x7f21280cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:14.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.910+0000 7f212f674640 1 -- 172.21.15.131:0/1487022685 shutdown_connections 2024-05-17T11:53:14.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.910+0000 7f212f674640 1 -- 172.21.15.131:0/1487022685 wait complete. 2024-05-17T11:53:14.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.912+0000 7f212f674640 1 Processor -- start 2024-05-17T11:53:14.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.912+0000 7f212f674640 1 -- start start 2024-05-17T11:53:14.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.913+0000 7f212f674640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212806cf80 0x7f21280b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:14.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.913+0000 7f212f674640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f212806dcb0 0x7f2128150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:14.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.913+0000 7f212f674640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21280b3e60 0x7f21281549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:14.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.913+0000 7f212f674640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f212806c6f0 con 0x7f212806dcb0 2024-05-17T11:53:14.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.913+0000 7f212f674640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2128072f10 con 0x7f212806cf80 2024-05-17T11:53:14.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.913+0000 7f212f674640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f212806c870 con 0x7f21280b3e60 2024-05-17T11:53:14.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.913+0000 7f212cc0f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f212806dcb0 0x7f2128150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:14.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.913+0000 7f212cc0f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f212806dcb0 0x7f2128150f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54528/0 (socket says 172.21.15.131:54528) 2024-05-17T11:53:14.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.913+0000 7f212cc0f640 1 -- 172.21.15.131:0/1024599831 learned_addr learned my addr 172.21.15.131:0/1024599831 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:14.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.914+0000 7f212dc11640 1 --2- 172.21.15.131:0/1024599831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21280b3e60 0x7f21281549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:14.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.914+0000 7f212d410640 1 --2- 172.21.15.131:0/1024599831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212806cf80 0x7f21280b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:14.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.914+0000 7f212cc0f640 1 -- 172.21.15.131:0/1024599831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21280b3e60 msgr2=0x7f21281549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:14.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.914+0000 7f212cc0f640 1 --2- 172.21.15.131:0/1024599831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21280b3e60 0x7f21281549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:14.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.914+0000 7f212cc0f640 1 -- 172.21.15.131:0/1024599831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212806cf80 msgr2=0x7f21280b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:14.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.914+0000 7f212cc0f640 1 --2- 172.21.15.131:0/1024599831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212806cf80 0x7f21280b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:14.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.914+0000 7f212cc0f640 1 -- 172.21.15.131:0/1024599831 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2128158d90 con 0x7f212806dcb0 2024-05-17T11:53:14.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.914+0000 7f212d410640 1 --2- 172.21.15.131:0/1024599831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212806cf80 0x7f21280b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T11:53:14.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.914+0000 7f212cc0f640 1 --2- 172.21.15.131:0/1024599831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f212806dcb0 0x7f2128150f00 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f211c009d10 tx=0x7f211c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:14.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.915+0000 7f2119ffb640 1 -- 172.21.15.131:0/1024599831 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c018020 con 0x7f212806dcb0 2024-05-17T11:53:14.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.915+0000 7f2119ffb640 1 -- 172.21.15.131:0/1024599831 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f211c014480 con 0x7f212806dcb0 2024-05-17T11:53:14.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.915+0000 7f212f674640 1 -- 172.21.15.131:0/1024599831 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2128159030 con 0x7f212806dcb0 2024-05-17T11:53:14.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.915+0000 7f2119ffb640 1 -- 172.21.15.131:0/1024599831 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c014830 con 0x7f212806dcb0 2024-05-17T11:53:14.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.915+0000 7f212f674640 1 -- 172.21.15.131:0/1024599831 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21281595f0 con 0x7f212806dcb0 2024-05-17T11:53:14.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.917+0000 7f212f674640 1 -- 172.21.15.131:0/1024599831 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21280b4f50 con 0x7f212806dcb0 2024-05-17T11:53:14.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.920+0000 7f2119ffb640 1 -- 172.21.15.131:0/1024599831 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f211c005d10 con 0x7f212806dcb0 2024-05-17T11:53:14.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.921+0000 7f2119ffb640 1 --2- 172.21.15.131:0/1024599831 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f210c0762d0 0x7f210c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:14.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.921+0000 7f2119ffb640 1 -- 172.21.15.131:0/1024599831 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6216+0+0 (secure 0 0 0) 0x7f211c0983f0 con 0x7f212806dcb0 2024-05-17T11:53:14.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.921+0000 7f212d410640 1 --2- 172.21.15.131:0/1024599831 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f210c0762d0 0x7f210c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:14.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.921+0000 7f212d410640 1 --2- 172.21.15.131:0/1024599831 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f210c0762d0 0x7f210c0787e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2124000f60 tx=0x7f2124009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:14.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:14.926+0000 7f2119ffb640 1 -- 172.21.15.131:0/1024599831 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f211c022030 con 0x7f212806dcb0 2024-05-17T11:53:15.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.109+0000 7f212f674640 1 -- 172.21.15.131:0/1024599831 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f212806cc80 con 0x7f212806dcb0 2024-05-17T11:53:15.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.568+0000 7f2119ffb640 1 -- 172.21.15.131:0/1024599831 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) ==== 181+0+0 (secure 0 0 0) 0x7f211c010040 con 0x7f212806dcb0 2024-05-17T11:53:15.554 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_metadata' removed 2024-05-17T11:53:15.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.576+0000 7f212f674640 1 -- 172.21.15.131:0/1024599831 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f210c0762d0 msgr2=0x7f210c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:15.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.576+0000 7f212f674640 1 --2- 172.21.15.131:0/1024599831 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f210c0762d0 0x7f210c0787e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2124000f60 tx=0x7f2124009040 comp rx=0 tx=0).stop 2024-05-17T11:53:15.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.576+0000 7f212f674640 1 -- 172.21.15.131:0/1024599831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f212806dcb0 msgr2=0x7f2128150f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:15.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.576+0000 7f212f674640 1 --2- 172.21.15.131:0/1024599831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f212806dcb0 0x7f2128150f00 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f211c009d10 tx=0x7f211c00c490 comp rx=0 tx=0).stop 2024-05-17T11:53:15.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.577+0000 7f212f674640 1 -- 172.21.15.131:0/1024599831 shutdown_connections 2024-05-17T11:53:15.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.577+0000 7f212f674640 1 --2- 172.21.15.131:0/1024599831 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f210c0762d0 0x7f210c0787e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:15.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.577+0000 7f212f674640 1 --2- 172.21.15.131:0/1024599831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f212806dcb0 0x7f2128150f00 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:15.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.577+0000 7f212f674640 1 --2- 172.21.15.131:0/1024599831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21280b3e60 0x7f21281549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:15.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.577+0000 7f212f674640 1 --2- 172.21.15.131:0/1024599831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f212806cf80 0x7f21280b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:15.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.577+0000 7f212f674640 1 -- 172.21.15.131:0/1024599831 >> 172.21.15.131:0/1024599831 conn(0x7f21280cd930 msgr2=0x7f212806e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:15.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.577+0000 7f212f674640 1 -- 172.21.15.131:0/1024599831 shutdown_connections 2024-05-17T11:53:15.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.578+0000 7f212f674640 1 -- 172.21.15.131:0/1024599831 wait complete. 2024-05-17T11:53:15.601 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-17T11:53:15.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.956+0000 7fb003038640 1 Processor -- start 2024-05-17T11:53:15.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.956+0000 7fb003038640 1 -- start start 2024-05-17T11:53:15.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.960+0000 7fb003038640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faffc0b6d20 0x7faffc0b7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:15.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.960+0000 7fb003038640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faffc15ee40 0x7faffc15f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:15.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.960+0000 7fb003038640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faffc0b7670 con 0x7faffc154600 2024-05-17T11:53:15.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.960+0000 7fb003038640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7faffc15da30 con 0x7faffc15ee40 2024-05-17T11:53:15.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.960+0000 7fb003038640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7faffc15dcf0 con 0x7faffc0b6d20 2024-05-17T11:53:15.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.960+0000 7fb000dd4640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7faffc154600 0x7faffc071280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:47852/0 (socket says 172.21.15.131:47852) 2024-05-17T11:53:15.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.960+0000 7fb000dd4640 1 -- 172.21.15.131:0/3626584247 learned_addr learned my addr 172.21.15.131:0/3626584247 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:15.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.960+0000 7faffbfff640 1 --2- 172.21.15.131:0/3626584247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faffc0b6d20 0x7faffc0b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:15.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.960+0000 7fb0015d5640 1 --2- 172.21.15.131:0/3626584247 >> v2:172.21.15.131:3300/0 conn(0x7faffc15ee40 0x7faffc15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:15.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.960+0000 7faffb7fe640 1 -- 172.21.15.131:0/3626584247 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143816536 0 0) 0x7fafec001110 con 0x7faffc154600 2024-05-17T11:53:15.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.961+0000 7faffb7fe640 1 -- 172.21.15.131:0/3626584247 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafe8003520 con 0x7faffc154600 2024-05-17T11:53:15.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.961+0000 7faffbfff640 1 -- 172.21.15.131:0/3626584247 >> v2:172.21.15.131:3300/0 conn(0x7faffc15ee40 msgr2=0x7faffc15f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:15.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.961+0000 7faffbfff640 1 --2- 172.21.15.131:0/3626584247 >> v2:172.21.15.131:3300/0 conn(0x7faffc15ee40 0x7faffc15f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:15.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.961+0000 7faffbfff640 1 -- 172.21.15.131:0/3626584247 >> v1:172.21.15.150:6789/0 conn(0x7faffc154600 legacy=0x7faffc071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:15.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.961+0000 7faffbfff640 1 -- 172.21.15.131:0/3626584247 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faffc15dfd0 con 0x7faffc0b6d20 2024-05-17T11:53:15.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.961+0000 7fb0015d5640 1 --2- 172.21.15.131:0/3626584247 >> v2:172.21.15.131:3300/0 conn(0x7faffc15ee40 0x7faffc15f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:15.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.962+0000 7faffbfff640 1 --2- 172.21.15.131:0/3626584247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faffc0b6d20 0x7faffc0b7130 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fafe40097a0 tx=0x7fafe402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a044fc4ea10fcbc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:15.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.963+0000 7faffb7fe640 1 -- 172.21.15.131:0/3626584247 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe4037070 con 0x7faffc0b6d20 2024-05-17T11:53:15.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.963+0000 7faffb7fe640 1 -- 172.21.15.131:0/3626584247 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe402ae50 con 0x7faffc0b6d20 2024-05-17T11:53:15.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.963+0000 7faffb7fe640 1 -- 172.21.15.131:0/3626584247 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe4032660 con 0x7faffc0b6d20 2024-05-17T11:53:15.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.965+0000 7fb003038640 1 -- 172.21.15.131:0/3626584247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faffc0b6d20 msgr2=0x7faffc0b7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:15.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.965+0000 7fb003038640 1 --2- 172.21.15.131:0/3626584247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faffc0b6d20 0x7faffc0b7130 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fafe40097a0 tx=0x7fafe402a100 comp rx=0 tx=0).stop 2024-05-17T11:53:15.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.965+0000 7fb003038640 1 -- 172.21.15.131:0/3626584247 shutdown_connections 2024-05-17T11:53:15.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.965+0000 7fb003038640 1 --2- 172.21.15.131:0/3626584247 >> v2:172.21.15.131:3300/0 conn(0x7faffc15ee40 0x7faffc15f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:15.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.965+0000 7fb003038640 1 --2- 172.21.15.131:0/3626584247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faffc0b6d20 0x7faffc0b7130 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:15.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.965+0000 7fb003038640 1 -- 172.21.15.131:0/3626584247 >> 172.21.15.131:0/3626584247 conn(0x7faffc06cf80 msgr2=0x7faffc06d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:15.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.965+0000 7fb003038640 1 -- 172.21.15.131:0/3626584247 shutdown_connections 2024-05-17T11:53:15.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.965+0000 7fb003038640 1 -- 172.21.15.131:0/3626584247 wait complete. 2024-05-17T11:53:15.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.970+0000 7fb003038640 1 Processor -- start 2024-05-17T11:53:15.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.970+0000 7fb003038640 1 -- start start 2024-05-17T11:53:15.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.974+0000 7fb003038640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faffc0b6d20 0x7faffc15a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:15.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.974+0000 7fb003038640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faffc154600 0x7faffc0cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:15.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.974+0000 7fb003038640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faffc15ee40 0x7faffc154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:15.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.974+0000 7fb003038640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faffc15e870 con 0x7faffc0b6d20 2024-05-17T11:53:15.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.974+0000 7fb003038640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faffc15e590 con 0x7faffc15ee40 2024-05-17T11:53:15.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.974+0000 7fb003038640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7faffc070ae0 con 0x7faffc154600 2024-05-17T11:53:15.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.974+0000 7fb000dd4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faffc0b6d20 0x7faffc15a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:15.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.974+0000 7fb000dd4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faffc0b6d20 0x7faffc15a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54542/0 (socket says 172.21.15.131:54542) 2024-05-17T11:53:15.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.974+0000 7fb000dd4640 1 -- 172.21.15.131:0/284820139 learned_addr learned my addr 172.21.15.131:0/284820139 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:15.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.974+0000 7faffbfff640 1 --2- 172.21.15.131:0/284820139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faffc154600 0x7faffc0cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:15.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.974+0000 7fb0015d5640 1 --2- 172.21.15.131:0/284820139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faffc15ee40 0x7faffc154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:15.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.975+0000 7fb000dd4640 1 -- 172.21.15.131:0/284820139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faffc154600 msgr2=0x7faffc0cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:15.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.975+0000 7fb000dd4640 1 --2- 172.21.15.131:0/284820139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faffc154600 0x7faffc0cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:15.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.975+0000 7fb000dd4640 1 -- 172.21.15.131:0/284820139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faffc15ee40 msgr2=0x7faffc154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:15.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.975+0000 7fb000dd4640 1 --2- 172.21.15.131:0/284820139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faffc15ee40 0x7faffc154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:15.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.975+0000 7fb000dd4640 1 -- 172.21.15.131:0/284820139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faffc14c5f0 con 0x7faffc0b6d20 2024-05-17T11:53:15.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.975+0000 7fb000dd4640 1 --2- 172.21.15.131:0/284820139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faffc0b6d20 0x7faffc15a5a0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fafec00c700 tx=0x7fafec00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:15.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.976+0000 7faff97fa640 1 -- 172.21.15.131:0/284820139 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec017070 con 0x7faffc0b6d20 2024-05-17T11:53:15.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.976+0000 7fb003038640 1 -- 172.21.15.131:0/284820139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faffc14c8d0 con 0x7faffc0b6d20 2024-05-17T11:53:15.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.976+0000 7faff97fa640 1 -- 172.21.15.131:0/284820139 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafec005ce0 con 0x7faffc0b6d20 2024-05-17T11:53:15.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.976+0000 7faff97fa640 1 -- 172.21.15.131:0/284820139 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec0072d0 con 0x7faffc0b6d20 2024-05-17T11:53:15.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.976+0000 7fb003038640 1 -- 172.21.15.131:0/284820139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faffc159da0 con 0x7faffc0b6d20 2024-05-17T11:53:15.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.978+0000 7fb003038640 1 -- 172.21.15.131:0/284820139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faffc06e630 con 0x7faffc0b6d20 2024-05-17T11:53:15.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.980+0000 7faff97fa640 1 -- 172.21.15.131:0/284820139 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fafec01a070 con 0x7faffc0b6d20 2024-05-17T11:53:15.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.981+0000 7faff97fa640 1 --2- 172.21.15.131:0/284820139 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fafdc0762d0 0x7fafdc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:15.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.981+0000 7faff97fa640 1 -- 172.21.15.131:0/284820139 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5778+0+0 (secure 0 0 0) 0x7fafec0969f0 con 0x7faffc0b6d20 2024-05-17T11:53:15.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.981+0000 7faffbfff640 1 --2- 172.21.15.131:0/284820139 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fafdc0762d0 0x7fafdc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:15.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.982+0000 7faffbfff640 1 --2- 172.21.15.131:0/284820139 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fafdc0762d0 0x7fafdc0787e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fafe4034000 tx=0x7fafe402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:15.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:15.995+0000 7faff97fa640 1 -- 172.21.15.131:0/284820139 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faffc06e630 con 0x7faffc0b6d20 2024-05-17T11:53:16.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:16.656+0000 7fb003038640 1 -- 172.21.15.131:0/284820139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7faffc0b7130 con 0x7faffc0b6d20 2024-05-17T11:53:17.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:17.576+0000 7faff97fa640 1 -- 172.21.15.131:0/284820139 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) ==== 169+0+0 (secure 0 0 0) 0x7faffc0b7670 con 0x7faffc0b6d20 2024-05-17T11:53:17.562 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_data' removed 2024-05-17T11:53:17.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:17.586+0000 7fb003038640 1 -- 172.21.15.131:0/284820139 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fafdc0762d0 msgr2=0x7fafdc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:17.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:17.586+0000 7fb003038640 1 --2- 172.21.15.131:0/284820139 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fafdc0762d0 0x7fafdc0787e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fafe4034000 tx=0x7fafe402e000 comp rx=0 tx=0).stop 2024-05-17T11:53:17.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:17.586+0000 7fb003038640 1 -- 172.21.15.131:0/284820139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faffc0b6d20 msgr2=0x7faffc15a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:17.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:17.586+0000 7fb003038640 1 --2- 172.21.15.131:0/284820139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faffc0b6d20 0x7faffc15a5a0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fafec00c700 tx=0x7fafec00cb00 comp rx=0 tx=0).stop 2024-05-17T11:53:17.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:17.587+0000 7fb003038640 1 -- 172.21.15.131:0/284820139 shutdown_connections 2024-05-17T11:53:17.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:17.587+0000 7fb003038640 1 --2- 172.21.15.131:0/284820139 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fafdc0762d0 0x7fafdc0787e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:17.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:17.587+0000 7fb003038640 1 --2- 172.21.15.131:0/284820139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faffc15ee40 0x7faffc154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:17.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:17.587+0000 7fb003038640 1 --2- 172.21.15.131:0/284820139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faffc154600 0x7faffc0cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:17.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:17.587+0000 7fb003038640 1 --2- 172.21.15.131:0/284820139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faffc0b6d20 0x7faffc15a5a0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:17.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:17.587+0000 7fb003038640 1 -- 172.21.15.131:0/284820139 >> 172.21.15.131:0/284820139 conn(0x7faffc06cf80 msgr2=0x7faffc0b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:17.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:17.587+0000 7fb003038640 1 -- 172.21.15.131:0/284820139 shutdown_connections 2024-05-17T11:53:17.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:17.587+0000 7fb003038640 1 -- 172.21.15.131:0/284820139 wait complete. 2024-05-17T11:53:17.614 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-17T11:53:18.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.066+0000 7f5379c4e640 1 Processor -- start 2024-05-17T11:53:18.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.066+0000 7f5379c4e640 1 -- start start 2024-05-17T11:53:18.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.068+0000 7f5379c4e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f53740cfe00 0x7f537415c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:18.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.068+0000 7f5379c4e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53740d0210 con 0x7f53740b6ef0 2024-05-17T11:53:18.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.068+0000 7f5379c4e640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f537415ccf0 con 0x7f53740d1470 2024-05-17T11:53:18.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.068+0000 7f5379c4e640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f537415d870 con 0x7f53740cfe00 2024-05-17T11:53:18.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.068+0000 7f5373fff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f53740b6ef0 0x7f53740ced00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38702/0 (socket says 172.21.15.131:38702) 2024-05-17T11:53:18.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.068+0000 7f5373fff640 1 -- 172.21.15.131:0/2023052543 learned_addr learned my addr 172.21.15.131:0/2023052543 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:18.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.069+0000 7f53737fe640 1 --2- 172.21.15.131:0/2023052543 >> v2:172.21.15.131:3300/0 conn(0x7f53740cfe00 0x7f537415c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:18.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.069+0000 7f53737fe640 1 -- 172.21.15.131:0/2023052543 >> v1:172.21.15.150:6789/0 conn(0x7f53740d1470 legacy=0x7f53740b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:18.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.069+0000 7f53737fe640 1 -- 172.21.15.131:0/2023052543 >> v1:172.21.15.131:6789/0 conn(0x7f53740b6ef0 legacy=0x7f53740ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:18.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.069+0000 7f53737fe640 1 -- 172.21.15.131:0/2023052543 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537415cfd0 con 0x7f53740cfe00 2024-05-17T11:53:18.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.071+0000 7f53737fe640 1 --2- 172.21.15.131:0/2023052543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53740cfe00 0x7f537415c3f0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f536c009df0 tx=0x7f536c02e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b375c08f219f5a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:18.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.071+0000 7f53727fc640 1 -- 172.21.15.131:0/2023052543 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c038020 con 0x7f53740cfe00 2024-05-17T11:53:18.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.071+0000 7f53727fc640 1 -- 172.21.15.131:0/2023052543 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536c034640 con 0x7f53740cfe00 2024-05-17T11:53:18.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.071+0000 7f53727fc640 1 -- 172.21.15.131:0/2023052543 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c030040 con 0x7f53740cfe00 2024-05-17T11:53:18.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.072+0000 7f5379c4e640 1 -- 172.21.15.131:0/2023052543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53740cfe00 msgr2=0x7f537415c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:18.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.072+0000 7f5379c4e640 1 --2- 172.21.15.131:0/2023052543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53740cfe00 0x7f537415c3f0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f536c009df0 tx=0x7f536c02e950 comp rx=0 tx=0).stop 2024-05-17T11:53:18.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.073+0000 7f5379c4e640 1 -- 172.21.15.131:0/2023052543 shutdown_connections 2024-05-17T11:53:18.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.073+0000 7f5379c4e640 1 --2- 172.21.15.131:0/2023052543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53740cfe00 0x7f537415c3f0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:18.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.073+0000 7f5379c4e640 1 -- 172.21.15.131:0/2023052543 >> 172.21.15.131:0/2023052543 conn(0x7f5374074670 msgr2=0x7f53740b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:18.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.073+0000 7f5379c4e640 1 -- 172.21.15.131:0/2023052543 shutdown_connections 2024-05-17T11:53:18.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.073+0000 7f5379c4e640 1 -- 172.21.15.131:0/2023052543 wait complete. 2024-05-17T11:53:18.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.081+0000 7f5379c4e640 1 Processor -- start 2024-05-17T11:53:18.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.082+0000 7f5379c4e640 1 -- start start 2024-05-17T11:53:18.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.088+0000 7f5379c4e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53740cfe00 0x7f5374156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:18.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.088+0000 7f5379c4e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53740d1470 0x7f53740ab100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:18.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.089+0000 7f53737fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53740cfe00 0x7f5374156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:18.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.089+0000 7f53737fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53740cfe00 0x7f5374156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:39730/0 (socket says 172.21.15.131:39730) 2024-05-17T11:53:18.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.089+0000 7f5372ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53740d1470 0x7f53740ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:18.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.089+0000 7f5372ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53740d1470 0x7f53740ab100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54566/0 (socket says 172.21.15.131:54566) 2024-05-17T11:53:18.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.089+0000 7f53737fe640 1 -- 172.21.15.131:0/32281755 learned_addr learned my addr 172.21.15.131:0/32281755 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:18.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.090+0000 7f5379c4e640 1 --2- 172.21.15.131:0/32281755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53740aa440 0x7f53740aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:18.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.090+0000 7f5379c4e640 1 -- 172.21.15.131:0/32281755 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f537415c930 con 0x7f53740d1470 2024-05-17T11:53:18.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.090+0000 7f5379c4e640 1 -- 172.21.15.131:0/32281755 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f537415d590 con 0x7f53740aa440 2024-05-17T11:53:18.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.090+0000 7f5379c4e640 1 -- 172.21.15.131:0/32281755 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f537415cab0 con 0x7f53740cfe00 2024-05-17T11:53:18.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.090+0000 7f5373fff640 1 --2- 172.21.15.131:0/32281755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53740aa440 0x7f53740aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:18.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.091+0000 7f53737fe640 1 -- 172.21.15.131:0/32281755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53740aa440 msgr2=0x7f53740aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:18.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.091+0000 7f53737fe640 1 --2- 172.21.15.131:0/32281755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53740aa440 0x7f53740aa850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:18.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.091+0000 7f53737fe640 1 -- 172.21.15.131:0/32281755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53740d1470 msgr2=0x7f53740ab100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:18.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.091+0000 7f53737fe640 1 --2- 172.21.15.131:0/32281755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53740d1470 0x7f53740ab100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:18.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.091+0000 7f53737fe640 1 -- 172.21.15.131:0/32281755 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53740ad1b0 con 0x7f53740cfe00 2024-05-17T11:53:18.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.091+0000 7f5372ffd640 1 --2- 172.21.15.131:0/32281755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53740d1470 0x7f53740ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:18.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.093+0000 7f53737fe640 1 --2- 172.21.15.131:0/32281755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53740cfe00 0x7f5374156b20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f536c009df0 tx=0x7f536c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:18.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.094+0000 7f535bfff640 1 -- 172.21.15.131:0/32281755 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c043070 con 0x7f53740cfe00 2024-05-17T11:53:18.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.094+0000 7f535bfff640 1 -- 172.21.15.131:0/32281755 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536c033b00 con 0x7f53740cfe00 2024-05-17T11:53:18.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.094+0000 7f535bfff640 1 -- 172.21.15.131:0/32281755 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c0102f0 con 0x7f53740cfe00 2024-05-17T11:53:18.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.095+0000 7f5379c4e640 1 -- 172.21.15.131:0/32281755 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53740aad90 con 0x7f53740cfe00 2024-05-17T11:53:18.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.096+0000 7f5379c4e640 1 -- 172.21.15.131:0/32281755 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f53740ac910 con 0x7f53740cfe00 2024-05-17T11:53:18.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.097+0000 7f5379c4e640 1 -- 172.21.15.131:0/32281755 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53740d19a0 con 0x7f53740cfe00 2024-05-17T11:53:18.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.098+0000 7f535bfff640 1 -- 172.21.15.131:0/32281755 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f536c03b020 con 0x7f53740cfe00 2024-05-17T11:53:18.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.099+0000 7f535bfff640 1 --2- 172.21.15.131:0/32281755 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f53600762d0 0x7f53600787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:18.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.099+0000 7f535bfff640 1 -- 172.21.15.131:0/32281755 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f536c0b8650 con 0x7f53740cfe00 2024-05-17T11:53:18.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.100+0000 7f5372ffd640 1 --2- 172.21.15.131:0/32281755 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f53600762d0 0x7f53600787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:18.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.101+0000 7f5372ffd640 1 --2- 172.21.15.131:0/32281755 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f53600762d0 0x7f53600787e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f53740d1180 tx=0x7f5368009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:18.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.107+0000 7f535bfff640 1 -- 172.21.15.131:0/32281755 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f53740aad90 con 0x7f53740cfe00 2024-05-17T11:53:18.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.355+0000 7f5379c4e640 1 -- 172.21.15.131:0/32281755 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f5374157350 con 0x7f53740cfe00 2024-05-17T11:53:18.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.360+0000 7f535bfff640 1 -- 172.21.15.131:0/32281755 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f53740ad1b0 con 0x7f53740cfe00 2024-05-17T11:53:18.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.363+0000 7f5379c4e640 1 -- 172.21.15.131:0/32281755 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f53600762d0 msgr2=0x7f53600787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:18.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.363+0000 7f5379c4e640 1 --2- 172.21.15.131:0/32281755 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f53600762d0 0x7f53600787e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f53740d1180 tx=0x7f5368009060 comp rx=0 tx=0).stop 2024-05-17T11:53:18.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.363+0000 7f5379c4e640 1 -- 172.21.15.131:0/32281755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53740cfe00 msgr2=0x7f5374156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:18.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.363+0000 7f5379c4e640 1 --2- 172.21.15.131:0/32281755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53740cfe00 0x7f5374156b20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f536c009df0 tx=0x7f536c004ab0 comp rx=0 tx=0).stop 2024-05-17T11:53:18.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.363+0000 7f5379c4e640 1 -- 172.21.15.131:0/32281755 shutdown_connections 2024-05-17T11:53:18.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.363+0000 7f5379c4e640 1 --2- 172.21.15.131:0/32281755 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f53600762d0 0x7f53600787e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:18.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.363+0000 7f5379c4e640 1 --2- 172.21.15.131:0/32281755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53740d1470 0x7f53740ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:18.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.363+0000 7f5379c4e640 1 --2- 172.21.15.131:0/32281755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53740aa440 0x7f53740aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:18.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.363+0000 7f5379c4e640 1 --2- 172.21.15.131:0/32281755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53740cfe00 0x7f5374156b20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:18.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.363+0000 7f5379c4e640 1 -- 172.21.15.131:0/32281755 >> 172.21.15.131:0/32281755 conn(0x7f5374074670 msgr2=0x7f537415d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:18.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.363+0000 7f5379c4e640 1 -- 172.21.15.131:0/32281755 shutdown_connections 2024-05-17T11:53:18.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.363+0000 7f5379c4e640 1 -- 172.21.15.131:0/32281755 wait complete. 2024-05-17T11:53:18.387 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-05-17T11:53:18.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.707+0000 7f10af81d640 1 Processor -- start 2024-05-17T11:53:18.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.707+0000 7f10af81d640 1 -- start start 2024-05-17T11:53:18.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.711+0000 7f10af81d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f10a815f770 0x7f10a80d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:18.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.711+0000 7f10af81d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f10a80d3da0 0x7f10a80d41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:18.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.711+0000 7f10af81d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10a80d46f0 con 0x7f10a80cf880 2024-05-17T11:53:18.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.711+0000 7f10af81d640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f10a80d05b0 con 0x7f10a80d3da0 2024-05-17T11:53:18.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.711+0000 7f10af81d640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f10a80d0890 con 0x7f10a815f770 2024-05-17T11:53:18.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.711+0000 7f10acdb8640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f10a80d3da0 0x7f10a80d41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:18.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.712+0000 7f10addba640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f10a80cf880 0x7f10a80cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38718/0 (socket says 172.21.15.131:38718) 2024-05-17T11:53:18.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.712+0000 7f10addba640 1 -- 172.21.15.131:0/29321101 learned_addr learned my addr 172.21.15.131:0/29321101 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:18.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.712+0000 7f10acdb8640 1 --2- 172.21.15.131:0/29321101 >> v2:172.21.15.131:3300/0 conn(0x7f10a80d3da0 0x7f10a80d41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54580/0 (socket says 172.21.15.131:54580) 2024-05-17T11:53:18.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.712+0000 7f10ad5b9640 1 --2- 172.21.15.131:0/29321101 >> v2:172.21.15.150:3300/0 conn(0x7f10a815f770 0x7f10a80d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:18.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.712+0000 7f10acdb8640 1 -- 172.21.15.131:0/29321101 >> v2:172.21.15.150:3300/0 conn(0x7f10a815f770 msgr2=0x7f10a80d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:18.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.712+0000 7f10acdb8640 1 --2- 172.21.15.131:0/29321101 >> v2:172.21.15.150:3300/0 conn(0x7f10a815f770 0x7f10a80d1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:18.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.712+0000 7f10acdb8640 1 -- 172.21.15.131:0/29321101 >> v1:172.21.15.131:6789/0 conn(0x7f10a80cf880 legacy=0x7f10a80cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:18.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.712+0000 7f10acdb8640 1 -- 172.21.15.131:0/29321101 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a80d0b70 con 0x7f10a80d3da0 2024-05-17T11:53:18.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.714+0000 7f10acdb8640 1 --2- 172.21.15.131:0/29321101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a80d3da0 0x7f10a80d41b0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f10a80d4960 tx=0x7f109802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de637e5b328a3df server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:18.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.714+0000 7f109ffff640 1 -- 172.21.15.131:0/29321101 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098037070 con 0x7f10a80d3da0 2024-05-17T11:53:18.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.715+0000 7f109ffff640 1 -- 172.21.15.131:0/29321101 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1098032440 con 0x7f10a80d3da0 2024-05-17T11:53:18.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.715+0000 7f109ffff640 1 -- 172.21.15.131:0/29321101 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098032810 con 0x7f10a80d3da0 2024-05-17T11:53:18.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.716+0000 7f10af81d640 1 -- 172.21.15.131:0/29321101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a80d3da0 msgr2=0x7f10a80d41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:18.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.716+0000 7f10af81d640 1 --2- 172.21.15.131:0/29321101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a80d3da0 0x7f10a80d41b0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f10a80d4960 tx=0x7f109802a1a0 comp rx=0 tx=0).stop 2024-05-17T11:53:18.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.716+0000 7f10af81d640 1 -- 172.21.15.131:0/29321101 shutdown_connections 2024-05-17T11:53:18.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.716+0000 7f10af81d640 1 --2- 172.21.15.131:0/29321101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a80d3da0 0x7f10a80d41b0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:18.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.717+0000 7f10af81d640 1 --2- 172.21.15.131:0/29321101 >> v2:172.21.15.150:3300/0 conn(0x7f10a815f770 0x7f10a80d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:18.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.717+0000 7f10af81d640 1 -- 172.21.15.131:0/29321101 >> 172.21.15.131:0/29321101 conn(0x7f10a80d2300 msgr2=0x7f10a80b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:18.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.717+0000 7f10af81d640 1 -- 172.21.15.131:0/29321101 shutdown_connections 2024-05-17T11:53:18.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.717+0000 7f10af81d640 1 -- 172.21.15.131:0/29321101 wait complete. 2024-05-17T11:53:18.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.722+0000 7f10af81d640 1 Processor -- start 2024-05-17T11:53:18.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.722+0000 7f10af81d640 1 -- start start 2024-05-17T11:53:18.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.726+0000 7f10af81d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a80cf880 0x7f10a80cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:18.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.726+0000 7f10af81d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80d3da0 0x7f10a81f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:18.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.726+0000 7f10af81d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a815f770 0x7f10a81f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:18.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.726+0000 7f10af81d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f10a80b87c0 con 0x7f10a80cf880 2024-05-17T11:53:18.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.726+0000 7f10af81d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f10a80d1130 con 0x7f10a80d3da0 2024-05-17T11:53:18.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.726+0000 7f10af81d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f10a80b8940 con 0x7f10a815f770 2024-05-17T11:53:18.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.726+0000 7f10ad5b9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a80cf880 0x7f10a80cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:18.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.726+0000 7f10ad5b9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a80cf880 0x7f10a80cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54586/0 (socket says 172.21.15.131:54586) 2024-05-17T11:53:18.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.726+0000 7f10ad5b9640 1 -- 172.21.15.131:0/360283795 learned_addr learned my addr 172.21.15.131:0/360283795 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:18.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.726+0000 7f10addba640 1 --2- 172.21.15.131:0/360283795 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a815f770 0x7f10a81f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:18.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.726+0000 7f10acdb8640 1 --2- 172.21.15.131:0/360283795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80d3da0 0x7f10a81f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:18.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.727+0000 7f10ad5b9640 1 -- 172.21.15.131:0/360283795 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a815f770 msgr2=0x7f10a81f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:18.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.727+0000 7f10ad5b9640 1 --2- 172.21.15.131:0/360283795 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a815f770 0x7f10a81f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:18.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.727+0000 7f10ad5b9640 1 -- 172.21.15.131:0/360283795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80d3da0 msgr2=0x7f10a81f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:18.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.727+0000 7f10ad5b9640 1 --2- 172.21.15.131:0/360283795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80d3da0 0x7f10a81f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:18.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.727+0000 7f10ad5b9640 1 -- 172.21.15.131:0/360283795 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a80cc7d0 con 0x7f10a80cf880 2024-05-17T11:53:18.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.727+0000 7f10addba640 1 --2- 172.21.15.131:0/360283795 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a815f770 0x7f10a81f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:18.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.727+0000 7f10ad5b9640 1 --2- 172.21.15.131:0/360283795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a80cf880 0x7f10a80cc290 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009d10 tx=0x7f10a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:18.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.727+0000 7f109dffb640 1 -- 172.21.15.131:0/360283795 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a4018020 con 0x7f10a80cf880 2024-05-17T11:53:18.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.728+0000 7f109dffb640 1 -- 172.21.15.131:0/360283795 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a4014480 con 0x7f10a80cf880 2024-05-17T11:53:18.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.728+0000 7f10af81d640 1 -- 172.21.15.131:0/360283795 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a80ce900 con 0x7f10a80cf880 2024-05-17T11:53:18.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.728+0000 7f109dffb640 1 -- 172.21.15.131:0/360283795 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a4014830 con 0x7f10a80cf880 2024-05-17T11:53:18.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.728+0000 7f10af81d640 1 -- 172.21.15.131:0/360283795 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a80ceec0 con 0x7f10a80cf880 2024-05-17T11:53:18.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.730+0000 7f10af81d640 1 -- 172.21.15.131:0/360283795 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a80d41b0 con 0x7f10a80cf880 2024-05-17T11:53:18.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.732+0000 7f109dffb640 1 -- 172.21.15.131:0/360283795 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f10a4005d10 con 0x7f10a80cf880 2024-05-17T11:53:18.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.733+0000 7f109dffb640 1 --2- 172.21.15.131:0/360283795 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f108c0762d0 0x7f108c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:18.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.733+0000 7f109dffb640 1 -- 172.21.15.131:0/360283795 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f10a4098180 con 0x7f10a80cf880 2024-05-17T11:53:18.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.733+0000 7f10acdb8640 1 --2- 172.21.15.131:0/360283795 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f108c0762d0 0x7f108c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:18.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.734+0000 7f10acdb8640 1 --2- 172.21.15.131:0/360283795 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f108c0762d0 0x7f108c0787e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1098034000 tx=0x7f109802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:18.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:18.746+0000 7f109dffb640 1 -- 172.21.15.131:0/360283795 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f10a4022030 con 0x7f10a80cf880 2024-05-17T11:53:18.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:19.003+0000 7f10af81d640 1 -- 172.21.15.131:0/360283795 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f10a80b9f80 con 0x7f10a80cf880 2024-05-17T11:53:19.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:19.608+0000 7f109dffb640 1 -- 172.21.15.131:0/360283795 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v14003) ==== 144+0+0 (secure 0 0 0) 0x7f10a4010040 con 0x7f10a80cf880 2024-05-17T11:53:19.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:19.621+0000 7f10af81d640 1 -- 172.21.15.131:0/360283795 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f108c0762d0 msgr2=0x7f108c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:19.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:19.622+0000 7f10af81d640 1 --2- 172.21.15.131:0/360283795 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f108c0762d0 0x7f108c0787e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1098034000 tx=0x7f109802e000 comp rx=0 tx=0).stop 2024-05-17T11:53:19.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:19.622+0000 7f10af81d640 1 -- 172.21.15.131:0/360283795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a80cf880 msgr2=0x7f10a80cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:19.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:19.622+0000 7f10af81d640 1 --2- 172.21.15.131:0/360283795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a80cf880 0x7f10a80cc290 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009d10 tx=0x7f10a400c490 comp rx=0 tx=0).stop 2024-05-17T11:53:19.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:19.623+0000 7f10af81d640 1 -- 172.21.15.131:0/360283795 shutdown_connections 2024-05-17T11:53:19.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:19.623+0000 7f10af81d640 1 --2- 172.21.15.131:0/360283795 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f108c0762d0 0x7f108c0787e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:19.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:19.623+0000 7f10af81d640 1 --2- 172.21.15.131:0/360283795 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10a815f770 0x7f10a81f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:19.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:19.623+0000 7f10af81d640 1 --2- 172.21.15.131:0/360283795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10a80d3da0 0x7f10a81f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:19.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:19.623+0000 7f10af81d640 1 --2- 172.21.15.131:0/360283795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a80cf880 0x7f10a80cc290 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:19.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:19.624+0000 7f10af81d640 1 -- 172.21.15.131:0/360283795 >> 172.21.15.131:0/360283795 conn(0x7f10a80d2300 msgr2=0x7f10a80b6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:19.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:19.624+0000 7f10af81d640 1 -- 172.21.15.131:0/360283795 shutdown_connections 2024-05-17T11:53:19.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:19.624+0000 7f10af81d640 1 -- 172.21.15.131:0/360283795 wait complete. 2024-05-17T11:53:19.714 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2024-05-17T11:53:19.715 INFO:tasks.cephfs_test_runner: 2024-05-17T11:53:19.715 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-17T11:53:19.715 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-17T11:53:19.715 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-17T11:53:19.715 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-17T11:53:19.715 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_931809a9e5d295bd61984693cac44fe131ded4bc/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-05-17T11:53:19.715 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-05-17T11:53:19.715 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_931809a9e5d295bd61984693cac44fe131ded4bc/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-05-17T11:53:19.715 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-05-17T11:53:19.716 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_931809a9e5d295bd61984693cac44fe131ded4bc/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-05-17T11:53:19.716 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-05-17T11:53:19.716 INFO:tasks.cephfs_test_runner:AssertionError: 17 != 0 2024-05-17T11:53:19.716 INFO:tasks.cephfs_test_runner: 2024-05-17T11:53:19.716 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-17T11:53:19.716 INFO:tasks.cephfs_test_runner:Ran 1 test in 27823.357s 2024-05-17T11:53:19.716 INFO:tasks.cephfs_test_runner: 2024-05-17T11:53:19.716 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-05-17T11:53:19.716 INFO:tasks.cephfs_test_runner: 2024-05-17T11:53:19.716 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-17T11:53:19.716 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-17T11:53:19.716 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-17T11:53:19.716 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-17T11:53:19.716 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_931809a9e5d295bd61984693cac44fe131ded4bc/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-05-17T11:53:19.717 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-05-17T11:53:19.717 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_931809a9e5d295bd61984693cac44fe131ded4bc/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-05-17T11:53:19.717 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-05-17T11:53:19.717 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_931809a9e5d295bd61984693cac44fe131ded4bc/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-05-17T11:53:19.717 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-05-17T11:53:19.717 INFO:tasks.cephfs_test_runner:AssertionError: 17 != 0 2024-05-17T11:53:19.717 INFO:tasks.cephfs_test_runner: 2024-05-17T11:53:19.717 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a4b16c58a5d7aa60dee491f6f096b7509e2f1269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_931809a9e5d295bd61984693cac44fe131ded4bc/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-17T11:53:19.935 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9d882c244a86454f8d89ed4ddd7fed48 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a4b16c58a5d7aa60dee491f6f096b7509e2f1269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_931809a9e5d295bd61984693cac44fe131ded4bc/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-17T11:53:19.936 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-17T11:53:19.945 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-17T11:53:19.997 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-17T11:53:19.998 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T11:53:19.998 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T11:53:20.002 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:53:20.017 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:53:20.065 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056323,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=242 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-17T11:53:20.065 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-17T11:53:20.065 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T11:53:20.171 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056323,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=242 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-17T11:53:20.205 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T11:53:20.205 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T11:53:20.231 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056335,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14287 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-17T11:53:20.231 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-17T11:53:20.231 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-17T11:53:20.291 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056335,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14287 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-17T11:53:20.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T11:53:20.292 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-05-17T11:53:20.373 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-17T11:53:20.374 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-17T11:53:20.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T11:53:20.374 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-17T11:53:20.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T11:53:20.483 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-17T11:53:20.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T11:53:20.544 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2024-05-17T11:53:20.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T11:53:20.696 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-05-17T11:53:20.735 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-17T11:53:20.735 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-17T11:53:20.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T11:53:20.736 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-17T11:53:20.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T11:53:20.801 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-17T11:53:20.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-17T11:53:20.868 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-05-17T11:53:20.964 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-17T11:53:20.975 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-17T11:53:20.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-17T11:53:21.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.409+0000 7f9fe25c0640 1 Processor -- start 2024-05-17T11:53:21.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.409+0000 7f9fe25c0640 1 -- start start 2024-05-17T11:53:21.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.414+0000 7f9fe25c0640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9fdc163900 0x7f9fdc072310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:21.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.414+0000 7f9fe25c0640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fdc0b5b70 con 0x7f9fdc06f600 2024-05-17T11:53:21.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.414+0000 7f9fe25c0640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fdc0b5e50 con 0x7f9fdc0d0760 2024-05-17T11:53:21.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.414+0000 7f9fe25c0640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f9fdc163d10 con 0x7f9fdc163900 2024-05-17T11:53:21.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.414+0000 7f9fe1dbf640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f9fdc06f600 0x7f9fdc06fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38730/0 (socket says 172.21.15.131:38730) 2024-05-17T11:53:21.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.414+0000 7f9fe1dbf640 1 -- 172.21.15.131:0/1101925580 learned_addr learned my addr 172.21.15.131:0/1101925580 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:21.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.414+0000 7f9fe0dbd640 1 --2- 172.21.15.131:0/1101925580 >> v2:172.21.15.150:3300/0 conn(0x7f9fdc163900 0x7f9fdc072310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:21.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.414+0000 7f9fd3fff640 1 -- 172.21.15.131:0/1101925580 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1082045690 0 0) 0x7f9fdc0b5b70 con 0x7f9fdc06f600 2024-05-17T11:53:21.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.414+0000 7f9fd3fff640 1 -- 172.21.15.131:0/1101925580 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fc8003520 con 0x7f9fdc06f600 2024-05-17T11:53:21.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.415+0000 7f9fd3fff640 1 -- 172.21.15.131:0/1101925580 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3278622349 0 0) 0x7f9fdc0b5e50 con 0x7f9fdc0d0760 2024-05-17T11:53:21.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.415+0000 7f9fd3fff640 1 -- 172.21.15.131:0/1101925580 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fdc0b5b70 con 0x7f9fdc0d0760 2024-05-17T11:53:21.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.415+0000 7f9fd3fff640 1 -- 172.21.15.131:0/1101925580 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3361937792 0 0) 0x7f9fc8003520 con 0x7f9fdc06f600 2024-05-17T11:53:21.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.415+0000 7f9fe0dbd640 1 -- 172.21.15.131:0/1101925580 >> v1:172.21.15.150:6789/0 conn(0x7f9fdc0d0760 legacy=0x7f9fdc0b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:21.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.415+0000 7f9fe0dbd640 1 -- 172.21.15.131:0/1101925580 >> v1:172.21.15.131:6789/0 conn(0x7f9fdc06f600 legacy=0x7f9fdc06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:21.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.415+0000 7f9fe0dbd640 1 -- 172.21.15.131:0/1101925580 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc0b6130 con 0x7f9fdc163900 2024-05-17T11:53:21.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.416+0000 7f9fe0dbd640 1 --2- 172.21.15.131:0/1101925580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc163900 0x7f9fdc072310 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0097a0 tx=0x7f9fcc02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c457ee79c087a40 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:21.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.416+0000 7f9fd3fff640 1 -- 172.21.15.131:0/1101925580 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc037070 con 0x7f9fdc163900 2024-05-17T11:53:21.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.416+0000 7f9fd3fff640 1 -- 172.21.15.131:0/1101925580 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fcc02aba0 con 0x7f9fdc163900 2024-05-17T11:53:21.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.416+0000 7f9fd3fff640 1 -- 172.21.15.131:0/1101925580 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40016f0 con 0x7f9fdc163900 2024-05-17T11:53:21.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.417+0000 7f9fe25c0640 1 -- 172.21.15.131:0/1101925580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc163900 msgr2=0x7f9fdc072310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:21.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.417+0000 7f9fe25c0640 1 --2- 172.21.15.131:0/1101925580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc163900 0x7f9fdc072310 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0097a0 tx=0x7f9fcc02a110 comp rx=0 tx=0).stop 2024-05-17T11:53:21.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.417+0000 7f9fe25c0640 1 -- 172.21.15.131:0/1101925580 shutdown_connections 2024-05-17T11:53:21.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.417+0000 7f9fe25c0640 1 --2- 172.21.15.131:0/1101925580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc163900 0x7f9fdc072310 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:21.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.417+0000 7f9fe25c0640 1 -- 172.21.15.131:0/1101925580 >> 172.21.15.131:0/1101925580 conn(0x7f9fdc06cd20 msgr2=0x7f9fdc06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:21.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.417+0000 7f9fe25c0640 1 -- 172.21.15.131:0/1101925580 shutdown_connections 2024-05-17T11:53:21.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.418+0000 7f9fe25c0640 1 -- 172.21.15.131:0/1101925580 wait complete. 2024-05-17T11:53:21.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.423+0000 7f9fe25c0640 1 Processor -- start 2024-05-17T11:53:21.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.423+0000 7f9fe25c0640 1 -- start start 2024-05-17T11:53:21.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.427+0000 7f9fe25c0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fdc06f600 0x7f9fdc15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:21.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.427+0000 7f9fe25c0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9fdc0d0760 0x7f9fdc15c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:21.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.427+0000 7f9fe15be640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fdc06f600 0x7f9fdc15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:21.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.427+0000 7f9fe15be640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fdc06f600 0x7f9fdc15afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54588/0 (socket says 172.21.15.131:54588) 2024-05-17T11:53:21.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.427+0000 7f9fe25c0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc163900 0x7f9fdc1ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:21.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.427+0000 7f9fe15be640 1 -- 172.21.15.131:0/810067201 learned_addr learned my addr 172.21.15.131:0/810067201 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:21.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.427+0000 7f9fe0dbd640 1 --2- 172.21.15.131:0/810067201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9fdc0d0760 0x7f9fdc15c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:21.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.427+0000 7f9fe25c0640 1 -- 172.21.15.131:0/810067201 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc0cea00 con 0x7f9fdc06f600 2024-05-17T11:53:21.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.428+0000 7f9fe25c0640 1 -- 172.21.15.131:0/810067201 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc0ce880 con 0x7f9fdc163900 2024-05-17T11:53:21.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.428+0000 7f9fe25c0640 1 -- 172.21.15.131:0/810067201 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9fdc0cf140 con 0x7f9fdc0d0760 2024-05-17T11:53:21.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.428+0000 7f9fe1dbf640 1 --2- 172.21.15.131:0/810067201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc163900 0x7f9fdc1ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:21.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.428+0000 7f9fe1dbf640 1 -- 172.21.15.131:0/810067201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9fdc0d0760 msgr2=0x7f9fdc15c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:21.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.428+0000 7f9fe1dbf640 1 --2- 172.21.15.131:0/810067201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9fdc0d0760 0x7f9fdc15c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:21.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.428+0000 7f9fe1dbf640 1 -- 172.21.15.131:0/810067201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fdc06f600 msgr2=0x7f9fdc15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:21.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.429+0000 7f9fe1dbf640 1 --2- 172.21.15.131:0/810067201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fdc06f600 0x7f9fdc15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:21.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.429+0000 7f9fe1dbf640 1 -- 172.21.15.131:0/810067201 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc159f10 con 0x7f9fdc163900 2024-05-17T11:53:21.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.429+0000 7f9fe15be640 1 --2- 172.21.15.131:0/810067201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fdc06f600 0x7f9fdc15afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:21.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.429+0000 7f9fe1dbf640 1 --2- 172.21.15.131:0/810067201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc163900 0x7f9fdc1ed5e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400c400 tx=0x7f9fd400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:21.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.429+0000 7f9fd1ffb640 1 -- 172.21.15.131:0/810067201 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4017070 con 0x7f9fdc163900 2024-05-17T11:53:21.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.429+0000 7f9fd1ffb640 1 -- 172.21.15.131:0/810067201 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd4005d20 con 0x7f9fdc163900 2024-05-17T11:53:21.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.429+0000 7f9fd1ffb640 1 -- 172.21.15.131:0/810067201 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4007310 con 0x7f9fdc163900 2024-05-17T11:53:21.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.429+0000 7f9fe25c0640 1 -- 172.21.15.131:0/810067201 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fdc15a1f0 con 0x7f9fdc163900 2024-05-17T11:53:21.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.430+0000 7f9fe25c0640 1 -- 172.21.15.131:0/810067201 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fdc15a7b0 con 0x7f9fdc163900 2024-05-17T11:53:21.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.433+0000 7f9fe25c0640 1 -- 172.21.15.131:0/810067201 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fdc072310 con 0x7f9fdc163900 2024-05-17T11:53:21.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.435+0000 7f9fd1ffb640 1 -- 172.21.15.131:0/810067201 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9fd401a070 con 0x7f9fdc163900 2024-05-17T11:53:21.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.436+0000 7f9fd1ffb640 1 --2- 172.21.15.131:0/810067201 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9fc0076320 0x7f9fc0078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:21.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.436+0000 7f9fd1ffb640 1 -- 172.21.15.131:0/810067201 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f9fd4096740 con 0x7f9fdc163900 2024-05-17T11:53:21.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.436+0000 7f9fe15be640 1 --2- 172.21.15.131:0/810067201 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9fc0076320 0x7f9fc0078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:21.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.438+0000 7f9fe15be640 1 --2- 172.21.15.131:0/810067201 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9fc0076320 0x7f9fc0078830 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80012e0 tx=0x7f9fd8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:21.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:21.441+0000 7f9fd1ffb640 1 -- 172.21.15.131:0/810067201 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9fd405fc10 con 0x7f9fdc163900 2024-05-17T11:53:22.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.085+0000 7f9fe25c0640 1 -- 172.21.15.131:0/810067201 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9fdc06fd20 con 0x7f9fc0076320 2024-05-17T11:53:22.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.086+0000 7f9fd1ffb640 1 -- 172.21.15.131:0/810067201 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13695 (secure 0 0 0) 0x7f9fdc06fd20 con 0x7f9fc0076320 2024-05-17T11:53:22.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:53:22.072 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-05-17T11:53:22.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.091+0000 7f9fe25c0640 1 -- 172.21.15.131:0/810067201 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9fc0076320 msgr2=0x7f9fc0078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:22.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.092+0000 7f9fe25c0640 1 --2- 172.21.15.131:0/810067201 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9fc0076320 0x7f9fc0078830 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80012e0 tx=0x7f9fd8009040 comp rx=0 tx=0).stop 2024-05-17T11:53:22.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.092+0000 7f9fe25c0640 1 -- 172.21.15.131:0/810067201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc163900 msgr2=0x7f9fdc1ed5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:22.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.092+0000 7f9fe25c0640 1 --2- 172.21.15.131:0/810067201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc163900 0x7f9fdc1ed5e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400c400 tx=0x7f9fd400c8c0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.092+0000 7f9fe25c0640 1 -- 172.21.15.131:0/810067201 shutdown_connections 2024-05-17T11:53:22.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.092+0000 7f9fe25c0640 1 --2- 172.21.15.131:0/810067201 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f9fc0076320 0x7f9fc0078830 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.092+0000 7f9fe25c0640 1 --2- 172.21.15.131:0/810067201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fdc163900 0x7f9fdc1ed5e0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.092+0000 7f9fe25c0640 1 --2- 172.21.15.131:0/810067201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9fdc0d0760 0x7f9fdc15c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.092+0000 7f9fe25c0640 1 --2- 172.21.15.131:0/810067201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fdc06f600 0x7f9fdc15afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.092+0000 7f9fe25c0640 1 -- 172.21.15.131:0/810067201 >> 172.21.15.131:0/810067201 conn(0x7f9fdc06cd20 msgr2=0x7f9fdc0b4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:22.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.092+0000 7f9fe25c0640 1 -- 172.21.15.131:0/810067201 shutdown_connections 2024-05-17T11:53:22.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.092+0000 7f9fe25c0640 1 -- 172.21.15.131:0/810067201 wait complete. 2024-05-17T11:53:22.106 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":13963,"stamp":"2024-05-17T11:53:21.425935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":17036524,"kb_used_data":6242256,"kb_used_omap":4260,"kb_used_meta":10777627,"kb_avail":737938196,"statfs":{"total":773094113280,"available":755648712704,"internally_reserved":0,"allocated":6392070144,"data_stored":6389554533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4362392,"internal_metadata":11036290920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":240,"apply_latency_ms":240,"commit_latency_ns":240000000,"apply_latency_ns":240000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9619719172,"num_objects":-8830,"num_object_clones":0,"num_object_copies":-17660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8830,"num_whiteouts":0,"num_read":-1843980,"num_read_kb":-129992856,"num_write":-7564072,"num_write_kb":-206882380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002770"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":380,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-17T11:53:17.586877+0000","last_change":"2024-05-17T04:08:56.447797+0000","last_active":"2024-05-17T11:53:17.586877+0000","last_peered":"2024-05-17T11:53:17.586877+0000","last_clean":"2024-05-17T11:53:17.586877+0000","last_became_active":"2024-05-17T04:08:56.446705+0000","last_became_peered":"2024-05-17T04:08:56.446705+0000","last_unstale":"2024-05-17T11:53:17.586877+0000","last_undegraded":"2024-05-17T11:53:17.586877+0000","last_fullsized":"2024-05-17T11:53:17.586877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_clean_scrub_stamp":"2024-05-17T04:08:54.847367+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:40:00.515431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580422,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":987048,"kb_used_data":1052,"kb_used_omap":264,"kb_used_meta":985719,"kb_avail":93384792,"statfs":{"total":96636764160,"available":95626027008,"internally_reserved":0,"allocated":1077248,"data_stored":797936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":270362,"internal_metadata":1009377254},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834580423,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1464932,"kb_used_data":472,"kb_used_omap":665,"kb_used_meta":1463782,"kb_avail":92906908,"statfs":{"total":96636764160,"available":95136673792,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":681731,"internal_metadata":1498913021},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834580422,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1439588,"kb_used_data":25048,"kb_used_omap":645,"kb_used_meta":1413882,"kb_avail":92932252,"statfs":{"total":96636764160,"available":95162626048,"internally_reserved":0,"allocated":25649152,"data_stored":25373392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":660519,"internal_metadata":1447816153},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834580424,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1538724,"kb_used_data":472,"kb_used_omap":1330,"kb_used_meta":1536909,"kb_avail":92833116,"statfs":{"total":96636764160,"available":95061110784,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1362198,"internal_metadata":1573795562},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834580352,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2950992,"kb_used_data":2090052,"kb_used_omap":433,"kb_used_meta":860494,"kb_avail":91420848,"statfs":{"total":96636764160,"available":93614948352,"internally_reserved":0,"allocated":2140213248,"data_stored":2139830010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":444198,"internal_metadata":881146074},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834580367,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3541740,"kb_used_data":1878816,"kb_used_omap":527,"kb_used_meta":1662384,"kb_avail":90830100,"statfs":{"total":96636764160,"available":93010022400,"internally_reserved":0,"allocated":1923907584,"data_stored":1923531264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":540297,"internal_metadata":1702281591},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834580386,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3317084,"kb_used_data":1710736,"kb_used_omap":30,"kb_used_meta":1606305,"kb_avail":91054756,"statfs":{"total":96636764160,"available":93240070144,"internally_reserved":0,"allocated":1751793664,"data_stored":1751452157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30843,"internal_metadata":1644857221},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834580388,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1796416,"kb_used_data":535608,"kb_used_omap":363,"kb_used_meta":1248148,"kb_avail":92575424,"statfs":{"total":96636764160,"available":94797234176,"internally_reserved":0,"allocated":548462592,"data_stored":548154638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":372244,"internal_metadata":1278104044},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":53,"apply_latency_ms":53,"commit_latency_ns":53000000,"apply_latency_ns":53000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-17T11:53:22.107 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-17T11:53:22.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.305+0000 7f2e31a03640 1 Processor -- start 2024-05-17T11:53:22.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.306+0000 7f2e31a03640 1 -- start start 2024-05-17T11:53:22.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.307+0000 7f2e31a03640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2e2c0cec60 0x7f2e2c0b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:22.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.307+0000 7f2e31a03640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2e2c073120 0x7f2e2c0b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.307+0000 7f2e31a03640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e2c0d06d0 con 0x7f2e2c15e2f0 2024-05-17T11:53:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.307+0000 7f2e31a03640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f2e2c0d12e0 con 0x7f2e2c0cec60 2024-05-17T11:53:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.307+0000 7f2e31a03640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f2e2c0d09b0 con 0x7f2e2c073120 2024-05-17T11:53:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.308+0000 7f2e30a01640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2e2c0cec60 0x7f2e2c0b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.308+0000 7f2e2bfff640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f2e2c15e2f0 0x7f2e2c072a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:47886/0 (socket says 172.21.15.131:47886) 2024-05-17T11:53:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.308+0000 7f2e2bfff640 1 -- 172.21.15.131:0/96817907 learned_addr learned my addr 172.21.15.131:0/96817907 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:22.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.308+0000 7f2e31202640 1 --2- 172.21.15.131:0/96817907 >> v2:172.21.15.150:3300/0 conn(0x7f2e2c073120 0x7f2e2c0b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:22.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.308+0000 7f2e2b7fe640 1 -- 172.21.15.131:0/96817907 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1783724541 0 0) 0x7f2e2c0d06d0 con 0x7f2e2c15e2f0 2024-05-17T11:53:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.308+0000 7f2e2b7fe640 1 -- 172.21.15.131:0/96817907 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e18003520 con 0x7f2e2c15e2f0 2024-05-17T11:53:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.308+0000 7f2e30a01640 1 -- 172.21.15.131:0/96817907 >> v2:172.21.15.150:3300/0 conn(0x7f2e2c073120 msgr2=0x7f2e2c0b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.308+0000 7f2e30a01640 1 --2- 172.21.15.131:0/96817907 >> v2:172.21.15.150:3300/0 conn(0x7f2e2c073120 0x7f2e2c0b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.308+0000 7f2e30a01640 1 -- 172.21.15.131:0/96817907 >> v1:172.21.15.150:6789/0 conn(0x7f2e2c15e2f0 legacy=0x7f2e2c072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.308+0000 7f2e30a01640 1 -- 172.21.15.131:0/96817907 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2c0d0c90 con 0x7f2e2c0cec60 2024-05-17T11:53:22.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.310+0000 7f2e30a01640 1 --2- 172.21.15.131:0/96817907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2c0cec60 0x7f2e2c0b1f30 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c073af0 tx=0x7f2e1402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b61f7deec45462 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:22.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.311+0000 7f2e2b7fe640 1 -- 172.21.15.131:0/96817907 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14037070 con 0x7f2e2c0cec60 2024-05-17T11:53:22.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.311+0000 7f2e2b7fe640 1 -- 172.21.15.131:0/96817907 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e14032440 con 0x7f2e2c0cec60 2024-05-17T11:53:22.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.311+0000 7f2e2b7fe640 1 -- 172.21.15.131:0/96817907 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14032810 con 0x7f2e2c0cec60 2024-05-17T11:53:22.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.312+0000 7f2e31a03640 1 -- 172.21.15.131:0/96817907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2c0cec60 msgr2=0x7f2e2c0b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.312+0000 7f2e31a03640 1 --2- 172.21.15.131:0/96817907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2c0cec60 0x7f2e2c0b1f30 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c073af0 tx=0x7f2e1402a1a0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.313+0000 7f2e31a03640 1 -- 172.21.15.131:0/96817907 shutdown_connections 2024-05-17T11:53:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.313+0000 7f2e31a03640 1 --2- 172.21.15.131:0/96817907 >> v2:172.21.15.150:3300/0 conn(0x7f2e2c073120 0x7f2e2c0b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.313+0000 7f2e31a03640 1 --2- 172.21.15.131:0/96817907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2c0cec60 0x7f2e2c0b1f30 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.313+0000 7f2e31a03640 1 -- 172.21.15.131:0/96817907 >> 172.21.15.131:0/96817907 conn(0x7f2e2c0d1770 msgr2=0x7f2e2c0d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.313+0000 7f2e31a03640 1 -- 172.21.15.131:0/96817907 shutdown_connections 2024-05-17T11:53:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.313+0000 7f2e31a03640 1 -- 172.21.15.131:0/96817907 wait complete. 2024-05-17T11:53:22.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.318+0000 7f2e31a03640 1 Processor -- start 2024-05-17T11:53:22.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.318+0000 7f2e31a03640 1 -- start start 2024-05-17T11:53:22.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.322+0000 7f2e31a03640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e2c0cec60 0x7f2e2c06de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:22.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.322+0000 7f2e31a03640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2c15e2f0 0x7f2e2c149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:22.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.322+0000 7f2e31a03640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e2c06d770 0x7f2e2c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:22.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.322+0000 7f2e31a03640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c0d04b0 con 0x7f2e2c15e2f0 2024-05-17T11:53:22.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.322+0000 7f2e31a03640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c0d0330 con 0x7f2e2c0cec60 2024-05-17T11:53:22.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.322+0000 7f2e31a03640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2e2c15e700 con 0x7f2e2c06d770 2024-05-17T11:53:22.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.322+0000 7f2e30a01640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e2c0cec60 0x7f2e2c06de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.322+0000 7f2e30a01640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e2c0cec60 0x7f2e2c06de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:35132/0 (socket says 172.21.15.131:35132) 2024-05-17T11:53:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.322+0000 7f2e2bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2c15e2f0 0x7f2e2c149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.322+0000 7f2e30a01640 1 -- 172.21.15.131:0/2222553573 learned_addr learned my addr 172.21.15.131:0/2222553573 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.322+0000 7f2e31202640 1 --2- 172.21.15.131:0/2222553573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e2c06d770 0x7f2e2c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.323+0000 7f2e30a01640 1 -- 172.21.15.131:0/2222553573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e2c06d770 msgr2=0x7f2e2c15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.323+0000 7f2e30a01640 1 --2- 172.21.15.131:0/2222553573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e2c06d770 0x7f2e2c15c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.323+0000 7f2e30a01640 1 -- 172.21.15.131:0/2222553573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2c15e2f0 msgr2=0x7f2e2c149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:22.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.323+0000 7f2e30a01640 1 --2- 172.21.15.131:0/2222553573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2c15e2f0 0x7f2e2c149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.323+0000 7f2e30a01640 1 -- 172.21.15.131:0/2222553573 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2c06c6f0 con 0x7f2e2c0cec60 2024-05-17T11:53:22.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.323+0000 7f2e30a01640 1 --2- 172.21.15.131:0/2222553573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e2c0cec60 0x7f2e2c06de20 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f2e14000c00 tx=0x7f2e140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:22.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.323+0000 7f2e297fa640 1 -- 172.21.15.131:0/2222553573 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14041020 con 0x7f2e2c0cec60 2024-05-17T11:53:22.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.324+0000 7f2e297fa640 1 -- 172.21.15.131:0/2222553573 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1403d700 con 0x7f2e2c0cec60 2024-05-17T11:53:22.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.324+0000 7f2e297fa640 1 -- 172.21.15.131:0/2222553573 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14037040 con 0x7f2e2c0cec60 2024-05-17T11:53:22.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.324+0000 7f2e31a03640 1 -- 172.21.15.131:0/2222553573 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2c06c9b0 con 0x7f2e2c0cec60 2024-05-17T11:53:22.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.324+0000 7f2e31a03640 1 -- 172.21.15.131:0/2222553573 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e2c06cf70 con 0x7f2e2c0cec60 2024-05-17T11:53:22.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.326+0000 7f2e297fa640 1 -- 172.21.15.131:0/2222553573 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2e14044020 con 0x7f2e2c0cec60 2024-05-17T11:53:22.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.326+0000 7f2e31a03640 1 -- 172.21.15.131:0/2222553573 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e2c0b28e0 con 0x7f2e2c0cec60 2024-05-17T11:53:22.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.327+0000 7f2e297fa640 1 --2- 172.21.15.131:0/2222553573 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2e0c076300 0x7f2e0c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:22.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.327+0000 7f2e2bfff640 1 --2- 172.21.15.131:0/2222553573 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2e0c076300 0x7f2e0c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:22.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.327+0000 7f2e297fa640 1 -- 172.21.15.131:0/2222553573 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f2e140b7af0 con 0x7f2e2c0cec60 2024-05-17T11:53:22.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.328+0000 7f2e2bfff640 1 --2- 172.21.15.131:0/2222553573 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2e0c076300 0x7f2e0c078810 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c005880 tx=0x7f2e1c006aa0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:22.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.332+0000 7f2e297fa640 1 -- 172.21.15.131:0/2222553573 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2e1404b030 con 0x7f2e2c0cec60 2024-05-17T11:53:22.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.558+0000 7f2e31a03640 1 -- 172.21.15.131:0/2222553573 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e2c06e360 con 0x7f2e0c076300 2024-05-17T11:53:22.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.559+0000 7f2e297fa640 1 -- 172.21.15.131:0/2222553573 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13695 (secure 0 0 0) 0x7f2e2c06e360 con 0x7f2e0c076300 2024-05-17T11:53:22.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:53:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-05-17T11:53:22.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.562+0000 7f2e31a03640 1 -- 172.21.15.131:0/2222553573 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2e0c076300 msgr2=0x7f2e0c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:22.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.562+0000 7f2e31a03640 1 --2- 172.21.15.131:0/2222553573 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2e0c076300 0x7f2e0c078810 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c005880 tx=0x7f2e1c006aa0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.562+0000 7f2e31a03640 1 -- 172.21.15.131:0/2222553573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e2c0cec60 msgr2=0x7f2e2c06de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:22.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.562+0000 7f2e31a03640 1 --2- 172.21.15.131:0/2222553573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e2c0cec60 0x7f2e2c06de20 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f2e14000c00 tx=0x7f2e140046c0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.562+0000 7f2e31a03640 1 -- 172.21.15.131:0/2222553573 shutdown_connections 2024-05-17T11:53:22.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.562+0000 7f2e31a03640 1 --2- 172.21.15.131:0/2222553573 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f2e0c076300 0x7f2e0c078810 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.562+0000 7f2e31a03640 1 --2- 172.21.15.131:0/2222553573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2c15e2f0 0x7f2e2c149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.562+0000 7f2e31a03640 1 --2- 172.21.15.131:0/2222553573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e2c06d770 0x7f2e2c15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.562+0000 7f2e31a03640 1 --2- 172.21.15.131:0/2222553573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e2c0cec60 0x7f2e2c06de20 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.562+0000 7f2e31a03640 1 -- 172.21.15.131:0/2222553573 >> 172.21.15.131:0/2222553573 conn(0x7f2e2c0d1770 msgr2=0x7f2e2c0b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:22.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.562+0000 7f2e31a03640 1 -- 172.21.15.131:0/2222553573 shutdown_connections 2024-05-17T11:53:22.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.562+0000 7f2e31a03640 1 -- 172.21.15.131:0/2222553573 wait complete. 2024-05-17T11:53:22.561 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":13963,"stamp":"2024-05-17T11:53:21.425935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":17036524,"kb_used_data":6242256,"kb_used_omap":4260,"kb_used_meta":10777627,"kb_avail":737938196,"statfs":{"total":773094113280,"available":755648712704,"internally_reserved":0,"allocated":6392070144,"data_stored":6389554533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4362392,"internal_metadata":11036290920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":240,"apply_latency_ms":240,"commit_latency_ns":240000000,"apply_latency_ns":240000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9619719172,"num_objects":-8830,"num_object_clones":0,"num_object_copies":-17660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8830,"num_whiteouts":0,"num_read":-1843980,"num_read_kb":-129992856,"num_write":-7564072,"num_write_kb":-206882380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002770"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":380,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-17T11:53:17.586877+0000","last_change":"2024-05-17T04:08:56.447797+0000","last_active":"2024-05-17T11:53:17.586877+0000","last_peered":"2024-05-17T11:53:17.586877+0000","last_clean":"2024-05-17T11:53:17.586877+0000","last_became_active":"2024-05-17T04:08:56.446705+0000","last_became_peered":"2024-05-17T04:08:56.446705+0000","last_unstale":"2024-05-17T11:53:17.586877+0000","last_undegraded":"2024-05-17T11:53:17.586877+0000","last_fullsized":"2024-05-17T11:53:17.586877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_clean_scrub_stamp":"2024-05-17T04:08:54.847367+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:40:00.515431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580422,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":987048,"kb_used_data":1052,"kb_used_omap":264,"kb_used_meta":985719,"kb_avail":93384792,"statfs":{"total":96636764160,"available":95626027008,"internally_reserved":0,"allocated":1077248,"data_stored":797936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":270362,"internal_metadata":1009377254},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834580423,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1464932,"kb_used_data":472,"kb_used_omap":665,"kb_used_meta":1463782,"kb_avail":92906908,"statfs":{"total":96636764160,"available":95136673792,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":681731,"internal_metadata":1498913021},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834580422,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1439588,"kb_used_data":25048,"kb_used_omap":645,"kb_used_meta":1413882,"kb_avail":92932252,"statfs":{"total":96636764160,"available":95162626048,"internally_reserved":0,"allocated":25649152,"data_stored":25373392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":660519,"internal_metadata":1447816153},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834580424,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1538724,"kb_used_data":472,"kb_used_omap":1330,"kb_used_meta":1536909,"kb_avail":92833116,"statfs":{"total":96636764160,"available":95061110784,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1362198,"internal_metadata":1573795562},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834580352,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2950992,"kb_used_data":2090052,"kb_used_omap":433,"kb_used_meta":860494,"kb_avail":91420848,"statfs":{"total":96636764160,"available":93614948352,"internally_reserved":0,"allocated":2140213248,"data_stored":2139830010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":444198,"internal_metadata":881146074},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834580367,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3541740,"kb_used_data":1878816,"kb_used_omap":527,"kb_used_meta":1662384,"kb_avail":90830100,"statfs":{"total":96636764160,"available":93010022400,"internally_reserved":0,"allocated":1923907584,"data_stored":1923531264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":540297,"internal_metadata":1702281591},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834580386,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3317084,"kb_used_data":1710736,"kb_used_omap":30,"kb_used_meta":1606305,"kb_avail":91054756,"statfs":{"total":96636764160,"available":93240070144,"internally_reserved":0,"allocated":1751793664,"data_stored":1751452157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30843,"internal_metadata":1644857221},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834580388,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1796416,"kb_used_data":535608,"kb_used_omap":363,"kb_used_meta":1248148,"kb_avail":92575424,"statfs":{"total":96636764160,"available":94797234176,"internally_reserved":0,"allocated":548462592,"data_stored":548154638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":372244,"internal_metadata":1278104044},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":53,"apply_latency_ms":53,"commit_latency_ns":53000000,"apply_latency_ns":53000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-17T11:53:22.562 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-17T11:53:22.562 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-17T11:53:22.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.741+0000 7f5aa7ed6640 1 Processor -- start 2024-05-17T11:53:22.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.742+0000 7f5aa7ed6640 1 -- start start 2024-05-17T11:53:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.745+0000 7f5aa7ed6640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5aa015aeb0 0x7f5aa006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.746+0000 7f5aa7ed6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5aa006e180 0x7f5aa00d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.746+0000 7f5aa7ed6640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aa015da10 con 0x7f5aa00d2890 2024-05-17T11:53:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.746+0000 7f5aa7ed6640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f5aa015e5c0 con 0x7f5aa006e180 2024-05-17T11:53:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.746+0000 7f5aa7ed6640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa00d2ca0 con 0x7f5aa015aeb0 2024-05-17T11:53:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.746+0000 7f5aa5471640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5aa006e180 0x7f5aa00d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.746+0000 7f5aa6473640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f5aa00d2890 0x7f5aa0073880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:47892/0 (socket says 172.21.15.131:47892) 2024-05-17T11:53:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.746+0000 7f5aa6473640 1 -- 172.21.15.131:0/826180477 learned_addr learned my addr 172.21.15.131:0/826180477 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.746+0000 7f5aa5c72640 1 --2- 172.21.15.131:0/826180477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5aa015aeb0 0x7f5aa006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.746+0000 7f5aa4c70640 1 -- 172.21.15.131:0/826180477 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738785600 0 0) 0x7f5a98001490 con 0x7f5aa00d2890 2024-05-17T11:53:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.746+0000 7f5aa4c70640 1 -- 172.21.15.131:0/826180477 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a8c003520 con 0x7f5aa00d2890 2024-05-17T11:53:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.747+0000 7f5aa5c72640 1 -- 172.21.15.131:0/826180477 >> v2:172.21.15.131:3300/0 conn(0x7f5aa006e180 msgr2=0x7f5aa00d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.747+0000 7f5aa5c72640 1 --2- 172.21.15.131:0/826180477 >> v2:172.21.15.131:3300/0 conn(0x7f5aa006e180 0x7f5aa00d2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.747+0000 7f5aa5c72640 1 -- 172.21.15.131:0/826180477 >> v1:172.21.15.150:6789/0 conn(0x7f5aa00d2890 legacy=0x7f5aa0073880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.747+0000 7f5aa5c72640 1 -- 172.21.15.131:0/826180477 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa015dc90 con 0x7f5aa015aeb0 2024-05-17T11:53:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.747+0000 7f5aa5471640 1 --2- 172.21.15.131:0/826180477 >> v2:172.21.15.131:3300/0 conn(0x7f5aa006e180 0x7f5aa00d2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.749+0000 7f5aa5c72640 1 --2- 172.21.15.131:0/826180477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5aa015aeb0 0x7f5aa006dc40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0097d0 tx=0x7f5a9c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4948de17f8b7ccb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.750+0000 7f5aa4c70640 1 -- 172.21.15.131:0/826180477 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c037070 con 0x7f5aa015aeb0 2024-05-17T11:53:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.750+0000 7f5aa4c70640 1 -- 172.21.15.131:0/826180477 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a9c032440 con 0x7f5aa015aeb0 2024-05-17T11:53:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.750+0000 7f5aa4c70640 1 -- 172.21.15.131:0/826180477 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c032810 con 0x7f5aa015aeb0 2024-05-17T11:53:22.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.751+0000 7f5aa7ed6640 1 -- 172.21.15.131:0/826180477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5aa015aeb0 msgr2=0x7f5aa006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:22.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.751+0000 7f5aa7ed6640 1 --2- 172.21.15.131:0/826180477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5aa015aeb0 0x7f5aa006dc40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0097d0 tx=0x7f5a9c02a1c0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.751+0000 7f5aa7ed6640 1 -- 172.21.15.131:0/826180477 shutdown_connections 2024-05-17T11:53:22.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.751+0000 7f5aa7ed6640 1 --2- 172.21.15.131:0/826180477 >> v2:172.21.15.131:3300/0 conn(0x7f5aa006e180 0x7f5aa00d2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.751+0000 7f5aa7ed6640 1 --2- 172.21.15.131:0/826180477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5aa015aeb0 0x7f5aa006dc40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.751+0000 7f5aa7ed6640 1 -- 172.21.15.131:0/826180477 >> 172.21.15.131:0/826180477 conn(0x7f5aa00b4250 msgr2=0x7f5aa00b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:22.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.752+0000 7f5aa7ed6640 1 -- 172.21.15.131:0/826180477 shutdown_connections 2024-05-17T11:53:22.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.752+0000 7f5aa7ed6640 1 -- 172.21.15.131:0/826180477 wait complete. 2024-05-17T11:53:22.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.757+0000 7f5aa7ed6640 1 Processor -- start 2024-05-17T11:53:22.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.757+0000 7f5aa7ed6640 1 -- start start 2024-05-17T11:53:22.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.760+0000 7f5aa7ed6640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5aa00d2890 0x7f5aa0150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:22.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.760+0000 7f5aa7ed6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5aa015aeb0 0x7f5aa015c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:22.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.760+0000 7f5aa7ed6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5aa0151030 0x7f5aa015c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:22.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.760+0000 7f5aa7ed6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa015b2c0 con 0x7f5aa0151030 2024-05-17T11:53:22.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.760+0000 7f5aa7ed6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa015e250 con 0x7f5aa015aeb0 2024-05-17T11:53:22.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.760+0000 7f5aa7ed6640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa00b59c0 con 0x7f5aa00d2890 2024-05-17T11:53:22.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.761+0000 7f5aa6473640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5aa0151030 0x7f5aa015c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:22.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.761+0000 7f5aa6473640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5aa0151030 0x7f5aa015c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:54626/0 (socket says 172.21.15.131:54626) 2024-05-17T11:53:22.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.761+0000 7f5aa6473640 1 -- 172.21.15.131:0/2583793696 learned_addr learned my addr 172.21.15.131:0/2583793696 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:22.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.761+0000 7f5aa5c72640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5aa00d2890 0x7f5aa0150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:22.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.761+0000 7f5aa5471640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5aa015aeb0 0x7f5aa015c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:22.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.761+0000 7f5aa5c72640 1 -- 172.21.15.131:0/2583793696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5aa015aeb0 msgr2=0x7f5aa015c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:22.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.761+0000 7f5aa5c72640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5aa015aeb0 0x7f5aa015c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.762+0000 7f5aa5c72640 1 -- 172.21.15.131:0/2583793696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5aa0151030 msgr2=0x7f5aa015c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:22.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.762+0000 7f5aa5c72640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5aa0151030 0x7f5aa015c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.762+0000 7f5aa5c72640 1 -- 172.21.15.131:0/2583793696 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa015b5e0 con 0x7f5aa00d2890 2024-05-17T11:53:22.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.762+0000 7f5aa5471640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5aa015aeb0 0x7f5aa015c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:22.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.762+0000 7f5aa6473640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5aa0151030 0x7f5aa015c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:22.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.762+0000 7f5aa5c72640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5aa00d2890 0x7f5aa0150af0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c031000 tx=0x7f5a9c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:22.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.762+0000 7f5a967fc640 1 -- 172.21.15.131:0/2583793696 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c041030 con 0x7f5aa00d2890 2024-05-17T11:53:22.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.762+0000 7f5a967fc640 1 -- 172.21.15.131:0/2583793696 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a9c03d4e0 con 0x7f5aa00d2890 2024-05-17T11:53:22.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.762+0000 7f5a967fc640 1 -- 172.21.15.131:0/2583793696 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c037040 con 0x7f5aa00d2890 2024-05-17T11:53:22.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.763+0000 7f5aa7ed6640 1 -- 172.21.15.131:0/2583793696 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa015b8c0 con 0x7f5aa00d2890 2024-05-17T11:53:22.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.763+0000 7f5aa7ed6640 1 -- 172.21.15.131:0/2583793696 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aa015be80 con 0x7f5aa00d2890 2024-05-17T11:53:22.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.764+0000 7f5aa7ed6640 1 -- 172.21.15.131:0/2583793696 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aa0161cc0 con 0x7f5aa00d2890 2024-05-17T11:53:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.768+0000 7f5a967fc640 1 -- 172.21.15.131:0/2583793696 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5a9c044070 con 0x7f5aa00d2890 2024-05-17T11:53:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.769+0000 7f5a967fc640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5a840762d0 0x7f5a840787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:22.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.769+0000 7f5a967fc640 1 -- 172.21.15.131:0/2583793696 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f5a9c0b7a80 con 0x7f5aa00d2890 2024-05-17T11:53:22.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.769+0000 7f5aa5471640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5a840762d0 0x7f5a840787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:22.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.770+0000 7f5aa5471640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5a840762d0 0x7f5a840787e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0156670 tx=0x7f5a90009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:22.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.774+0000 7f5a967fc640 1 -- 172.21.15.131:0/2583793696 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5a9c0b9e20 con 0x7f5aa00d2890 2024-05-17T11:53:22.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.958+0000 7f5aa7ed6640 1 -- 172.21.15.131:0/2583793696 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5aa00b16e0 con 0x7f5a840762d0 2024-05-17T11:53:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.959+0000 7f5a967fc640 1 -- 172.21.15.131:0/2583793696 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13695 (secure 0 0 0) 0x7f5aa00b16e0 con 0x7f5a840762d0 2024-05-17T11:53:22.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:53:22.946 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-05-17T11:53:22.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.963+0000 7f5aa7ed6640 1 -- 172.21.15.131:0/2583793696 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5a840762d0 msgr2=0x7f5a840787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:22.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.963+0000 7f5aa7ed6640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5a840762d0 0x7f5a840787e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0156670 tx=0x7f5a90009190 comp rx=0 tx=0).stop 2024-05-17T11:53:22.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.964+0000 7f5aa7ed6640 1 -- 172.21.15.131:0/2583793696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5aa00d2890 msgr2=0x7f5aa0150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:22.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.964+0000 7f5aa7ed6640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5aa00d2890 0x7f5aa0150af0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c031000 tx=0x7f5a9c0046c0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.964+0000 7f5aa7ed6640 1 -- 172.21.15.131:0/2583793696 shutdown_connections 2024-05-17T11:53:22.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.964+0000 7f5aa7ed6640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5a840762d0 0x7f5a840787e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.964+0000 7f5aa7ed6640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5aa0151030 0x7f5aa015c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.964+0000 7f5aa7ed6640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5aa015aeb0 0x7f5aa015c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.964+0000 7f5aa7ed6640 1 --2- 172.21.15.131:0/2583793696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5aa00d2890 0x7f5aa0150af0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:22.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.964+0000 7f5aa7ed6640 1 -- 172.21.15.131:0/2583793696 >> 172.21.15.131:0/2583793696 conn(0x7f5aa00b4250 msgr2=0x7f5aa0158e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:22.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.964+0000 7f5aa7ed6640 1 -- 172.21.15.131:0/2583793696 shutdown_connections 2024-05-17T11:53:22.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:22.964+0000 7f5aa7ed6640 1 -- 172.21.15.131:0/2583793696 wait complete. 2024-05-17T11:53:22.973 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":13963,"stamp":"2024-05-17T11:53:21.425935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":17036524,"kb_used_data":6242256,"kb_used_omap":4260,"kb_used_meta":10777627,"kb_avail":737938196,"statfs":{"total":773094113280,"available":755648712704,"internally_reserved":0,"allocated":6392070144,"data_stored":6389554533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4362392,"internal_metadata":11036290920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":240,"apply_latency_ms":240,"commit_latency_ns":240000000,"apply_latency_ns":240000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9619719172,"num_objects":-8830,"num_object_clones":0,"num_object_copies":-17660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8830,"num_whiteouts":0,"num_read":-1843980,"num_read_kb":-129992856,"num_write":-7564072,"num_write_kb":-206882380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002770"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":380,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-17T11:53:17.586877+0000","last_change":"2024-05-17T04:08:56.447797+0000","last_active":"2024-05-17T11:53:17.586877+0000","last_peered":"2024-05-17T11:53:17.586877+0000","last_clean":"2024-05-17T11:53:17.586877+0000","last_became_active":"2024-05-17T04:08:56.446705+0000","last_became_peered":"2024-05-17T04:08:56.446705+0000","last_unstale":"2024-05-17T11:53:17.586877+0000","last_undegraded":"2024-05-17T11:53:17.586877+0000","last_fullsized":"2024-05-17T11:53:17.586877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_clean_scrub_stamp":"2024-05-17T04:08:54.847367+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:40:00.515431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580422,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":987048,"kb_used_data":1052,"kb_used_omap":264,"kb_used_meta":985719,"kb_avail":93384792,"statfs":{"total":96636764160,"available":95626027008,"internally_reserved":0,"allocated":1077248,"data_stored":797936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":270362,"internal_metadata":1009377254},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834580423,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1464932,"kb_used_data":472,"kb_used_omap":665,"kb_used_meta":1463782,"kb_avail":92906908,"statfs":{"total":96636764160,"available":95136673792,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":681731,"internal_metadata":1498913021},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834580422,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1439588,"kb_used_data":25048,"kb_used_omap":645,"kb_used_meta":1413882,"kb_avail":92932252,"statfs":{"total":96636764160,"available":95162626048,"internally_reserved":0,"allocated":25649152,"data_stored":25373392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":660519,"internal_metadata":1447816153},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834580424,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1538724,"kb_used_data":472,"kb_used_omap":1330,"kb_used_meta":1536909,"kb_avail":92833116,"statfs":{"total":96636764160,"available":95061110784,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1362198,"internal_metadata":1573795562},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834580352,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2950992,"kb_used_data":2090052,"kb_used_omap":433,"kb_used_meta":860494,"kb_avail":91420848,"statfs":{"total":96636764160,"available":93614948352,"internally_reserved":0,"allocated":2140213248,"data_stored":2139830010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":444198,"internal_metadata":881146074},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834580367,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3541740,"kb_used_data":1878816,"kb_used_omap":527,"kb_used_meta":1662384,"kb_avail":90830100,"statfs":{"total":96636764160,"available":93010022400,"internally_reserved":0,"allocated":1923907584,"data_stored":1923531264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":540297,"internal_metadata":1702281591},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834580386,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3317084,"kb_used_data":1710736,"kb_used_omap":30,"kb_used_meta":1606305,"kb_avail":91054756,"statfs":{"total":96636764160,"available":93240070144,"internally_reserved":0,"allocated":1751793664,"data_stored":1751452157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30843,"internal_metadata":1644857221},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834580388,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1796416,"kb_used_data":535608,"kb_used_omap":363,"kb_used_meta":1248148,"kb_avail":92575424,"statfs":{"total":96636764160,"available":94797234176,"internally_reserved":0,"allocated":548462592,"data_stored":548154638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":372244,"internal_metadata":1278104044},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":53,"apply_latency_ms":53,"commit_latency_ns":53000000,"apply_latency_ns":53000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-17T11:53:22.974 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-17T11:53:23.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.267+0000 7f84d7fda640 1 Processor -- start 2024-05-17T11:53:23.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.267+0000 7f84d7fda640 1 -- start start 2024-05-17T11:53:23.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.271+0000 7f84d7fda640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f84d0152d20 0x7f84d015c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:23.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.271+0000 7f84d7fda640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84d00736c0 0x7f84d0073ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:23.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.271+0000 7f84d7fda640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f84d00b5e20 0x7f84d00b6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:23.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.271+0000 7f84d7fda640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f84d0074010 con 0x7f84d00b5e20 2024-05-17T11:53:23.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.271+0000 7f84d7fda640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f84d006efa0 con 0x7f84d0152d20 2024-05-17T11:53:23.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.271+0000 7f84d7fda640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f84d006f280 con 0x7f84d00736c0 2024-05-17T11:53:23.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.271+0000 7f84d5d76640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f84d0152d20 0x7f84d015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:23.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.271+0000 7f84d5d76640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f84d0152d20 0x7f84d015c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:35150/0 (socket says 172.21.15.131:35150) 2024-05-17T11:53:23.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.271+0000 7f84d5575640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84d00736c0 0x7f84d0073ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:23.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.271+0000 7f84d5d76640 1 -- 172.21.15.131:0/478694677 learned_addr learned my addr 172.21.15.131:0/478694677 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:23.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.271+0000 7f84d6577640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f84d00b5e20 0x7f84d00b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:23.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.272+0000 7f84d5d76640 1 -- 172.21.15.131:0/478694677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84d00736c0 msgr2=0x7f84d0073ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:23.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.272+0000 7f84d5d76640 1 --2- 172.21.15.131:0/478694677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84d00736c0 0x7f84d0073ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:23.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.272+0000 7f84d5d76640 1 -- 172.21.15.131:0/478694677 >> v2:172.21.15.131:3300/0 conn(0x7f84d00b5e20 msgr2=0x7f84d00b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:23.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.272+0000 7f84d5d76640 1 --2- 172.21.15.131:0/478694677 >> v2:172.21.15.131:3300/0 conn(0x7f84d00b5e20 0x7f84d00b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:23.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.272+0000 7f84d5d76640 1 -- 172.21.15.131:0/478694677 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d006f560 con 0x7f84d0152d20 2024-05-17T11:53:23.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.273+0000 7f84d5d76640 1 --2- 172.21.15.131:0/478694677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d0152d20 0x7f84d015c910 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f84d0074280 tx=0x7f84cc02c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=810a1d1d79d44fb server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:23.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.273+0000 7f84d4d74640 1 -- 172.21.15.131:0/478694677 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc039070 con 0x7f84d0152d20 2024-05-17T11:53:23.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.273+0000 7f84d4d74640 1 -- 172.21.15.131:0/478694677 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84cc00a5f0 con 0x7f84d0152d20 2024-05-17T11:53:23.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.273+0000 7f84d4d74640 1 -- 172.21.15.131:0/478694677 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc00a9e0 con 0x7f84d0152d20 2024-05-17T11:53:23.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.275+0000 7f84d7fda640 1 -- 172.21.15.131:0/478694677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d0152d20 msgr2=0x7f84d015c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:23.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.275+0000 7f84d7fda640 1 --2- 172.21.15.131:0/478694677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d0152d20 0x7f84d015c910 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f84d0074280 tx=0x7f84cc02c810 comp rx=0 tx=0).stop 2024-05-17T11:53:23.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.275+0000 7f84d7fda640 1 -- 172.21.15.131:0/478694677 shutdown_connections 2024-05-17T11:53:23.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.275+0000 7f84d7fda640 1 --2- 172.21.15.131:0/478694677 >> v2:172.21.15.131:3300/0 conn(0x7f84d00b5e20 0x7f84d00b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:23.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.275+0000 7f84d7fda640 1 --2- 172.21.15.131:0/478694677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84d00736c0 0x7f84d0073ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:23.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.275+0000 7f84d7fda640 1 --2- 172.21.15.131:0/478694677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d0152d20 0x7f84d015c910 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:23.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.275+0000 7f84d7fda640 1 -- 172.21.15.131:0/478694677 >> 172.21.15.131:0/478694677 conn(0x7f84d00d2140 msgr2=0x7f84d0072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:23.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.275+0000 7f84d7fda640 1 -- 172.21.15.131:0/478694677 shutdown_connections 2024-05-17T11:53:23.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.275+0000 7f84d7fda640 1 -- 172.21.15.131:0/478694677 wait complete. 2024-05-17T11:53:23.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.280+0000 7f84d7fda640 1 Processor -- start 2024-05-17T11:53:23.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.281+0000 7f84d7fda640 1 -- start start 2024-05-17T11:53:23.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.284+0000 7f84d7fda640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d00736c0 0x7f84d01f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:23.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.284+0000 7f84d7fda640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84d00b5e20 0x7f84d01549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:23.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.284+0000 7f84d7fda640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84d0152d20 0x7f84d014a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:23.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.284+0000 7f84d7fda640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f84d015d200 con 0x7f84d0152d20 2024-05-17T11:53:23.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.284+0000 7f84d7fda640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f84d006fb20 con 0x7f84d00736c0 2024-05-17T11:53:23.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.284+0000 7f84d7fda640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f84d015ce50 con 0x7f84d00b5e20 2024-05-17T11:53:23.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.285+0000 7f84d5d76640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d00736c0 0x7f84d01f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:23.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.285+0000 7f84d5d76640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d00736c0 0x7f84d01f1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:35156/0 (socket says 172.21.15.131:35156) 2024-05-17T11:53:23.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.285+0000 7f84d5d76640 1 -- 172.21.15.131:0/196664710 learned_addr learned my addr 172.21.15.131:0/196664710 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:23.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.285+0000 7f84d6577640 1 --2- 172.21.15.131:0/196664710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84d0152d20 0x7f84d014a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:23.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.285+0000 7f84d5575640 1 --2- 172.21.15.131:0/196664710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84d00b5e20 0x7f84d01549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:23.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.285+0000 7f84d5d76640 1 -- 172.21.15.131:0/196664710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84d00b5e20 msgr2=0x7f84d01549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:23.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.285+0000 7f84d5d76640 1 --2- 172.21.15.131:0/196664710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84d00b5e20 0x7f84d01549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:23.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.285+0000 7f84d5d76640 1 -- 172.21.15.131:0/196664710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84d0152d20 msgr2=0x7f84d014a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:23.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.285+0000 7f84d5d76640 1 --2- 172.21.15.131:0/196664710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84d0152d20 0x7f84d014a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:23.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.285+0000 7f84d5d76640 1 -- 172.21.15.131:0/196664710 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d01f1ad0 con 0x7f84d00736c0 2024-05-17T11:53:23.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.286+0000 7f84d5d76640 1 --2- 172.21.15.131:0/196664710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d00736c0 0x7f84d01f1590 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f84cc037040 tx=0x7f84cc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:23.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.286+0000 7f84c67fc640 1 -- 172.21.15.131:0/196664710 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc039040 con 0x7f84d00736c0 2024-05-17T11:53:23.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.286+0000 7f84c67fc640 1 -- 172.21.15.131:0/196664710 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84cc003e30 con 0x7f84d00736c0 2024-05-17T11:53:23.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.286+0000 7f84d7fda640 1 -- 172.21.15.131:0/196664710 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d0155400 con 0x7f84d00736c0 2024-05-17T11:53:23.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.286+0000 7f84c67fc640 1 -- 172.21.15.131:0/196664710 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc00c650 con 0x7f84d00736c0 2024-05-17T11:53:23.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.286+0000 7f84d7fda640 1 -- 172.21.15.131:0/196664710 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d01559c0 con 0x7f84d00736c0 2024-05-17T11:53:23.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.288+0000 7f84c67fc640 1 -- 172.21.15.131:0/196664710 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f84cc046020 con 0x7f84d00736c0 2024-05-17T11:53:23.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.288+0000 7f84d7fda640 1 -- 172.21.15.131:0/196664710 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84d00b5590 con 0x7f84d00736c0 2024-05-17T11:53:23.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.289+0000 7f84c67fc640 1 --2- 172.21.15.131:0/196664710 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f84b40762d0 0x7f84b40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:23.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.290+0000 7f84d5575640 1 --2- 172.21.15.131:0/196664710 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f84b40762d0 0x7f84b40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:23.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.290+0000 7f84c67fc640 1 -- 172.21.15.131:0/196664710 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f84cc0b9790 con 0x7f84d00736c0 2024-05-17T11:53:23.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.290+0000 7f84d5575640 1 --2- 172.21.15.131:0/196664710 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f84b40762d0 0x7f84b40787e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f84d0155f20 tx=0x7f84c0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:23.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.293+0000 7f84c67fc640 1 -- 172.21.15.131:0/196664710 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f84cc082b60 con 0x7f84d00736c0 2024-05-17T11:53:23.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.857+0000 7f84d7fda640 1 -- 172.21.15.131:0/196664710 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84d0073c70 con 0x7f84d00736c0 2024-05-17T11:53:23.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.858+0000 7f84c67fc640 1 -- 172.21.15.131:0/196664710 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+13317 (secure 0 0 0) 0x7f84cc086e60 con 0x7f84d00736c0 2024-05-17T11:53:23.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:53:23.844 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":41,"fsid":"c9e29f2b-51db-4d2a-bace-3a87edcda397","created":"2024-05-17T04:08:42.332183+0000","modified":"2024-05-17T11:53:17.570769+0000","last_up_change":"2024-05-17T04:08:53.845356+0000","last_in_change":"2024-05-17T04:08:44.632547+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-17T04:08:54.724090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"681b916b-7c1d-4f04-88d7-8ce0acca5731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6819","nonce":2798377402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6824","nonce":2798377402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6831","nonce":2798377402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2798377402},{"type":"v1","addr":"172.21.15.131:6828","nonce":2798377402}]},"public_addr":"172.21.15.131:6819/2798377402","cluster_addr":"172.21.15.131:6824/2798377402","heartbeat_back_addr":"172.21.15.131:6831/2798377402","heartbeat_front_addr":"172.21.15.131:6828/2798377402","state":["exists","up"]},{"osd":1,"uuid":"2c1a0cff-fe51-4321-bc12-4fce285e0506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6818","nonce":730333560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6821","nonce":730333560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6827","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6829","nonce":730333560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6823","nonce":730333560},{"type":"v1","addr":"172.21.15.131:6825","nonce":730333560}]},"public_addr":"172.21.15.131:6818/730333560","cluster_addr":"172.21.15.131:6821/730333560","heartbeat_back_addr":"172.21.15.131:6829/730333560","heartbeat_front_addr":"172.21.15.131:6825/730333560","state":["exists","up"]},{"osd":2,"uuid":"93025ad1-b979-4efb-9693-fa5ee41c80aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6801","nonce":797420574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6803","nonce":797420574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6807","nonce":797420574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":797420574},{"type":"v1","addr":"172.21.15.131:6805","nonce":797420574}]},"public_addr":"172.21.15.131:6801/797420574","cluster_addr":"172.21.15.131:6803/797420574","heartbeat_back_addr":"172.21.15.131:6807/797420574","heartbeat_front_addr":"172.21.15.131:6805/797420574","state":["exists","up"]},{"osd":3,"uuid":"615a41eb-71fc-4751-8aec-4f03ee61d8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6809","nonce":4197534495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6811","nonce":4197534495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6815","nonce":4197534495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":4197534495},{"type":"v1","addr":"172.21.15.131:6813","nonce":4197534495}]},"public_addr":"172.21.15.131:6809/4197534495","cluster_addr":"172.21.15.131:6811/4197534495","heartbeat_back_addr":"172.21.15.131:6815/4197534495","heartbeat_front_addr":"172.21.15.131:6813/4197534495","state":["exists","up"]},{"osd":4,"uuid":"bbc3c773-dd6d-4a5c-915d-70cd59896f5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6801","nonce":2205449991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6803","nonce":2205449991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6807","nonce":2205449991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2205449991},{"type":"v1","addr":"172.21.15.150:6805","nonce":2205449991}]},"public_addr":"172.21.15.150:6801/2205449991","cluster_addr":"172.21.15.150:6803/2205449991","heartbeat_back_addr":"172.21.15.150:6807/2205449991","heartbeat_front_addr":"172.21.15.150:6805/2205449991","state":["exists","up"]},{"osd":5,"uuid":"9d1030bb-bf6f-4fee-b1ea-9a7c94a49488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6810","nonce":491308104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6814","nonce":491308104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6822","nonce":491308104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":491308104},{"type":"v1","addr":"172.21.15.150:6818","nonce":491308104}]},"public_addr":"172.21.15.150:6810/491308104","cluster_addr":"172.21.15.150:6814/491308104","heartbeat_back_addr":"172.21.15.150:6822/491308104","heartbeat_front_addr":"172.21.15.150:6818/491308104","state":["exists","up"]},{"osd":6,"uuid":"c8dc3f80-e552-424b-8faa-218fb03cd631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6809","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6811","nonce":1730671783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6813","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6815","nonce":1730671783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6823","nonce":1730671783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":1730671783},{"type":"v1","addr":"172.21.15.150:6819","nonce":1730671783}]},"public_addr":"172.21.15.150:6811/1730671783","cluster_addr":"172.21.15.150:6815/1730671783","heartbeat_back_addr":"172.21.15.150:6823/1730671783","heartbeat_front_addr":"172.21.15.150:6819/1730671783","state":["exists","up"]},{"osd":7,"uuid":"a70e8c9d-e153-4858-bd65-f1097433f8e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6825","nonce":2147509392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6827","nonce":2147509392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6831","nonce":2147509392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2147509392},{"type":"v1","addr":"172.21.15.150:6829","nonce":2147509392}]},"public_addr":"172.21.15.150:6825/2147509392","cluster_addr":"172.21.15.150:6827/2147509392","heartbeat_back_addr":"172.21.15.150:6831/2147509392","heartbeat_front_addr":"172.21.15.150:6829/2147509392","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.800317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.836684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.796870+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.791189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.798881+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.834540+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.857863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-17T04:08:49.858930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.131:6836/119325169":"2024-05-18T11:53:12.485184+0000","172.21.15.131:6834/119325169":"2024-05-18T11:53:12.485184+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-17T11:53:23.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.863+0000 7f84d7fda640 1 -- 172.21.15.131:0/196664710 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f84b40762d0 msgr2=0x7f84b40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:23.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.863+0000 7f84d7fda640 1 --2- 172.21.15.131:0/196664710 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f84b40762d0 0x7f84b40787e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f84d0155f20 tx=0x7f84c0009190 comp rx=0 tx=0).stop 2024-05-17T11:53:23.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.863+0000 7f84d7fda640 1 -- 172.21.15.131:0/196664710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d00736c0 msgr2=0x7f84d01f1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:23.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.863+0000 7f84d7fda640 1 --2- 172.21.15.131:0/196664710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d00736c0 0x7f84d01f1590 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f84cc037040 tx=0x7f84cc004a40 comp rx=0 tx=0).stop 2024-05-17T11:53:23.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.863+0000 7f84d7fda640 1 -- 172.21.15.131:0/196664710 shutdown_connections 2024-05-17T11:53:23.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.863+0000 7f84d7fda640 1 --2- 172.21.15.131:0/196664710 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f84b40762d0 0x7f84b40787e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:23.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.863+0000 7f84d7fda640 1 --2- 172.21.15.131:0/196664710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84d0152d20 0x7f84d014a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:23.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.863+0000 7f84d7fda640 1 --2- 172.21.15.131:0/196664710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f84d00b5e20 0x7f84d01549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:23.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.863+0000 7f84d7fda640 1 --2- 172.21.15.131:0/196664710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84d00736c0 0x7f84d01f1590 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:23.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.863+0000 7f84d7fda640 1 -- 172.21.15.131:0/196664710 >> 172.21.15.131:0/196664710 conn(0x7f84d00d2140 msgr2=0x7f84d006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:23.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.863+0000 7f84d7fda640 1 -- 172.21.15.131:0/196664710 shutdown_connections 2024-05-17T11:53:23.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:23.863+0000 7f84d7fda640 1 -- 172.21.15.131:0/196664710 wait complete. 2024-05-17T11:53:24.878 INFO:tasks.ceph:Scrubbing osd.0 2024-05-17T11:53:24.878 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-17T11:53:25.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.083+0000 7fad05be0640 1 Processor -- start 2024-05-17T11:53:25.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.084+0000 7fad05be0640 1 -- start start 2024-05-17T11:53:25.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.087+0000 7fad05be0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fad000b8d60 0x7fad0015d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:25.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.087+0000 7fad05be0640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad000b2a60 con 0x7fad000d2890 2024-05-17T11:53:25.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.087+0000 7fad05be0640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad000b2d40 con 0x7fad000d01e0 2024-05-17T11:53:25.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.087+0000 7fad05be0640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fad000b4a50 con 0x7fad000b8d60 2024-05-17T11:53:25.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.088+0000 7facf6ffd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fad000d2890 0x7fad000cfad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38364/0 (socket says 172.21.15.131:38364) 2024-05-17T11:53:25.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.088+0000 7facff7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fad000b8d60 0x7fad0015d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:25.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.088+0000 7facf6ffd640 1 -- 172.21.15.131:0/4191341701 learned_addr learned my addr 172.21.15.131:0/4191341701 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:25.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.088+0000 7facfeffd640 1 -- 172.21.15.131:0/4191341701 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1259493159 0 0) 0x7fad000b2a60 con 0x7fad000d2890 2024-05-17T11:53:25.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.088+0000 7facfeffd640 1 -- 172.21.15.131:0/4191341701 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facec003520 con 0x7fad000d2890 2024-05-17T11:53:25.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.088+0000 7facfeffd640 1 -- 172.21.15.131:0/4191341701 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2455052138 0 0) 0x7fad000b2d40 con 0x7fad000d01e0 2024-05-17T11:53:25.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.088+0000 7facfeffd640 1 -- 172.21.15.131:0/4191341701 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad000b2a60 con 0x7fad000d01e0 2024-05-17T11:53:25.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.088+0000 7facff7fe640 1 -- 172.21.15.131:0/4191341701 >> v1:172.21.15.150:6789/0 conn(0x7fad000d01e0 legacy=0x7fad000b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:25.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.088+0000 7facff7fe640 1 -- 172.21.15.131:0/4191341701 >> v1:172.21.15.131:6789/0 conn(0x7fad000d2890 legacy=0x7fad000cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:25.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.089+0000 7facff7fe640 1 -- 172.21.15.131:0/4191341701 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad000b3020 con 0x7fad000b8d60 2024-05-17T11:53:25.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.090+0000 7facff7fe640 1 --2- 172.21.15.131:0/4191341701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad000b8d60 0x7fad0015d540 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7facf0009d90 tx=0x7facf002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c7c796b2e2af10 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:25.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.091+0000 7facfeffd640 1 -- 172.21.15.131:0/4191341701 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf0007740 con 0x7fad000b8d60 2024-05-17T11:53:25.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.091+0000 7facfeffd640 1 -- 172.21.15.131:0/4191341701 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facf00078e0 con 0x7fad000b8d60 2024-05-17T11:53:25.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.091+0000 7facfeffd640 1 -- 172.21.15.131:0/4191341701 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf0007cb0 con 0x7fad000b8d60 2024-05-17T11:53:25.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.092+0000 7fad05be0640 1 -- 172.21.15.131:0/4191341701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad000b8d60 msgr2=0x7fad0015d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:25.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.093+0000 7fad05be0640 1 --2- 172.21.15.131:0/4191341701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad000b8d60 0x7fad0015d540 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7facf0009d90 tx=0x7facf002a6f0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.093+0000 7fad05be0640 1 -- 172.21.15.131:0/4191341701 shutdown_connections 2024-05-17T11:53:25.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.093+0000 7fad05be0640 1 --2- 172.21.15.131:0/4191341701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad000b8d60 0x7fad0015d540 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.093+0000 7fad05be0640 1 -- 172.21.15.131:0/4191341701 >> 172.21.15.131:0/4191341701 conn(0x7fad000b4dd0 msgr2=0x7fad000b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:25.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.093+0000 7fad05be0640 1 -- 172.21.15.131:0/4191341701 shutdown_connections 2024-05-17T11:53:25.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.093+0000 7fad05be0640 1 -- 172.21.15.131:0/4191341701 wait complete. 2024-05-17T11:53:25.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.098+0000 7fad05be0640 1 Processor -- start 2024-05-17T11:53:25.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.098+0000 7fad05be0640 1 -- start start 2024-05-17T11:53:25.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.102+0000 7fad05be0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad000b8d60 0x7fad0014cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:25.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.102+0000 7fad05be0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad000d2890 0x7fad0014c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:25.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.102+0000 7fad05be0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad0006f2d0 0x7fad000cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:25.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.102+0000 7fad05be0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fad000b38c0 con 0x7fad000d2890 2024-05-17T11:53:25.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.102+0000 7fad05be0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fad000b35e0 con 0x7fad0006f2d0 2024-05-17T11:53:25.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.102+0000 7fad05be0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fad000b6870 con 0x7fad000b8d60 2024-05-17T11:53:25.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.102+0000 7facf6ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad000d2890 0x7fad0014c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:25.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.102+0000 7facf6ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad000d2890 0x7fad0014c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55172/0 (socket says 172.21.15.131:55172) 2024-05-17T11:53:25.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.102+0000 7facf6ffd640 1 -- 172.21.15.131:0/2462664785 learned_addr learned my addr 172.21.15.131:0/2462664785 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:25.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.102+0000 7facff7fe640 1 --2- 172.21.15.131:0/2462664785 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad000b8d60 0x7fad0014cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:25.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.102+0000 7facfffff640 1 --2- 172.21.15.131:0/2462664785 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad0006f2d0 0x7fad000cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:25.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.103+0000 7facfffff640 1 -- 172.21.15.131:0/2462664785 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad000b8d60 msgr2=0x7fad0014cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:25.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.103+0000 7facfffff640 1 --2- 172.21.15.131:0/2462664785 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad000b8d60 0x7fad0014cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.103+0000 7facfffff640 1 -- 172.21.15.131:0/2462664785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad000d2890 msgr2=0x7fad0014c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:25.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.103+0000 7facfffff640 1 --2- 172.21.15.131:0/2462664785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad000d2890 0x7fad0014c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.103+0000 7facfffff640 1 -- 172.21.15.131:0/2462664785 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0006fc70 con 0x7fad0006f2d0 2024-05-17T11:53:25.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.103+0000 7facf6ffd640 1 --2- 172.21.15.131:0/2462664785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad000d2890 0x7fad0014c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:25.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.103+0000 7facfffff640 1 --2- 172.21.15.131:0/2462664785 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad0006f2d0 0x7fad000cfa10 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7facf800c3f0 tx=0x7facf800c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:25.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.103+0000 7facfcff9640 1 -- 172.21.15.131:0/2462664785 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf8017070 con 0x7fad0006f2d0 2024-05-17T11:53:25.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.103+0000 7facfcff9640 1 -- 172.21.15.131:0/2462664785 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facf80052f0 con 0x7fad0006f2d0 2024-05-17T11:53:25.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.103+0000 7fad05be0640 1 -- 172.21.15.131:0/2462664785 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0006ff50 con 0x7fad0006f2d0 2024-05-17T11:53:25.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.103+0000 7facfcff9640 1 -- 172.21.15.131:0/2462664785 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf8003830 con 0x7fad0006f2d0 2024-05-17T11:53:25.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.103+0000 7fad05be0640 1 -- 172.21.15.131:0/2462664785 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad0014c8e0 con 0x7fad0006f2d0 2024-05-17T11:53:25.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.105+0000 7fad05be0640 1 -- 172.21.15.131:0/2462664785 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad0015d540 con 0x7fad0006f2d0 2024-05-17T11:53:25.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.105+0000 7facfcff9640 1 -- 172.21.15.131:0/2462664785 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7facf801a070 con 0x7fad0006f2d0 2024-05-17T11:53:25.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.107+0000 7facfcff9640 1 --2- 172.21.15.131:0/2462664785 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7face0076300 0x7face0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:25.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.107+0000 7facff7fe640 1 --2- 172.21.15.131:0/2462664785 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7face0076300 0x7face0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:25.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.107+0000 7facfcff9640 1 -- 172.21.15.131:0/2462664785 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7facf8096650 con 0x7fad0006f2d0 2024-05-17T11:53:25.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.107+0000 7facfcff9640 1 --2- 172.21.15.131:0/2462664785 >> [v2:172.21.15.131:6817/2798377402,v1:172.21.15.131:6819/2798377402] conn(0x7face007c7f0 0x7face007ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:25.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.107+0000 7facfcff9640 1 -- 172.21.15.131:0/2462664785 --> [v2:172.21.15.131:6817/2798377402,v1:172.21.15.131:6819/2798377402] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7facf800de50 con 0x7face007c7f0 2024-05-17T11:53:25.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.107+0000 7facfcff9640 1 -- 172.21.15.131:0/2462664785 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7facf809d050 con 0x7fad0006f2d0 2024-05-17T11:53:25.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.108+0000 7facf6ffd640 1 --2- 172.21.15.131:0/2462664785 >> [v2:172.21.15.131:6817/2798377402,v1:172.21.15.131:6819/2798377402] conn(0x7face007c7f0 0x7face007ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:25.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.108+0000 7facff7fe640 1 --2- 172.21.15.131:0/2462664785 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7face0076300 0x7face0078810 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7facf0034000 tx=0x7facf002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:25.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.108+0000 7facf6ffd640 1 --2- 172.21.15.131:0/2462664785 >> [v2:172.21.15.131:6817/2798377402,v1:172.21.15.131:6819/2798377402] conn(0x7face007c7f0 0x7face007ec80 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:25.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.109+0000 7facfcff9640 1 -- 172.21.15.131:0/2462664785 <== osd.0 v2:172.21.15.131:6817/2798377402 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7facf800de50 con 0x7face007c7f0 2024-05-17T11:53:25.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.123+0000 7fad05be0640 1 -- 172.21.15.131:0/2462664785 --> [v2:172.21.15.131:6817/2798377402,v1:172.21.15.131:6819/2798377402] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fad0006aad0 con 0x7face007c7f0 2024-05-17T11:53:25.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.123+0000 7facfcff9640 1 -- 172.21.15.131:0/2462664785 <== osd.0 v2:172.21.15.131:6817/2798377402 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fad0006aad0 con 0x7face007c7f0 2024-05-17T11:53:25.109 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T11:53:25.109 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-17T11:53:25.110 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T11:53:25.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.124+0000 7fad05be0640 1 -- 172.21.15.131:0/2462664785 >> [v2:172.21.15.131:6817/2798377402,v1:172.21.15.131:6819/2798377402] conn(0x7face007c7f0 msgr2=0x7face007ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:25.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.124+0000 7fad05be0640 1 --2- 172.21.15.131:0/2462664785 >> [v2:172.21.15.131:6817/2798377402,v1:172.21.15.131:6819/2798377402] conn(0x7face007c7f0 0x7face007ec80 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.124+0000 7fad05be0640 1 -- 172.21.15.131:0/2462664785 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7face0076300 msgr2=0x7face0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:25.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.124+0000 7fad05be0640 1 --2- 172.21.15.131:0/2462664785 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7face0076300 0x7face0078810 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7facf0034000 tx=0x7facf002f000 comp rx=0 tx=0).stop 2024-05-17T11:53:25.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.124+0000 7fad05be0640 1 -- 172.21.15.131:0/2462664785 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad0006f2d0 msgr2=0x7fad000cfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:25.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.124+0000 7fad05be0640 1 --2- 172.21.15.131:0/2462664785 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad0006f2d0 0x7fad000cfa10 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7facf800c3f0 tx=0x7facf800c8b0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.124+0000 7facfffff640 1 -- 172.21.15.131:0/2462664785 reap_dead start 2024-05-17T11:53:25.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.124+0000 7fad05be0640 1 -- 172.21.15.131:0/2462664785 shutdown_connections 2024-05-17T11:53:25.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.124+0000 7fad05be0640 1 -- 172.21.15.131:0/2462664785 >> 172.21.15.131:0/2462664785 conn(0x7fad000b4dd0 msgr2=0x7fad000d3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:25.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.125+0000 7fad05be0640 1 -- 172.21.15.131:0/2462664785 shutdown_connections 2024-05-17T11:53:25.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.125+0000 7fad05be0640 1 -- 172.21.15.131:0/2462664785 wait complete. 2024-05-17T11:53:25.125 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-17T11:53:25.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.311+0000 7f261e6df640 1 Processor -- start 2024-05-17T11:53:25.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.311+0000 7f261e6df640 1 -- start start 2024-05-17T11:53:25.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.315+0000 7f261e6df640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f261815f770 0x7f26180d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:25.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.315+0000 7f261e6df640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f26180d3da0 0x7f26180d41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:25.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.315+0000 7f261e6df640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f26180cf880 0x7f26180cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:25.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.315+0000 7f261e6df640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f26180d46f0 con 0x7f26180cf880 2024-05-17T11:53:25.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.315+0000 7f261e6df640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f26180d05b0 con 0x7f26180d3da0 2024-05-17T11:53:25.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.315+0000 7f261e6df640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f26180d0890 con 0x7f261815f770 2024-05-17T11:53:25.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.315+0000 7f261cc7c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f26180cf880 0x7f26180cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:25.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.315+0000 7f261cc7c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f26180cf880 0x7f26180cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55180/0 (socket says 172.21.15.131:55180) 2024-05-17T11:53:25.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.315+0000 7f2617fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f261815f770 0x7f26180d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:25.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.315+0000 7f261cc7c640 1 -- 172.21.15.131:0/1510026921 learned_addr learned my addr 172.21.15.131:0/1510026921 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:25.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.315+0000 7f260ffff640 1 --2- 172.21.15.131:0/1510026921 >> v2:172.21.15.150:3300/0 conn(0x7f26180d3da0 0x7f26180d41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:25.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.315+0000 7f2617fff640 1 -- 172.21.15.131:0/1510026921 >> v2:172.21.15.150:3300/0 conn(0x7f26180d3da0 msgr2=0x7f26180d41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:25.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.315+0000 7f2617fff640 1 --2- 172.21.15.131:0/1510026921 >> v2:172.21.15.150:3300/0 conn(0x7f26180d3da0 0x7f26180d41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.316+0000 7f2617fff640 1 -- 172.21.15.131:0/1510026921 >> v2:172.21.15.131:3300/0 conn(0x7f26180cf880 msgr2=0x7f26180cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:25.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.316+0000 7f2617fff640 1 --2- 172.21.15.131:0/1510026921 >> v2:172.21.15.131:3300/0 conn(0x7f26180cf880 0x7f26180cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.316+0000 7f2617fff640 1 -- 172.21.15.131:0/1510026921 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26180d0b70 con 0x7f261815f770 2024-05-17T11:53:25.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.316+0000 7f2617fff640 1 --2- 172.21.15.131:0/1510026921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f261815f770 0x7f26180d1650 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f26180d4d30 tx=0x7f260802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1773553d4bf575fc server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:25.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.317+0000 7f26177fe640 1 -- 172.21.15.131:0/1510026921 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608037070 con 0x7f261815f770 2024-05-17T11:53:25.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.317+0000 7f26177fe640 1 -- 172.21.15.131:0/1510026921 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f260802ae50 con 0x7f261815f770 2024-05-17T11:53:25.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.317+0000 7f26177fe640 1 -- 172.21.15.131:0/1510026921 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608032660 con 0x7f261815f770 2024-05-17T11:53:25.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.318+0000 7f261e6df640 1 -- 172.21.15.131:0/1510026921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f261815f770 msgr2=0x7f26180d1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:25.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.318+0000 7f261e6df640 1 --2- 172.21.15.131:0/1510026921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f261815f770 0x7f26180d1650 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f26180d4d30 tx=0x7f260802a100 comp rx=0 tx=0).stop 2024-05-17T11:53:25.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.319+0000 7f261e6df640 1 -- 172.21.15.131:0/1510026921 shutdown_connections 2024-05-17T11:53:25.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.319+0000 7f261e6df640 1 --2- 172.21.15.131:0/1510026921 >> v2:172.21.15.131:3300/0 conn(0x7f26180cf880 0x7f26180cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.319+0000 7f261e6df640 1 --2- 172.21.15.131:0/1510026921 >> v2:172.21.15.150:3300/0 conn(0x7f26180d3da0 0x7f26180d41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.319+0000 7f261e6df640 1 --2- 172.21.15.131:0/1510026921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f261815f770 0x7f26180d1650 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.319+0000 7f261e6df640 1 -- 172.21.15.131:0/1510026921 >> 172.21.15.131:0/1510026921 conn(0x7f26180d2300 msgr2=0x7f26180b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:25.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.319+0000 7f261e6df640 1 -- 172.21.15.131:0/1510026921 shutdown_connections 2024-05-17T11:53:25.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.319+0000 7f261e6df640 1 -- 172.21.15.131:0/1510026921 wait complete. 2024-05-17T11:53:25.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.324+0000 7f261e6df640 1 Processor -- start 2024-05-17T11:53:25.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.324+0000 7f261e6df640 1 -- start start 2024-05-17T11:53:25.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.327+0000 7f261e6df640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26180cf880 0x7f26180cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:25.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.327+0000 7f261e6df640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26180d3da0 0x7f26180cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:25.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.327+0000 7f261e6df640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f261815f770 0x7f2618159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:25.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.327+0000 7f261e6df640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f26180d01d0 con 0x7f26180cf880 2024-05-17T11:53:25.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.328+0000 7f261e6df640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f26180d1130 con 0x7f26180d3da0 2024-05-17T11:53:25.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.328+0000 7f261e6df640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f26180d0350 con 0x7f261815f770 2024-05-17T11:53:25.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.328+0000 7f2617fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26180cf880 0x7f26180cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:25.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.328+0000 7f2617fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26180cf880 0x7f26180cd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55186/0 (socket says 172.21.15.131:55186) 2024-05-17T11:53:25.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.328+0000 7f2617fff640 1 -- 172.21.15.131:0/4028983692 learned_addr learned my addr 172.21.15.131:0/4028983692 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:25.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.328+0000 7f261cc7c640 1 --2- 172.21.15.131:0/4028983692 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f261815f770 0x7f2618159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:25.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.328+0000 7f260ffff640 1 --2- 172.21.15.131:0/4028983692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26180d3da0 0x7f26180cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:25.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.328+0000 7f2617fff640 1 -- 172.21.15.131:0/4028983692 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f261815f770 msgr2=0x7f2618159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:25.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.328+0000 7f2617fff640 1 --2- 172.21.15.131:0/4028983692 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f261815f770 0x7f2618159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.328+0000 7f2617fff640 1 -- 172.21.15.131:0/4028983692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26180d3da0 msgr2=0x7f26180cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:25.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.328+0000 7f2617fff640 1 --2- 172.21.15.131:0/4028983692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26180d3da0 0x7f26180cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.328+0000 7f2617fff640 1 -- 172.21.15.131:0/4028983692 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26180cc810 con 0x7f26180cf880 2024-05-17T11:53:25.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.329+0000 7f2617fff640 1 --2- 172.21.15.131:0/4028983692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26180cf880 0x7f26180cd8b0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f2608000c00 tx=0x7f26080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:25.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.329+0000 7f26157fa640 1 -- 172.21.15.131:0/4028983692 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608041070 con 0x7f26180cf880 2024-05-17T11:53:25.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.329+0000 7f26157fa640 1 -- 172.21.15.131:0/4028983692 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f260803c460 con 0x7f26180cf880 2024-05-17T11:53:25.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.329+0000 7f261e6df640 1 -- 172.21.15.131:0/4028983692 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26180ccaf0 con 0x7f26180cf880 2024-05-17T11:53:25.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.329+0000 7f26157fa640 1 -- 172.21.15.131:0/4028983692 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608037040 con 0x7f26180cf880 2024-05-17T11:53:25.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.329+0000 7f261e6df640 1 -- 172.21.15.131:0/4028983692 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26180cd0b0 con 0x7f26180cf880 2024-05-17T11:53:25.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.331+0000 7f261e6df640 1 -- 172.21.15.131:0/4028983692 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26180d41b0 con 0x7f26180cf880 2024-05-17T11:53:25.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.333+0000 7f26157fa640 1 -- 172.21.15.131:0/4028983692 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2608044070 con 0x7f26180cf880 2024-05-17T11:53:25.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.334+0000 7f26157fa640 1 --2- 172.21.15.131:0/4028983692 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f25f80762d0 0x7f25f80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:25.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.335+0000 7f260ffff640 1 --2- 172.21.15.131:0/4028983692 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f25f80762d0 0x7f25f80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:25.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.335+0000 7f26157fa640 1 -- 172.21.15.131:0/4028983692 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f26080b7630 con 0x7f26180cf880 2024-05-17T11:53:25.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.336+0000 7f260ffff640 1 --2- 172.21.15.131:0/4028983692 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f25f80762d0 0x7f25f80787e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f26181f8d60 tx=0x7f2600009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:25.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.347+0000 7f26157fa640 1 -- 172.21.15.131:0/4028983692 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2608080990 con 0x7f26180cf880 2024-05-17T11:53:25.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.911+0000 7f261e6df640 1 -- 172.21.15.131:0/4028983692 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f2618158c90 con 0x7f25f80762d0 2024-05-17T11:53:25.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.912+0000 7f26157fa640 1 -- 172.21.15.131:0/4028983692 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2618158c90 con 0x7f25f80762d0 2024-05-17T11:53:25.897 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 0 to deep-scrub 2024-05-17T11:53:25.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.916+0000 7f261e6df640 1 -- 172.21.15.131:0/4028983692 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f25f80762d0 msgr2=0x7f25f80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:25.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.916+0000 7f261e6df640 1 --2- 172.21.15.131:0/4028983692 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f25f80762d0 0x7f25f80787e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f26181f8d60 tx=0x7f2600009190 comp rx=0 tx=0).stop 2024-05-17T11:53:25.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.916+0000 7f261e6df640 1 -- 172.21.15.131:0/4028983692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26180cf880 msgr2=0x7f26180cd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:25.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.916+0000 7f261e6df640 1 --2- 172.21.15.131:0/4028983692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26180cf880 0x7f26180cd8b0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f2608000c00 tx=0x7f26080046c0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.916+0000 7f261e6df640 1 -- 172.21.15.131:0/4028983692 shutdown_connections 2024-05-17T11:53:25.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.916+0000 7f261e6df640 1 --2- 172.21.15.131:0/4028983692 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f25f80762d0 0x7f25f80787e0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.916+0000 7f261e6df640 1 --2- 172.21.15.131:0/4028983692 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f261815f770 0x7f2618159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.916+0000 7f261e6df640 1 --2- 172.21.15.131:0/4028983692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26180d3da0 0x7f26180cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.916+0000 7f261e6df640 1 --2- 172.21.15.131:0/4028983692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26180cf880 0x7f26180cd8b0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:25.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.916+0000 7f261e6df640 1 -- 172.21.15.131:0/4028983692 >> 172.21.15.131:0/4028983692 conn(0x7f26180d2300 msgr2=0x7f26180b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:25.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.916+0000 7f261e6df640 1 -- 172.21.15.131:0/4028983692 shutdown_connections 2024-05-17T11:53:25.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:25.916+0000 7f261e6df640 1 -- 172.21.15.131:0/4028983692 wait complete. 2024-05-17T11:53:25.928 INFO:tasks.ceph:Scrubbing osd.1 2024-05-17T11:53:25.928 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-17T11:53:26.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.134+0000 7fe5e2d54640 1 Processor -- start 2024-05-17T11:53:26.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.134+0000 7fe5e2d54640 1 -- start start 2024-05-17T11:53:26.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.138+0000 7fe5e2d54640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe5dc0b67e0 0x7fe5dc15c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:26.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.138+0000 7fe5e2d54640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5dc0d0de0 con 0x7fe5dc156bc0 2024-05-17T11:53:26.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.138+0000 7fe5e2d54640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5dc0d10c0 con 0x7fe5dc070680 2024-05-17T11:53:26.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.138+0000 7fe5e2d54640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe5dc0d13a0 con 0x7fe5dc0b67e0 2024-05-17T11:53:26.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.138+0000 7fe5e0af0640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe5dc156bc0 0x7fe5dc0b60d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38380/0 (socket says 172.21.15.131:38380) 2024-05-17T11:53:26.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.138+0000 7fe5e0af0640 1 -- 172.21.15.131:0/1626008624 learned_addr learned my addr 172.21.15.131:0/1626008624 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:26.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.138+0000 7fe5dbfff640 1 --2- 172.21.15.131:0/1626008624 >> v2:172.21.15.131:3300/0 conn(0x7fe5dc0b67e0 0x7fe5dc15c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:26.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.139+0000 7fe5db7fe640 1 -- 172.21.15.131:0/1626008624 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 494317043 0 0) 0x7fe5dc0d10c0 con 0x7fe5dc070680 2024-05-17T11:53:26.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.139+0000 7fe5db7fe640 1 -- 172.21.15.131:0/1626008624 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5c8003520 con 0x7fe5dc070680 2024-05-17T11:53:26.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.139+0000 7fe5db7fe640 1 -- 172.21.15.131:0/1626008624 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3422583905 0 0) 0x7fe5dc0d0de0 con 0x7fe5dc156bc0 2024-05-17T11:53:26.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.139+0000 7fe5dbfff640 1 -- 172.21.15.131:0/1626008624 >> v1:172.21.15.150:6789/0 conn(0x7fe5dc070680 legacy=0x7fe5dc165f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:26.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.139+0000 7fe5dbfff640 1 -- 172.21.15.131:0/1626008624 >> v1:172.21.15.131:6789/0 conn(0x7fe5dc156bc0 legacy=0x7fe5dc0b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:26.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.139+0000 7fe5dbfff640 1 -- 172.21.15.131:0/1626008624 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc0d1680 con 0x7fe5dc0b67e0 2024-05-17T11:53:26.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.141+0000 7fe5dbfff640 1 --2- 172.21.15.131:0/1626008624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5dc0b67e0 0x7fe5dc15c900 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0097a0 tx=0x7fe5cc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c9bc239596dfa2 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:26.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.141+0000 7fe5db7fe640 1 -- 172.21.15.131:0/1626008624 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc037070 con 0x7fe5dc0b67e0 2024-05-17T11:53:26.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.141+0000 7fe5db7fe640 1 -- 172.21.15.131:0/1626008624 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5cc032440 con 0x7fe5dc0b67e0 2024-05-17T11:53:26.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.141+0000 7fe5db7fe640 1 -- 172.21.15.131:0/1626008624 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc0327f0 con 0x7fe5dc0b67e0 2024-05-17T11:53:26.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.143+0000 7fe5e2d54640 1 -- 172.21.15.131:0/1626008624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5dc0b67e0 msgr2=0x7fe5dc15c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:26.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.143+0000 7fe5e2d54640 1 --2- 172.21.15.131:0/1626008624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5dc0b67e0 0x7fe5dc15c900 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0097a0 tx=0x7fe5cc02a230 comp rx=0 tx=0).stop 2024-05-17T11:53:26.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.143+0000 7fe5e2d54640 1 -- 172.21.15.131:0/1626008624 shutdown_connections 2024-05-17T11:53:26.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.143+0000 7fe5e2d54640 1 --2- 172.21.15.131:0/1626008624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5dc0b67e0 0x7fe5dc15c900 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:26.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.143+0000 7fe5e2d54640 1 -- 172.21.15.131:0/1626008624 >> 172.21.15.131:0/1626008624 conn(0x7fe5dc073710 msgr2=0x7fe5dc073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:26.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.143+0000 7fe5e2d54640 1 -- 172.21.15.131:0/1626008624 shutdown_connections 2024-05-17T11:53:26.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.143+0000 7fe5e2d54640 1 -- 172.21.15.131:0/1626008624 wait complete. 2024-05-17T11:53:26.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.148+0000 7fe5e2d54640 1 Processor -- start 2024-05-17T11:53:26.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.148+0000 7fe5e2d54640 1 -- start start 2024-05-17T11:53:26.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.152+0000 7fe5e2d54640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5dc070680 0x7fe5dc14c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:26.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.152+0000 7fe5e2d54640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5dc156bc0 0x7fe5dc0ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:26.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.152+0000 7fe5e2d54640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5dc0cdcd0 0x7fe5dc0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:26.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.152+0000 7fe5e2d54640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc0713c0 con 0x7fe5dc0cdcd0 2024-05-17T11:53:26.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.152+0000 7fe5e2d54640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc074910 con 0x7fe5dc070680 2024-05-17T11:53:26.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.152+0000 7fe5e2d54640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe5dc071540 con 0x7fe5dc156bc0 2024-05-17T11:53:26.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.152+0000 7fe5e12f1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5dc0cdcd0 0x7fe5dc0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:26.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.152+0000 7fe5e12f1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5dc0cdcd0 0x7fe5dc0ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55204/0 (socket says 172.21.15.131:55204) 2024-05-17T11:53:26.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.152+0000 7fe5e12f1640 1 -- 172.21.15.131:0/3593533459 learned_addr learned my addr 172.21.15.131:0/3593533459 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:26.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.153+0000 7fe5e0af0640 1 --2- 172.21.15.131:0/3593533459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5dc070680 0x7fe5dc14c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:26.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.153+0000 7fe5dbfff640 1 --2- 172.21.15.131:0/3593533459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5dc156bc0 0x7fe5dc0ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:26.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.153+0000 7fe5e12f1640 1 -- 172.21.15.131:0/3593533459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5dc156bc0 msgr2=0x7fe5dc0ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:26.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.153+0000 7fe5e12f1640 1 --2- 172.21.15.131:0/3593533459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5dc156bc0 0x7fe5dc0ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:26.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.153+0000 7fe5e12f1640 1 -- 172.21.15.131:0/3593533459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5dc070680 msgr2=0x7fe5dc14c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:26.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.153+0000 7fe5e12f1640 1 --2- 172.21.15.131:0/3593533459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5dc070680 0x7fe5dc14c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:26.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.153+0000 7fe5e12f1640 1 -- 172.21.15.131:0/3593533459 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc0ce620 con 0x7fe5dc0cdcd0 2024-05-17T11:53:26.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.153+0000 7fe5dbfff640 1 --2- 172.21.15.131:0/3593533459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5dc156bc0 0x7fe5dc0ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:26.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.153+0000 7fe5e12f1640 1 --2- 172.21.15.131:0/3593533459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5dc0cdcd0 0x7fe5dc0ce0e0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400c760 tx=0x7fe5d400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:26.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.154+0000 7fe5d97fa640 1 -- 172.21.15.131:0/3593533459 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4003b70 con 0x7fe5dc0cdcd0 2024-05-17T11:53:26.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.154+0000 7fe5d97fa640 1 -- 172.21.15.131:0/3593533459 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d4003d30 con 0x7fe5dc0cdcd0 2024-05-17T11:53:26.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.154+0000 7fe5e2d54640 1 -- 172.21.15.131:0/3593533459 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5dc14ced0 con 0x7fe5dc0cdcd0 2024-05-17T11:53:26.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.154+0000 7fe5d97fa640 1 -- 172.21.15.131:0/3593533459 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d400aa90 con 0x7fe5dc0cdcd0 2024-05-17T11:53:26.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.154+0000 7fe5e2d54640 1 -- 172.21.15.131:0/3593533459 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5dc0caf00 con 0x7fe5dc0cdcd0 2024-05-17T11:53:26.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.156+0000 7fe5e2d54640 1 -- 172.21.15.131:0/3593533459 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe5dc156620 con 0x7fe5dc0cdcd0 2024-05-17T11:53:26.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.158+0000 7fe5d97fa640 1 -- 172.21.15.131:0/3593533459 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe5d400ac30 con 0x7fe5dc0cdcd0 2024-05-17T11:53:26.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.159+0000 7fe5d97fa640 1 --2- 172.21.15.131:0/3593533459 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe5bc0762d0 0x7fe5bc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:26.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.159+0000 7fe5d97fa640 1 -- 172.21.15.131:0/3593533459 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7fe5d4097220 con 0x7fe5dc0cdcd0 2024-05-17T11:53:26.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.159+0000 7fe5e0af0640 1 --2- 172.21.15.131:0/3593533459 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe5bc0762d0 0x7fe5bc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:26.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.160+0000 7fe5d97fa640 1 --2- 172.21.15.131:0/3593533459 >> [v2:172.21.15.131:6816/730333560,v1:172.21.15.131:6818/730333560] conn(0x7fe5bc07c7c0 0x7fe5bc07ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:26.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.160+0000 7fe5d97fa640 1 -- 172.21.15.131:0/3593533459 --> [v2:172.21.15.131:6816/730333560,v1:172.21.15.131:6818/730333560] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe5bc07f320 con 0x7fe5bc07c7c0 2024-05-17T11:53:26.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.160+0000 7fe5d97fa640 1 -- 172.21.15.131:0/3593533459 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fe5d409e050 con 0x7fe5dc0cdcd0 2024-05-17T11:53:26.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.160+0000 7fe5dbfff640 1 --2- 172.21.15.131:0/3593533459 >> [v2:172.21.15.131:6816/730333560,v1:172.21.15.131:6818/730333560] conn(0x7fe5bc07c7c0 0x7fe5bc07ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:26.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.160+0000 7fe5e0af0640 1 --2- 172.21.15.131:0/3593533459 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe5bc0762d0 0x7fe5bc0787e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4000f60 tx=0x7fe5c4007e40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:26.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.161+0000 7fe5dbfff640 1 --2- 172.21.15.131:0/3593533459 >> [v2:172.21.15.131:6816/730333560,v1:172.21.15.131:6818/730333560] conn(0x7fe5bc07c7c0 0x7fe5bc07ec50 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:26.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.162+0000 7fe5d97fa640 1 -- 172.21.15.131:0/3593533459 <== osd.1 v2:172.21.15.131:6816/730333560 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe5bc07f320 con 0x7fe5bc07c7c0 2024-05-17T11:53:26.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.176+0000 7fe5e2d54640 1 -- 172.21.15.131:0/3593533459 --> [v2:172.21.15.131:6816/730333560,v1:172.21.15.131:6818/730333560] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe5dc0ca9b0 con 0x7fe5bc07c7c0 2024-05-17T11:53:26.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.176+0000 7fe5d97fa640 1 -- 172.21.15.131:0/3593533459 <== osd.1 v2:172.21.15.131:6816/730333560 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe5dc0ca9b0 con 0x7fe5bc07c7c0 2024-05-17T11:53:26.162 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T11:53:26.162 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-17T11:53:26.162 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T11:53:26.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.176+0000 7fe5e2d54640 1 -- 172.21.15.131:0/3593533459 >> [v2:172.21.15.131:6816/730333560,v1:172.21.15.131:6818/730333560] conn(0x7fe5bc07c7c0 msgr2=0x7fe5bc07ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:26.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.176+0000 7fe5e2d54640 1 --2- 172.21.15.131:0/3593533459 >> [v2:172.21.15.131:6816/730333560,v1:172.21.15.131:6818/730333560] conn(0x7fe5bc07c7c0 0x7fe5bc07ec50 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:26.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.177+0000 7fe5e2d54640 1 -- 172.21.15.131:0/3593533459 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe5bc0762d0 msgr2=0x7fe5bc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:26.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.177+0000 7fe5e2d54640 1 --2- 172.21.15.131:0/3593533459 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fe5bc0762d0 0x7fe5bc0787e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4000f60 tx=0x7fe5c4007e40 comp rx=0 tx=0).stop 2024-05-17T11:53:26.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.177+0000 7fe5e2d54640 1 -- 172.21.15.131:0/3593533459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5dc0cdcd0 msgr2=0x7fe5dc0ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:26.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.177+0000 7fe5e2d54640 1 --2- 172.21.15.131:0/3593533459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5dc0cdcd0 0x7fe5dc0ce0e0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400c760 tx=0x7fe5d400cc20 comp rx=0 tx=0).stop 2024-05-17T11:53:26.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.177+0000 7fe5e12f1640 1 -- 172.21.15.131:0/3593533459 reap_dead start 2024-05-17T11:53:26.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.177+0000 7fe5e2d54640 1 -- 172.21.15.131:0/3593533459 shutdown_connections 2024-05-17T11:53:26.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.177+0000 7fe5e2d54640 1 -- 172.21.15.131:0/3593533459 >> 172.21.15.131:0/3593533459 conn(0x7fe5dc073710 msgr2=0x7fe5dc06cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:26.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.177+0000 7fe5e2d54640 1 -- 172.21.15.131:0/3593533459 shutdown_connections 2024-05-17T11:53:26.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.177+0000 7fe5e2d54640 1 -- 172.21.15.131:0/3593533459 wait complete. 2024-05-17T11:53:26.176 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-17T11:53:26.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.482+0000 7f17f8038640 1 Processor -- start 2024-05-17T11:53:26.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.483+0000 7f17f8038640 1 -- start start 2024-05-17T11:53:26.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.485+0000 7f17f8038640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17f015df40 0x7f17f0073d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:26.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.485+0000 7f17f8038640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f17f00d0150 0x7f17f00d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:26.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.485+0000 7f17f8038640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f00d0aa0 con 0x7f17f0074260 2024-05-17T11:53:26.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.485+0000 7f17f8038640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f17f0072ff0 con 0x7f17f00d0150 2024-05-17T11:53:26.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.485+0000 7f17f8038640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f17f0164cd0 con 0x7f17f015df40 2024-05-17T11:53:26.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.485+0000 7f17f55d3640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f17f0074260 0x7f17f006c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38386/0 (socket says 172.21.15.131:38386) 2024-05-17T11:53:26.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.485+0000 7f17f55d3640 1 -- 172.21.15.131:0/3333606216 learned_addr learned my addr 172.21.15.131:0/3333606216 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:26.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.485+0000 7f17f5dd4640 1 --2- 172.21.15.131:0/3333606216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17f015df40 0x7f17f0073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:26.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.485+0000 7f17f65d5640 1 --2- 172.21.15.131:0/3333606216 >> v2:172.21.15.150:3300/0 conn(0x7f17f00d0150 0x7f17f00d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:26.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.485+0000 7f17f4dd2640 1 -- 172.21.15.131:0/3333606216 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3016685140 0 0) 0x7f17e0001110 con 0x7f17f0074260 2024-05-17T11:53:26.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.486+0000 7f17f65d5640 1 -- 172.21.15.131:0/3333606216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17f015df40 msgr2=0x7f17f0073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:26.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.486+0000 7f17f65d5640 1 --2- 172.21.15.131:0/3333606216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17f015df40 0x7f17f0073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:26.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.486+0000 7f17f65d5640 1 -- 172.21.15.131:0/3333606216 >> v1:172.21.15.131:6789/0 conn(0x7f17f0074260 legacy=0x7f17f006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:26.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.486+0000 7f17f65d5640 1 -- 172.21.15.131:0/3333606216 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f0073240 con 0x7f17f00d0150 2024-05-17T11:53:26.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.486+0000 7f17f5dd4640 1 --2- 172.21.15.131:0/3333606216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17f015df40 0x7f17f0073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:26.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.488+0000 7f17f65d5640 1 --2- 172.21.15.131:0/3333606216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17f00d0150 0x7f17f00d0560 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009d90 tx=0x7f17e802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce8f358c7dcfc47b server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:26.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.488+0000 7f17f4dd2640 1 -- 172.21.15.131:0/3333606216 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8007740 con 0x7f17f00d0150 2024-05-17T11:53:26.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.488+0000 7f17f4dd2640 1 -- 172.21.15.131:0/3333606216 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e80078e0 con 0x7f17f00d0150 2024-05-17T11:53:26.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.488+0000 7f17f4dd2640 1 -- 172.21.15.131:0/3333606216 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8007cb0 con 0x7f17f00d0150 2024-05-17T11:53:26.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.490+0000 7f17f8038640 1 -- 172.21.15.131:0/3333606216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17f00d0150 msgr2=0x7f17f00d0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:26.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.490+0000 7f17f8038640 1 --2- 172.21.15.131:0/3333606216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17f00d0150 0x7f17f00d0560 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009d90 tx=0x7f17e802a660 comp rx=0 tx=0).stop 2024-05-17T11:53:26.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.490+0000 7f17f8038640 1 -- 172.21.15.131:0/3333606216 shutdown_connections 2024-05-17T11:53:26.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.490+0000 7f17f8038640 1 --2- 172.21.15.131:0/3333606216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17f00d0150 0x7f17f00d0560 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:26.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.490+0000 7f17f8038640 1 --2- 172.21.15.131:0/3333606216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17f015df40 0x7f17f0073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:26.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.490+0000 7f17f8038640 1 -- 172.21.15.131:0/3333606216 >> 172.21.15.131:0/3333606216 conn(0x7f17f00b36d0 msgr2=0x7f17f00d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:26.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.490+0000 7f17f8038640 1 -- 172.21.15.131:0/3333606216 shutdown_connections 2024-05-17T11:53:26.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.490+0000 7f17f8038640 1 -- 172.21.15.131:0/3333606216 wait complete. 2024-05-17T11:53:26.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.495+0000 7f17f8038640 1 Processor -- start 2024-05-17T11:53:26.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.495+0000 7f17f8038640 1 -- start start 2024-05-17T11:53:26.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.499+0000 7f17f8038640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17f0074260 0x7f17f0150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:26.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.499+0000 7f17f8038640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17f00d0150 0x7f17f0160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:26.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.499+0000 7f17f8038640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17f015df40 0x7f17f01f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:26.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.499+0000 7f17f8038640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f17f015e350 con 0x7f17f015df40 2024-05-17T11:53:26.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.499+0000 7f17f8038640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f17f0073800 con 0x7f17f0074260 2024-05-17T11:53:26.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.499+0000 7f17f8038640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f17f006ce00 con 0x7f17f00d0150 2024-05-17T11:53:26.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.500+0000 7f17f65d5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17f015df40 0x7f17f01f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:26.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.500+0000 7f17f5dd4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17f0074260 0x7f17f0150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:26.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.500+0000 7f17f55d3640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17f00d0150 0x7f17f0160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:26.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.500+0000 7f17f65d5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17f015df40 0x7f17f01f9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55208/0 (socket says 172.21.15.131:55208) 2024-05-17T11:53:26.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.500+0000 7f17f65d5640 1 -- 172.21.15.131:0/3693786456 learned_addr learned my addr 172.21.15.131:0/3693786456 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:26.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.500+0000 7f17f5dd4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17f0074260 0x7f17f0150050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:55628/0 (socket says 172.21.15.131:55628) 2024-05-17T11:53:26.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.500+0000 7f17f5dd4640 1 -- 172.21.15.131:0/3693786456 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17f00d0150 msgr2=0x7f17f0160f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:26.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.500+0000 7f17f5dd4640 1 --2- 172.21.15.131:0/3693786456 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17f00d0150 0x7f17f0160f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:26.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.500+0000 7f17f5dd4640 1 -- 172.21.15.131:0/3693786456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17f015df40 msgr2=0x7f17f01f9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:26.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.500+0000 7f17f5dd4640 1 --2- 172.21.15.131:0/3693786456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17f015df40 0x7f17f01f9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:26.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.500+0000 7f17f5dd4640 1 -- 172.21.15.131:0/3693786456 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f0150590 con 0x7f17f0074260 2024-05-17T11:53:26.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.500+0000 7f17f5dd4640 1 --2- 172.21.15.131:0/3693786456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17f0074260 0x7f17f0150050 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00e870 tx=0x7f17ec00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:26.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.501+0000 7f17e67fc640 1 -- 172.21.15.131:0/3693786456 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec017070 con 0x7f17f0074260 2024-05-17T11:53:26.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.501+0000 7f17e67fc640 1 -- 172.21.15.131:0/3693786456 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec00c940 con 0x7f17f0074260 2024-05-17T11:53:26.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.501+0000 7f17f8038640 1 -- 172.21.15.131:0/3693786456 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f015f980 con 0x7f17f0074260 2024-05-17T11:53:26.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.501+0000 7f17e67fc640 1 -- 172.21.15.131:0/3693786456 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec00cd10 con 0x7f17f0074260 2024-05-17T11:53:26.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.501+0000 7f17f8038640 1 -- 172.21.15.131:0/3693786456 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f0160160 con 0x7f17f0074260 2024-05-17T11:53:26.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.503+0000 7f17e67fc640 1 -- 172.21.15.131:0/3693786456 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f17ec01a070 con 0x7f17f0074260 2024-05-17T11:53:26.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.503+0000 7f17f8038640 1 -- 172.21.15.131:0/3693786456 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f0160b60 con 0x7f17f0074260 2024-05-17T11:53:26.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.504+0000 7f17e67fc640 1 --2- 172.21.15.131:0/3693786456 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f17d4076300 0x7f17d4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:26.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.505+0000 7f17f55d3640 1 --2- 172.21.15.131:0/3693786456 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f17d4076300 0x7f17d4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:26.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.505+0000 7f17e67fc640 1 -- 172.21.15.131:0/3693786456 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f17ec0971c0 con 0x7f17f0074260 2024-05-17T11:53:26.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.506+0000 7f17f55d3640 1 --2- 172.21.15.131:0/3693786456 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f17d4076300 0x7f17d4078810 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f17f01efab0 tx=0x7f17e0007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:26.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:26.509+0000 7f17e67fc640 1 -- 172.21.15.131:0/3693786456 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f17f0150590 con 0x7f17f0074260 2024-05-17T11:53:27.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.067+0000 7f17f8038640 1 -- 172.21.15.131:0/3693786456 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f17f00d0560 con 0x7f17d4076300 2024-05-17T11:53:27.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.067+0000 7f17e67fc640 1 -- 172.21.15.131:0/3693786456 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f17f00d0560 con 0x7f17d4076300 2024-05-17T11:53:27.053 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 1 to deep-scrub 2024-05-17T11:53:27.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.071+0000 7f17f8038640 1 -- 172.21.15.131:0/3693786456 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f17d4076300 msgr2=0x7f17d4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:27.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.072+0000 7f17f8038640 1 --2- 172.21.15.131:0/3693786456 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f17d4076300 0x7f17d4078810 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f17f01efab0 tx=0x7f17e0007de0 comp rx=0 tx=0).stop 2024-05-17T11:53:27.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.072+0000 7f17f8038640 1 -- 172.21.15.131:0/3693786456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17f0074260 msgr2=0x7f17f0150050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:27.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.072+0000 7f17f8038640 1 --2- 172.21.15.131:0/3693786456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17f0074260 0x7f17f0150050 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00e870 tx=0x7f17ec00ed30 comp rx=0 tx=0).stop 2024-05-17T11:53:27.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.072+0000 7f17f8038640 1 -- 172.21.15.131:0/3693786456 shutdown_connections 2024-05-17T11:53:27.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.072+0000 7f17f8038640 1 --2- 172.21.15.131:0/3693786456 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f17d4076300 0x7f17d4078810 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:27.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.072+0000 7f17f8038640 1 --2- 172.21.15.131:0/3693786456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17f015df40 0x7f17f01f9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:27.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.072+0000 7f17f8038640 1 --2- 172.21.15.131:0/3693786456 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17f00d0150 0x7f17f0160f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:27.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.072+0000 7f17f8038640 1 --2- 172.21.15.131:0/3693786456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17f0074260 0x7f17f0150050 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:27.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.072+0000 7f17f8038640 1 -- 172.21.15.131:0/3693786456 >> 172.21.15.131:0/3693786456 conn(0x7f17f00b36d0 msgr2=0x7f17f0167420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:27.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.072+0000 7f17f8038640 1 -- 172.21.15.131:0/3693786456 shutdown_connections 2024-05-17T11:53:27.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.072+0000 7f17f8038640 1 -- 172.21.15.131:0/3693786456 wait complete. 2024-05-17T11:53:27.085 INFO:tasks.ceph:Scrubbing osd.2 2024-05-17T11:53:27.085 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-17T11:53:27.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.402+0000 7feed0a64640 1 Processor -- start 2024-05-17T11:53:27.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.402+0000 7feed0a64640 1 -- start start 2024-05-17T11:53:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.407+0000 7feed0a64640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feecc0cdd60 0x7feecc0b4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.407+0000 7feed0a64640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feecc15c5d0 con 0x7feecc0735b0 2024-05-17T11:53:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.407+0000 7feed0a64640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feecc15c8b0 con 0x7feecc15c030 2024-05-17T11:53:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.407+0000 7feed0a64640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7feecc06ef90 con 0x7feecc0cdd60 2024-05-17T11:53:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.407+0000 7feec9d9b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feecc0cdd60 0x7feecc0b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.407+0000 7feecad9d640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7feecc0735b0 0x7feecc0739c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38400/0 (socket says 172.21.15.131:38400) 2024-05-17T11:53:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.407+0000 7feecad9d640 1 -- 172.21.15.131:0/2479229211 learned_addr learned my addr 172.21.15.131:0/2479229211 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:27.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.407+0000 7feeca59c640 1 --1- 172.21.15.131:0/2479229211 >> v1:172.21.15.150:6789/0 conn(0x7feecc15c030 0x7feecc160030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:38970/0 (socket says 172.21.15.131:38970) 2024-05-17T11:53:27.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.407+0000 7feec9d9b640 1 -- 172.21.15.131:0/2479229211 >> v1:172.21.15.150:6789/0 conn(0x7feecc15c030 legacy=0x7feecc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:27.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.408+0000 7feec9d9b640 1 -- 172.21.15.131:0/2479229211 >> v1:172.21.15.131:6789/0 conn(0x7feecc0735b0 legacy=0x7feecc0739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:27.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.408+0000 7feec9d9b640 1 -- 172.21.15.131:0/2479229211 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc15cb90 con 0x7feecc0cdd60 2024-05-17T11:53:27.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.408+0000 7feec9d9b640 1 --2- 172.21.15.131:0/2479229211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feecc0cdd60 0x7feecc0b4850 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feeb400ba70 tx=0x7feeb402c6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc4b7d64cf0060a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:27.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.409+0000 7feec959a640 1 -- 172.21.15.131:0/2479229211 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb403a070 con 0x7feecc0cdd60 2024-05-17T11:53:27.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.409+0000 7feec959a640 1 -- 172.21.15.131:0/2479229211 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb4032480 con 0x7feecc0cdd60 2024-05-17T11:53:27.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.409+0000 7feec959a640 1 -- 172.21.15.131:0/2479229211 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4032850 con 0x7feecc0cdd60 2024-05-17T11:53:27.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.411+0000 7feed0a64640 1 -- 172.21.15.131:0/2479229211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feecc0cdd60 msgr2=0x7feecc0b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:27.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.411+0000 7feed0a64640 1 --2- 172.21.15.131:0/2479229211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feecc0cdd60 0x7feecc0b4850 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feeb400ba70 tx=0x7feeb402c6b0 comp rx=0 tx=0).stop 2024-05-17T11:53:27.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.411+0000 7feed0a64640 1 -- 172.21.15.131:0/2479229211 shutdown_connections 2024-05-17T11:53:27.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.411+0000 7feed0a64640 1 --2- 172.21.15.131:0/2479229211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feecc0cdd60 0x7feecc0b4850 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:27.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.411+0000 7feed0a64640 1 -- 172.21.15.131:0/2479229211 >> 172.21.15.131:0/2479229211 conn(0x7feecc0b3bb0 msgr2=0x7feecc072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:27.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.411+0000 7feed0a64640 1 -- 172.21.15.131:0/2479229211 shutdown_connections 2024-05-17T11:53:27.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.411+0000 7feed0a64640 1 -- 172.21.15.131:0/2479229211 wait complete. 2024-05-17T11:53:27.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.417+0000 7feed0a64640 1 Processor -- start 2024-05-17T11:53:27.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.417+0000 7feed0a64640 1 -- start start 2024-05-17T11:53:27.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.421+0000 7feed0a64640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feecc0735b0 0x7feecc143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:27.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.421+0000 7feed0a64640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feecc0cdd60 0x7feecc1e5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:27.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.421+0000 7feed0a64640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feecc15c030 0x7feecc1e5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:27.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.421+0000 7feed0a64640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feecc0ce170 con 0x7feecc0735b0 2024-05-17T11:53:27.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.421+0000 7feed0a64640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7feecc0b4d90 con 0x7feecc15c030 2024-05-17T11:53:27.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.421+0000 7feed0a64640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7feecc06c6f0 con 0x7feecc0cdd60 2024-05-17T11:53:27.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.421+0000 7feeca59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feecc0735b0 0x7feecc143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:27.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.421+0000 7feeca59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feecc0735b0 0x7feecc143ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55224/0 (socket says 172.21.15.131:55224) 2024-05-17T11:53:27.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.421+0000 7feeca59c640 1 -- 172.21.15.131:0/2571140642 learned_addr learned my addr 172.21.15.131:0/2571140642 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:27.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.421+0000 7feec9d9b640 1 --2- 172.21.15.131:0/2571140642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feecc0cdd60 0x7feecc1e5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:27.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.421+0000 7feecad9d640 1 --2- 172.21.15.131:0/2571140642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feecc15c030 0x7feecc1e5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:27.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.422+0000 7feeca59c640 1 -- 172.21.15.131:0/2571140642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feecc0cdd60 msgr2=0x7feecc1e5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:27.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.422+0000 7feeca59c640 1 --2- 172.21.15.131:0/2571140642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feecc0cdd60 0x7feecc1e5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:27.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.422+0000 7feeca59c640 1 -- 172.21.15.131:0/2571140642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feecc15c030 msgr2=0x7feecc1e5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:27.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.422+0000 7feeca59c640 1 --2- 172.21.15.131:0/2571140642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feecc15c030 0x7feecc1e5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:27.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.422+0000 7feeca59c640 1 -- 172.21.15.131:0/2571140642 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc1447c0 con 0x7feecc0735b0 2024-05-17T11:53:27.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.422+0000 7feeca59c640 1 --2- 172.21.15.131:0/2571140642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feecc0735b0 0x7feecc143ec0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7feebc00c460 tx=0x7feebc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:27.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.422+0000 7feec2ffd640 1 -- 172.21.15.131:0/2571140642 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc018070 con 0x7feecc0735b0 2024-05-17T11:53:27.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.422+0000 7feec2ffd640 1 -- 172.21.15.131:0/2571140642 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feebc007480 con 0x7feecc0735b0 2024-05-17T11:53:27.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.422+0000 7feed0a64640 1 -- 172.21.15.131:0/2571140642 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feecc144aa0 con 0x7feecc0735b0 2024-05-17T11:53:27.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.422+0000 7feec2ffd640 1 -- 172.21.15.131:0/2571140642 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc0047e0 con 0x7feecc0735b0 2024-05-17T11:53:27.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.423+0000 7feed0a64640 1 -- 172.21.15.131:0/2571140642 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feecc145060 con 0x7feecc0735b0 2024-05-17T11:53:27.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.424+0000 7feed0a64640 1 -- 172.21.15.131:0/2571140642 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feecc06cac0 con 0x7feecc0735b0 2024-05-17T11:53:27.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.427+0000 7feec2ffd640 1 -- 172.21.15.131:0/2571140642 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feebc0049a0 con 0x7feecc0735b0 2024-05-17T11:53:27.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.428+0000 7feec2ffd640 1 --2- 172.21.15.131:0/2571140642 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7feeac0762d0 0x7feeac0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:27.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.428+0000 7feec2ffd640 1 -- 172.21.15.131:0/2571140642 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7feebc096e00 con 0x7feecc0735b0 2024-05-17T11:53:27.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.428+0000 7feec9d9b640 1 --2- 172.21.15.131:0/2571140642 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7feeac0762d0 0x7feeac0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:27.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.428+0000 7feec2ffd640 1 --2- 172.21.15.131:0/2571140642 >> [v2:172.21.15.131:6800/797420574,v1:172.21.15.131:6801/797420574] conn(0x7feeac07c7c0 0x7feeac07ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:27.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.428+0000 7feec2ffd640 1 -- 172.21.15.131:0/2571140642 --> [v2:172.21.15.131:6800/797420574,v1:172.21.15.131:6801/797420574] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feeac07f320 con 0x7feeac07c7c0 2024-05-17T11:53:27.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.428+0000 7feec2ffd640 1 -- 172.21.15.131:0/2571140642 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7feebc097290 con 0x7feecc0735b0 2024-05-17T11:53:27.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.428+0000 7feecad9d640 1 --2- 172.21.15.131:0/2571140642 >> [v2:172.21.15.131:6800/797420574,v1:172.21.15.131:6801/797420574] conn(0x7feeac07c7c0 0x7feeac07ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:27.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.429+0000 7feec9d9b640 1 --2- 172.21.15.131:0/2571140642 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7feeac0762d0 0x7feeac0787e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7feeb4037000 tx=0x7feeb4030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:27.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.429+0000 7feecad9d640 1 --2- 172.21.15.131:0/2571140642 >> [v2:172.21.15.131:6800/797420574,v1:172.21.15.131:6801/797420574] conn(0x7feeac07c7c0 0x7feeac07ec50 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:27.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.431+0000 7feec2ffd640 1 -- 172.21.15.131:0/2571140642 <== osd.2 v2:172.21.15.131:6800/797420574 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feeac07f320 con 0x7feeac07c7c0 2024-05-17T11:53:27.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.471+0000 7feed0a64640 1 -- 172.21.15.131:0/2571140642 --> [v2:172.21.15.131:6800/797420574,v1:172.21.15.131:6801/797420574] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7feecc06ab20 con 0x7feeac07c7c0 2024-05-17T11:53:27.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.471+0000 7feec2ffd640 1 -- 172.21.15.131:0/2571140642 <== osd.2 v2:172.21.15.131:6800/797420574 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7feecc06ab20 con 0x7feeac07c7c0 2024-05-17T11:53:27.457 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T11:53:27.457 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-17T11:53:27.457 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T11:53:27.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.472+0000 7feed0a64640 1 -- 172.21.15.131:0/2571140642 >> [v2:172.21.15.131:6800/797420574,v1:172.21.15.131:6801/797420574] conn(0x7feeac07c7c0 msgr2=0x7feeac07ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:27.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.472+0000 7feed0a64640 1 --2- 172.21.15.131:0/2571140642 >> [v2:172.21.15.131:6800/797420574,v1:172.21.15.131:6801/797420574] conn(0x7feeac07c7c0 0x7feeac07ec50 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:27.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.472+0000 7feed0a64640 1 -- 172.21.15.131:0/2571140642 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7feeac0762d0 msgr2=0x7feeac0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:27.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.472+0000 7feed0a64640 1 --2- 172.21.15.131:0/2571140642 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7feeac0762d0 0x7feeac0787e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7feeb4037000 tx=0x7feeb4030000 comp rx=0 tx=0).stop 2024-05-17T11:53:27.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.472+0000 7feed0a64640 1 -- 172.21.15.131:0/2571140642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feecc0735b0 msgr2=0x7feecc143ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:27.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.472+0000 7feed0a64640 1 --2- 172.21.15.131:0/2571140642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feecc0735b0 0x7feecc143ec0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7feebc00c460 tx=0x7feebc00c920 comp rx=0 tx=0).stop 2024-05-17T11:53:27.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.472+0000 7feecad9d640 1 -- 172.21.15.131:0/2571140642 reap_dead start 2024-05-17T11:53:27.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.473+0000 7feed0a64640 1 -- 172.21.15.131:0/2571140642 shutdown_connections 2024-05-17T11:53:27.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.473+0000 7feed0a64640 1 -- 172.21.15.131:0/2571140642 >> 172.21.15.131:0/2571140642 conn(0x7feecc0b3bb0 msgr2=0x7feecc072e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:27.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.473+0000 7feed0a64640 1 -- 172.21.15.131:0/2571140642 shutdown_connections 2024-05-17T11:53:27.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.473+0000 7feed0a64640 1 -- 172.21.15.131:0/2571140642 wait complete. 2024-05-17T11:53:27.485 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-17T11:53:27.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.815+0000 7f8d1061d640 1 Processor -- start 2024-05-17T11:53:27.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.815+0000 7f8d1061d640 1 -- start start 2024-05-17T11:53:27.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.819+0000 7f8d1061d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8d08152d20 0x7f8d0815c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:27.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.819+0000 7f8d1061d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d080736c0 0x7f8d08073ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:27.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.819+0000 7f8d1061d640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d08074010 con 0x7f8d080b5e20 2024-05-17T11:53:27.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.820+0000 7f8d1061d640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f8d0806efa0 con 0x7f8d08152d20 2024-05-17T11:53:27.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.820+0000 7f8d1061d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8d0806f280 con 0x7f8d080736c0 2024-05-17T11:53:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.820+0000 7f8d0e3b9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8d08152d20 0x7f8d0815c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.820+0000 7f8d0dbb8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d080736c0 0x7f8d08073ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.820+0000 7f8d0ebba640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8d080b5e20 0x7f8d080b6230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:38986/0 (socket says 172.21.15.131:38986) 2024-05-17T11:53:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.820+0000 7f8d0ebba640 1 -- 172.21.15.131:0/4122447473 learned_addr learned my addr 172.21.15.131:0/4122447473 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.820+0000 7f8d0d3b7640 1 -- 172.21.15.131:0/4122447473 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052867979 0 0) 0x7f8d00001490 con 0x7f8d080b5e20 2024-05-17T11:53:27.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.820+0000 7f8d0d3b7640 1 -- 172.21.15.131:0/4122447473 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cf4003520 con 0x7f8d080b5e20 2024-05-17T11:53:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.821+0000 7f8d0e3b9640 1 -- 172.21.15.131:0/4122447473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d080736c0 msgr2=0x7f8d08073ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.821+0000 7f8d0e3b9640 1 --2- 172.21.15.131:0/4122447473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d080736c0 0x7f8d08073ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.821+0000 7f8d0e3b9640 1 -- 172.21.15.131:0/4122447473 >> v1:172.21.15.150:6789/0 conn(0x7f8d080b5e20 legacy=0x7f8d080b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.821+0000 7f8d0e3b9640 1 -- 172.21.15.131:0/4122447473 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0806f560 con 0x7f8d08152d20 2024-05-17T11:53:27.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.821+0000 7f8d0dbb8640 1 --2- 172.21.15.131:0/4122447473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d080736c0 0x7f8d08073ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:27.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.823+0000 7f8d0e3b9640 1 --2- 172.21.15.131:0/4122447473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d08152d20 0x7f8d0815c910 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f8d040097a0 tx=0x7f8d0402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4caed5af21e3a6d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:27.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.823+0000 7f8d0d3b7640 1 -- 172.21.15.131:0/4122447473 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d04037070 con 0x7f8d08152d20 2024-05-17T11:53:27.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.823+0000 7f8d0d3b7640 1 -- 172.21.15.131:0/4122447473 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0402ae50 con 0x7f8d08152d20 2024-05-17T11:53:27.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.823+0000 7f8d0d3b7640 1 -- 172.21.15.131:0/4122447473 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d04032660 con 0x7f8d08152d20 2024-05-17T11:53:27.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.825+0000 7f8d1061d640 1 -- 172.21.15.131:0/4122447473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d08152d20 msgr2=0x7f8d0815c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:27.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.825+0000 7f8d1061d640 1 --2- 172.21.15.131:0/4122447473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d08152d20 0x7f8d0815c910 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f8d040097a0 tx=0x7f8d0402a100 comp rx=0 tx=0).stop 2024-05-17T11:53:27.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.825+0000 7f8d1061d640 1 -- 172.21.15.131:0/4122447473 shutdown_connections 2024-05-17T11:53:27.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.825+0000 7f8d1061d640 1 --2- 172.21.15.131:0/4122447473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d080736c0 0x7f8d08073ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:27.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.825+0000 7f8d1061d640 1 --2- 172.21.15.131:0/4122447473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d08152d20 0x7f8d0815c910 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:27.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.825+0000 7f8d1061d640 1 -- 172.21.15.131:0/4122447473 >> 172.21.15.131:0/4122447473 conn(0x7f8d080d2140 msgr2=0x7f8d08072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:27.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.825+0000 7f8d1061d640 1 -- 172.21.15.131:0/4122447473 shutdown_connections 2024-05-17T11:53:27.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.825+0000 7f8d1061d640 1 -- 172.21.15.131:0/4122447473 wait complete. 2024-05-17T11:53:27.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.830+0000 7f8d1061d640 1 Processor -- start 2024-05-17T11:53:27.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.830+0000 7f8d1061d640 1 -- start start 2024-05-17T11:53:27.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.834+0000 7f8d1061d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d080736c0 0x7f8d0814f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:27.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.834+0000 7f8d1061d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d080b5e20 0x7f8d08146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:27.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.834+0000 7f8d1061d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d08152d20 0x7f8d080cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:27.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.834+0000 7f8d1061d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0815d200 con 0x7f8d080b5e20 2024-05-17T11:53:27.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.834+0000 7f8d1061d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0806fb20 con 0x7f8d08152d20 2024-05-17T11:53:27.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.834+0000 7f8d1061d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8d08071050 con 0x7f8d080736c0 2024-05-17T11:53:27.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.834+0000 7f8d0ebba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d08152d20 0x7f8d080cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:27.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.834+0000 7f8d0ebba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d08152d20 0x7f8d080cf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:55660/0 (socket says 172.21.15.131:55660) 2024-05-17T11:53:27.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.834+0000 7f8d0ebba640 1 -- 172.21.15.131:0/2149634729 learned_addr learned my addr 172.21.15.131:0/2149634729 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:27.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.834+0000 7f8d0dbb8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d080b5e20 0x7f8d08146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:27.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.834+0000 7f8d0e3b9640 1 --2- 172.21.15.131:0/2149634729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d080736c0 0x7f8d0814f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:27.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.835+0000 7f8d0ebba640 1 -- 172.21.15.131:0/2149634729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d080736c0 msgr2=0x7f8d0814f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:27.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.835+0000 7f8d0ebba640 1 --2- 172.21.15.131:0/2149634729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d080736c0 0x7f8d0814f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:27.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.835+0000 7f8d0ebba640 1 -- 172.21.15.131:0/2149634729 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d080b5e20 msgr2=0x7f8d08146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:27.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.835+0000 7f8d0ebba640 1 --2- 172.21.15.131:0/2149634729 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d080b5e20 0x7f8d08146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:27.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.835+0000 7f8d0ebba640 1 -- 172.21.15.131:0/2149634729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0815aeb0 con 0x7f8d08152d20 2024-05-17T11:53:27.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.835+0000 7f8d0ebba640 1 --2- 172.21.15.131:0/2149634729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d08152d20 0x7f8d080cf1d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000cad0 tx=0x7f8d0000cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:27.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.835+0000 7f8cfeffd640 1 -- 172.21.15.131:0/2149634729 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0000ac30 con 0x7f8d08152d20 2024-05-17T11:53:27.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.835+0000 7f8cfeffd640 1 -- 172.21.15.131:0/2149634729 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0000add0 con 0x7f8d08152d20 2024-05-17T11:53:27.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.835+0000 7f8d1061d640 1 -- 172.21.15.131:0/2149634729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d08147460 con 0x7f8d08152d20 2024-05-17T11:53:27.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.836+0000 7f8cfeffd640 1 -- 172.21.15.131:0/2149634729 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d00012600 con 0x7f8d08152d20 2024-05-17T11:53:27.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.836+0000 7f8d1061d640 1 -- 172.21.15.131:0/2149634729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d0814c000 con 0x7f8d08152d20 2024-05-17T11:53:27.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.838+0000 7f8d1061d640 1 -- 172.21.15.131:0/2149634729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d080b5590 con 0x7f8d08152d20 2024-05-17T11:53:27.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.839+0000 7f8cfeffd640 1 -- 172.21.15.131:0/2149634729 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8d000127a0 con 0x7f8d08152d20 2024-05-17T11:53:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.840+0000 7f8cfeffd640 1 --2- 172.21.15.131:0/2149634729 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cec0762d0 0x7f8cec0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.841+0000 7f8d0e3b9640 1 --2- 172.21.15.131:0/2149634729 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cec0762d0 0x7f8cec0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:27.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.841+0000 7f8cfeffd640 1 -- 172.21.15.131:0/2149634729 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f8d000979f0 con 0x7f8d08152d20 2024-05-17T11:53:27.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.841+0000 7f8d0e3b9640 1 --2- 172.21.15.131:0/2149634729 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cec0762d0 0x7f8cec0787e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8d04034000 tx=0x7f8d0402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:27.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:27.845+0000 7f8cfeffd640 1 -- 172.21.15.131:0/2149634729 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8d08074010 con 0x7f8d08152d20 2024-05-17T11:53:28.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.400+0000 7f8d1061d640 1 -- 172.21.15.131:0/2149634729 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f8d080b11e0 con 0x7f8cec0762d0 2024-05-17T11:53:28.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.400+0000 7f8cfeffd640 1 -- 172.21.15.131:0/2149634729 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8d080b11e0 con 0x7f8cec0762d0 2024-05-17T11:53:28.387 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 2 to deep-scrub 2024-05-17T11:53:28.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.404+0000 7f8d1061d640 1 -- 172.21.15.131:0/2149634729 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cec0762d0 msgr2=0x7f8cec0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:28.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.404+0000 7f8d1061d640 1 --2- 172.21.15.131:0/2149634729 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cec0762d0 0x7f8cec0787e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8d04034000 tx=0x7f8d0402e000 comp rx=0 tx=0).stop 2024-05-17T11:53:28.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.404+0000 7f8d1061d640 1 -- 172.21.15.131:0/2149634729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d08152d20 msgr2=0x7f8d080cf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:28.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.404+0000 7f8d1061d640 1 --2- 172.21.15.131:0/2149634729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d08152d20 0x7f8d080cf1d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000cad0 tx=0x7f8d0000cf90 comp rx=0 tx=0).stop 2024-05-17T11:53:28.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.405+0000 7f8d1061d640 1 -- 172.21.15.131:0/2149634729 shutdown_connections 2024-05-17T11:53:28.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.405+0000 7f8d1061d640 1 --2- 172.21.15.131:0/2149634729 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f8cec0762d0 0x7f8cec0787e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:28.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.405+0000 7f8d1061d640 1 --2- 172.21.15.131:0/2149634729 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d080b5e20 0x7f8d08146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:28.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.405+0000 7f8d1061d640 1 --2- 172.21.15.131:0/2149634729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d08152d20 0x7f8d080cf1d0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:28.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.405+0000 7f8d1061d640 1 --2- 172.21.15.131:0/2149634729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d080736c0 0x7f8d0814f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:28.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.405+0000 7f8d1061d640 1 -- 172.21.15.131:0/2149634729 >> 172.21.15.131:0/2149634729 conn(0x7f8d080d2140 msgr2=0x7f8d08158910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:28.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.405+0000 7f8d1061d640 1 -- 172.21.15.131:0/2149634729 shutdown_connections 2024-05-17T11:53:28.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.405+0000 7f8d1061d640 1 -- 172.21.15.131:0/2149634729 wait complete. 2024-05-17T11:53:28.418 INFO:tasks.ceph:Scrubbing osd.3 2024-05-17T11:53:28.418 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-17T11:53:28.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.754+0000 7f7777573640 1 Processor -- start 2024-05-17T11:53:28.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.755+0000 7f7777573640 1 -- start start 2024-05-17T11:53:28.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.759+0000 7f7777573640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7770154600 0x7f7770071280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:28.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.759+0000 7f7777573640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f77700b6d20 0x7f77700b7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:28.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.759+0000 7f7777573640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f777006f380 0x7f777006f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:28.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.759+0000 7f7777573640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f77700b7670 con 0x7f7770154600 2024-05-17T11:53:28.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.759+0000 7f7777573640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f777015da30 con 0x7f77700b6d20 2024-05-17T11:53:28.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.759+0000 7f7777573640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f777015dcf0 con 0x7f777006f380 2024-05-17T11:53:28.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.759+0000 7f7775b10640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f777006f380 0x7f777006f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:28.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.759+0000 7f7774b0e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f77700b6d20 0x7f77700b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:28.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.759+0000 7f7775b10640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f777006f380 0x7f777006f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:37406/0 (socket says 172.21.15.131:37406) 2024-05-17T11:53:28.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.759+0000 7f7775b10640 1 -- 172.21.15.131:0/3133695502 learned_addr learned my addr 172.21.15.131:0/3133695502 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:28.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.759+0000 7f777530f640 1 --2- 172.21.15.131:0/3133695502 >> v2:172.21.15.131:3300/0 conn(0x7f7770154600 0x7f7770071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:28.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.760+0000 7f7775b10640 1 -- 172.21.15.131:0/3133695502 >> v2:172.21.15.150:3300/0 conn(0x7f77700b6d20 msgr2=0x7f77700b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:28.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.760+0000 7f7775b10640 1 --2- 172.21.15.131:0/3133695502 >> v2:172.21.15.150:3300/0 conn(0x7f77700b6d20 0x7f77700b7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:28.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.760+0000 7f7775b10640 1 -- 172.21.15.131:0/3133695502 >> v2:172.21.15.131:3300/0 conn(0x7f7770154600 msgr2=0x7f7770071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:28.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.760+0000 7f7775b10640 1 --2- 172.21.15.131:0/3133695502 >> v2:172.21.15.131:3300/0 conn(0x7f7770154600 0x7f7770071280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:28.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.760+0000 7f7775b10640 1 -- 172.21.15.131:0/3133695502 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777015dfd0 con 0x7f777006f380 2024-05-17T11:53:28.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.760+0000 7f7774b0e640 1 --2- 172.21.15.131:0/3133695502 >> v2:172.21.15.150:3300/0 conn(0x7f77700b6d20 0x7f77700b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:28.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.762+0000 7f7775b10640 1 --2- 172.21.15.131:0/3133695502 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f777006f380 0x7f777006f790 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f77700b4ac0 tx=0x7f776802a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc5ee58f02ea5d57 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:28.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.762+0000 7f7767fff640 1 -- 172.21.15.131:0/3133695502 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7768036070 con 0x7f777006f380 2024-05-17T11:53:28.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.762+0000 7f7767fff640 1 -- 172.21.15.131:0/3133695502 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7768031600 con 0x7f777006f380 2024-05-17T11:53:28.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.762+0000 7f7767fff640 1 -- 172.21.15.131:0/3133695502 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77680319d0 con 0x7f777006f380 2024-05-17T11:53:28.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.764+0000 7f7777573640 1 -- 172.21.15.131:0/3133695502 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f777006f380 msgr2=0x7f777006f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:28.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.764+0000 7f7777573640 1 --2- 172.21.15.131:0/3133695502 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f777006f380 0x7f777006f790 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f77700b4ac0 tx=0x7f776802a610 comp rx=0 tx=0).stop 2024-05-17T11:53:28.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.764+0000 7f7777573640 1 -- 172.21.15.131:0/3133695502 shutdown_connections 2024-05-17T11:53:28.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.764+0000 7f7777573640 1 --2- 172.21.15.131:0/3133695502 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f777006f380 0x7f777006f790 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:28.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.764+0000 7f7777573640 1 --2- 172.21.15.131:0/3133695502 >> v2:172.21.15.150:3300/0 conn(0x7f77700b6d20 0x7f77700b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:28.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.764+0000 7f7777573640 1 --2- 172.21.15.131:0/3133695502 >> v2:172.21.15.131:3300/0 conn(0x7f7770154600 0x7f7770071280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:28.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.764+0000 7f7777573640 1 -- 172.21.15.131:0/3133695502 >> 172.21.15.131:0/3133695502 conn(0x7f777006cf80 msgr2=0x7f777006d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:28.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.765+0000 7f7777573640 1 -- 172.21.15.131:0/3133695502 shutdown_connections 2024-05-17T11:53:28.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.765+0000 7f7777573640 1 -- 172.21.15.131:0/3133695502 wait complete. 2024-05-17T11:53:28.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.770+0000 7f7777573640 1 Processor -- start 2024-05-17T11:53:28.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.770+0000 7f7777573640 1 -- start start 2024-05-17T11:53:28.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.773+0000 7f7777573640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f777006f380 0x7f777013f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:28.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.773+0000 7f7777573640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77700b6d20 0x7f77701415d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:28.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.773+0000 7f7777573640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7770154600 0x7f7770141b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:28.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.773+0000 7f7777573640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f777015e870 con 0x7f77700b6d20 2024-05-17T11:53:28.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.773+0000 7f7777573640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f777015e590 con 0x7f7770154600 2024-05-17T11:53:28.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.773+0000 7f7777573640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f77700717c0 con 0x7f777006f380 2024-05-17T11:53:28.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.774+0000 7f7774b0e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77700b6d20 0x7f77701415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:28.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.774+0000 7f7775b10640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7770154600 0x7f7770141b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:28.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.774+0000 7f777530f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f777006f380 0x7f777013f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:28.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.774+0000 7f7775b10640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7770154600 0x7f7770141b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:55678/0 (socket says 172.21.15.131:55678) 2024-05-17T11:53:28.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.774+0000 7f7774b0e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77700b6d20 0x7f77701415d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55238/0 (socket says 172.21.15.131:55238) 2024-05-17T11:53:28.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.774+0000 7f7775b10640 1 -- 172.21.15.131:0/1919384745 learned_addr learned my addr 172.21.15.131:0/1919384745 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:28.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.774+0000 7f777530f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f777006f380 0x7f777013f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:37416/0 (socket says 172.21.15.131:37416) 2024-05-17T11:53:28.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.775+0000 7f7775b10640 1 -- 172.21.15.131:0/1919384745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f777006f380 msgr2=0x7f777013f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:28.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.775+0000 7f7775b10640 1 --2- 172.21.15.131:0/1919384745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f777006f380 0x7f777013f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:28.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.775+0000 7f7775b10640 1 -- 172.21.15.131:0/1919384745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77700b6d20 msgr2=0x7f77701415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:28.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.775+0000 7f7775b10640 1 --2- 172.21.15.131:0/1919384745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77700b6d20 0x7f77701415d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:28.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.775+0000 7f7775b10640 1 -- 172.21.15.131:0/1919384745 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777013fe80 con 0x7f7770154600 2024-05-17T11:53:28.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.775+0000 7f777530f640 1 --2- 172.21.15.131:0/1919384745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f777006f380 0x7f777013f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:28.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.775+0000 7f7775b10640 1 --2- 172.21.15.131:0/1919384745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7770154600 0x7f7770141b10 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f7768009f40 tx=0x7f7768004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:28.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.775+0000 7f7765ffb640 1 -- 172.21.15.131:0/1919384745 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776803f020 con 0x7f7770154600 2024-05-17T11:53:28.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.775+0000 7f7765ffb640 1 -- 172.21.15.131:0/1919384745 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7768037040 con 0x7f7770154600 2024-05-17T11:53:28.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.775+0000 7f7765ffb640 1 -- 172.21.15.131:0/1919384745 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7768036070 con 0x7f7770154600 2024-05-17T11:53:28.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.775+0000 7f7777573640 1 -- 172.21.15.131:0/1919384745 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7770140530 con 0x7f7770154600 2024-05-17T11:53:28.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.776+0000 7f7777573640 1 -- 172.21.15.131:0/1919384745 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7770140af0 con 0x7f7770154600 2024-05-17T11:53:28.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.778+0000 7f7777573640 1 -- 172.21.15.131:0/1919384745 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7770070ae0 con 0x7f7770154600 2024-05-17T11:53:28.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.779+0000 7f7765ffb640 1 -- 172.21.15.131:0/1919384745 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7768042020 con 0x7f7770154600 2024-05-17T11:53:28.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.780+0000 7f7765ffb640 1 --2- 172.21.15.131:0/1919384745 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7754076300 0x7f7754078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:28.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.780+0000 7f7765ffb640 1 -- 172.21.15.131:0/1919384745 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f77680b7a90 con 0x7f7770154600 2024-05-17T11:53:28.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.780+0000 7f7765ffb640 1 --2- 172.21.15.131:0/1919384745 >> [v2:172.21.15.131:6808/4197534495,v1:172.21.15.131:6809/4197534495] conn(0x7f775407c7f0 0x7f775407ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:28.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.780+0000 7f7765ffb640 1 -- 172.21.15.131:0/1919384745 --> [v2:172.21.15.131:6808/4197534495,v1:172.21.15.131:6809/4197534495] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7768031600 con 0x7f775407c7f0 2024-05-17T11:53:28.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.780+0000 7f7765ffb640 1 -- 172.21.15.131:0/1919384745 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f77680bc2c0 con 0x7f7770154600 2024-05-17T11:53:28.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.780+0000 7f777530f640 1 --2- 172.21.15.131:0/1919384745 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7754076300 0x7f7754078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:28.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.781+0000 7f7774b0e640 1 --2- 172.21.15.131:0/1919384745 >> [v2:172.21.15.131:6808/4197534495,v1:172.21.15.131:6809/4197534495] conn(0x7f775407c7f0 0x7f775407ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:28.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.781+0000 7f7774b0e640 1 --2- 172.21.15.131:0/1919384745 >> [v2:172.21.15.131:6808/4197534495,v1:172.21.15.131:6809/4197534495] conn(0x7f775407c7f0 0x7f775407ec80 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:28.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.782+0000 7f777530f640 1 --2- 172.21.15.131:0/1919384745 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7754076300 0x7f7754078810 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f776c009e90 tx=0x7f776c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:28.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.782+0000 7f7765ffb640 1 -- 172.21.15.131:0/1919384745 <== osd.3 v2:172.21.15.131:6808/4197534495 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7768031600 con 0x7f775407c7f0 2024-05-17T11:53:28.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.821+0000 7f7777573640 1 -- 172.21.15.131:0/1919384745 --> [v2:172.21.15.131:6808/4197534495,v1:172.21.15.131:6809/4197534495] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f77701402e0 con 0x7f775407c7f0 2024-05-17T11:53:28.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.821+0000 7f7765ffb640 1 -- 172.21.15.131:0/1919384745 <== osd.3 v2:172.21.15.131:6808/4197534495 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f77701402e0 con 0x7f775407c7f0 2024-05-17T11:53:28.808 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T11:53:28.808 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-17T11:53:28.808 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T11:53:28.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.822+0000 7f7777573640 1 -- 172.21.15.131:0/1919384745 >> [v2:172.21.15.131:6808/4197534495,v1:172.21.15.131:6809/4197534495] conn(0x7f775407c7f0 msgr2=0x7f775407ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:28.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.822+0000 7f7777573640 1 --2- 172.21.15.131:0/1919384745 >> [v2:172.21.15.131:6808/4197534495,v1:172.21.15.131:6809/4197534495] conn(0x7f775407c7f0 0x7f775407ec80 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:28.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.822+0000 7f7777573640 1 -- 172.21.15.131:0/1919384745 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7754076300 msgr2=0x7f7754078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:28.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.822+0000 7f7777573640 1 --2- 172.21.15.131:0/1919384745 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f7754076300 0x7f7754078810 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f776c009e90 tx=0x7f776c009190 comp rx=0 tx=0).stop 2024-05-17T11:53:28.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.822+0000 7f7777573640 1 -- 172.21.15.131:0/1919384745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7770154600 msgr2=0x7f7770141b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:28.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.823+0000 7f7777573640 1 --2- 172.21.15.131:0/1919384745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7770154600 0x7f7770141b10 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f7768009f40 tx=0x7f7768004a40 comp rx=0 tx=0).stop 2024-05-17T11:53:28.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.823+0000 7f7775b10640 1 -- 172.21.15.131:0/1919384745 reap_dead start 2024-05-17T11:53:28.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.823+0000 7f7777573640 1 -- 172.21.15.131:0/1919384745 shutdown_connections 2024-05-17T11:53:28.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.823+0000 7f7777573640 1 -- 172.21.15.131:0/1919384745 >> 172.21.15.131:0/1919384745 conn(0x7f777006cf80 msgr2=0x7f77700b2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:28.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.823+0000 7f7777573640 1 -- 172.21.15.131:0/1919384745 shutdown_connections 2024-05-17T11:53:28.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:28.823+0000 7f7777573640 1 -- 172.21.15.131:0/1919384745 wait complete. 2024-05-17T11:53:28.836 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-17T11:53:29.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.157+0000 7f5dcd5c2640 1 Processor -- start 2024-05-17T11:53:29.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.157+0000 7f5dcd5c2640 1 -- start start 2024-05-17T11:53:29.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.161+0000 7f5dcd5c2640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5dc8071d90 0x7f5dc815db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:29.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.161+0000 7f5dcd5c2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc815ecc0 0x7f5dc80cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:29.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.161+0000 7f5dcd5c2640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dc815e0e0 con 0x7f5dc80cdd40 2024-05-17T11:53:29.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.161+0000 7f5dcd5c2640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc8158010 con 0x7f5dc8071d90 2024-05-17T11:53:29.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.161+0000 7f5dcd5c2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc815e3c0 con 0x7f5dc815ecc0 2024-05-17T11:53:29.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.161+0000 7f5dc77fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f5dc80cdd40 0x7f5dc80d13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38406/0 (socket says 172.21.15.131:38406) 2024-05-17T11:53:29.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.161+0000 7f5dc77fe640 1 -- 172.21.15.131:0/3044522460 learned_addr learned my addr 172.21.15.131:0/3044522460 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:29.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.161+0000 7f5dc6ffd640 1 --2- 172.21.15.131:0/3044522460 >> v2:172.21.15.150:3300/0 conn(0x7f5dc8071d90 0x7f5dc815db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:29.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.161+0000 7f5dc67fc640 1 --2- 172.21.15.131:0/3044522460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc815ecc0 0x7f5dc80cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:29.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.162+0000 7f5dc67fc640 1 -- 172.21.15.131:0/3044522460 >> v2:172.21.15.150:3300/0 conn(0x7f5dc8071d90 msgr2=0x7f5dc815db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:29.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.162+0000 7f5dc67fc640 1 --2- 172.21.15.131:0/3044522460 >> v2:172.21.15.150:3300/0 conn(0x7f5dc8071d90 0x7f5dc815db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:29.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.162+0000 7f5dc67fc640 1 -- 172.21.15.131:0/3044522460 >> v1:172.21.15.131:6789/0 conn(0x7f5dc80cdd40 legacy=0x7f5dc80d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:29.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.162+0000 7f5dc67fc640 1 -- 172.21.15.131:0/3044522460 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc815e6a0 con 0x7f5dc815ecc0 2024-05-17T11:53:29.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.163+0000 7f5dc67fc640 1 --2- 172.21.15.131:0/3044522460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc815ecc0 0x7f5dc80cd800 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0097a0 tx=0x7f5dbc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18cf8c84e0e7088c server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:29.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.163+0000 7f5dc5ffb640 1 -- 172.21.15.131:0/3044522460 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc037070 con 0x7f5dc815ecc0 2024-05-17T11:53:29.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.163+0000 7f5dc5ffb640 1 -- 172.21.15.131:0/3044522460 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dbc032440 con 0x7f5dc815ecc0 2024-05-17T11:53:29.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.163+0000 7f5dc5ffb640 1 -- 172.21.15.131:0/3044522460 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc032810 con 0x7f5dc815ecc0 2024-05-17T11:53:29.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.165+0000 7f5dcd5c2640 1 -- 172.21.15.131:0/3044522460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc815ecc0 msgr2=0x7f5dc80cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:29.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.165+0000 7f5dcd5c2640 1 --2- 172.21.15.131:0/3044522460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc815ecc0 0x7f5dc80cd800 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0097a0 tx=0x7f5dbc02a180 comp rx=0 tx=0).stop 2024-05-17T11:53:29.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.165+0000 7f5dcd5c2640 1 -- 172.21.15.131:0/3044522460 shutdown_connections 2024-05-17T11:53:29.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.165+0000 7f5dcd5c2640 1 --2- 172.21.15.131:0/3044522460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc815ecc0 0x7f5dc80cd800 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:29.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.165+0000 7f5dcd5c2640 1 --2- 172.21.15.131:0/3044522460 >> v2:172.21.15.150:3300/0 conn(0x7f5dc8071d90 0x7f5dc815db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:29.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.165+0000 7f5dcd5c2640 1 -- 172.21.15.131:0/3044522460 >> 172.21.15.131:0/3044522460 conn(0x7f5dc80d2fd0 msgr2=0x7f5dc80d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:29.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.166+0000 7f5dcd5c2640 1 -- 172.21.15.131:0/3044522460 shutdown_connections 2024-05-17T11:53:29.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.166+0000 7f5dcd5c2640 1 -- 172.21.15.131:0/3044522460 wait complete. 2024-05-17T11:53:29.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.171+0000 7f5dcd5c2640 1 Processor -- start 2024-05-17T11:53:29.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.171+0000 7f5dcd5c2640 1 -- start start 2024-05-17T11:53:29.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.175+0000 7f5dcd5c2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dc8071d90 0x7f5dc80cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:29.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.175+0000 7f5dcd5c2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc80cdd40 0x7f5dc8151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:29.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.175+0000 7f5dcd5c2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc815ecc0 0x7f5dc80c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:29.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.175+0000 7f5dcd5c2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc80d2a50 con 0x7f5dc8071d90 2024-05-17T11:53:29.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.175+0000 7f5dcd5c2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc80d28d0 con 0x7f5dc815ecc0 2024-05-17T11:53:29.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.175+0000 7f5dcd5c2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc815f0d0 con 0x7f5dc80cdd40 2024-05-17T11:53:29.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.175+0000 7f5dc67fc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc80cdd40 0x7f5dc8151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:29.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.175+0000 7f5dc6ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dc8071d90 0x7f5dc80cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:29.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.175+0000 7f5dc67fc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc80cdd40 0x7f5dc8151430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:37428/0 (socket says 172.21.15.131:37428) 2024-05-17T11:53:29.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.175+0000 7f5dc67fc640 1 -- 172.21.15.131:0/1847468644 learned_addr learned my addr 172.21.15.131:0/1847468644 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:29.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.175+0000 7f5dc77fe640 1 --2- 172.21.15.131:0/1847468644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc815ecc0 0x7f5dc80c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:29.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.176+0000 7f5dc67fc640 1 -- 172.21.15.131:0/1847468644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc815ecc0 msgr2=0x7f5dc80c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:29.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.176+0000 7f5dc67fc640 1 --2- 172.21.15.131:0/1847468644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc815ecc0 0x7f5dc80c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:29.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.176+0000 7f5dc67fc640 1 -- 172.21.15.131:0/1847468644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dc8071d90 msgr2=0x7f5dc80cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:29.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.176+0000 7f5dc67fc640 1 --2- 172.21.15.131:0/1847468644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dc8071d90 0x7f5dc80cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:29.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.176+0000 7f5dc67fc640 1 -- 172.21.15.131:0/1847468644 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc80ca2f0 con 0x7f5dc80cdd40 2024-05-17T11:53:29.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.176+0000 7f5dc67fc640 1 --2- 172.21.15.131:0/1847468644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc80cdd40 0x7f5dc8151430 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0098c0 tx=0x7f5dbc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:29.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.176+0000 7f5daf7fe640 1 -- 172.21.15.131:0/1847468644 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc037040 con 0x7f5dc80cdd40 2024-05-17T11:53:29.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.176+0000 7f5daf7fe640 1 -- 172.21.15.131:0/1847468644 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dbc030500 con 0x7f5dc80cdd40 2024-05-17T11:53:29.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.176+0000 7f5daf7fe640 1 -- 172.21.15.131:0/1847468644 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0308d0 con 0x7f5dc80cdd40 2024-05-17T11:53:29.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.176+0000 7f5dcd5c2640 1 -- 172.21.15.131:0/1847468644 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc80ca5d0 con 0x7f5dc80cdd40 2024-05-17T11:53:29.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.177+0000 7f5dcd5c2640 1 -- 172.21.15.131:0/1847468644 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc81f6630 con 0x7f5dc80cdd40 2024-05-17T11:53:29.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.179+0000 7f5dcd5c2640 1 -- 172.21.15.131:0/1847468644 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc815db00 con 0x7f5dc80cdd40 2024-05-17T11:53:29.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.180+0000 7f5daf7fe640 1 -- 172.21.15.131:0/1847468644 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5dbc044020 con 0x7f5dc80cdd40 2024-05-17T11:53:29.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.182+0000 7f5daf7fe640 1 --2- 172.21.15.131:0/1847468644 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5db40762d0 0x7f5db40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:29.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.182+0000 7f5daf7fe640 1 -- 172.21.15.131:0/1847468644 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f5dbc0b7500 con 0x7f5dc80cdd40 2024-05-17T11:53:29.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.182+0000 7f5dc6ffd640 1 --2- 172.21.15.131:0/1847468644 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5db40762d0 0x7f5db40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:29.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.183+0000 7f5dc6ffd640 1 --2- 172.21.15.131:0/1847468644 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5db40762d0 0x7f5db40787e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80cef40 tx=0x7f5db8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:29.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.186+0000 7f5daf7fe640 1 -- 172.21.15.131:0/1847468644 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5dbc04b020 con 0x7f5dc80cdd40 2024-05-17T11:53:29.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.749+0000 7f5dcd5c2640 1 -- 172.21.15.131:0/1847468644 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f5dc80ca0a0 con 0x7f5db40762d0 2024-05-17T11:53:29.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.750+0000 7f5daf7fe640 1 -- 172.21.15.131:0/1847468644 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5dc80ca0a0 con 0x7f5db40762d0 2024-05-17T11:53:29.737 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 3 to deep-scrub 2024-05-17T11:53:29.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.755+0000 7f5dcd5c2640 1 -- 172.21.15.131:0/1847468644 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5db40762d0 msgr2=0x7f5db40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:29.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.755+0000 7f5dcd5c2640 1 --2- 172.21.15.131:0/1847468644 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5db40762d0 0x7f5db40787e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80cef40 tx=0x7f5db8009190 comp rx=0 tx=0).stop 2024-05-17T11:53:29.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.755+0000 7f5dcd5c2640 1 -- 172.21.15.131:0/1847468644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc80cdd40 msgr2=0x7f5dc8151430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:29.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.755+0000 7f5dcd5c2640 1 --2- 172.21.15.131:0/1847468644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc80cdd40 0x7f5dc8151430 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0098c0 tx=0x7f5dbc0046c0 comp rx=0 tx=0).stop 2024-05-17T11:53:29.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.755+0000 7f5dcd5c2640 1 -- 172.21.15.131:0/1847468644 shutdown_connections 2024-05-17T11:53:29.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.755+0000 7f5dcd5c2640 1 --2- 172.21.15.131:0/1847468644 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f5db40762d0 0x7f5db40787e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:29.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.755+0000 7f5dcd5c2640 1 --2- 172.21.15.131:0/1847468644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dc815ecc0 0x7f5dc80c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:29.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.755+0000 7f5dcd5c2640 1 --2- 172.21.15.131:0/1847468644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc80cdd40 0x7f5dc8151430 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:29.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.755+0000 7f5dcd5c2640 1 --2- 172.21.15.131:0/1847468644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dc8071d90 0x7f5dc80cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:29.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.755+0000 7f5dcd5c2640 1 -- 172.21.15.131:0/1847468644 >> 172.21.15.131:0/1847468644 conn(0x7f5dc80d2fd0 msgr2=0x7f5dc81577e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:29.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.755+0000 7f5dcd5c2640 1 -- 172.21.15.131:0/1847468644 shutdown_connections 2024-05-17T11:53:29.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:29.755+0000 7f5dcd5c2640 1 -- 172.21.15.131:0/1847468644 wait complete. 2024-05-17T11:53:29.770 INFO:tasks.ceph:Scrubbing osd.4 2024-05-17T11:53:29.770 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-17T11:53:30.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.094+0000 7fbf4ec55640 1 Processor -- start 2024-05-17T11:53:30.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.094+0000 7fbf4ec55640 1 -- start start 2024-05-17T11:53:30.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.098+0000 7fbf4ec55640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbf4815c050 0x7fbf4806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:30.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.098+0000 7fbf4ec55640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf4815c5a0 con 0x7fbf48073560 2024-05-17T11:53:30.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.098+0000 7fbf4ec55640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf4815c880 con 0x7fbf480702b0 2024-05-17T11:53:30.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.098+0000 7fbf4ec55640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fbf4815cb60 con 0x7fbf4815c050 2024-05-17T11:53:30.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.098+0000 7fbf4d1f2640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fbf48073560 0x7fbf4806d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38410/0 (socket says 172.21.15.131:38410) 2024-05-17T11:53:30.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.098+0000 7fbf4d1f2640 1 -- 172.21.15.131:0/638037199 learned_addr learned my addr 172.21.15.131:0/638037199 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:30.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.098+0000 7fbf4c9f1640 1 --2- 172.21.15.131:0/638037199 >> v2:172.21.15.150:3300/0 conn(0x7fbf4815c050 0x7fbf4806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:30.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.099+0000 7fbf477fe640 1 -- 172.21.15.131:0/638037199 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2715742339 0 0) 0x7fbf4815c5a0 con 0x7fbf48073560 2024-05-17T11:53:30.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.099+0000 7fbf477fe640 1 -- 172.21.15.131:0/638037199 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf38003520 con 0x7fbf48073560 2024-05-17T11:53:30.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.099+0000 7fbf477fe640 1 -- 172.21.15.131:0/638037199 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1265659196 0 0) 0x7fbf4815c880 con 0x7fbf480702b0 2024-05-17T11:53:30.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.099+0000 7fbf477fe640 1 -- 172.21.15.131:0/638037199 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf4815c5a0 con 0x7fbf480702b0 2024-05-17T11:53:30.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.099+0000 7fbf4c9f1640 1 -- 172.21.15.131:0/638037199 >> v1:172.21.15.150:6789/0 conn(0x7fbf480702b0 legacy=0x7fbf48072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:30.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.099+0000 7fbf4c9f1640 1 -- 172.21.15.131:0/638037199 >> v1:172.21.15.131:6789/0 conn(0x7fbf48073560 legacy=0x7fbf4806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:30.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.099+0000 7fbf4c9f1640 1 -- 172.21.15.131:0/638037199 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4815ce40 con 0x7fbf4815c050 2024-05-17T11:53:30.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.101+0000 7fbf4c9f1640 1 --2- 172.21.15.131:0/638037199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf4815c050 0x7fbf4806fd70 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0097a0 tx=0x7fbf3c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61fe76b90a50a93d server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:30.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.102+0000 7fbf477fe640 1 -- 172.21.15.131:0/638037199 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c037070 con 0x7fbf4815c050 2024-05-17T11:53:30.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.102+0000 7fbf477fe640 1 -- 172.21.15.131:0/638037199 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3c032440 con 0x7fbf4815c050 2024-05-17T11:53:30.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.102+0000 7fbf477fe640 1 -- 172.21.15.131:0/638037199 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c032810 con 0x7fbf4815c050 2024-05-17T11:53:30.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.103+0000 7fbf4ec55640 1 -- 172.21.15.131:0/638037199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf4815c050 msgr2=0x7fbf4806fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:30.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.103+0000 7fbf4ec55640 1 --2- 172.21.15.131:0/638037199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf4815c050 0x7fbf4806fd70 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0097a0 tx=0x7fbf3c02a1a0 comp rx=0 tx=0).stop 2024-05-17T11:53:30.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.104+0000 7fbf4ec55640 1 -- 172.21.15.131:0/638037199 shutdown_connections 2024-05-17T11:53:30.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.104+0000 7fbf4ec55640 1 --2- 172.21.15.131:0/638037199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf4815c050 0x7fbf4806fd70 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:30.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.104+0000 7fbf4ec55640 1 -- 172.21.15.131:0/638037199 >> 172.21.15.131:0/638037199 conn(0x7fbf480d17e0 msgr2=0x7fbf480d1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:30.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.104+0000 7fbf4ec55640 1 -- 172.21.15.131:0/638037199 shutdown_connections 2024-05-17T11:53:30.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.104+0000 7fbf4ec55640 1 -- 172.21.15.131:0/638037199 wait complete. 2024-05-17T11:53:30.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.109+0000 7fbf4ec55640 1 Processor -- start 2024-05-17T11:53:30.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.109+0000 7fbf4ec55640 1 -- start start 2024-05-17T11:53:30.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.113+0000 7fbf4ec55640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf480702b0 0x7fbf48154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:30.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.113+0000 7fbf4ec55640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf4815c050 0x7fbf481f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:30.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.113+0000 7fbf4ec55640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf480aca70 0x7fbf480b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:30.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.113+0000 7fbf4ec55640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4806dae0 con 0x7fbf480702b0 2024-05-17T11:53:30.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.113+0000 7fbf4ec55640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbf481564b0 con 0x7fbf4815c050 2024-05-17T11:53:30.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.113+0000 7fbf4ec55640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbf4806dc60 con 0x7fbf480aca70 2024-05-17T11:53:30.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.114+0000 7fbf4c9f1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf480702b0 0x7fbf48154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:30.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.114+0000 7fbf4c9f1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf480702b0 0x7fbf48154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55258/0 (socket says 172.21.15.131:55258) 2024-05-17T11:53:30.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.114+0000 7fbf4c9f1640 1 -- 172.21.15.131:0/3046607428 learned_addr learned my addr 172.21.15.131:0/3046607428 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:30.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.114+0000 7fbf4d1f2640 1 --2- 172.21.15.131:0/3046607428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf480aca70 0x7fbf480b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:30.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.114+0000 7fbf47fff640 1 --2- 172.21.15.131:0/3046607428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf4815c050 0x7fbf481f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:30.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.114+0000 7fbf4d1f2640 1 -- 172.21.15.131:0/3046607428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf4815c050 msgr2=0x7fbf481f3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:30.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.114+0000 7fbf4d1f2640 1 --2- 172.21.15.131:0/3046607428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf4815c050 0x7fbf481f3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:30.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.114+0000 7fbf4d1f2640 1 -- 172.21.15.131:0/3046607428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf480702b0 msgr2=0x7fbf48154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:30.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.114+0000 7fbf4d1f2640 1 --2- 172.21.15.131:0/3046607428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf480702b0 0x7fbf48154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:30.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.114+0000 7fbf4d1f2640 1 -- 172.21.15.131:0/3046607428 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf481f4230 con 0x7fbf480aca70 2024-05-17T11:53:30.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.114+0000 7fbf47fff640 1 --2- 172.21.15.131:0/3046607428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf4815c050 0x7fbf481f3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:30.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.115+0000 7fbf4d1f2640 1 --2- 172.21.15.131:0/3046607428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf480aca70 0x7fbf480b37b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000ca70 tx=0x7fbf4000ce70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:30.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.115+0000 7fbf457fa640 1 -- 172.21.15.131:0/3046607428 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000ab10 con 0x7fbf480aca70 2024-05-17T11:53:30.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.115+0000 7fbf457fa640 1 -- 172.21.15.131:0/3046607428 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf4000acd0 con 0x7fbf480aca70 2024-05-17T11:53:30.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.115+0000 7fbf4ec55640 1 -- 172.21.15.131:0/3046607428 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf480acf40 con 0x7fbf480aca70 2024-05-17T11:53:30.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.115+0000 7fbf457fa640 1 -- 172.21.15.131:0/3046607428 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf40012640 con 0x7fbf480aca70 2024-05-17T11:53:30.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.115+0000 7fbf4ec55640 1 -- 172.21.15.131:0/3046607428 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf480aa7c0 con 0x7fbf480aca70 2024-05-17T11:53:30.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.117+0000 7fbf4ec55640 1 -- 172.21.15.131:0/3046607428 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbf4815bb40 con 0x7fbf480aca70 2024-05-17T11:53:30.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.119+0000 7fbf457fa640 1 -- 172.21.15.131:0/3046607428 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbf400127e0 con 0x7fbf480aca70 2024-05-17T11:53:30.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.120+0000 7fbf457fa640 1 --2- 172.21.15.131:0/3046607428 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbf2c076320 0x7fbf2c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:30.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.120+0000 7fbf4c9f1640 1 --2- 172.21.15.131:0/3046607428 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbf2c076320 0x7fbf2c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:30.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.121+0000 7fbf457fa640 1 -- 172.21.15.131:0/3046607428 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7fbf40097850 con 0x7fbf480aca70 2024-05-17T11:53:30.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.121+0000 7fbf457fa640 1 --2- 172.21.15.131:0/3046607428 >> [v2:172.21.15.150:6800/2205449991,v1:172.21.15.150:6801/2205449991] conn(0x7fbf2c07c810 0x7fbf2c07eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:30.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.121+0000 7fbf457fa640 1 -- 172.21.15.131:0/3046607428 --> [v2:172.21.15.150:6800/2205449991,v1:172.21.15.150:6801/2205449991] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf40007ac0 con 0x7fbf2c07c810 2024-05-17T11:53:30.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.121+0000 7fbf457fa640 1 -- 172.21.15.131:0/3046607428 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fbf4009c2a0 con 0x7fbf480aca70 2024-05-17T11:53:30.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.121+0000 7fbf4c9f1640 1 --2- 172.21.15.131:0/3046607428 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbf2c076320 0x7fbf2c078830 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c02a1e0 tx=0x7fbf3c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:30.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.121+0000 7fbf47fff640 1 --2- 172.21.15.131:0/3046607428 >> [v2:172.21.15.150:6800/2205449991,v1:172.21.15.150:6801/2205449991] conn(0x7fbf2c07c810 0x7fbf2c07eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:30.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.122+0000 7fbf47fff640 1 --2- 172.21.15.131:0/3046607428 >> [v2:172.21.15.150:6800/2205449991,v1:172.21.15.150:6801/2205449991] conn(0x7fbf2c07c810 0x7fbf2c07eca0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:30.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.123+0000 7fbf457fa640 1 -- 172.21.15.131:0/3046607428 <== osd.4 v2:172.21.15.150:6800/2205449991 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbf40007ac0 con 0x7fbf2c07c810 2024-05-17T11:53:30.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.162+0000 7fbf4ec55640 1 -- 172.21.15.131:0/3046607428 --> [v2:172.21.15.150:6800/2205449991,v1:172.21.15.150:6801/2205449991] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbf4806fd70 con 0x7fbf2c07c810 2024-05-17T11:53:30.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.163+0000 7fbf457fa640 1 -- 172.21.15.131:0/3046607428 <== osd.4 v2:172.21.15.150:6800/2205449991 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbf4806fd70 con 0x7fbf2c07c810 2024-05-17T11:53:30.150 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T11:53:30.150 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-17T11:53:30.150 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T11:53:30.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.164+0000 7fbf4ec55640 1 -- 172.21.15.131:0/3046607428 >> [v2:172.21.15.150:6800/2205449991,v1:172.21.15.150:6801/2205449991] conn(0x7fbf2c07c810 msgr2=0x7fbf2c07eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:30.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.164+0000 7fbf4ec55640 1 --2- 172.21.15.131:0/3046607428 >> [v2:172.21.15.150:6800/2205449991,v1:172.21.15.150:6801/2205449991] conn(0x7fbf2c07c810 0x7fbf2c07eca0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:30.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.164+0000 7fbf4ec55640 1 -- 172.21.15.131:0/3046607428 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbf2c076320 msgr2=0x7fbf2c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:30.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.164+0000 7fbf4ec55640 1 --2- 172.21.15.131:0/3046607428 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbf2c076320 0x7fbf2c078830 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c02a1e0 tx=0x7fbf3c02e000 comp rx=0 tx=0).stop 2024-05-17T11:53:30.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.164+0000 7fbf4ec55640 1 -- 172.21.15.131:0/3046607428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf480aca70 msgr2=0x7fbf480b37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:30.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.164+0000 7fbf4ec55640 1 --2- 172.21.15.131:0/3046607428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf480aca70 0x7fbf480b37b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000ca70 tx=0x7fbf4000ce70 comp rx=0 tx=0).stop 2024-05-17T11:53:30.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.164+0000 7fbf4d1f2640 1 -- 172.21.15.131:0/3046607428 reap_dead start 2024-05-17T11:53:30.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.165+0000 7fbf4ec55640 1 -- 172.21.15.131:0/3046607428 shutdown_connections 2024-05-17T11:53:30.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.165+0000 7fbf4ec55640 1 -- 172.21.15.131:0/3046607428 >> 172.21.15.131:0/3046607428 conn(0x7fbf480d17e0 msgr2=0x7fbf4806c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:30.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.165+0000 7fbf4ec55640 1 -- 172.21.15.131:0/3046607428 shutdown_connections 2024-05-17T11:53:30.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.165+0000 7fbf4ec55640 1 -- 172.21.15.131:0/3046607428 wait complete. 2024-05-17T11:53:30.176 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-17T11:53:30.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.485+0000 7f375b3d3640 1 Processor -- start 2024-05-17T11:53:30.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.485+0000 7f375b3d3640 1 -- start start 2024-05-17T11:53:30.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.487+0000 7f375b3d3640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f375415df40 0x7f3754073d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:30.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.487+0000 7f375b3d3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3754074260 0x7f375406c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:30.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.487+0000 7f375b3d3640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f375406cc30 0x7f37540d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:30.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.487+0000 7f375b3d3640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f3754072ff0 con 0x7f3754074260 2024-05-17T11:53:30.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.487+0000 7f375b3d3640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f375406d040 con 0x7f375415df40 2024-05-17T11:53:30.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.487+0000 7f375b3d3640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3754164cd0 con 0x7f375406cc30 2024-05-17T11:53:30.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.487+0000 7f375896e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3754074260 0x7f375406c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:30.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.488+0000 7f3759970640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f375406cc30 0x7f37540d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:30.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.488+0000 7f375896e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3754074260 0x7f375406c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55260/0 (socket says 172.21.15.131:55260) 2024-05-17T11:53:30.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.488+0000 7f375896e640 1 -- 172.21.15.131:0/2975648161 learned_addr learned my addr 172.21.15.131:0/2975648161 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:30.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.488+0000 7f375916f640 1 --2- 172.21.15.131:0/2975648161 >> v2:172.21.15.150:3300/0 conn(0x7f375415df40 0x7f3754073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:30.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.488+0000 7f3759970640 1 -- 172.21.15.131:0/2975648161 >> v2:172.21.15.150:3300/0 conn(0x7f375415df40 msgr2=0x7f3754073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:30.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.488+0000 7f3759970640 1 --2- 172.21.15.131:0/2975648161 >> v2:172.21.15.150:3300/0 conn(0x7f375415df40 0x7f3754073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:30.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.488+0000 7f3759970640 1 -- 172.21.15.131:0/2975648161 >> v2:172.21.15.131:3300/0 conn(0x7f3754074260 msgr2=0x7f375406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:30.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.488+0000 7f3759970640 1 --2- 172.21.15.131:0/2975648161 >> v2:172.21.15.131:3300/0 conn(0x7f3754074260 0x7f375406c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:30.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.488+0000 7f3759970640 1 -- 172.21.15.131:0/2975648161 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3754073240 con 0x7f375406cc30 2024-05-17T11:53:30.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.489+0000 7f3759970640 1 --2- 172.21.15.131:0/2975648161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f375406cc30 0x7f37540d0150 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3754072070 tx=0x7f374c02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=442c3fd9d9780de5 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:30.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.489+0000 7f3747fff640 1 -- 172.21.15.131:0/2975648161 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c037070 con 0x7f375406cc30 2024-05-17T11:53:30.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.489+0000 7f3747fff640 1 -- 172.21.15.131:0/2975648161 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f374c032440 con 0x7f375406cc30 2024-05-17T11:53:30.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.489+0000 7f3747fff640 1 -- 172.21.15.131:0/2975648161 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c02ae60 con 0x7f375406cc30 2024-05-17T11:53:30.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.490+0000 7f375b3d3640 1 -- 172.21.15.131:0/2975648161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f375406cc30 msgr2=0x7f37540d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:30.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.490+0000 7f375b3d3640 1 --2- 172.21.15.131:0/2975648161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f375406cc30 0x7f37540d0150 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3754072070 tx=0x7f374c02a110 comp rx=0 tx=0).stop 2024-05-17T11:53:30.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.490+0000 7f375b3d3640 1 -- 172.21.15.131:0/2975648161 shutdown_connections 2024-05-17T11:53:30.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.490+0000 7f375b3d3640 1 --2- 172.21.15.131:0/2975648161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f375406cc30 0x7f37540d0150 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:30.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.490+0000 7f375b3d3640 1 --2- 172.21.15.131:0/2975648161 >> v2:172.21.15.131:3300/0 conn(0x7f3754074260 0x7f375406c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:30.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.490+0000 7f375b3d3640 1 --2- 172.21.15.131:0/2975648161 >> v2:172.21.15.150:3300/0 conn(0x7f375415df40 0x7f3754073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:30.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.490+0000 7f375b3d3640 1 -- 172.21.15.131:0/2975648161 >> 172.21.15.131:0/2975648161 conn(0x7f37540b36d0 msgr2=0x7f37540d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:30.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.491+0000 7f375b3d3640 1 -- 172.21.15.131:0/2975648161 shutdown_connections 2024-05-17T11:53:30.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.491+0000 7f375b3d3640 1 -- 172.21.15.131:0/2975648161 wait complete. 2024-05-17T11:53:30.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.493+0000 7f375b3d3640 1 Processor -- start 2024-05-17T11:53:30.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.493+0000 7f375b3d3640 1 -- start start 2024-05-17T11:53:30.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.494+0000 7f375b3d3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f375406cc30 0x7f375415fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:30.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.494+0000 7f375b3d3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3754074260 0x7f375414a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:30.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.494+0000 7f375b3d3640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f375415df40 0x7f37541664f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:30.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.494+0000 7f375b3d3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f375415e350 con 0x7f375406cc30 2024-05-17T11:53:30.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.494+0000 7f375b3d3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3754073800 con 0x7f3754074260 2024-05-17T11:53:30.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.494+0000 7f375b3d3640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f37540d0690 con 0x7f375415df40 2024-05-17T11:53:30.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.494+0000 7f375916f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f375406cc30 0x7f375415fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:30.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.494+0000 7f375916f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f375406cc30 0x7f375415fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55274/0 (socket says 172.21.15.131:55274) 2024-05-17T11:53:30.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.494+0000 7f375916f640 1 -- 172.21.15.131:0/4075561424 learned_addr learned my addr 172.21.15.131:0/4075561424 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:30.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.495+0000 7f3759970640 1 --2- 172.21.15.131:0/4075561424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f375415df40 0x7f37541664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:30.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.495+0000 7f375896e640 1 --2- 172.21.15.131:0/4075561424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3754074260 0x7f375414a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:30.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.495+0000 7f3759970640 1 -- 172.21.15.131:0/4075561424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3754074260 msgr2=0x7f375414a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:30.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.495+0000 7f3759970640 1 --2- 172.21.15.131:0/4075561424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3754074260 0x7f375414a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:30.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.495+0000 7f3759970640 1 -- 172.21.15.131:0/4075561424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f375406cc30 msgr2=0x7f375415fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:30.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.495+0000 7f3759970640 1 --2- 172.21.15.131:0/4075561424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f375406cc30 0x7f375415fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:30.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.495+0000 7f3759970640 1 -- 172.21.15.131:0/4075561424 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3754160480 con 0x7f375415df40 2024-05-17T11:53:30.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.495+0000 7f3759970640 1 --2- 172.21.15.131:0/4075561424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f375415df40 0x7f37541664f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f374c031000 tx=0x7f374c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:30.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.496+0000 7f3745ffb640 1 -- 172.21.15.131:0/4075561424 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c041030 con 0x7f375415df40 2024-05-17T11:53:30.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.496+0000 7f3745ffb640 1 -- 172.21.15.131:0/4075561424 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f374c03d4e0 con 0x7f375415df40 2024-05-17T11:53:30.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.496+0000 7f375b3d3640 1 -- 172.21.15.131:0/4075561424 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3754160760 con 0x7f375415df40 2024-05-17T11:53:30.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.496+0000 7f3745ffb640 1 -- 172.21.15.131:0/4075561424 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c037040 con 0x7f375415df40 2024-05-17T11:53:30.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.496+0000 7f375b3d3640 1 -- 172.21.15.131:0/4075561424 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3754160d20 con 0x7f375415df40 2024-05-17T11:53:30.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.498+0000 7f3745ffb640 1 -- 172.21.15.131:0/4075561424 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f374c03d8b0 con 0x7f375415df40 2024-05-17T11:53:30.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.499+0000 7f375b3d3640 1 -- 172.21.15.131:0/4075561424 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f375406c6f0 con 0x7f375415df40 2024-05-17T11:53:30.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.500+0000 7f3745ffb640 1 --2- 172.21.15.131:0/4075561424 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3738076300 0x7f3738078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:30.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.500+0000 7f375916f640 1 --2- 172.21.15.131:0/4075561424 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3738076300 0x7f3738078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:30.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.500+0000 7f3745ffb640 1 -- 172.21.15.131:0/4075561424 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f374c0b7470 con 0x7f375415df40 2024-05-17T11:53:30.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.501+0000 7f375916f640 1 --2- 172.21.15.131:0/4075561424 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3738076300 0x7f3738078810 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f37480094c0 tx=0x7f374800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:30.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:30.505+0000 7f3745ffb640 1 -- 172.21.15.131:0/4075561424 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f374c0807c0 con 0x7f375415df40 2024-05-17T11:53:31.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.067+0000 7f375b3d3640 1 -- 172.21.15.131:0/4075561424 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f375415c3b0 con 0x7f3738076300 2024-05-17T11:53:31.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.067+0000 7f3745ffb640 1 -- 172.21.15.131:0/4075561424 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f375415c3b0 con 0x7f3738076300 2024-05-17T11:53:31.054 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 4 to deep-scrub 2024-05-17T11:53:31.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.072+0000 7f375b3d3640 1 -- 172.21.15.131:0/4075561424 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3738076300 msgr2=0x7f3738078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:31.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.072+0000 7f375b3d3640 1 --2- 172.21.15.131:0/4075561424 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3738076300 0x7f3738078810 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f37480094c0 tx=0x7f374800b040 comp rx=0 tx=0).stop 2024-05-17T11:53:31.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.072+0000 7f375b3d3640 1 -- 172.21.15.131:0/4075561424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f375415df40 msgr2=0x7f37541664f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:31.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.072+0000 7f375b3d3640 1 --2- 172.21.15.131:0/4075561424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f375415df40 0x7f37541664f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f374c031000 tx=0x7f374c0046c0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.072+0000 7f375b3d3640 1 -- 172.21.15.131:0/4075561424 shutdown_connections 2024-05-17T11:53:31.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.072+0000 7f375b3d3640 1 --2- 172.21.15.131:0/4075561424 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3738076300 0x7f3738078810 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.072+0000 7f375b3d3640 1 --2- 172.21.15.131:0/4075561424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f375415df40 0x7f37541664f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.072+0000 7f375b3d3640 1 --2- 172.21.15.131:0/4075561424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3754074260 0x7f375414a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.072+0000 7f375b3d3640 1 --2- 172.21.15.131:0/4075561424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f375406cc30 0x7f375415fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.072+0000 7f375b3d3640 1 -- 172.21.15.131:0/4075561424 >> 172.21.15.131:0/4075561424 conn(0x7f37540b36d0 msgr2=0x7f375406d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:31.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.072+0000 7f375b3d3640 1 -- 172.21.15.131:0/4075561424 shutdown_connections 2024-05-17T11:53:31.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.072+0000 7f375b3d3640 1 -- 172.21.15.131:0/4075561424 wait complete. 2024-05-17T11:53:31.087 INFO:tasks.ceph:Scrubbing osd.5 2024-05-17T11:53:31.087 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-17T11:53:31.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.413+0000 7f54188df640 1 Processor -- start 2024-05-17T11:53:31.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.413+0000 7f54188df640 1 -- start start 2024-05-17T11:53:31.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.417+0000 7f54188df640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f54140709b0 0x7f54141601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:31.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.417+0000 7f54188df640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f541415c010 0x7f541415c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:31.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.417+0000 7f54188df640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f541415c960 con 0x7f5414159750 2024-05-17T11:53:31.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.417+0000 7f54188df640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f541415cc10 con 0x7f54140709b0 2024-05-17T11:53:31.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.417+0000 7f54188df640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f541415cef0 con 0x7f541415c010 2024-05-17T11:53:31.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.418+0000 7f5409d9b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f54140709b0 0x7f54141601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:31.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.418+0000 7f541259c640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f5414159750 0x7f54140702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38422/0 (socket says 172.21.15.131:38422) 2024-05-17T11:53:31.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.418+0000 7f541259c640 1 -- 172.21.15.131:0/2871833581 learned_addr learned my addr 172.21.15.131:0/2871833581 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:31.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.418+0000 7f5412d9d640 1 --2- 172.21.15.131:0/2871833581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f541415c010 0x7f541415c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:31.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.418+0000 7f5412d9d640 1 -- 172.21.15.131:0/2871833581 >> v2:172.21.15.131:3300/0 conn(0x7f54140709b0 msgr2=0x7f54141601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:31.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.418+0000 7f5412d9d640 1 --2- 172.21.15.131:0/2871833581 >> v2:172.21.15.131:3300/0 conn(0x7f54140709b0 0x7f54141601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.418+0000 7f5412d9d640 1 -- 172.21.15.131:0/2871833581 >> v1:172.21.15.131:6789/0 conn(0x7f5414159750 legacy=0x7f54140702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:31.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.418+0000 7f5412d9d640 1 -- 172.21.15.131:0/2871833581 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541415f6e0 con 0x7f541415c010 2024-05-17T11:53:31.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.418+0000 7f5409d9b640 1 --2- 172.21.15.131:0/2871833581 >> v2:172.21.15.131:3300/0 conn(0x7f54140709b0 0x7f54141601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:31.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.419+0000 7f5412d9d640 1 --2- 172.21.15.131:0/2871833581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f541415c010 0x7f541415c420 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f540c009d90 tx=0x7f540c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a4accd0c0703f2a server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:31.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.420+0000 7f5411d9b640 1 -- 172.21.15.131:0/2871833581 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c007740 con 0x7f541415c010 2024-05-17T11:53:31.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.420+0000 7f5411d9b640 1 -- 172.21.15.131:0/2871833581 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f540c0078e0 con 0x7f541415c010 2024-05-17T11:53:31.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.420+0000 7f5411d9b640 1 -- 172.21.15.131:0/2871833581 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c007cb0 con 0x7f541415c010 2024-05-17T11:53:31.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.421+0000 7f54188df640 1 -- 172.21.15.131:0/2871833581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f541415c010 msgr2=0x7f541415c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:31.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.421+0000 7f54188df640 1 --2- 172.21.15.131:0/2871833581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f541415c010 0x7f541415c420 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f540c009d90 tx=0x7f540c02a660 comp rx=0 tx=0).stop 2024-05-17T11:53:31.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.422+0000 7f54188df640 1 -- 172.21.15.131:0/2871833581 shutdown_connections 2024-05-17T11:53:31.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.422+0000 7f54188df640 1 --2- 172.21.15.131:0/2871833581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f541415c010 0x7f541415c420 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.422+0000 7f54188df640 1 --2- 172.21.15.131:0/2871833581 >> v2:172.21.15.131:3300/0 conn(0x7f54140709b0 0x7f54141601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.422+0000 7f54188df640 1 -- 172.21.15.131:0/2871833581 >> 172.21.15.131:0/2871833581 conn(0x7f5414072ec0 msgr2=0x7f54140732d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:31.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.422+0000 7f54188df640 1 -- 172.21.15.131:0/2871833581 shutdown_connections 2024-05-17T11:53:31.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.422+0000 7f54188df640 1 -- 172.21.15.131:0/2871833581 wait complete. 2024-05-17T11:53:31.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.427+0000 7f54188df640 1 Processor -- start 2024-05-17T11:53:31.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.428+0000 7f54188df640 1 -- start start 2024-05-17T11:53:31.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.431+0000 7f54188df640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5414159750 0x7f54141431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:31.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.431+0000 7f54188df640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f541415c010 0x7f54141496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:31.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.431+0000 7f54188df640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54140b2290 0x7f541414bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:31.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.431+0000 7f54188df640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f541406e420 con 0x7f541415c010 2024-05-17T11:53:31.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.431+0000 7f54188df640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f541415fca0 con 0x7f54140b2290 2024-05-17T11:53:31.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.431+0000 7f54188df640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f541406c6f0 con 0x7f5414159750 2024-05-17T11:53:31.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.432+0000 7f5409d9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f541415c010 0x7f54141496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:31.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.432+0000 7f5409d9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f541415c010 0x7f54141496f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55296/0 (socket says 172.21.15.131:55296) 2024-05-17T11:53:31.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.432+0000 7f5409d9b640 1 -- 172.21.15.131:0/2040887950 learned_addr learned my addr 172.21.15.131:0/2040887950 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:31.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.432+0000 7f541259c640 1 --2- 172.21.15.131:0/2040887950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5414159750 0x7f54141431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:31.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.432+0000 7f5412d9d640 1 --2- 172.21.15.131:0/2040887950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54140b2290 0x7f541414bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:31.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.432+0000 7f5412d9d640 1 -- 172.21.15.131:0/2040887950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5414159750 msgr2=0x7f54141431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:31.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.432+0000 7f5412d9d640 1 --2- 172.21.15.131:0/2040887950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5414159750 0x7f54141431a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.432+0000 7f5412d9d640 1 -- 172.21.15.131:0/2040887950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f541415c010 msgr2=0x7f54141496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:31.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.432+0000 7f5412d9d640 1 --2- 172.21.15.131:0/2040887950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f541415c010 0x7f54141496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.432+0000 7f5412d9d640 1 -- 172.21.15.131:0/2040887950 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54140b07a0 con 0x7f54140b2290 2024-05-17T11:53:31.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.433+0000 7f5412d9d640 1 --2- 172.21.15.131:0/2040887950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54140b2290 0x7f541414bad0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f541415d0c0 tx=0x7f540c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:31.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.433+0000 7f540b7fe640 1 -- 172.21.15.131:0/2040887950 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c03f070 con 0x7f54140b2290 2024-05-17T11:53:31.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.433+0000 7f540b7fe640 1 -- 172.21.15.131:0/2040887950 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f540c031c00 con 0x7f54140b2290 2024-05-17T11:53:31.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.433+0000 7f540b7fe640 1 -- 172.21.15.131:0/2040887950 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c009450 con 0x7f54140b2290 2024-05-17T11:53:31.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.433+0000 7f54188df640 1 -- 172.21.15.131:0/2040887950 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54140b14d0 con 0x7f54140b2290 2024-05-17T11:53:31.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.433+0000 7f54188df640 1 -- 172.21.15.131:0/2040887950 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54140b1a90 con 0x7f54140b2290 2024-05-17T11:53:31.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.435+0000 7f54188df640 1 -- 172.21.15.131:0/2040887950 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54140b0ca0 con 0x7f54140b2290 2024-05-17T11:53:31.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.437+0000 7f540b7fe640 1 -- 172.21.15.131:0/2040887950 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f540c044460 con 0x7f54140b2290 2024-05-17T11:53:31.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.438+0000 7f540b7fe640 1 --2- 172.21.15.131:0/2040887950 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f53f40762d0 0x7f53f40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:31.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.438+0000 7f540b7fe640 1 -- 172.21.15.131:0/2040887950 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f540c0b8a50 con 0x7f54140b2290 2024-05-17T11:53:31.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.438+0000 7f541259c640 1 --2- 172.21.15.131:0/2040887950 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f53f40762d0 0x7f53f40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:31.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.438+0000 7f540b7fe640 1 --2- 172.21.15.131:0/2040887950 >> [v2:172.21.15.150:6808/491308104,v1:172.21.15.150:6810/491308104] conn(0x7f53f407c7c0 0x7f53f407ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:31.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.438+0000 7f540b7fe640 1 -- 172.21.15.131:0/2040887950 --> [v2:172.21.15.150:6808/491308104,v1:172.21.15.150:6810/491308104] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53f407f320 con 0x7f53f407c7c0 2024-05-17T11:53:31.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.438+0000 7f540b7fe640 1 -- 172.21.15.131:0/2040887950 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f540c0bd2a0 con 0x7f54140b2290 2024-05-17T11:53:31.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.439+0000 7f5409d9b640 1 --2- 172.21.15.131:0/2040887950 >> [v2:172.21.15.150:6808/491308104,v1:172.21.15.150:6810/491308104] conn(0x7f53f407c7c0 0x7f53f407ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:31.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.439+0000 7f541259c640 1 --2- 172.21.15.131:0/2040887950 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f53f40762d0 0x7f53f40787e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5404000f60 tx=0x7f5404009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:31.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.439+0000 7f5409d9b640 1 --2- 172.21.15.131:0/2040887950 >> [v2:172.21.15.150:6808/491308104,v1:172.21.15.150:6810/491308104] conn(0x7f53f407c7c0 0x7f53f407ec50 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:31.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.440+0000 7f540b7fe640 1 -- 172.21.15.131:0/2040887950 <== osd.5 v2:172.21.15.150:6808/491308104 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53f407f320 con 0x7f53f407c7c0 2024-05-17T11:53:31.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.479+0000 7f54188df640 1 -- 172.21.15.131:0/2040887950 --> [v2:172.21.15.150:6808/491308104,v1:172.21.15.150:6810/491308104] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f54141601c0 con 0x7f53f407c7c0 2024-05-17T11:53:31.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.479+0000 7f540b7fe640 1 -- 172.21.15.131:0/2040887950 <== osd.5 v2:172.21.15.150:6808/491308104 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f54141601c0 con 0x7f53f407c7c0 2024-05-17T11:53:31.466 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T11:53:31.466 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-17T11:53:31.467 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T11:53:31.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.480+0000 7f54188df640 1 -- 172.21.15.131:0/2040887950 >> [v2:172.21.15.150:6808/491308104,v1:172.21.15.150:6810/491308104] conn(0x7f53f407c7c0 msgr2=0x7f53f407ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:31.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.480+0000 7f54188df640 1 --2- 172.21.15.131:0/2040887950 >> [v2:172.21.15.150:6808/491308104,v1:172.21.15.150:6810/491308104] conn(0x7f53f407c7c0 0x7f53f407ec50 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.481+0000 7f54188df640 1 -- 172.21.15.131:0/2040887950 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f53f40762d0 msgr2=0x7f53f40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:31.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.481+0000 7f54188df640 1 --2- 172.21.15.131:0/2040887950 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f53f40762d0 0x7f53f40787e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5404000f60 tx=0x7f5404009040 comp rx=0 tx=0).stop 2024-05-17T11:53:31.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.481+0000 7f54188df640 1 -- 172.21.15.131:0/2040887950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54140b2290 msgr2=0x7f541414bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:31.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.481+0000 7f54188df640 1 --2- 172.21.15.131:0/2040887950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54140b2290 0x7f541414bad0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f541415d0c0 tx=0x7f540c004a40 comp rx=0 tx=0).stop 2024-05-17T11:53:31.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.481+0000 7f5412d9d640 1 -- 172.21.15.131:0/2040887950 reap_dead start 2024-05-17T11:53:31.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.481+0000 7f54188df640 1 -- 172.21.15.131:0/2040887950 shutdown_connections 2024-05-17T11:53:31.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.481+0000 7f54188df640 1 -- 172.21.15.131:0/2040887950 >> 172.21.15.131:0/2040887950 conn(0x7f5414072ec0 msgr2=0x7f5414070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:31.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.481+0000 7f54188df640 1 -- 172.21.15.131:0/2040887950 shutdown_connections 2024-05-17T11:53:31.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.481+0000 7f54188df640 1 -- 172.21.15.131:0/2040887950 wait complete. 2024-05-17T11:53:31.492 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-17T11:53:31.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.689+0000 7fea3cd7a640 1 Processor -- start 2024-05-17T11:53:31.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.689+0000 7fea3cd7a640 1 -- start start 2024-05-17T11:53:31.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.690+0000 7fea3cd7a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea380d44b0 0x7fea380d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:31.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.690+0000 7fea3cd7a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fea380cf880 0x7fea380cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:31.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.690+0000 7fea3cd7a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea380d05b0 con 0x7fea3815f770 2024-05-17T11:53:31.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.690+0000 7fea3cd7a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fea380d0890 con 0x7fea380cf880 2024-05-17T11:53:31.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.690+0000 7fea3cd7a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fea380d0b70 con 0x7fea380d44b0 2024-05-17T11:53:31.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.691+0000 7fea3659c640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fea3815f770 0x7fea380d3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38438/0 (socket says 172.21.15.131:38438) 2024-05-17T11:53:31.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.691+0000 7fea3659c640 1 -- 172.21.15.131:0/3463751288 learned_addr learned my addr 172.21.15.131:0/3463751288 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:31.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.691+0000 7fea36d9d640 1 --2- 172.21.15.131:0/3463751288 >> v2:172.21.15.131:3300/0 conn(0x7fea380cf880 0x7fea380cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:31.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.691+0000 7fea35d9b640 1 --2- 172.21.15.131:0/3463751288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea380d44b0 0x7fea380d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:31.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.691+0000 7fea3559a640 1 -- 172.21.15.131:0/3463751288 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2120275263 0 0) 0x7fea380d05b0 con 0x7fea3815f770 2024-05-17T11:53:31.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.691+0000 7fea3559a640 1 -- 172.21.15.131:0/3463751288 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea20003520 con 0x7fea3815f770 2024-05-17T11:53:31.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.692+0000 7fea36d9d640 1 -- 172.21.15.131:0/3463751288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea380d44b0 msgr2=0x7fea380d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:31.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.692+0000 7fea36d9d640 1 --2- 172.21.15.131:0/3463751288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea380d44b0 0x7fea380d1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.692+0000 7fea36d9d640 1 -- 172.21.15.131:0/3463751288 >> v1:172.21.15.131:6789/0 conn(0x7fea3815f770 legacy=0x7fea380d3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:31.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.692+0000 7fea36d9d640 1 -- 172.21.15.131:0/3463751288 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea380d0e50 con 0x7fea380cf880 2024-05-17T11:53:31.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.692+0000 7fea35d9b640 1 --2- 172.21.15.131:0/3463751288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea380d44b0 0x7fea380d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:31.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.693+0000 7fea36d9d640 1 --2- 172.21.15.131:0/3463751288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea380cf880 0x7fea380cfc90 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fea30009d90 tx=0x7fea3002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbc47955d11a399 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:31.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.694+0000 7fea3559a640 1 -- 172.21.15.131:0/3463751288 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30007740 con 0x7fea380cf880 2024-05-17T11:53:31.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.694+0000 7fea3559a640 1 -- 172.21.15.131:0/3463751288 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea300078e0 con 0x7fea380cf880 2024-05-17T11:53:31.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.694+0000 7fea3559a640 1 -- 172.21.15.131:0/3463751288 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30007c90 con 0x7fea380cf880 2024-05-17T11:53:31.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.696+0000 7fea3cd7a640 1 -- 172.21.15.131:0/3463751288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea380cf880 msgr2=0x7fea380cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:31.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.696+0000 7fea3cd7a640 1 --2- 172.21.15.131:0/3463751288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea380cf880 0x7fea380cfc90 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fea30009d90 tx=0x7fea3002a660 comp rx=0 tx=0).stop 2024-05-17T11:53:31.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.696+0000 7fea3cd7a640 1 -- 172.21.15.131:0/3463751288 shutdown_connections 2024-05-17T11:53:31.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.696+0000 7fea3cd7a640 1 --2- 172.21.15.131:0/3463751288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea380cf880 0x7fea380cfc90 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.696+0000 7fea3cd7a640 1 --2- 172.21.15.131:0/3463751288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea380d44b0 0x7fea380d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.696+0000 7fea3cd7a640 1 -- 172.21.15.131:0/3463751288 >> 172.21.15.131:0/3463751288 conn(0x7fea380d2300 msgr2=0x7fea380b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:31.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.696+0000 7fea3cd7a640 1 -- 172.21.15.131:0/3463751288 shutdown_connections 2024-05-17T11:53:31.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.696+0000 7fea3cd7a640 1 -- 172.21.15.131:0/3463751288 wait complete. 2024-05-17T11:53:31.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.701+0000 7fea3cd7a640 1 Processor -- start 2024-05-17T11:53:31.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.702+0000 7fea3cd7a640 1 -- start start 2024-05-17T11:53:31.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.705+0000 7fea3cd7a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea380cf880 0x7fea380ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:31.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.705+0000 7fea3cd7a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea3815f770 0x7fea3815b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:31.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.705+0000 7fea3cd7a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea381611a0 0x7fea381615b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:31.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.705+0000 7fea3cd7a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fea380d0350 con 0x7fea381611a0 2024-05-17T11:53:31.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.705+0000 7fea3cd7a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fea380d01d0 con 0x7fea3815f770 2024-05-17T11:53:31.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.705+0000 7fea3cd7a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fea380b87c0 con 0x7fea380cf880 2024-05-17T11:53:31.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.706+0000 7fea3659c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea380cf880 0x7fea380ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:31.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.706+0000 7fea36d9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea381611a0 0x7fea381615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:31.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.706+0000 7fea35d9b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea3815f770 0x7fea3815b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:31.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.706+0000 7fea3659c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea380cf880 0x7fea380ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:37492/0 (socket says 172.21.15.131:37492) 2024-05-17T11:53:31.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.706+0000 7fea3659c640 1 -- 172.21.15.131:0/3567062229 learned_addr learned my addr 172.21.15.131:0/3567062229 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:31.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.706+0000 7fea3659c640 1 -- 172.21.15.131:0/3567062229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea3815f770 msgr2=0x7fea3815b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:31.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.706+0000 7fea3659c640 1 --2- 172.21.15.131:0/3567062229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea3815f770 0x7fea3815b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.706+0000 7fea3659c640 1 -- 172.21.15.131:0/3567062229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea381611a0 msgr2=0x7fea381615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:31.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.706+0000 7fea3659c640 1 --2- 172.21.15.131:0/3567062229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea381611a0 0x7fea381615b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:31.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.706+0000 7fea3659c640 1 -- 172.21.15.131:0/3567062229 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea38161af0 con 0x7fea380cf880 2024-05-17T11:53:31.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.706+0000 7fea36d9d640 1 --2- 172.21.15.131:0/3567062229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea381611a0 0x7fea381615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:31.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.706+0000 7fea3659c640 1 --2- 172.21.15.131:0/3567062229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea380cf880 0x7fea380ce080 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fea2800c440 tx=0x7fea2800c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:31.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.707+0000 7fea26ffd640 1 -- 172.21.15.131:0/3567062229 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28017070 con 0x7fea380cf880 2024-05-17T11:53:31.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.707+0000 7fea26ffd640 1 -- 172.21.15.131:0/3567062229 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea28005ce0 con 0x7fea380cf880 2024-05-17T11:53:31.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.707+0000 7fea3cd7a640 1 -- 172.21.15.131:0/3567062229 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea380ce5c0 con 0x7fea380cf880 2024-05-17T11:53:31.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.707+0000 7fea26ffd640 1 -- 172.21.15.131:0/3567062229 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28007270 con 0x7fea380cf880 2024-05-17T11:53:31.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.707+0000 7fea3cd7a640 1 -- 172.21.15.131:0/3567062229 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fea380c9ea0 con 0x7fea380cf880 2024-05-17T11:53:31.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.709+0000 7fea26ffd640 1 -- 172.21.15.131:0/3567062229 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fea2801a070 con 0x7fea380cf880 2024-05-17T11:53:31.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.709+0000 7fea3cd7a640 1 -- 172.21.15.131:0/3567062229 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea380cfc90 con 0x7fea380cf880 2024-05-17T11:53:31.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.710+0000 7fea26ffd640 1 --2- 172.21.15.131:0/3567062229 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fea180762d0 0x7fea180787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:31.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.710+0000 7fea35d9b640 1 --2- 172.21.15.131:0/3567062229 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fea180762d0 0x7fea180787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:31.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.710+0000 7fea26ffd640 1 -- 172.21.15.131:0/3567062229 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7fea28096610 con 0x7fea380cf880 2024-05-17T11:53:31.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.711+0000 7fea35d9b640 1 --2- 172.21.15.131:0/3567062229 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fea180762d0 0x7fea180787e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fea380b42d0 tx=0x7fea2c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:31.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:31.714+0000 7fea26ffd640 1 -- 172.21.15.131:0/3567062229 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fea38161af0 con 0x7fea380cf880 2024-05-17T11:53:32.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.285+0000 7fea3cd7a640 1 -- 172.21.15.131:0/3567062229 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fea3815b7b0 con 0x7fea180762d0 2024-05-17T11:53:32.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.286+0000 7fea26ffd640 1 -- 172.21.15.131:0/3567062229 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fea3815b7b0 con 0x7fea180762d0 2024-05-17T11:53:32.273 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 5 to deep-scrub 2024-05-17T11:53:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.291+0000 7fea3cd7a640 1 -- 172.21.15.131:0/3567062229 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fea180762d0 msgr2=0x7fea180787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.291+0000 7fea3cd7a640 1 --2- 172.21.15.131:0/3567062229 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fea180762d0 0x7fea180787e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fea380b42d0 tx=0x7fea2c009190 comp rx=0 tx=0).stop 2024-05-17T11:53:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.291+0000 7fea3cd7a640 1 -- 172.21.15.131:0/3567062229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea380cf880 msgr2=0x7fea380ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.291+0000 7fea3cd7a640 1 --2- 172.21.15.131:0/3567062229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea380cf880 0x7fea380ce080 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fea2800c440 tx=0x7fea2800c900 comp rx=0 tx=0).stop 2024-05-17T11:53:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.292+0000 7fea3cd7a640 1 -- 172.21.15.131:0/3567062229 shutdown_connections 2024-05-17T11:53:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.292+0000 7fea3cd7a640 1 --2- 172.21.15.131:0/3567062229 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fea180762d0 0x7fea180787e0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.292+0000 7fea3cd7a640 1 --2- 172.21.15.131:0/3567062229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea381611a0 0x7fea381615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.292+0000 7fea3cd7a640 1 --2- 172.21.15.131:0/3567062229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea3815f770 0x7fea3815b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.292+0000 7fea3cd7a640 1 --2- 172.21.15.131:0/3567062229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea380cf880 0x7fea380ce080 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.292+0000 7fea3cd7a640 1 -- 172.21.15.131:0/3567062229 >> 172.21.15.131:0/3567062229 conn(0x7fea380d2300 msgr2=0x7fea380b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:32.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.292+0000 7fea3cd7a640 1 -- 172.21.15.131:0/3567062229 shutdown_connections 2024-05-17T11:53:32.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.292+0000 7fea3cd7a640 1 -- 172.21.15.131:0/3567062229 wait complete. 2024-05-17T11:53:32.307 INFO:tasks.ceph:Scrubbing osd.6 2024-05-17T11:53:32.307 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-17T11:53:32.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.507+0000 7f45ca10e640 1 Processor -- start 2024-05-17T11:53:32.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.508+0000 7f45ca10e640 1 -- start start 2024-05-17T11:53:32.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.512+0000 7f45ca10e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c4140890 0x7f45c4070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:32.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.512+0000 7f45ca10e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45c4140550 con 0x7f45c40708d0 2024-05-17T11:53:32.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.512+0000 7f45ca10e640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45c4142cc0 con 0x7f45c40b6ef0 2024-05-17T11:53:32.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.512+0000 7f45ca10e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f45c415d7c0 con 0x7f45c4140890 2024-05-17T11:53:32.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.512+0000 7f45c890b640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f45c40708d0 0x7f45c40b67e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38442/0 (socket says 172.21.15.131:38442) 2024-05-17T11:53:32.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.512+0000 7f45c890b640 1 -- 172.21.15.131:0/3928490855 learned_addr learned my addr 172.21.15.131:0/3928490855 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:32.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.512+0000 7f45c910c640 1 --2- 172.21.15.131:0/3928490855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c4140890 0x7f45c4070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:32.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.513+0000 7f45c910c640 1 -- 172.21.15.131:0/3928490855 >> v1:172.21.15.150:6789/0 conn(0x7f45c40b6ef0 legacy=0x7f45c415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:32.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.513+0000 7f45c910c640 1 -- 172.21.15.131:0/3928490855 >> v1:172.21.15.131:6789/0 conn(0x7f45c40708d0 legacy=0x7f45c40b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:32.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.513+0000 7f45c910c640 1 -- 172.21.15.131:0/3928490855 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c4142fa0 con 0x7f45c4140890 2024-05-17T11:53:32.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.513+0000 7f45c910c640 1 --2- 172.21.15.131:0/3928490855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c4140890 0x7f45c4070390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f45c00097d0 tx=0x7f45c002a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=101ec398e6fc276a server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:32.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.514+0000 7f45bbfff640 1 -- 172.21.15.131:0/3928490855 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0037070 con 0x7f45c4140890 2024-05-17T11:53:32.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.514+0000 7f45bbfff640 1 -- 172.21.15.131:0/3928490855 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c002ae30 con 0x7f45c4140890 2024-05-17T11:53:32.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.514+0000 7f45bbfff640 1 -- 172.21.15.131:0/3928490855 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0032640 con 0x7f45c4140890 2024-05-17T11:53:32.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.515+0000 7f45ca10e640 1 -- 172.21.15.131:0/3928490855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c4140890 msgr2=0x7f45c4070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:32.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.515+0000 7f45ca10e640 1 --2- 172.21.15.131:0/3928490855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c4140890 0x7f45c4070390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f45c00097d0 tx=0x7f45c002a0e0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.515+0000 7f45ca10e640 1 -- 172.21.15.131:0/3928490855 shutdown_connections 2024-05-17T11:53:32.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.515+0000 7f45ca10e640 1 --2- 172.21.15.131:0/3928490855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c4140890 0x7f45c4070390 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.515+0000 7f45ca10e640 1 -- 172.21.15.131:0/3928490855 >> 172.21.15.131:0/3928490855 conn(0x7f45c40745f0 msgr2=0x7f45c40b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:32.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.516+0000 7f45ca10e640 1 -- 172.21.15.131:0/3928490855 shutdown_connections 2024-05-17T11:53:32.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.516+0000 7f45ca10e640 1 -- 172.21.15.131:0/3928490855 wait complete. 2024-05-17T11:53:32.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.520+0000 7f45ca10e640 1 Processor -- start 2024-05-17T11:53:32.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.521+0000 7f45ca10e640 1 -- start start 2024-05-17T11:53:32.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.524+0000 7f45ca10e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45c40708d0 0x7f45c40cea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:32.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.524+0000 7f45ca10e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c4140890 0x7f45c40cef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:32.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.524+0000 7f45ca10e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c40cd990 0x7f45c40cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:32.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.524+0000 7f45ca10e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f45c4143560 con 0x7f45c40708d0 2024-05-17T11:53:32.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.524+0000 7f45ca10e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f45c4070ce0 con 0x7f45c4140890 2024-05-17T11:53:32.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.524+0000 7f45c910c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45c40708d0 0x7f45c40cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:32.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.524+0000 7f45ca10e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f45c406dbb0 con 0x7f45c40cd990 2024-05-17T11:53:32.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.524+0000 7f45c910c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45c40708d0 0x7f45c40cea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55334/0 (socket says 172.21.15.131:55334) 2024-05-17T11:53:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.524+0000 7f45c910c640 1 -- 172.21.15.131:0/4173160531 learned_addr learned my addr 172.21.15.131:0/4173160531 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.525+0000 7f45c890b640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c4140890 0x7f45c40cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.525+0000 7f45c990d640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c40cd990 0x7f45c40cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.525+0000 7f45c910c640 1 -- 172.21.15.131:0/4173160531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c40cd990 msgr2=0x7f45c40cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.525+0000 7f45c910c640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c40cd990 0x7f45c40cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.525+0000 7f45c910c640 1 -- 172.21.15.131:0/4173160531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c4140890 msgr2=0x7f45c40cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.525+0000 7f45c910c640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c4140890 0x7f45c40cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.525+0000 7f45c910c640 1 -- 172.21.15.131:0/4173160531 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c415a950 con 0x7f45c40708d0 2024-05-17T11:53:32.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.525+0000 7f45c990d640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45c40cd990 0x7f45c40cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-17T11:53:32.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.525+0000 7f45c890b640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c4140890 0x7f45c40cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-17T11:53:32.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.525+0000 7f45c910c640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45c40708d0 0x7f45c40cea10 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f45c0000c00 tx=0x7f45c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:32.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.526+0000 7f45b9ffb640 1 -- 172.21.15.131:0/4173160531 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0041030 con 0x7f45c40708d0 2024-05-17T11:53:32.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.526+0000 7f45ca10e640 1 -- 172.21.15.131:0/4173160531 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c413d490 con 0x7f45c40708d0 2024-05-17T11:53:32.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.526+0000 7f45ca10e640 1 -- 172.21.15.131:0/4173160531 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c413da50 con 0x7f45c40708d0 2024-05-17T11:53:32.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.526+0000 7f45b9ffb640 1 -- 172.21.15.131:0/4173160531 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c003b610 con 0x7f45c40708d0 2024-05-17T11:53:32.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.526+0000 7f45b9ffb640 1 -- 172.21.15.131:0/4173160531 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0037040 con 0x7f45c40708d0 2024-05-17T11:53:32.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.527+0000 7f45ca10e640 1 -- 172.21.15.131:0/4173160531 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45a4001030 con 0x7f45c40708d0 2024-05-17T11:53:32.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.530+0000 7f45b9ffb640 1 -- 172.21.15.131:0/4173160531 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f45c0044070 con 0x7f45c40708d0 2024-05-17T11:53:32.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.531+0000 7f45b9ffb640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f45a80762d0 0x7f45a80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:32.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.531+0000 7f45b9ffb640 1 -- 172.21.15.131:0/4173160531 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f45c00b7e90 con 0x7f45c40708d0 2024-05-17T11:53:32.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.531+0000 7f45b9ffb640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.150:6809/1730671783,v1:172.21.15.150:6811/1730671783] conn(0x7f45a807c7c0 0x7f45a807ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:32.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.531+0000 7f45b9ffb640 1 -- 172.21.15.131:0/4173160531 --> [v2:172.21.15.150:6809/1730671783,v1:172.21.15.150:6811/1730671783] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45c000af30 con 0x7f45a807c7c0 2024-05-17T11:53:32.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.531+0000 7f45b9ffb640 1 -- 172.21.15.131:0/4173160531 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f45c00b8320 con 0x7f45c40708d0 2024-05-17T11:53:32.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.531+0000 7f45c890b640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f45a80762d0 0x7f45a80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:32.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.531+0000 7f45c990d640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.150:6809/1730671783,v1:172.21.15.150:6811/1730671783] conn(0x7f45a807c7c0 0x7f45a807ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:32.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.532+0000 7f45c990d640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.150:6809/1730671783,v1:172.21.15.150:6811/1730671783] conn(0x7f45a807c7c0 0x7f45a807ec50 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:32.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.532+0000 7f45c890b640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f45a80762d0 0x7f45a80787e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f45c40d0bf0 tx=0x7f45b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:32.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.533+0000 7f45b9ffb640 1 -- 172.21.15.131:0/4173160531 <== osd.6 v2:172.21.15.150:6809/1730671783 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f45c000af30 con 0x7f45a807c7c0 2024-05-17T11:53:32.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.545+0000 7f45ca10e640 1 -- 172.21.15.131:0/4173160531 --> [v2:172.21.15.150:6809/1730671783,v1:172.21.15.150:6811/1730671783] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f45a4002e30 con 0x7f45a807c7c0 2024-05-17T11:53:32.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.546+0000 7f45b9ffb640 1 -- 172.21.15.131:0/4173160531 <== osd.6 v2:172.21.15.150:6809/1730671783 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f45a4002e30 con 0x7f45a807c7c0 2024-05-17T11:53:32.533 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T11:53:32.533 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-17T11:53:32.533 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T11:53:32.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.546+0000 7f45ca10e640 1 -- 172.21.15.131:0/4173160531 >> [v2:172.21.15.150:6809/1730671783,v1:172.21.15.150:6811/1730671783] conn(0x7f45a807c7c0 msgr2=0x7f45a807ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:32.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.546+0000 7f45ca10e640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.150:6809/1730671783,v1:172.21.15.150:6811/1730671783] conn(0x7f45a807c7c0 0x7f45a807ec50 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.547+0000 7f45ca10e640 1 -- 172.21.15.131:0/4173160531 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f45a80762d0 msgr2=0x7f45a80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:32.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.547+0000 7f45ca10e640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f45a80762d0 0x7f45a80787e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f45c40d0bf0 tx=0x7f45b4009040 comp rx=0 tx=0).stop 2024-05-17T11:53:32.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.547+0000 7f45ca10e640 1 -- 172.21.15.131:0/4173160531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45c40708d0 msgr2=0x7f45c40cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:32.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.547+0000 7f45ca10e640 1 --2- 172.21.15.131:0/4173160531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45c40708d0 0x7f45c40cea10 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f45c0000c00 tx=0x7f45c00046c0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.547+0000 7f45c990d640 1 -- 172.21.15.131:0/4173160531 reap_dead start 2024-05-17T11:53:32.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.547+0000 7f45ca10e640 1 -- 172.21.15.131:0/4173160531 shutdown_connections 2024-05-17T11:53:32.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.547+0000 7f45ca10e640 1 -- 172.21.15.131:0/4173160531 >> 172.21.15.131:0/4173160531 conn(0x7f45c40745f0 msgr2=0x7f45c415bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:32.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.547+0000 7f45ca10e640 1 -- 172.21.15.131:0/4173160531 shutdown_connections 2024-05-17T11:53:32.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.547+0000 7f45ca10e640 1 -- 172.21.15.131:0/4173160531 wait complete. 2024-05-17T11:53:32.547 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-17T11:53:32.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.863+0000 7fa2b69a8640 1 Processor -- start 2024-05-17T11:53:32.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.863+0000 7fa2b69a8640 1 -- start start 2024-05-17T11:53:32.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.867+0000 7fa2b69a8640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa2b0073a00 0x7fa2b015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:32.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.867+0000 7fa2b69a8640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa2b006e6a0 0x7fa2b00b4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:32.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.867+0000 7fa2b69a8640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2b00ce350 con 0x7fa2b00d1180 2024-05-17T11:53:32.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.867+0000 7fa2b69a8640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa2b00ce630 con 0x7fa2b0073a00 2024-05-17T11:53:32.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.867+0000 7fa2b69a8640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa2b00ce910 con 0x7fa2b006e6a0 2024-05-17T11:53:32.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.867+0000 7fa2affff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa2b0073a00 0x7fa2b015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:32.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.868+0000 7fa2af7fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa2b00d1180 0x7fa2b006df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38452/0 (socket says 172.21.15.131:38452) 2024-05-17T11:53:32.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.868+0000 7fa2af7fe640 1 -- 172.21.15.131:0/3268197171 learned_addr learned my addr 172.21.15.131:0/3268197171 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:32.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.868+0000 7fa2b4f45640 1 --2- 172.21.15.131:0/3268197171 >> v2:172.21.15.150:3300/0 conn(0x7fa2b006e6a0 0x7fa2b00b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:32.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.868+0000 7fa2affff640 1 -- 172.21.15.131:0/3268197171 >> v2:172.21.15.150:3300/0 conn(0x7fa2b006e6a0 msgr2=0x7fa2b00b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:32.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.868+0000 7fa2affff640 1 --2- 172.21.15.131:0/3268197171 >> v2:172.21.15.150:3300/0 conn(0x7fa2b006e6a0 0x7fa2b00b4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.868+0000 7fa2affff640 1 -- 172.21.15.131:0/3268197171 >> v1:172.21.15.131:6789/0 conn(0x7fa2b00d1180 legacy=0x7fa2b006df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:32.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.868+0000 7fa2affff640 1 -- 172.21.15.131:0/3268197171 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b00cebf0 con 0x7fa2b0073a00 2024-05-17T11:53:32.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.868+0000 7fa2b4f45640 1 --2- 172.21.15.131:0/3268197171 >> v2:172.21.15.150:3300/0 conn(0x7fa2b006e6a0 0x7fa2b00b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:32.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.869+0000 7fa2affff640 1 --2- 172.21.15.131:0/3268197171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b0073a00 0x7fa2b015d3b0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00ce160 tx=0x7fa2a002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d046a8605f608f server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:32.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.869+0000 7fa2aeffd640 1 -- 172.21.15.131:0/3268197171 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0037070 con 0x7fa2b0073a00 2024-05-17T11:53:32.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.870+0000 7fa2aeffd640 1 -- 172.21.15.131:0/3268197171 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2a0032440 con 0x7fa2b0073a00 2024-05-17T11:53:32.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.870+0000 7fa2aeffd640 1 -- 172.21.15.131:0/3268197171 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0032810 con 0x7fa2b0073a00 2024-05-17T11:53:32.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.871+0000 7fa2b69a8640 1 -- 172.21.15.131:0/3268197171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b0073a00 msgr2=0x7fa2b015d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:32.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.871+0000 7fa2b69a8640 1 --2- 172.21.15.131:0/3268197171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b0073a00 0x7fa2b015d3b0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00ce160 tx=0x7fa2a002a1a0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.871+0000 7fa2b69a8640 1 -- 172.21.15.131:0/3268197171 shutdown_connections 2024-05-17T11:53:32.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.871+0000 7fa2b69a8640 1 --2- 172.21.15.131:0/3268197171 >> v2:172.21.15.150:3300/0 conn(0x7fa2b006e6a0 0x7fa2b00b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.871+0000 7fa2b69a8640 1 --2- 172.21.15.131:0/3268197171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b0073a00 0x7fa2b015d3b0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.871+0000 7fa2b69a8640 1 -- 172.21.15.131:0/3268197171 >> 172.21.15.131:0/3268197171 conn(0x7fa2b00d2140 msgr2=0x7fa2b0072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:32.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.872+0000 7fa2b69a8640 1 -- 172.21.15.131:0/3268197171 shutdown_connections 2024-05-17T11:53:32.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.872+0000 7fa2b69a8640 1 -- 172.21.15.131:0/3268197171 wait complete. 2024-05-17T11:53:32.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.877+0000 7fa2b69a8640 1 Processor -- start 2024-05-17T11:53:32.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.877+0000 7fa2b69a8640 1 -- start start 2024-05-17T11:53:32.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.881+0000 7fa2b69a8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b0073a00 0x7fa2b01f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:32.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.881+0000 7fa2b69a8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b00d1180 0x7fa2b0143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:32.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.881+0000 7fa2b69a8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2b014d2b0 0x7fa2b015f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:32.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.881+0000 7fa2b69a8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b00d1710 con 0x7fa2b0073a00 2024-05-17T11:53:32.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.881+0000 7fa2b69a8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b00d1590 con 0x7fa2b00d1180 2024-05-17T11:53:32.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.881+0000 7fa2b69a8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b00b4db0 con 0x7fa2b014d2b0 2024-05-17T11:53:32.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.881+0000 7fa2af7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b00d1180 0x7fa2b0143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:32.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.881+0000 7fa2affff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b0073a00 0x7fa2b01f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:32.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.881+0000 7fa2af7fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b00d1180 0x7fa2b0143330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.131:55778/0 (socket says 172.21.15.131:55778) 2024-05-17T11:53:32.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.881+0000 7fa2af7fe640 1 -- 172.21.15.131:0/2268325287 learned_addr learned my addr 172.21.15.131:0/2268325287 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:32.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.881+0000 7fa2b4f45640 1 --2- 172.21.15.131:0/2268325287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2b014d2b0 0x7fa2b015f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:32.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.882+0000 7fa2af7fe640 1 -- 172.21.15.131:0/2268325287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2b014d2b0 msgr2=0x7fa2b015f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:32.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.882+0000 7fa2af7fe640 1 --2- 172.21.15.131:0/2268325287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2b014d2b0 0x7fa2b015f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.882+0000 7fa2af7fe640 1 -- 172.21.15.131:0/2268325287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b0073a00 msgr2=0x7fa2b01f32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:32.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.882+0000 7fa2af7fe640 1 --2- 172.21.15.131:0/2268325287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b0073a00 0x7fa2b01f32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:32.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.882+0000 7fa2af7fe640 1 -- 172.21.15.131:0/2268325287 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b0143870 con 0x7fa2b00d1180 2024-05-17T11:53:32.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.882+0000 7fa2af7fe640 1 --2- 172.21.15.131:0/2268325287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b00d1180 0x7fa2b0143330 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400c400 tx=0x7fa2a400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:32.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.882+0000 7fa2acff9640 1 -- 172.21.15.131:0/2268325287 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4017070 con 0x7fa2b00d1180 2024-05-17T11:53:32.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.882+0000 7fa2acff9640 1 -- 172.21.15.131:0/2268325287 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2a4005d00 con 0x7fa2b00d1180 2024-05-17T11:53:32.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.882+0000 7fa2b69a8640 1 -- 172.21.15.131:0/2268325287 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b015d600 con 0x7fa2b00d1180 2024-05-17T11:53:32.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.882+0000 7fa2acff9640 1 -- 172.21.15.131:0/2268325287 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4007310 con 0x7fa2b00d1180 2024-05-17T11:53:32.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.883+0000 7fa2b69a8640 1 -- 172.21.15.131:0/2268325287 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b015dbc0 con 0x7fa2b00d1180 2024-05-17T11:53:32.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.885+0000 7fa2acff9640 1 -- 172.21.15.131:0/2268325287 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa2a401a070 con 0x7fa2b00d1180 2024-05-17T11:53:32.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.885+0000 7fa2b69a8640 1 -- 172.21.15.131:0/2268325287 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2b00b4870 con 0x7fa2b00d1180 2024-05-17T11:53:32.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.886+0000 7fa2acff9640 1 --2- 172.21.15.131:0/2268325287 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa29c076300 0x7fa29c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:32.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.886+0000 7fa2acff9640 1 -- 172.21.15.131:0/2268325287 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7fa2a4096850 con 0x7fa2b00d1180 2024-05-17T11:53:32.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.886+0000 7fa2affff640 1 --2- 172.21.15.131:0/2268325287 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa29c076300 0x7fa29c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:32.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.888+0000 7fa2affff640 1 --2- 172.21.15.131:0/2268325287 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa29c076300 0x7fa29c078810 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0034000 tx=0x7fa2a002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:32.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:32.891+0000 7fa2acff9640 1 -- 172.21.15.131:0/2268325287 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa2b0143870 con 0x7fa2b00d1180 2024-05-17T11:53:33.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.456+0000 7fa2b69a8640 1 -- 172.21.15.131:0/2268325287 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fa2b015d3b0 con 0x7fa29c076300 2024-05-17T11:53:33.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.457+0000 7fa2acff9640 1 -- 172.21.15.131:0/2268325287 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa2b015d3b0 con 0x7fa29c076300 2024-05-17T11:53:33.444 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 6 to deep-scrub 2024-05-17T11:53:33.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.462+0000 7fa2b69a8640 1 -- 172.21.15.131:0/2268325287 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa29c076300 msgr2=0x7fa29c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:33.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.462+0000 7fa2b69a8640 1 --2- 172.21.15.131:0/2268325287 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa29c076300 0x7fa29c078810 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0034000 tx=0x7fa2a002e000 comp rx=0 tx=0).stop 2024-05-17T11:53:33.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.462+0000 7fa2b69a8640 1 -- 172.21.15.131:0/2268325287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b00d1180 msgr2=0x7fa2b0143330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:33.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.462+0000 7fa2b69a8640 1 --2- 172.21.15.131:0/2268325287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b00d1180 0x7fa2b0143330 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400c400 tx=0x7fa2a400c8c0 comp rx=0 tx=0).stop 2024-05-17T11:53:33.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.462+0000 7fa2b69a8640 1 -- 172.21.15.131:0/2268325287 shutdown_connections 2024-05-17T11:53:33.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.462+0000 7fa2b69a8640 1 --2- 172.21.15.131:0/2268325287 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fa29c076300 0x7fa29c078810 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:33.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.462+0000 7fa2b69a8640 1 --2- 172.21.15.131:0/2268325287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2b014d2b0 0x7fa2b015f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:33.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.462+0000 7fa2b69a8640 1 --2- 172.21.15.131:0/2268325287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b00d1180 0x7fa2b0143330 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:33.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.462+0000 7fa2b69a8640 1 --2- 172.21.15.131:0/2268325287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b0073a00 0x7fa2b01f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:33.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.462+0000 7fa2b69a8640 1 -- 172.21.15.131:0/2268325287 >> 172.21.15.131:0/2268325287 conn(0x7fa2b00d2140 msgr2=0x7fa2b00b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:33.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.462+0000 7fa2b69a8640 1 -- 172.21.15.131:0/2268325287 shutdown_connections 2024-05-17T11:53:33.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.462+0000 7fa2b69a8640 1 -- 172.21.15.131:0/2268325287 wait complete. 2024-05-17T11:53:33.477 INFO:tasks.ceph:Scrubbing osd.7 2024-05-17T11:53:33.477 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-17T11:53:33.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.789+0000 7f448603c640 1 Processor -- start 2024-05-17T11:53:33.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.789+0000 7f448603c640 1 -- start start 2024-05-17T11:53:33.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.793+0000 7f448603c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f44800d4570 0x7f448015ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:33.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.793+0000 7f448603c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44801604d0 0x7f44800cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:33.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.793+0000 7f448603c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448006c820 con 0x7f448015f6a0 2024-05-17T11:53:33.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.793+0000 7f448603c640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f4480160d00 con 0x7f44800d4570 2024-05-17T11:53:33.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.793+0000 7f448603c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f448006cb00 con 0x7f44801604d0 2024-05-17T11:53:33.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.794+0000 7f447f7fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f448015f6a0 0x7f44800d3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38456/0 (socket says 172.21.15.131:38456) 2024-05-17T11:53:33.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.794+0000 7f447f7fe640 1 -- 172.21.15.131:0/763752628 learned_addr learned my addr 172.21.15.131:0/763752628 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:33.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.794+0000 7f447ffff640 1 --2- 172.21.15.131:0/763752628 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44801604d0 0x7f44800cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:33.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.794+0000 7f447effd640 1 --2- 172.21.15.131:0/763752628 >> v2:172.21.15.150:3300/0 conn(0x7f44800d4570 0x7f448015ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:33.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.794+0000 7f447e7fc640 1 -- 172.21.15.131:0/763752628 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3691132283 0 0) 0x7f448006c820 con 0x7f448015f6a0 2024-05-17T11:53:33.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.794+0000 7f447e7fc640 1 -- 172.21.15.131:0/763752628 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4468003520 con 0x7f448015f6a0 2024-05-17T11:53:33.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.795+0000 7f447ffff640 1 -- 172.21.15.131:0/763752628 >> v2:172.21.15.150:3300/0 conn(0x7f44800d4570 msgr2=0x7f448015ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:33.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.795+0000 7f447ffff640 1 --2- 172.21.15.131:0/763752628 >> v2:172.21.15.150:3300/0 conn(0x7f44800d4570 0x7f448015ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:33.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.795+0000 7f447ffff640 1 -- 172.21.15.131:0/763752628 >> v1:172.21.15.131:6789/0 conn(0x7f448015f6a0 legacy=0x7f44800d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:33.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.795+0000 7f447ffff640 1 -- 172.21.15.131:0/763752628 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448006cde0 con 0x7f44801604d0 2024-05-17T11:53:33.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.795+0000 7f447effd640 1 --2- 172.21.15.131:0/763752628 >> v2:172.21.15.150:3300/0 conn(0x7f44800d4570 0x7f448015ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:33.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.797+0000 7f447ffff640 1 --2- 172.21.15.131:0/763752628 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44801604d0 0x7f44800cf8d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4478009d90 tx=0x7f447802a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf6ee4c89523cea8 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:33.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.797+0000 7f447e7fc640 1 -- 172.21.15.131:0/763752628 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478007740 con 0x7f44801604d0 2024-05-17T11:53:33.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.797+0000 7f447e7fc640 1 -- 172.21.15.131:0/763752628 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44780078e0 con 0x7f44801604d0 2024-05-17T11:53:33.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.797+0000 7f447e7fc640 1 -- 172.21.15.131:0/763752628 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478007cb0 con 0x7f44801604d0 2024-05-17T11:53:33.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.799+0000 7f448603c640 1 -- 172.21.15.131:0/763752628 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44801604d0 msgr2=0x7f44800cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:33.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.799+0000 7f448603c640 1 --2- 172.21.15.131:0/763752628 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44801604d0 0x7f44800cf8d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4478009d90 tx=0x7f447802a530 comp rx=0 tx=0).stop 2024-05-17T11:53:33.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.799+0000 7f448603c640 1 -- 172.21.15.131:0/763752628 shutdown_connections 2024-05-17T11:53:33.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.799+0000 7f448603c640 1 --2- 172.21.15.131:0/763752628 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44801604d0 0x7f44800cf8d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:33.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.799+0000 7f448603c640 1 --2- 172.21.15.131:0/763752628 >> v2:172.21.15.150:3300/0 conn(0x7f44800d4570 0x7f448015ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:33.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.799+0000 7f448603c640 1 -- 172.21.15.131:0/763752628 >> 172.21.15.131:0/763752628 conn(0x7f44800d58b0 msgr2=0x7f44800b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:33.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.799+0000 7f448603c640 1 -- 172.21.15.131:0/763752628 shutdown_connections 2024-05-17T11:53:33.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.799+0000 7f448603c640 1 -- 172.21.15.131:0/763752628 wait complete. 2024-05-17T11:53:33.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.804+0000 7f448603c640 1 Processor -- start 2024-05-17T11:53:33.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.805+0000 7f448603c640 1 -- start start 2024-05-17T11:53:33.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.808+0000 7f448603c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448015f6a0 0x7f44800c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:33.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.808+0000 7f448603c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44801604d0 0x7f4480155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.808+0000 7f448603c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44800b9980 0x7f44800b9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.808+0000 7f448603c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f448015fc30 con 0x7f44801604d0 2024-05-17T11:53:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.808+0000 7f448603c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f448015fab0 con 0x7f44800b9980 2024-05-17T11:53:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.808+0000 7f448603c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f44801608e0 con 0x7f448015f6a0 2024-05-17T11:53:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.809+0000 7f447effd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44801604d0 0x7f4480155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.809+0000 7f447effd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44801604d0 0x7f4480155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55370/0 (socket says 172.21.15.131:55370) 2024-05-17T11:53:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.809+0000 7f447effd640 1 -- 172.21.15.131:0/2626723678 learned_addr learned my addr 172.21.15.131:0/2626723678 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.809+0000 7f447f7fe640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448015f6a0 0x7f44800c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:33.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.809+0000 7f447ffff640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44800b9980 0x7f44800b9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:33.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.809+0000 7f447f7fe640 1 -- 172.21.15.131:0/2626723678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44800b9980 msgr2=0x7f44800b9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:33.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.809+0000 7f447f7fe640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44800b9980 0x7f44800b9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:33.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.809+0000 7f447f7fe640 1 -- 172.21.15.131:0/2626723678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44801604d0 msgr2=0x7f4480155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:33.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.809+0000 7f447f7fe640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44801604d0 0x7f4480155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:33.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.809+0000 7f447f7fe640 1 -- 172.21.15.131:0/2626723678 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44800ba2d0 con 0x7f448015f6a0 2024-05-17T11:53:33.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.810+0000 7f447ffff640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44800b9980 0x7f44800b9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:33.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.810+0000 7f447effd640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44801604d0 0x7f4480155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:33.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.810+0000 7f447f7fe640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448015f6a0 0x7f44800c8170 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f447000c390 tx=0x7f447000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:33.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.810+0000 7f4467fff640 1 -- 172.21.15.131:0/2626723678 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470017070 con 0x7f448015f6a0 2024-05-17T11:53:33.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.810+0000 7f4467fff640 1 -- 172.21.15.131:0/2626723678 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4470005ce0 con 0x7f448015f6a0 2024-05-17T11:53:33.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.810+0000 7f448603c640 1 -- 172.21.15.131:0/2626723678 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4480154430 con 0x7f448015f6a0 2024-05-17T11:53:33.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.810+0000 7f4467fff640 1 -- 172.21.15.131:0/2626723678 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44700072d0 con 0x7f448015f6a0 2024-05-17T11:53:33.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.811+0000 7f448603c640 1 -- 172.21.15.131:0/2626723678 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f44801549f0 con 0x7f448015f6a0 2024-05-17T11:53:33.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.812+0000 7f448603c640 1 -- 172.21.15.131:0/2626723678 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f44801541e0 con 0x7f448015f6a0 2024-05-17T11:53:33.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.814+0000 7f4467fff640 1 -- 172.21.15.131:0/2626723678 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f447001a070 con 0x7f448015f6a0 2024-05-17T11:53:33.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.815+0000 7f4467fff640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f446c0762d0 0x7f446c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:33.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.816+0000 7f447effd640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f446c0762d0 0x7f446c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:33.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.816+0000 7f4467fff640 1 -- 172.21.15.131:0/2626723678 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f44700966e0 con 0x7f448015f6a0 2024-05-17T11:53:33.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.816+0000 7f4467fff640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.150:6824/2147509392,v1:172.21.15.150:6825/2147509392] conn(0x7f446c07c7c0 0x7f446c07ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:33.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.816+0000 7f4467fff640 1 -- 172.21.15.131:0/2626723678 --> [v2:172.21.15.150:6824/2147509392,v1:172.21.15.150:6825/2147509392] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4470011e50 con 0x7f446c07c7c0 2024-05-17T11:53:33.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.816+0000 7f4467fff640 1 -- 172.21.15.131:0/2626723678 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f447009d050 con 0x7f448015f6a0 2024-05-17T11:53:33.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.816+0000 7f447effd640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f446c0762d0 0x7f446c0787e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f44800cec30 tx=0x7f4474009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:33.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.817+0000 7f447ffff640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.150:6824/2147509392,v1:172.21.15.150:6825/2147509392] conn(0x7f446c07c7c0 0x7f446c07ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:33.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.817+0000 7f447ffff640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.150:6824/2147509392,v1:172.21.15.150:6825/2147509392] conn(0x7f446c07c7c0 0x7f446c07ec50 crc :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:33.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.818+0000 7f4467fff640 1 -- 172.21.15.131:0/2626723678 <== osd.7 v2:172.21.15.150:6824/2147509392 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4470011e50 con 0x7f446c07c7c0 2024-05-17T11:53:33.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.857+0000 7f448603c640 1 -- 172.21.15.131:0/2626723678 --> [v2:172.21.15.150:6824/2147509392,v1:172.21.15.150:6825/2147509392] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f448015ff90 con 0x7f446c07c7c0 2024-05-17T11:53:33.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.857+0000 7f4467fff640 1 -- 172.21.15.131:0/2626723678 <== osd.7 v2:172.21.15.150:6824/2147509392 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f448015ff90 con 0x7f446c07c7c0 2024-05-17T11:53:33.844 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-05-17T11:53:33.844 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-17T11:53:33.845 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-05-17T11:53:33.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.858+0000 7f448603c640 1 -- 172.21.15.131:0/2626723678 >> [v2:172.21.15.150:6824/2147509392,v1:172.21.15.150:6825/2147509392] conn(0x7f446c07c7c0 msgr2=0x7f446c07ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:33.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.858+0000 7f448603c640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.150:6824/2147509392,v1:172.21.15.150:6825/2147509392] conn(0x7f446c07c7c0 0x7f446c07ec50 crc :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:33.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.859+0000 7f448603c640 1 -- 172.21.15.131:0/2626723678 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f446c0762d0 msgr2=0x7f446c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:33.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.859+0000 7f448603c640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f446c0762d0 0x7f446c0787e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f44800cec30 tx=0x7f4474009190 comp rx=0 tx=0).stop 2024-05-17T11:53:33.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.859+0000 7f448603c640 1 -- 172.21.15.131:0/2626723678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448015f6a0 msgr2=0x7f44800c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:33.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.859+0000 7f448603c640 1 --2- 172.21.15.131:0/2626723678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448015f6a0 0x7f44800c8170 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f447000c390 tx=0x7f447000c850 comp rx=0 tx=0).stop 2024-05-17T11:53:33.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.859+0000 7f447ffff640 1 -- 172.21.15.131:0/2626723678 reap_dead start 2024-05-17T11:53:33.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.859+0000 7f448603c640 1 -- 172.21.15.131:0/2626723678 shutdown_connections 2024-05-17T11:53:33.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.859+0000 7f448603c640 1 -- 172.21.15.131:0/2626723678 >> 172.21.15.131:0/2626723678 conn(0x7f44800d58b0 msgr2=0x7f44800d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:33.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.859+0000 7f448603c640 1 -- 172.21.15.131:0/2626723678 shutdown_connections 2024-05-17T11:53:33.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:33.859+0000 7f448603c640 1 -- 172.21.15.131:0/2626723678 wait complete. 2024-05-17T11:53:33.871 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-17T11:53:34.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.189+0000 7f245d43d640 1 Processor -- start 2024-05-17T11:53:34.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.189+0000 7f245d43d640 1 -- start start 2024-05-17T11:53:34.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.193+0000 7f245d43d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f245815f5f0 0x7f24580b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:34.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.193+0000 7f245d43d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f24580736c0 0x7f2458073ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:34.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.193+0000 7f245d43d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24580b48a0 con 0x7f24580af900 2024-05-17T11:53:34.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.193+0000 7f245d43d640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f2458074010 con 0x7f24580736c0 2024-05-17T11:53:34.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.193+0000 7f245d43d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f24580b6d30 con 0x7f245815f5f0 2024-05-17T11:53:34.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.194+0000 7f2456ffd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f24580af900 0x7f2458163bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:38460/0 (socket says 172.21.15.131:38460) 2024-05-17T11:53:34.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.194+0000 7f24577fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f24580736c0 0x7f2458073ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:34.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.194+0000 7f2456ffd640 1 -- 172.21.15.131:0/89983226 learned_addr learned my addr 172.21.15.131:0/89983226 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:34.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.194+0000 7f24567fc640 1 --2- 172.21.15.131:0/89983226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f245815f5f0 0x7f24580b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:34.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.194+0000 7f2455ffb640 1 -- 172.21.15.131:0/89983226 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2655445649 0 0) 0x7f24580b48a0 con 0x7f24580af900 2024-05-17T11:53:34.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.194+0000 7f2455ffb640 1 -- 172.21.15.131:0/89983226 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2440003520 con 0x7f24580af900 2024-05-17T11:53:34.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.194+0000 7f24567fc640 1 -- 172.21.15.131:0/89983226 >> v2:172.21.15.131:3300/0 conn(0x7f24580736c0 msgr2=0x7f2458073ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:34.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.194+0000 7f24567fc640 1 --2- 172.21.15.131:0/89983226 >> v2:172.21.15.131:3300/0 conn(0x7f24580736c0 0x7f2458073ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:34.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.194+0000 7f24567fc640 1 -- 172.21.15.131:0/89983226 >> v1:172.21.15.131:6789/0 conn(0x7f24580af900 legacy=0x7f2458163bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:34.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.194+0000 7f24567fc640 1 -- 172.21.15.131:0/89983226 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24580afdc0 con 0x7f245815f5f0 2024-05-17T11:53:34.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.196+0000 7f24567fc640 1 --2- 172.21.15.131:0/89983226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f245815f5f0 0x7f24580b5310 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f244c009d90 tx=0x7f244c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f6c8d162193ade4 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:34.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.197+0000 7f2455ffb640 1 -- 172.21.15.131:0/89983226 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c007740 con 0x7f245815f5f0 2024-05-17T11:53:34.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.197+0000 7f2455ffb640 1 -- 172.21.15.131:0/89983226 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f244c0078e0 con 0x7f245815f5f0 2024-05-17T11:53:34.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.197+0000 7f2455ffb640 1 -- 172.21.15.131:0/89983226 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c007cb0 con 0x7f245815f5f0 2024-05-17T11:53:34.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.198+0000 7f245d43d640 1 -- 172.21.15.131:0/89983226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f245815f5f0 msgr2=0x7f24580b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:34.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.198+0000 7f245d43d640 1 --2- 172.21.15.131:0/89983226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f245815f5f0 0x7f24580b5310 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f244c009d90 tx=0x7f244c02a660 comp rx=0 tx=0).stop 2024-05-17T11:53:34.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.198+0000 7f245d43d640 1 -- 172.21.15.131:0/89983226 shutdown_connections 2024-05-17T11:53:34.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.198+0000 7f245d43d640 1 --2- 172.21.15.131:0/89983226 >> v2:172.21.15.131:3300/0 conn(0x7f24580736c0 0x7f2458073ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:34.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.198+0000 7f245d43d640 1 --2- 172.21.15.131:0/89983226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f245815f5f0 0x7f24580b5310 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:34.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.198+0000 7f245d43d640 1 -- 172.21.15.131:0/89983226 >> 172.21.15.131:0/89983226 conn(0x7f24580d2140 msgr2=0x7f2458072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:34.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.198+0000 7f245d43d640 1 -- 172.21.15.131:0/89983226 shutdown_connections 2024-05-17T11:53:34.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.198+0000 7f245d43d640 1 -- 172.21.15.131:0/89983226 wait complete. 2024-05-17T11:53:34.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.200+0000 7f245d43d640 1 Processor -- start 2024-05-17T11:53:34.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.200+0000 7f245d43d640 1 -- start start 2024-05-17T11:53:34.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.201+0000 7f245d43d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24580736c0 0x7f24580d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:34.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.201+0000 7f245d43d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f245815f5f0 0x7f245814ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:34.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.201+0000 7f245d43d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24580c6770 0x7f245815b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:34.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.201+0000 7f245d43d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f24580b00a0 con 0x7f24580c6770 2024-05-17T11:53:34.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.201+0000 7f245d43d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f245815fa00 con 0x7f24580736c0 2024-05-17T11:53:34.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.201+0000 7f245d43d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f24580b0220 con 0x7f245815f5f0 2024-05-17T11:53:34.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.201+0000 7f24577fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24580c6770 0x7f245815b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:34.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.201+0000 7f24577fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24580c6770 0x7f245815b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55390/0 (socket says 172.21.15.131:55390) 2024-05-17T11:53:34.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.201+0000 7f24577fe640 1 -- 172.21.15.131:0/3641814187 learned_addr learned my addr 172.21.15.131:0/3641814187 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:34.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.201+0000 7f24567fc640 1 --2- 172.21.15.131:0/3641814187 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f245815f5f0 0x7f245814ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:34.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.202+0000 7f2456ffd640 1 --2- 172.21.15.131:0/3641814187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24580736c0 0x7f24580d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:34.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.202+0000 7f24567fc640 1 -- 172.21.15.131:0/3641814187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24580736c0 msgr2=0x7f24580d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:34.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.202+0000 7f24567fc640 1 --2- 172.21.15.131:0/3641814187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24580736c0 0x7f24580d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:34.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.202+0000 7f24567fc640 1 -- 172.21.15.131:0/3641814187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24580c6770 msgr2=0x7f245815b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:34.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.202+0000 7f24567fc640 1 --2- 172.21.15.131:0/3641814187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24580c6770 0x7f245815b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:34.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.202+0000 7f24567fc640 1 -- 172.21.15.131:0/3641814187 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245814cf70 con 0x7f245815f5f0 2024-05-17T11:53:34.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.202+0000 7f24567fc640 1 --2- 172.21.15.131:0/3641814187 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f245815f5f0 0x7f245814ca30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f244c031000 tx=0x7f244c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:34.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.202+0000 7f243f7fe640 1 -- 172.21.15.131:0/3641814187 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c03f070 con 0x7f245815f5f0 2024-05-17T11:53:34.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.203+0000 7f243f7fe640 1 -- 172.21.15.131:0/3641814187 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f244c031c60 con 0x7f245815f5f0 2024-05-17T11:53:34.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.203+0000 7f245d43d640 1 -- 172.21.15.131:0/3641814187 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245814a310 con 0x7f245815f5f0 2024-05-17T11:53:34.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.203+0000 7f243f7fe640 1 -- 172.21.15.131:0/3641814187 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c009450 con 0x7f245815f5f0 2024-05-17T11:53:34.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.203+0000 7f245d43d640 1 -- 172.21.15.131:0/3641814187 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f245814a8d0 con 0x7f245815f5f0 2024-05-17T11:53:34.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.205+0000 7f245d43d640 1 -- 172.21.15.131:0/3641814187 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2458149cb0 con 0x7f245815f5f0 2024-05-17T11:53:34.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.207+0000 7f243f7fe640 1 -- 172.21.15.131:0/3641814187 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f244c007790 con 0x7f245815f5f0 2024-05-17T11:53:34.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.208+0000 7f243f7fe640 1 --2- 172.21.15.131:0/3641814187 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f24440762d0 0x7f24440787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:34.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.208+0000 7f2456ffd640 1 --2- 172.21.15.131:0/3641814187 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f24440762d0 0x7f24440787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:34.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.208+0000 7f243f7fe640 1 -- 172.21.15.131:0/3641814187 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f244c0b86c0 con 0x7f245815f5f0 2024-05-17T11:53:34.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.209+0000 7f2456ffd640 1 --2- 172.21.15.131:0/3641814187 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f24440762d0 0x7f24440787e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2448005880 tx=0x7f2448006aa0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:34.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.213+0000 7f243f7fe640 1 -- 172.21.15.131:0/3641814187 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2458149cb0 con 0x7f245815f5f0 2024-05-17T11:53:34.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.768+0000 7f245d43d640 1 -- 172.21.15.131:0/3641814187 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f24580b5970 con 0x7f24440762d0 2024-05-17T11:53:34.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.769+0000 7f243f7fe640 1 -- 172.21.15.131:0/3641814187 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f24580b5970 con 0x7f24440762d0 2024-05-17T11:53:34.756 INFO:teuthology.orchestra.run.smithi131.stderr:instructed osd(s) 7 to deep-scrub 2024-05-17T11:53:34.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.773+0000 7f245d43d640 1 -- 172.21.15.131:0/3641814187 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f24440762d0 msgr2=0x7f24440787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:34.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.773+0000 7f245d43d640 1 --2- 172.21.15.131:0/3641814187 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f24440762d0 0x7f24440787e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2448005880 tx=0x7f2448006aa0 comp rx=0 tx=0).stop 2024-05-17T11:53:34.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.773+0000 7f245d43d640 1 -- 172.21.15.131:0/3641814187 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f245815f5f0 msgr2=0x7f245814ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:34.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.773+0000 7f245d43d640 1 --2- 172.21.15.131:0/3641814187 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f245815f5f0 0x7f245814ca30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f244c031000 tx=0x7f244c004a40 comp rx=0 tx=0).stop 2024-05-17T11:53:34.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.773+0000 7f245d43d640 1 -- 172.21.15.131:0/3641814187 shutdown_connections 2024-05-17T11:53:34.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.773+0000 7f245d43d640 1 --2- 172.21.15.131:0/3641814187 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f24440762d0 0x7f24440787e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:34.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.773+0000 7f245d43d640 1 --2- 172.21.15.131:0/3641814187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24580c6770 0x7f245815b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:34.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.773+0000 7f245d43d640 1 --2- 172.21.15.131:0/3641814187 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f245815f5f0 0x7f245814ca30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:34.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.773+0000 7f245d43d640 1 --2- 172.21.15.131:0/3641814187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24580736c0 0x7f24580d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:34.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.774+0000 7f245d43d640 1 -- 172.21.15.131:0/3641814187 >> 172.21.15.131:0/3641814187 conn(0x7f24580d2140 msgr2=0x7f24580b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:34.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.774+0000 7f245d43d640 1 -- 172.21.15.131:0/3641814187 shutdown_connections 2024-05-17T11:53:34.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:34.774+0000 7f245d43d640 1 -- 172.21.15.131:0/3641814187 wait complete. 2024-05-17T11:53:34.789 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-17T11:53:35.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.103+0000 7f3a41f54640 1 Processor -- start 2024-05-17T11:53:35.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.103+0000 7f3a41f54640 1 -- start start 2024-05-17T11:53:35.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.107+0000 7f3a41f54640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3a3c160800 0x7f3a3c0b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:35.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.107+0000 7f3a41f54640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3a3c0cfb50 0x7f3a3c0cff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:35.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.107+0000 7f3a41f54640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3c0cf690 con 0x7f3a3c06df90 2024-05-17T11:53:35.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.107+0000 7f3a41f54640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f3a3c15cc70 con 0x7f3a3c160800 2024-05-17T11:53:35.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.107+0000 7f3a41f54640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f3a3c15cf50 con 0x7f3a3c0cfb50 2024-05-17T11:53:35.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.107+0000 7f3a3b7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3a3c160800 0x7f3a3c0b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:35.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.108+0000 7f3a3bfff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3a3c0cfb50 0x7f3a3c0cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:35.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.108+0000 7f3a32ffd640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3a3c06df90 0x7f3a3c06e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:60656/0 (socket says 172.21.15.131:60656) 2024-05-17T11:53:35.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.108+0000 7f3a32ffd640 1 -- 172.21.15.131:0/43794191 learned_addr learned my addr 172.21.15.131:0/43794191 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:35.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.108+0000 7f3a3affd640 1 -- 172.21.15.131:0/43794191 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283782288 0 0) 0x7f3a24001110 con 0x7f3a3c06df90 2024-05-17T11:53:35.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.108+0000 7f3a3b7fe640 1 -- 172.21.15.131:0/43794191 >> v2:172.21.15.150:3300/0 conn(0x7f3a3c0cfb50 msgr2=0x7f3a3c0cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:35.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.108+0000 7f3a3b7fe640 1 --2- 172.21.15.131:0/43794191 >> v2:172.21.15.150:3300/0 conn(0x7f3a3c0cfb50 0x7f3a3c0cff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:35.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.108+0000 7f3a3b7fe640 1 -- 172.21.15.131:0/43794191 >> v1:172.21.15.150:6789/0 conn(0x7f3a3c06df90 legacy=0x7f3a3c06e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:35.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.108+0000 7f3a3b7fe640 1 -- 172.21.15.131:0/43794191 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3c15d230 con 0x7f3a3c160800 2024-05-17T11:53:35.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.110+0000 7f3a3b7fe640 1 --2- 172.21.15.131:0/43794191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a3c160800 0x7f3a3c0b0c00 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c156e00 tx=0x7f3a2c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a152fa3e980d043c server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:35.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.110+0000 7f3a3affd640 1 -- 172.21.15.131:0/43794191 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c037070 con 0x7f3a3c160800 2024-05-17T11:53:35.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.111+0000 7f3a3affd640 1 -- 172.21.15.131:0/43794191 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a2c032440 con 0x7f3a3c160800 2024-05-17T11:53:35.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.111+0000 7f3a3affd640 1 -- 172.21.15.131:0/43794191 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c032810 con 0x7f3a3c160800 2024-05-17T11:53:35.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.112+0000 7f3a41f54640 1 -- 172.21.15.131:0/43794191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a3c160800 msgr2=0x7f3a3c0b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:35.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.112+0000 7f3a41f54640 1 --2- 172.21.15.131:0/43794191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a3c160800 0x7f3a3c0b0c00 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c156e00 tx=0x7f3a2c02a1a0 comp rx=0 tx=0).stop 2024-05-17T11:53:35.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.113+0000 7f3a41f54640 1 -- 172.21.15.131:0/43794191 shutdown_connections 2024-05-17T11:53:35.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.113+0000 7f3a41f54640 1 --2- 172.21.15.131:0/43794191 >> v2:172.21.15.150:3300/0 conn(0x7f3a3c0cfb50 0x7f3a3c0cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:35.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.113+0000 7f3a41f54640 1 --2- 172.21.15.131:0/43794191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a3c160800 0x7f3a3c0b0c00 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:35.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.113+0000 7f3a41f54640 1 -- 172.21.15.131:0/43794191 >> 172.21.15.131:0/43794191 conn(0x7f3a3c0d2140 msgr2=0x7f3a3c072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:35.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.113+0000 7f3a41f54640 1 -- 172.21.15.131:0/43794191 shutdown_connections 2024-05-17T11:53:35.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.113+0000 7f3a41f54640 1 -- 172.21.15.131:0/43794191 wait complete. 2024-05-17T11:53:35.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.118+0000 7f3a41f54640 1 Processor -- start 2024-05-17T11:53:35.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.118+0000 7f3a41f54640 1 -- start start 2024-05-17T11:53:35.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.122+0000 7f3a41f54640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a3c06df90 0x7f3a3c1f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:35.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.122+0000 7f3a41f54640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a3c0cfb50 0x7f3a3c15c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:35.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.122+0000 7f3a41f54640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a3c160800 0x7f3a3c0b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:35.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.122+0000 7f3a41f54640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c0b1140 con 0x7f3a3c06df90 2024-05-17T11:53:35.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.122+0000 7f3a41f54640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c160c10 con 0x7f3a3c160800 2024-05-17T11:53:35.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.122+0000 7f3a41f54640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3c0b12c0 con 0x7f3a3c0cfb50 2024-05-17T11:53:35.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.122+0000 7f3a3b7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a3c06df90 0x7f3a3c1f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:35.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.123+0000 7f3a3b7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a3c06df90 0x7f3a3c1f7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56708/0 (socket says 172.21.15.131:56708) 2024-05-17T11:53:35.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.123+0000 7f3a3b7fe640 1 -- 172.21.15.131:0/811600 learned_addr learned my addr 172.21.15.131:0/811600 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:35.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.123+0000 7f3a3bfff640 1 --2- 172.21.15.131:0/811600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a3c160800 0x7f3a3c0b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:35.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.123+0000 7f3a32ffd640 1 --2- 172.21.15.131:0/811600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a3c0cfb50 0x7f3a3c15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:35.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.123+0000 7f3a3b7fe640 1 -- 172.21.15.131:0/811600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a3c0cfb50 msgr2=0x7f3a3c15c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:35.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.123+0000 7f3a3b7fe640 1 --2- 172.21.15.131:0/811600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a3c0cfb50 0x7f3a3c15c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:35.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.123+0000 7f3a3b7fe640 1 -- 172.21.15.131:0/811600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a3c160800 msgr2=0x7f3a3c0b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:35.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.123+0000 7f3a3b7fe640 1 --2- 172.21.15.131:0/811600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a3c160800 0x7f3a3c0b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:35.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.123+0000 7f3a3b7fe640 1 -- 172.21.15.131:0/811600 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3c1f4340 con 0x7f3a3c06df90 2024-05-17T11:53:35.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.124+0000 7f3a3b7fe640 1 --2- 172.21.15.131:0/811600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a3c06df90 0x7f3a3c1f7bd0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c000c00 tx=0x7f3a2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:35.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.124+0000 7f3a38ff9640 1 -- 172.21.15.131:0/811600 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c041070 con 0x7f3a3c06df90 2024-05-17T11:53:35.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.124+0000 7f3a38ff9640 1 -- 172.21.15.131:0/811600 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a2c03c890 con 0x7f3a3c06df90 2024-05-17T11:53:35.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.124+0000 7f3a38ff9640 1 -- 172.21.15.131:0/811600 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c037040 con 0x7f3a3c06df90 2024-05-17T11:53:35.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.124+0000 7f3a41f54640 1 -- 172.21.15.131:0/811600 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a3c1f4620 con 0x7f3a3c06df90 2024-05-17T11:53:35.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.124+0000 7f3a41f54640 1 -- 172.21.15.131:0/811600 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a3c156f50 con 0x7f3a3c06df90 2024-05-17T11:53:35.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.126+0000 7f3a41f54640 1 -- 172.21.15.131:0/811600 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a3c15c820 con 0x7f3a3c06df90 2024-05-17T11:53:35.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.128+0000 7f3a38ff9640 1 -- 172.21.15.131:0/811600 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3a2c044070 con 0x7f3a3c06df90 2024-05-17T11:53:35.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.129+0000 7f3a38ff9640 1 --2- 172.21.15.131:0/811600 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3a1c0762d0 0x7f3a1c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:35.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.129+0000 7f3a38ff9640 1 -- 172.21.15.131:0/811600 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f3a2c0b7e50 con 0x7f3a3c06df90 2024-05-17T11:53:35.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.129+0000 7f3a32ffd640 1 --2- 172.21.15.131:0/811600 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3a1c0762d0 0x7f3a1c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:35.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.130+0000 7f3a32ffd640 1 --2- 172.21.15.131:0/811600 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3a1c0762d0 0x7f3a1c0787e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c160310 tx=0x7f3a24007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:35.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.142+0000 7f3a38ff9640 1 -- 172.21.15.131:0/811600 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3a2c0812d0 con 0x7f3a3c06df90 2024-05-17T11:53:35.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.695+0000 7f3a41f54640 1 -- 172.21.15.131:0/811600 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a3c073f10 con 0x7f3a1c0762d0 2024-05-17T11:53:35.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.696+0000 7f3a38ff9640 1 -- 172.21.15.131:0/811600 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13390 (secure 0 0 0) 0x7f3a3c073f10 con 0x7f3a1c0762d0 2024-05-17T11:53:35.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:53:35.684 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-05-17T11:53:35.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.702+0000 7f3a41f54640 1 -- 172.21.15.131:0/811600 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3a1c0762d0 msgr2=0x7f3a1c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:35.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.702+0000 7f3a41f54640 1 --2- 172.21.15.131:0/811600 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3a1c0762d0 0x7f3a1c0787e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c160310 tx=0x7f3a24007de0 comp rx=0 tx=0).stop 2024-05-17T11:53:35.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.702+0000 7f3a41f54640 1 -- 172.21.15.131:0/811600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a3c06df90 msgr2=0x7f3a3c1f7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:35.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.702+0000 7f3a41f54640 1 --2- 172.21.15.131:0/811600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a3c06df90 0x7f3a3c1f7bd0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c000c00 tx=0x7f3a2c0046c0 comp rx=0 tx=0).stop 2024-05-17T11:53:35.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.702+0000 7f3a41f54640 1 -- 172.21.15.131:0/811600 shutdown_connections 2024-05-17T11:53:35.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.702+0000 7f3a41f54640 1 --2- 172.21.15.131:0/811600 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f3a1c0762d0 0x7f3a1c0787e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:35.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.702+0000 7f3a41f54640 1 --2- 172.21.15.131:0/811600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a3c160800 0x7f3a3c0b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:35.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.702+0000 7f3a41f54640 1 --2- 172.21.15.131:0/811600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a3c0cfb50 0x7f3a3c15c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:35.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.702+0000 7f3a41f54640 1 --2- 172.21.15.131:0/811600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a3c06df90 0x7f3a3c1f7bd0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:35.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.702+0000 7f3a41f54640 1 -- 172.21.15.131:0/811600 >> 172.21.15.131:0/811600 conn(0x7f3a3c0d2140 msgr2=0x7f3a3c0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:35.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.702+0000 7f3a41f54640 1 -- 172.21.15.131:0/811600 shutdown_connections 2024-05-17T11:53:35.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:35.702+0000 7f3a41f54640 1 -- 172.21.15.131:0/811600 wait complete. 2024-05-17T11:53:35.718 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":13970,"stamp":"2024-05-17T11:53:35.430407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":10881308,"kb_used_data":4936,"kb_used_omap":4260,"kb_used_meta":10872027,"kb_avail":744093412,"statfs":{"total":773094113280,"available":761951653888,"internally_reserved":0,"allocated":5054464,"data_stored":2841280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4362392,"internal_metadata":11132956520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003751"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":381,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-17T11:53:17.586937+0000","last_change":"2024-05-17T04:08:56.447797+0000","last_active":"2024-05-17T11:53:17.586937+0000","last_peered":"2024-05-17T11:53:17.586937+0000","last_clean":"2024-05-17T11:53:17.586937+0000","last_became_active":"2024-05-17T04:08:56.446705+0000","last_became_peered":"2024-05-17T04:08:56.446705+0000","last_unstale":"2024-05-17T11:53:17.586937+0000","last_undegraded":"2024-05-17T11:53:17.586937+0000","last_fullsized":"2024-05-17T11:53:17.586937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-17T04:08:54.847367+0000","last_clean_scrub_stamp":"2024-05-17T04:08:54.847367+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580425,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":987048,"kb_used_data":1052,"kb_used_omap":264,"kb_used_meta":985719,"kb_avail":93384792,"statfs":{"total":96636764160,"available":95626027008,"internally_reserved":0,"allocated":1077248,"data_stored":797936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":270362,"internal_metadata":1009377254},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834580426,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1464932,"kb_used_data":472,"kb_used_omap":665,"kb_used_meta":1463782,"kb_avail":92906908,"statfs":{"total":96636764160,"available":95136673792,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":681731,"internal_metadata":1498913021},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834580424,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1415012,"kb_used_data":472,"kb_used_omap":645,"kb_used_meta":1413882,"kb_avail":92956828,"statfs":{"total":96636764160,"available":95187791872,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":660519,"internal_metadata":1447816153},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834580427,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1538724,"kb_used_data":472,"kb_used_omap":1330,"kb_used_meta":1536909,"kb_avail":92833116,"statfs":{"total":96636764160,"available":95061110784,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1362198,"internal_metadata":1573795562},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834580355,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":883616,"kb_used_data":472,"kb_used_omap":433,"kb_used_meta":882702,"kb_avail":93488224,"statfs":{"total":96636764160,"available":95731941376,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":444198,"internal_metadata":903887066},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834580370,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1699492,"kb_used_data":472,"kb_used_omap":527,"kb_used_meta":1698480,"kb_avail":92672348,"statfs":{"total":96636764160,"available":94896484352,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":540297,"internal_metadata":1739243895},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834580389,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1624864,"kb_used_data":472,"kb_used_omap":30,"kb_used_meta":1624353,"kb_avail":92746976,"statfs":{"total":96636764160,"available":94972903424,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30843,"internal_metadata":1663338373},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834580390,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1267620,"kb_used_data":1052,"kb_used_omap":363,"kb_used_meta":1266196,"kb_avail":93104220,"statfs":{"total":96636764160,"available":95338721280,"internally_reserved":0,"allocated":1077248,"data_stored":797936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":372244,"internal_metadata":1296585196},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-17T11:53:35.721 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-17T04:08:54.847367+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=17, tm_hour=4, tm_min=8, tm_sec=54, tm_wday=4, tm_yday=138, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=17, tm_hour=11, tm_min=53, tm_sec=23, tm_wday=4, tm_yday=138, tm_isdst=0) 2024-05-17T11:53:35.721 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-17T11:53:50.161 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:53:50.166 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:53:55.722 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-17T11:53:56.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.033+0000 7fbd94a74640 1 Processor -- start 2024-05-17T11:53:56.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.033+0000 7fbd94a74640 1 -- start start 2024-05-17T11:53:56.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.037+0000 7fbd94a74640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbd9015c4c0 0x7fbd900cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:56.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.038+0000 7fbd94a74640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd900cfbd0 con 0x7fbd900707e0 2024-05-17T11:53:56.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.038+0000 7fbd94a74640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd901601f0 con 0x7fbd90073dd0 2024-05-17T11:53:56.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.038+0000 7fbd94a74640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fbd901604d0 con 0x7fbd9015c4c0 2024-05-17T11:53:56.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.038+0000 7fbd87fff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fbd900707e0 0x7fbd900736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:54686/0 (socket says 172.21.15.131:54686) 2024-05-17T11:53:56.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.038+0000 7fbd87fff640 1 -- 172.21.15.131:0/3720291805 learned_addr learned my addr 172.21.15.131:0/3720291805 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:56.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.038+0000 7fbd8e59c640 1 --2- 172.21.15.131:0/3720291805 >> v2:172.21.15.131:3300/0 conn(0x7fbd9015c4c0 0x7fbd900cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:56.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.038+0000 7fbd8dd9b640 1 -- 172.21.15.131:0/3720291805 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2492292336 0 0) 0x7fbd900cfbd0 con 0x7fbd900707e0 2024-05-17T11:53:56.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.038+0000 7fbd8dd9b640 1 -- 172.21.15.131:0/3720291805 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd7c003520 con 0x7fbd900707e0 2024-05-17T11:53:56.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.039+0000 7fbd8dd9b640 1 -- 172.21.15.131:0/3720291805 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2237694254 0 0) 0x7fbd901601f0 con 0x7fbd90073dd0 2024-05-17T11:53:56.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.039+0000 7fbd8dd9b640 1 -- 172.21.15.131:0/3720291805 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd900cfbd0 con 0x7fbd90073dd0 2024-05-17T11:53:56.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.039+0000 7fbd8e59c640 1 -- 172.21.15.131:0/3720291805 >> v1:172.21.15.150:6789/0 conn(0x7fbd90073dd0 legacy=0x7fbd9006f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:56.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.039+0000 7fbd8e59c640 1 -- 172.21.15.131:0/3720291805 >> v1:172.21.15.131:6789/0 conn(0x7fbd900707e0 legacy=0x7fbd900736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:56.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.039+0000 7fbd8dd9b640 1 -- 172.21.15.131:0/3720291805 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 409815228 0 0) 0x7fbd7c003520 con 0x7fbd900707e0 2024-05-17T11:53:56.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.039+0000 7fbd8e59c640 1 -- 172.21.15.131:0/3720291805 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd901607b0 con 0x7fbd9015c4c0 2024-05-17T11:53:56.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.040+0000 7fbd8e59c640 1 --2- 172.21.15.131:0/3720291805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd9015c4c0 0x7fbd900cf690 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fbd800097a0 tx=0x7fbd8002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2707f639db4d4474 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:56.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.040+0000 7fbd8dd9b640 1 -- 172.21.15.131:0/3720291805 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80037070 con 0x7fbd9015c4c0 2024-05-17T11:53:56.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.040+0000 7fbd8dd9b640 1 -- 172.21.15.131:0/3720291805 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8002ac50 con 0x7fbd9015c4c0 2024-05-17T11:53:56.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.040+0000 7fbd8dd9b640 1 -- 172.21.15.131:0/3720291805 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd78001710 con 0x7fbd9015c4c0 2024-05-17T11:53:56.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.042+0000 7fbd94a74640 1 -- 172.21.15.131:0/3720291805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd9015c4c0 msgr2=0x7fbd900cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:56.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.042+0000 7fbd94a74640 1 --2- 172.21.15.131:0/3720291805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd9015c4c0 0x7fbd900cf690 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fbd800097a0 tx=0x7fbd8002a1c0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.042+0000 7fbd94a74640 1 -- 172.21.15.131:0/3720291805 shutdown_connections 2024-05-17T11:53:56.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.042+0000 7fbd94a74640 1 --2- 172.21.15.131:0/3720291805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd9015c4c0 0x7fbd900cf690 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.042+0000 7fbd94a74640 1 -- 172.21.15.131:0/3720291805 >> 172.21.15.131:0/3720291805 conn(0x7fbd900d2140 msgr2=0x7fbd90072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:56.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.042+0000 7fbd94a74640 1 -- 172.21.15.131:0/3720291805 shutdown_connections 2024-05-17T11:53:56.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.042+0000 7fbd94a74640 1 -- 172.21.15.131:0/3720291805 wait complete. 2024-05-17T11:53:56.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.048+0000 7fbd94a74640 1 Processor -- start 2024-05-17T11:53:56.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.048+0000 7fbd94a74640 1 -- start start 2024-05-17T11:53:56.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.052+0000 7fbd94a74640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd900707e0 0x7fbd90140f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:56.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.052+0000 7fbd94a74640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd9015c4c0 0x7fbd90151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:56.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.052+0000 7fbd94a74640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd901550a0 0x7fbd9006cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:56.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.052+0000 7fbd94a74640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9015ff90 con 0x7fbd901550a0 2024-05-17T11:53:56.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.052+0000 7fbd94a74640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9015fe10 con 0x7fbd9015c4c0 2024-05-17T11:53:56.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.052+0000 7fbd94a74640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbd90070bf0 con 0x7fbd900707e0 2024-05-17T11:53:56.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.052+0000 7fbd8e59c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd900707e0 0x7fbd90140f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:56.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.052+0000 7fbd87fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd9015c4c0 0x7fbd90151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:56.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.052+0000 7fbd8e59c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd900707e0 0x7fbd90140f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.131:46244/0 (socket says 172.21.15.131:46244) 2024-05-17T11:53:56.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.052+0000 7fbd8e59c640 1 -- 172.21.15.131:0/903045876 learned_addr learned my addr 172.21.15.131:0/903045876 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:56.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.052+0000 7fbd8ed9d640 1 --2- 172.21.15.131:0/903045876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd901550a0 0x7fbd9006cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:56.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.053+0000 7fbd8e59c640 1 -- 172.21.15.131:0/903045876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd9015c4c0 msgr2=0x7fbd90151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:56.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.053+0000 7fbd8e59c640 1 --2- 172.21.15.131:0/903045876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd9015c4c0 0x7fbd90151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.053+0000 7fbd8e59c640 1 -- 172.21.15.131:0/903045876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd901550a0 msgr2=0x7fbd9006cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:56.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.053+0000 7fbd8e59c640 1 --2- 172.21.15.131:0/903045876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd901550a0 0x7fbd9006cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.053+0000 7fbd8e59c640 1 -- 172.21.15.131:0/903045876 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd90141490 con 0x7fbd900707e0 2024-05-17T11:53:56.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.053+0000 7fbd87fff640 1 --2- 172.21.15.131:0/903045876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd9015c4c0 0x7fbd90151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:56.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.054+0000 7fbd8e59c640 1 --2- 172.21.15.131:0/903045876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd900707e0 0x7fbd90140f50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbd80035040 tx=0x7fbd800046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:56.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.054+0000 7fbd86ffd640 1 -- 172.21.15.131:0/903045876 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80041070 con 0x7fbd900707e0 2024-05-17T11:53:56.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.054+0000 7fbd86ffd640 1 -- 172.21.15.131:0/903045876 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8003c460 con 0x7fbd900707e0 2024-05-17T11:53:56.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.054+0000 7fbd94a74640 1 -- 172.21.15.131:0/903045876 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd90144730 con 0x7fbd900707e0 2024-05-17T11:53:56.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.054+0000 7fbd86ffd640 1 -- 172.21.15.131:0/903045876 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80037040 con 0x7fbd900707e0 2024-05-17T11:53:56.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.054+0000 7fbd94a74640 1 -- 172.21.15.131:0/903045876 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd901545c0 con 0x7fbd900707e0 2024-05-17T11:53:56.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.056+0000 7fbd94a74640 1 -- 172.21.15.131:0/903045876 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd900cef90 con 0x7fbd900707e0 2024-05-17T11:53:56.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.058+0000 7fbd86ffd640 1 -- 172.21.15.131:0/903045876 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbd80044070 con 0x7fbd900707e0 2024-05-17T11:53:56.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.059+0000 7fbd86ffd640 1 --2- 172.21.15.131:0/903045876 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbd700762d0 0x7fbd700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:56.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.059+0000 7fbd87fff640 1 --2- 172.21.15.131:0/903045876 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbd700762d0 0x7fbd700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:56.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.059+0000 7fbd86ffd640 1 -- 172.21.15.131:0/903045876 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7fbd800b79f0 con 0x7fbd900707e0 2024-05-17T11:53:56.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.060+0000 7fbd87fff640 1 --2- 172.21.15.131:0/903045876 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbd700762d0 0x7fbd700787e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbd901f5800 tx=0x7fbd780049e0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:56.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.064+0000 7fbd86ffd640 1 -- 172.21.15.131:0/903045876 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbd900cef90 con 0x7fbd900707e0 2024-05-17T11:53:56.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.611+0000 7fbd94a74640 1 -- 172.21.15.131:0/903045876 --> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbd900cf690 con 0x7fbd700762d0 2024-05-17T11:53:56.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.612+0000 7fbd86ffd640 1 -- 172.21.15.131:0/903045876 <== mgr.4113 v2:172.21.15.131:6832/3533746931 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13431 (secure 0 0 0) 0x7fbd900cf690 con 0x7fbd700762d0 2024-05-17T11:53:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:53:56.600 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-05-17T11:53:56.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.617+0000 7fbd94a74640 1 -- 172.21.15.131:0/903045876 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbd700762d0 msgr2=0x7fbd700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:56.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.617+0000 7fbd94a74640 1 --2- 172.21.15.131:0/903045876 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbd700762d0 0x7fbd700787e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbd901f5800 tx=0x7fbd780049e0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.617+0000 7fbd94a74640 1 -- 172.21.15.131:0/903045876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd900707e0 msgr2=0x7fbd90140f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:56.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.617+0000 7fbd94a74640 1 --2- 172.21.15.131:0/903045876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd900707e0 0x7fbd90140f50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbd80035040 tx=0x7fbd800046c0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.617+0000 7fbd94a74640 1 -- 172.21.15.131:0/903045876 shutdown_connections 2024-05-17T11:53:56.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.617+0000 7fbd94a74640 1 --2- 172.21.15.131:0/903045876 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fbd700762d0 0x7fbd700787e0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.617+0000 7fbd94a74640 1 --2- 172.21.15.131:0/903045876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd901550a0 0x7fbd9006cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.617+0000 7fbd94a74640 1 --2- 172.21.15.131:0/903045876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd9015c4c0 0x7fbd90151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.617+0000 7fbd94a74640 1 --2- 172.21.15.131:0/903045876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd900707e0 0x7fbd90140f50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.617+0000 7fbd94a74640 1 -- 172.21.15.131:0/903045876 >> 172.21.15.131:0/903045876 conn(0x7fbd900d2140 msgr2=0x7fbd9006f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:56.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.617+0000 7fbd94a74640 1 -- 172.21.15.131:0/903045876 shutdown_connections 2024-05-17T11:53:56.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.617+0000 7fbd94a74640 1 -- 172.21.15.131:0/903045876 wait complete. 2024-05-17T11:53:56.632 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":13980,"stamp":"2024-05-17T11:53:55.436568+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":10881304,"kb_used_data":4936,"kb_used_omap":4260,"kb_used_meta":10872027,"kb_avail":744093416,"statfs":{"total":773094113280,"available":761951657984,"internally_reserved":0,"allocated":5054464,"data_stored":2841280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4362392,"internal_metadata":11132956520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003549"},"pg_stats":[{"pgid":"1.0","version":"41'74","reported_seq":391,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-17T11:53:35.722876+0000","last_change":"2024-05-17T11:53:35.722984+0000","last_active":"2024-05-17T11:53:35.722876+0000","last_peered":"2024-05-17T11:53:35.722876+0000","last_clean":"2024-05-17T11:53:35.722876+0000","last_became_active":"2024-05-17T04:08:56.446705+0000","last_became_peered":"2024-05-17T04:08:56.446705+0000","last_unstale":"2024-05-17T11:53:35.722876+0000","last_undegraded":"2024-05-17T11:53:35.722876+0000","last_fullsized":"2024-05-17T11:53:35.722876+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'74","last_scrub_stamp":"2024-05-17T11:53:35.722717+0000","last_deep_scrub":"41'74","last_deep_scrub_stamp":"2024-05-17T11:53:35.722717+0000","last_clean_scrub_stamp":"2024-05-17T11:53:35.722717+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T23:05:04.137120+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580429,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":987044,"kb_used_data":1052,"kb_used_omap":264,"kb_used_meta":985719,"kb_avail":93384796,"statfs":{"total":96636764160,"available":95626031104,"internally_reserved":0,"allocated":1077248,"data_stored":797936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":270362,"internal_metadata":1009377254},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834580430,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1464932,"kb_used_data":472,"kb_used_omap":665,"kb_used_meta":1463782,"kb_avail":92906908,"statfs":{"total":96636764160,"available":95136673792,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":681731,"internal_metadata":1498913021},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834580428,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1415012,"kb_used_data":472,"kb_used_omap":645,"kb_used_meta":1413882,"kb_avail":92956828,"statfs":{"total":96636764160,"available":95187791872,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":660519,"internal_metadata":1447816153},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834580431,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1538724,"kb_used_data":472,"kb_used_omap":1330,"kb_used_meta":1536909,"kb_avail":92833116,"statfs":{"total":96636764160,"available":95061110784,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1362198,"internal_metadata":1573795562},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834580359,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":883616,"kb_used_data":472,"kb_used_omap":433,"kb_used_meta":882702,"kb_avail":93488224,"statfs":{"total":96636764160,"available":95731941376,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":444198,"internal_metadata":903887066},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834580374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1699492,"kb_used_data":472,"kb_used_omap":527,"kb_used_meta":1698480,"kb_avail":92672348,"statfs":{"total":96636764160,"available":94896484352,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":540297,"internal_metadata":1739243895},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834580393,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1624864,"kb_used_data":472,"kb_used_omap":30,"kb_used_meta":1624353,"kb_avail":92746976,"statfs":{"total":96636764160,"available":94972903424,"internally_reserved":0,"allocated":483328,"data_stored":207568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30843,"internal_metadata":1663338373},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834580394,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1267620,"kb_used_data":1052,"kb_used_omap":363,"kb_used_meta":1266196,"kb_avail":93104220,"statfs":{"total":96636764160,"available":95338721280,"internally_reserved":0,"allocated":1077248,"data_stored":797936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":372244,"internal_metadata":1296585196},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-17T11:53:56.633 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-17T11:53:56.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.959+0000 7f6a6df7a640 1 Processor -- start 2024-05-17T11:53:56.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.959+0000 7f6a6df7a640 1 -- start start 2024-05-17T11:53:56.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.963+0000 7f6a6df7a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6a680ce380 0x7f6a680d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:56.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.963+0000 7f6a6df7a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6a680704f0 0x7f6a6815c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:56.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.963+0000 7f6a6df7a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a680ced60 con 0x7f6a68160b10 2024-05-17T11:53:56.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.963+0000 7f6a6df7a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6a68160680 con 0x7f6a680ce380 2024-05-17T11:53:56.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.963+0000 7f6a6df7a640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f6a680cf000 con 0x7f6a680704f0 2024-05-17T11:53:56.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.963+0000 7f6a66ffd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f6a68160b10 0x7f6a6806fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:54698/0 (socket says 172.21.15.131:54698) 2024-05-17T11:53:56.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.963+0000 7f6a67fff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6a680704f0 0x7f6a6815c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:56.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.963+0000 7f6a66ffd640 1 -- 172.21.15.131:0/2757213020 learned_addr learned my addr 172.21.15.131:0/2757213020 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:56.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.963+0000 7f6a677fe640 1 --2- 172.21.15.131:0/2757213020 >> v2:172.21.15.131:3300/0 conn(0x7f6a680ce380 0x7f6a680d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:56.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.964+0000 7f6a67fff640 1 -- 172.21.15.131:0/2757213020 >> v2:172.21.15.131:3300/0 conn(0x7f6a680ce380 msgr2=0x7f6a680d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:56.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.964+0000 7f6a67fff640 1 --2- 172.21.15.131:0/2757213020 >> v2:172.21.15.131:3300/0 conn(0x7f6a680ce380 0x7f6a680d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.964+0000 7f6a67fff640 1 -- 172.21.15.131:0/2757213020 >> v1:172.21.15.131:6789/0 conn(0x7f6a68160b10 legacy=0x7f6a6806fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:56.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.964+0000 7f6a667fc640 1 -- 172.21.15.131:0/2757213020 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2826894624 0 0) 0x7f6a680ced60 con 0x7f6a68160b10 2024-05-17T11:53:56.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.964+0000 7f6a67fff640 1 -- 172.21.15.131:0/2757213020 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a68160030 con 0x7f6a680704f0 2024-05-17T11:53:56.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.966+0000 7f6a67fff640 1 --2- 172.21.15.131:0/2757213020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a680704f0 0x7f6a6815c2f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6a680cebd0 tx=0x7f6a6002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d36fcfd9d5b20c63 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:56.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.966+0000 7f6a667fc640 1 -- 172.21.15.131:0/2757213020 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a60007740 con 0x7f6a680704f0 2024-05-17T11:53:56.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.967+0000 7f6a667fc640 1 -- 172.21.15.131:0/2757213020 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a600078e0 con 0x7f6a680704f0 2024-05-17T11:53:56.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.967+0000 7f6a667fc640 1 -- 172.21.15.131:0/2757213020 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a60007cb0 con 0x7f6a680704f0 2024-05-17T11:53:56.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.968+0000 7f6a6df7a640 1 -- 172.21.15.131:0/2757213020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a680704f0 msgr2=0x7f6a6815c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:56.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.968+0000 7f6a6df7a640 1 --2- 172.21.15.131:0/2757213020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a680704f0 0x7f6a6815c2f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6a680cebd0 tx=0x7f6a6002a5f0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.969+0000 7f6a6df7a640 1 -- 172.21.15.131:0/2757213020 shutdown_connections 2024-05-17T11:53:56.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.969+0000 7f6a6df7a640 1 --2- 172.21.15.131:0/2757213020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a680704f0 0x7f6a6815c2f0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.969+0000 7f6a6df7a640 1 --2- 172.21.15.131:0/2757213020 >> v2:172.21.15.131:3300/0 conn(0x7f6a680ce380 0x7f6a680d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.969+0000 7f6a6df7a640 1 -- 172.21.15.131:0/2757213020 >> 172.21.15.131:0/2757213020 conn(0x7f6a680734f0 msgr2=0x7f6a68073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:56.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.969+0000 7f6a6df7a640 1 -- 172.21.15.131:0/2757213020 shutdown_connections 2024-05-17T11:53:56.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.969+0000 7f6a6df7a640 1 -- 172.21.15.131:0/2757213020 wait complete. 2024-05-17T11:53:56.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.974+0000 7f6a6df7a640 1 Processor -- start 2024-05-17T11:53:56.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.974+0000 7f6a6df7a640 1 -- start start 2024-05-17T11:53:56.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.978+0000 7f6a6df7a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a680ce380 0x7f6a68150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:56.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.978+0000 7f6a6df7a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a68160b10 0x7f6a681537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:56.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.978+0000 7f6a6df7a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a68153d20 0x7f6a6806ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:56.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.978+0000 7f6a6df7a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6a680b6290 con 0x7f6a680ce380 2024-05-17T11:53:56.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.978+0000 7f6a6df7a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6a680cf2e0 con 0x7f6a68153d20 2024-05-17T11:53:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.978+0000 7f6a6df7a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6a680b6410 con 0x7f6a68160b10 2024-05-17T11:53:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.978+0000 7f6a677fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a680ce380 0x7f6a68150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.979+0000 7f6a677fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a680ce380 0x7f6a68150650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39100/0 (socket says 172.21.15.131:39100) 2024-05-17T11:53:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.979+0000 7f6a677fe640 1 -- 172.21.15.131:0/3921798953 learned_addr learned my addr 172.21.15.131:0/3921798953 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.979+0000 7f6a66ffd640 1 --2- 172.21.15.131:0/3921798953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a68160b10 0x7f6a681537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.979+0000 7f6a67fff640 1 --2- 172.21.15.131:0/3921798953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a68153d20 0x7f6a6806ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.979+0000 7f6a677fe640 1 -- 172.21.15.131:0/3921798953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a68160b10 msgr2=0x7f6a681537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.979+0000 7f6a677fe640 1 --2- 172.21.15.131:0/3921798953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a68160b10 0x7f6a681537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.979+0000 7f6a677fe640 1 -- 172.21.15.131:0/3921798953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a68153d20 msgr2=0x7f6a6806ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:56.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.979+0000 7f6a677fe640 1 --2- 172.21.15.131:0/3921798953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a68153d20 0x7f6a6806ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:56.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.979+0000 7f6a677fe640 1 -- 172.21.15.131:0/3921798953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a68156a80 con 0x7f6a680ce380 2024-05-17T11:53:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.980+0000 7f6a677fe640 1 --2- 172.21.15.131:0/3921798953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a680ce380 0x7f6a68150650 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800e870 tx=0x7f6a5800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.980+0000 7f6a4ffff640 1 -- 172.21.15.131:0/3921798953 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a58017070 con 0x7f6a680ce380 2024-05-17T11:53:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.980+0000 7f6a4ffff640 1 -- 172.21.15.131:0/3921798953 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5800c940 con 0x7f6a680ce380 2024-05-17T11:53:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.980+0000 7f6a6df7a640 1 -- 172.21.15.131:0/3921798953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a68156d60 con 0x7f6a680ce380 2024-05-17T11:53:56.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.980+0000 7f6a4ffff640 1 -- 172.21.15.131:0/3921798953 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5800cd30 con 0x7f6a680ce380 2024-05-17T11:53:56.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.980+0000 7f6a6df7a640 1 -- 172.21.15.131:0/3921798953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a68157320 con 0x7f6a680ce380 2024-05-17T11:53:56.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.982+0000 7f6a6df7a640 1 -- 172.21.15.131:0/3921798953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a680d12c0 con 0x7f6a680ce380 2024-05-17T11:53:56.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.985+0000 7f6a4ffff640 1 -- 172.21.15.131:0/3921798953 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6a5801a070 con 0x7f6a680ce380 2024-05-17T11:53:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.985+0000 7f6a4ffff640 1 --2- 172.21.15.131:0/3921798953 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6a540762d0 0x7f6a540787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.985+0000 7f6a4ffff640 1 -- 172.21.15.131:0/3921798953 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f6a58097680 con 0x7f6a680ce380 2024-05-17T11:53:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.985+0000 7f6a66ffd640 1 --2- 172.21.15.131:0/3921798953 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6a540762d0 0x7f6a540787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:56.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.986+0000 7f6a66ffd640 1 --2- 172.21.15.131:0/3921798953 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6a540762d0 0x7f6a540787e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c000f60 tx=0x7f6a5c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:56.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:56.999+0000 7f6a4ffff640 1 -- 172.21.15.131:0/3921798953 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6a58060a80 con 0x7f6a680ce380 2024-05-17T11:53:57.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.184+0000 7f6a6df7a640 1 -- 172.21.15.131:0/3921798953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f6a6815ba00 con 0x7f6a680ce380 2024-05-17T11:53:57.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.191+0000 7f6a4ffff640 1 -- 172.21.15.131:0/3921798953 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f6a58064d80 con 0x7f6a680ce380 2024-05-17T11:53:57.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.193+0000 7f6a4ffff640 1 -- 172.21.15.131:0/3921798953 <== mon.0 v2:172.21.15.131:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6a58060590 con 0x7f6a680ce380 2024-05-17T11:53:57.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.196+0000 7f6a6df7a640 1 -- 172.21.15.131:0/3921798953 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6a540762d0 msgr2=0x7f6a540787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:57.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.196+0000 7f6a6df7a640 1 --2- 172.21.15.131:0/3921798953 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6a540762d0 0x7f6a540787e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c000f60 tx=0x7f6a5c009040 comp rx=0 tx=0).stop 2024-05-17T11:53:57.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.196+0000 7f6a6df7a640 1 -- 172.21.15.131:0/3921798953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a680ce380 msgr2=0x7f6a68150650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:57.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.196+0000 7f6a6df7a640 1 --2- 172.21.15.131:0/3921798953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a680ce380 0x7f6a68150650 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800e870 tx=0x7f6a5800ed30 comp rx=0 tx=0).stop 2024-05-17T11:53:57.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.197+0000 7f6a6df7a640 1 -- 172.21.15.131:0/3921798953 shutdown_connections 2024-05-17T11:53:57.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.197+0000 7f6a6df7a640 1 --2- 172.21.15.131:0/3921798953 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7f6a540762d0 0x7f6a540787e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:57.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.197+0000 7f6a6df7a640 1 --2- 172.21.15.131:0/3921798953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a68153d20 0x7f6a6806ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:57.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.197+0000 7f6a6df7a640 1 --2- 172.21.15.131:0/3921798953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a68160b10 0x7f6a681537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:57.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.197+0000 7f6a6df7a640 1 --2- 172.21.15.131:0/3921798953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a680ce380 0x7f6a68150650 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:57.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.197+0000 7f6a6df7a640 1 -- 172.21.15.131:0/3921798953 >> 172.21.15.131:0/3921798953 conn(0x7f6a680734f0 msgr2=0x7f6a6815a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:57.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.197+0000 7f6a6df7a640 1 -- 172.21.15.131:0/3921798953 shutdown_connections 2024-05-17T11:53:57.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.197+0000 7f6a6df7a640 1 -- 172.21.15.131:0/3921798953 wait complete. 2024-05-17T11:53:57.198 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-17T11:53:57.199 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-17T11:53:57.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.515+0000 7fc72567f640 1 Processor -- start 2024-05-17T11:53:57.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.516+0000 7fc72567f640 1 -- start start 2024-05-17T11:53:57.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.519+0000 7fc72567f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc720142650 0x7fc72015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:57.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.519+0000 7fc72567f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc720071aa0 0x7fc720143660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:57.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.520+0000 7fc72567f640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc720160750 con 0x7fc7201601d0 2024-05-17T11:53:57.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.520+0000 7fc72567f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc720142a60 con 0x7fc720142650 2024-05-17T11:53:57.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.520+0000 7fc72567f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc7201431d0 con 0x7fc720071aa0 2024-05-17T11:53:57.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.520+0000 7fc71effd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc720142650 0x7fc72015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:57.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.520+0000 7fc71f7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc720071aa0 0x7fc720143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:57.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.520+0000 7fc71e7fc640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fc7201601d0 0x7fc720071390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.131:55406/0 (socket says 172.21.15.131:55406) 2024-05-17T11:53:57.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.520+0000 7fc71effd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc720142650 0x7fc72015fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39114/0 (socket says 172.21.15.131:39114) 2024-05-17T11:53:57.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.520+0000 7fc71e7fc640 1 -- 172.21.15.131:0/2888171600 learned_addr learned my addr 172.21.15.131:0/2888171600 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-17T11:53:57.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.520+0000 7fc71dffb640 1 -- 172.21.15.131:0/2888171600 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1362847723 0 0) 0x7fc720160750 con 0x7fc7201601d0 2024-05-17T11:53:57.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.521+0000 7fc71dffb640 1 -- 172.21.15.131:0/2888171600 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc708003520 con 0x7fc7201601d0 2024-05-17T11:53:57.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.521+0000 7fc71f7fe640 1 -- 172.21.15.131:0/2888171600 >> v2:172.21.15.131:3300/0 conn(0x7fc720142650 msgr2=0x7fc72015fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-17T11:53:57.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.521+0000 7fc71f7fe640 1 --2- 172.21.15.131:0/2888171600 >> v2:172.21.15.131:3300/0 conn(0x7fc720142650 0x7fc72015fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:57.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.521+0000 7fc71f7fe640 1 -- 172.21.15.131:0/2888171600 >> v1:172.21.15.150:6789/0 conn(0x7fc7201601d0 legacy=0x7fc720071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:57.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.521+0000 7fc71f7fe640 1 -- 172.21.15.131:0/2888171600 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc720160a30 con 0x7fc720071aa0 2024-05-17T11:53:57.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.523+0000 7fc71f7fe640 1 --2- 172.21.15.131:0/2888171600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc720071aa0 0x7fc720143660 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc718009d90 tx=0x7fc71802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e0e6e0e927feb02 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:57.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.523+0000 7fc71dffb640 1 -- 172.21.15.131:0/2888171600 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718007740 con 0x7fc720071aa0 2024-05-17T11:53:57.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.523+0000 7fc71dffb640 1 -- 172.21.15.131:0/2888171600 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc7180078e0 con 0x7fc720071aa0 2024-05-17T11:53:57.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.523+0000 7fc71dffb640 1 -- 172.21.15.131:0/2888171600 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718007cd0 con 0x7fc720071aa0 2024-05-17T11:53:57.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.525+0000 7fc72567f640 1 -- 172.21.15.131:0/2888171600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc720071aa0 msgr2=0x7fc720143660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:57.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.525+0000 7fc72567f640 1 --2- 172.21.15.131:0/2888171600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc720071aa0 0x7fc720143660 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc718009d90 tx=0x7fc71802a660 comp rx=0 tx=0).stop 2024-05-17T11:53:57.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.525+0000 7fc72567f640 1 -- 172.21.15.131:0/2888171600 shutdown_connections 2024-05-17T11:53:57.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.525+0000 7fc72567f640 1 --2- 172.21.15.131:0/2888171600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc720071aa0 0x7fc720143660 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:57.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.525+0000 7fc72567f640 1 --2- 172.21.15.131:0/2888171600 >> v2:172.21.15.131:3300/0 conn(0x7fc720142650 0x7fc72015fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:57.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.525+0000 7fc72567f640 1 -- 172.21.15.131:0/2888171600 >> 172.21.15.131:0/2888171600 conn(0x7fc7200735d0 msgr2=0x7fc7200739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:57.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.525+0000 7fc72567f640 1 -- 172.21.15.131:0/2888171600 shutdown_connections 2024-05-17T11:53:57.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.525+0000 7fc72567f640 1 -- 172.21.15.131:0/2888171600 wait complete. 2024-05-17T11:53:57.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.531+0000 7fc72567f640 1 Processor -- start 2024-05-17T11:53:57.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.531+0000 7fc72567f640 1 -- start start 2024-05-17T11:53:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.534+0000 7fc72567f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc720142650 0x7fc7201e8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.534+0000 7fc72567f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7201601d0 0x7fc72013e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.534+0000 7fc72567f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7200ab4d0 0x7fc720148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.534+0000 7fc72567f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc7200d1560 con 0x7fc720142650 2024-05-17T11:53:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.534+0000 7fc72567f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc7200d13e0 con 0x7fc7201601d0 2024-05-17T11:53:57.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.534+0000 7fc72567f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc720143ba0 con 0x7fc7200ab4d0 2024-05-17T11:53:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.535+0000 7fc71effd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc720142650 0x7fc7201e8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.535+0000 7fc71effd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc720142650 0x7fc7201e8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39130/0 (socket says 172.21.15.131:39130) 2024-05-17T11:53:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.535+0000 7fc71e7fc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7201601d0 0x7fc72013e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.535+0000 7fc71effd640 1 -- 172.21.15.131:0/1705252593 learned_addr learned my addr 172.21.15.131:0/1705252593 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-17T11:53:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.535+0000 7fc71f7fe640 1 --2- 172.21.15.131:0/1705252593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7200ab4d0 0x7fc720148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.535+0000 7fc71e7fc640 1 -- 172.21.15.131:0/1705252593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7200ab4d0 msgr2=0x7fc720148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.535+0000 7fc71e7fc640 1 --2- 172.21.15.131:0/1705252593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7200ab4d0 0x7fc720148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:57.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.536+0000 7fc71e7fc640 1 -- 172.21.15.131:0/1705252593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc720142650 msgr2=0x7fc7201e8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:57.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.536+0000 7fc71e7fc640 1 --2- 172.21.15.131:0/1705252593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc720142650 0x7fc7201e8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:57.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.536+0000 7fc71e7fc640 1 -- 172.21.15.131:0/1705252593 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7200abc20 con 0x7fc7201601d0 2024-05-17T11:53:57.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.536+0000 7fc71f7fe640 1 --2- 172.21.15.131:0/1705252593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7200ab4d0 0x7fc720148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:57.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.536+0000 7fc71effd640 1 --2- 172.21.15.131:0/1705252593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc720142650 0x7fc7201e8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-17T11:53:57.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.536+0000 7fc71e7fc640 1 --2- 172.21.15.131:0/1705252593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7201601d0 0x7fc72013e4a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc714001eb0 tx=0x7fc71400c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:57.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.536+0000 7fc7077fe640 1 -- 172.21.15.131:0/1705252593 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714017070 con 0x7fc7201601d0 2024-05-17T11:53:57.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.536+0000 7fc7077fe640 1 -- 172.21.15.131:0/1705252593 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc714005ce0 con 0x7fc7201601d0 2024-05-17T11:53:57.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.536+0000 7fc72567f640 1 -- 172.21.15.131:0/1705252593 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72014f620 con 0x7fc7201601d0 2024-05-17T11:53:57.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.536+0000 7fc7077fe640 1 -- 172.21.15.131:0/1705252593 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7140072f0 con 0x7fc7201601d0 2024-05-17T11:53:57.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.537+0000 7fc72567f640 1 -- 172.21.15.131:0/1705252593 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc72014fbe0 con 0x7fc7201601d0 2024-05-17T11:53:57.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.538+0000 7fc72567f640 1 -- 172.21.15.131:0/1705252593 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc720143660 con 0x7fc7201601d0 2024-05-17T11:53:57.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.540+0000 7fc7077fe640 1 -- 172.21.15.131:0/1705252593 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc71401a070 con 0x7fc7201601d0 2024-05-17T11:53:57.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.541+0000 7fc7077fe640 1 --2- 172.21.15.131:0/1705252593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc70c076300 0x7fc70c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-17T11:53:57.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.542+0000 7fc7077fe640 1 -- 172.21.15.131:0/1705252593 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7fc7140968a0 con 0x7fc7201601d0 2024-05-17T11:53:57.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.542+0000 7fc71effd640 1 --2- 172.21.15.131:0/1705252593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc70c076300 0x7fc70c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-17T11:53:57.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.543+0000 7fc71effd640 1 --2- 172.21.15.131:0/1705252593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc70c076300 0x7fc70c078810 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc710009f50 tx=0x7fc710009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-17T11:53:57.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.546+0000 7fc7077fe640 1 -- 172.21.15.131:0/1705252593 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc7200abc20 con 0x7fc7201601d0 2024-05-17T11:53:57.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.770+0000 7fc72567f640 1 -- 172.21.15.131:0/1705252593 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7200b6ec0 con 0x7fc7201601d0 2024-05-17T11:53:57.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.772+0000 7fc7077fe640 1 -- 172.21.15.131:0/1705252593 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3872 (secure 0 0 0) 0x7fc71405fbf0 con 0x7fc7201601d0 2024-05-17T11:53:57.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-17T11:53:57.758 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/569182744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":569182744},{"type":"v1","addr":"172.21.15.150:6835","nonce":569182744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/1749773301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1749773301},{"type":"v1","addr":"172.21.15.150:6834","nonce":1749773301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3795031678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3795031678},{"type":"v1","addr":"172.21.15.131:6837","nonce":3795031678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":8941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/34251763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":34251763},{"type":"v1","addr":"172.21.15.131:6836","nonce":34251763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-05-17T11:53:57.758 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 19 2024-05-17T11:53:57.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.774+0000 7fc72567f640 1 -- 172.21.15.131:0/1705252593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc70c076300 msgr2=0x7fc70c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:57.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.774+0000 7fc72567f640 1 --2- 172.21.15.131:0/1705252593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc70c076300 0x7fc70c078810 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc710009f50 tx=0x7fc710009190 comp rx=0 tx=0).stop 2024-05-17T11:53:57.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.774+0000 7fc72567f640 1 -- 172.21.15.131:0/1705252593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7201601d0 msgr2=0x7fc72013e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-17T11:53:57.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.774+0000 7fc72567f640 1 --2- 172.21.15.131:0/1705252593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7201601d0 0x7fc72013e4a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc714001eb0 tx=0x7fc71400c820 comp rx=0 tx=0).stop 2024-05-17T11:53:57.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.774+0000 7fc72567f640 1 -- 172.21.15.131:0/1705252593 shutdown_connections 2024-05-17T11:53:57.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.774+0000 7fc72567f640 1 --2- 172.21.15.131:0/1705252593 >> [v2:172.21.15.131:6832/3533746931,v1:172.21.15.131:6833/3533746931] conn(0x7fc70c076300 0x7fc70c078810 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:57.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.774+0000 7fc72567f640 1 --2- 172.21.15.131:0/1705252593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7200ab4d0 0x7fc720148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:57.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.774+0000 7fc72567f640 1 --2- 172.21.15.131:0/1705252593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7201601d0 0x7fc72013e4a0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:57.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.774+0000 7fc72567f640 1 --2- 172.21.15.131:0/1705252593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc720142650 0x7fc7201e8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-17T11:53:57.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.774+0000 7fc72567f640 1 -- 172.21.15.131:0/1705252593 >> 172.21.15.131:0/1705252593 conn(0x7fc7200735d0 msgr2=0x7fc720160d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-17T11:53:57.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.774+0000 7fc72567f640 1 -- 172.21.15.131:0/1705252593 shutdown_connections 2024-05-17T11:53:57.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-17T11:53:57.774+0000 7fc72567f640 1 -- 172.21.15.131:0/1705252593 wait complete. 2024-05-17T11:53:57.776 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-17T11:53:57.776 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-17T11:53:57.776 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-17T11:53:57.776 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:53:57.804 INFO:tasks.ceph.mds.a:Stopped 2024-05-17T11:53:57.804 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-17T11:53:57.804 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:53:57.866 INFO:tasks.ceph.mds.c:Stopped 2024-05-17T11:53:57.867 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-17T11:53:57.867 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:53:57.881 INFO:tasks.ceph.mds.b:Stopped 2024-05-17T11:53:57.881 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-17T11:53:57.881 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:53:57.934 INFO:tasks.ceph.mds.d:Stopped 2024-05-17T11:53:57.934 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-17T11:53:57.935 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-17T11:53:57.935 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:54:02.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-05-17T11:54:04.036 INFO:tasks.ceph.osd.0:Stopped 2024-05-17T11:54:04.037 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-17T11:54:04.037 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:54:08.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-17T11:54:08.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-05-17T11:54:10.139 INFO:tasks.ceph.osd.1:Stopped 2024-05-17T11:54:10.139 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-17T11:54:10.139 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:54:14.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-17T11:54:14.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-17T11:54:16.241 INFO:tasks.ceph.osd.2:Stopped 2024-05-17T11:54:16.241 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-17T11:54:16.242 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:54:20.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-17T11:54:20.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-17T11:54:20.364 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:54:20.368 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:54:22.343 INFO:tasks.ceph.osd.3:Stopped 2024-05-17T11:54:22.344 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-17T11:54:22.344 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:54:22.420 INFO:tasks.ceph.osd.4:Stopped 2024-05-17T11:54:22.421 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-17T11:54:22.421 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:54:22.520 INFO:tasks.ceph.osd.5:Stopped 2024-05-17T11:54:22.521 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-17T11:54:22.521 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:54:22.587 INFO:tasks.ceph.osd.6:Stopped 2024-05-17T11:54:22.587 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-17T11:54:22.587 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:54:22.663 INFO:tasks.ceph.osd.7:Stopped 2024-05-17T11:54:22.664 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-17T11:54:22.664 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-17T11:54:22.664 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:54:22.713 INFO:tasks.ceph.mgr.y:Stopped 2024-05-17T11:54:22.713 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-17T11:54:22.713 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:54:22.741 INFO:tasks.ceph.mgr.x:Stopped 2024-05-17T11:54:22.741 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-17T11:54:22.742 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-17T11:54:22.742 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:54:22.806 INFO:tasks.ceph.mon.a:Stopped 2024-05-17T11:54:22.806 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-17T11:54:22.806 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:54:22.827 INFO:tasks.ceph.mon.b:Stopped 2024-05-17T11:54:22.827 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-17T11:54:22.827 INFO:teuthology.orchestra.run:waiting for 300 2024-05-17T11:54:22.888 INFO:tasks.ceph.mon.c:Stopped 2024-05-17T11:54:22.888 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-17T11:54:22.888 DEBUG:teuthology.orchestra.run.smithi131:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-05-17T11:54:23.141 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-17T11:54:23.142 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-17T11:54:23.399 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-17T11:54:23.399 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-17T11:54:23.559 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-17T11:54:23.559 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-17T11:54:23.686 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-17T11:54:23.686 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-17T11:54:23.857 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi150.front.sepia.ceph.com 2024-05-17T11:54:23.857 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-17T11:54:24.206 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi150.front.sepia.ceph.com 2024-05-17T11:54:24.206 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-17T11:54:24.356 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi150.front.sepia.ceph.com 2024-05-17T11:54:24.357 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-17T11:54:24.459 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi150.front.sepia.ceph.com 2024-05-17T11:54:24.459 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-17T11:54:24.563 INFO:tasks.ceph:Archiving mon data... 2024-05-17T11:54:24.565 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314/data/mon.a.tgz 2024-05-17T11:54:24.565 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-05-17T11:54:24.617 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.QdGFQ8B3fV 2024-05-17T11:54:24.617 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.QdGFQ8B3fV 2024-05-17T11:54:24.954 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.QdGFQ8B3fV 2024-05-17T11:54:25.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-17T11:54:25.074 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.QdGFQ8B3fV is 574KB 2024-05-17T11:54:25.164 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.QdGFQ8B3fV 2024-05-17T11:54:25.197 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314/data/mon.b.tgz 2024-05-17T11:54:25.197 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-05-17T11:54:25.215 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.axfW8REf1k 2024-05-17T11:54:25.215 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.axfW8REf1k 2024-05-17T11:54:25.378 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.axfW8REf1k 2024-05-17T11:54:25.490 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.axfW8REf1k is 577KB 2024-05-17T11:54:25.560 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.axfW8REf1k 2024-05-17T11:54:25.575 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314/data/mon.c.tgz 2024-05-17T11:54:25.575 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-05-17T11:54:25.629 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.Ei0JF31Nwv 2024-05-17T11:54:25.629 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Ei0JF31Nwv 2024-05-17T11:54:25.779 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.Ei0JF31Nwv 2024-05-17T11:54:25.861 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.Ei0JF31Nwv is 577KB 2024-05-17T11:54:25.931 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.Ei0JF31Nwv 2024-05-17T11:54:25.946 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-17T11:54:25.946 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-17T11:54:25.949 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-17T11:54:26.069 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-17T11:54:26.085 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-17T11:54:26.085 INFO:tasks.ceph:Archiving crash dumps... 2024-05-17T11:54:26.087 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314/remote/smithi131/crash 2024-05-17T11:54:26.088 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-17T11:54:26.169 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314/remote/smithi150/crash 2024-05-17T11:54:26.170 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-17T11:54:26.194 INFO:tasks.ceph:Shutting down logrotate 2024-05-17T11:54:26.194 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:54:26.198 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-17T11:54:26.292 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-17T11:54:26.368 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-17T11:54:26.418 INFO:tasks.ceph:Compressing logs... 2024-05-17T11:54:26.418 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-17T11:54:26.421 DEBUG:teuthology.orchestra.run.smithi150:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-17T11:54:26.453 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36956.log 2024-05-17T11:54:26.453 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37085.log 2024-05-17T11:54:26.458 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36996.log 2024-05-17T11:54:26.458 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37085.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-17T11:54:26.459 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36996.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-17T11:54:26.459 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43342.log 2024-05-17T11:54:26.459 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-17T11:54:26.459 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.1.43342.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-17T11:54:26.459 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-17T11:54:26.459 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-17T11:54:26.459 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43798.log 2024-05-17T11:54:26.460 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-17T11:54:26.460 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.3.43798.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-17T11:54:26.460 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37207.log 2024-05-17T11:54:26.460 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-17T11:54:26.460 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37247.log 2024-05-17T11:54:26.460 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37036.log 2024-05-17T11:54:26.460 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37127.log 2024-05-17T11:54:26.460 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37167.log 2024-05-17T11:54:26.461 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37127.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-17T11:54:26.461 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37167.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-17T11:54:26.463 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36956.log.gz 2024-05-17T11:54:26.463 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36996.log.gz 2024-05-17T11:54:26.464 INFO:teuthology.orchestra.run.smithi150.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37036.log.gz 2024-05-17T11:54:26.466 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37085.log.gz 2024-05-17T11:54:26.466 INFO:teuthology.orchestra.run.smithi150.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37127.log.gz 2024-05-17T11:54:26.467 INFO:teuthology.orchestra.run.smithi150.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37167.log.gz 2024-05-17T11:54:26.467 INFO:teuthology.orchestra.run.smithi150.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37207.log.gz 2024-05-17T11:54:26.468 INFO:teuthology.orchestra.run.smithi150.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37247.log.gz 2024-05-17T11:54:26.485 INFO:teuthology.orchestra.run.smithi150.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-17T11:54:26.500 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511910.log 2024-05-17T11:54:26.500 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449046.log 2024-05-17T11:54:26.501 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203096.log 2024-05-17T11:54:26.502 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.511910.log: /var/log/ceph/ceph-client.admin.449046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274609.log 2024-05-17T11:54:26.502 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.203096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434855.log 2024-05-17T11:54:26.503 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353889.log 2024-05-17T11:54:26.503 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236426.log 2024-05-17T11:54:26.504 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392502.log 2024-05-17T11:54:26.505 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444330.log 2024-05-17T11:54:26.505 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219171.log 2024-05-17T11:54:26.506 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455310.log 2024-05-17T11:54:26.507 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180826.log 2024-05-17T11:54:26.507 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156149.log 2024-05-17T11:54:26.507 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483592.log 2024-05-17T11:54:26.508 INFO:teuthology.orchestra.run.smithi150.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.1.43342.log.gz 2024-05-17T11:54:26.508 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.3.43798.log.gz 2024-05-17T11:54:26.509 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125605.log 2024-05-17T11:54:26.509 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43052.log 2024-05-17T11:54:26.509 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44361.log 2024-05-17T11:54:26.510 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139406.log 2024-05-17T11:54:26.510 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190996.log 2024-05-17T11:54:26.511 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47180.log 2024-05-17T11:54:26.511 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470720.log 2024-05-17T11:54:26.512 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261412.log 2024-05-17T11:54:26.513 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454459.log 2024-05-17T11:54:26.513 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402760.log 2024-05-17T11:54:26.514 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540433.log 2024-05-17T11:54:26.515 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45503.log 2024-05-17T11:54:26.515 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45507.log 2024-05-17T11:54:26.516 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147673.log 2024-05-17T11:54:26.517 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352613.log 2024-05-17T11:54:26.517 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231646.log 2024-05-17T11:54:26.518 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160362.log 2024-05-17T11:54:26.518 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150272.log 2024-05-17T11:54:26.519 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191870.log 2024-05-17T11:54:26.520 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454037.log 2024-05-17T11:54:26.524 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.434855.log: /var/log/ceph/ceph-client.admin.274609.log: gzip 81.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.449046.log.gz 2024-05-17T11:54:26.524 INFO:teuthology.orchestra.run.smithi131.stderr: --verbose -- /var/log/ceph/ceph-client.admin.239104.log 2024-05-17T11:54:26.524 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.483592.log: /var/log/ceph/ceph-client.admin.150272.log: /var/log/ceph/ceph-client.admin.470720.log: /var/log/ceph/ceph-client.admin.540433.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.203096.log.gz 2024-05-17T11:54:26.524 INFO:teuthology.orchestra.run.smithi131.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.511910.log.gz 2024-05-17T11:54:26.524 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.454037.log: /var/log/ceph/ceph-client.admin.353889.log: /var/log/ceph/ceph-client.admin.236426.log: /var/log/ceph/ceph-client.admin.444330.log: /var/log/ceph/ceph-client.admin.47180.log: /var/log/ceph/ceph-client.admin.125605.log: /var/log/ceph/ceph-client.admin.454459.log: gzip/var/log/ceph/ceph-client.admin.219171.log: -5 --verbose/var/log/ceph/ceph-client.admin.352613.log: -- /var/log/ceph/ceph-client.admin.566357.log 2024-05-17T11:54:26.524 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.261412.log: /var/log/ceph/ceph-client.admin.455310.log: /var/log/ceph/ceph-client.admin.160362.log: /var/log/ceph/ceph-client.admin.45507.log: /var/log/ceph/ceph-client.admin.392502.log: /var/log/ceph/ceph-client.admin.239104.log: /var/log/ceph/ceph-client.admin.180826.log: /var/log/ceph/ceph-client.admin.156149.log: /var/log/ceph/ceph-client.admin.43052.log: /var/log/ceph/ceph-client.admin.191870.log: /var/log/ceph/ceph-client.admin.44361.log: /var/log/ceph/ceph-client.admin.139406.log: /var/log/ceph/ceph-client.admin.190996.log: /var/log/ceph/ceph-client.admin.402760.log: /var/log/ceph/ceph-client.admin.45503.log: /var/log/ceph/ceph-client.admin.147673.log: /var/log/ceph/ceph-client.admin.231646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512920.log 2024-05-17T11:54:26.524 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.566357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43138.log 2024-05-17T11:54:26.526 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.512920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429606.log 2024-05-17T11:54:26.526 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500604.log 2024-05-17T11:54:26.526 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397422.log 2024-05-17T11:54:26.527 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.429606.log: /var/log/ceph/ceph-client.admin.500604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391223.log 2024-05-17T11:54:26.527 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43052.log.gz 2024-05-17T11:54:26.528 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.397422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555312.log 2024-05-17T11:54:26.528 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.391223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577683.log 2024-05-17T11:54:26.529 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.555312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193687.log 2024-05-17T11:54:26.529 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515109.log 2024-05-17T11:54:26.530 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.577683.log: /var/log/ceph/ceph-client.admin.193687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439609.log 2024-05-17T11:54:26.530 INFO:teuthology.orchestra.run.smithi131.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.577683.log.gz 2024-05-17T11:54:26.530 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212143.log 2024-05-17T11:54:26.531 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.515109.log: /var/log/ceph/ceph-client.admin.439609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458209.log 2024-05-17T11:54:26.531 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.212143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214280.log 2024-05-17T11:54:26.532 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.458209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230385.log 2024-05-17T11:54:26.532 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.214280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505459.log 2024-05-17T11:54:26.534 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44361.log.gz 2024-05-17T11:54:26.534 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228216.log 2024-05-17T11:54:26.534 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.230385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517717.log 2024-05-17T11:54:26.535 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.228216.log: /var/log/ceph/ceph-client.admin.505459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440042.log 2024-05-17T11:54:26.535 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44319.log 2024-05-17T11:54:26.536 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.517717.log: /var/log/ceph/ceph-client.admin.440042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483160.log 2024-05-17T11:54:26.536 INFO:teuthology.orchestra.run.smithi131.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.444330.log.gz 2024-05-17T11:54:26.536 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142445.log 2024-05-17T11:54:26.537 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44319.log: /var/log/ceph/ceph-client.admin.483160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200910.log 2024-05-17T11:54:26.538 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.454037.log.gz 2024-05-17T11:54:26.538 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.142445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497167.log 2024-05-17T11:54:26.539 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.200910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230809.log 2024-05-17T11:54:26.539 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.497167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217007.log 2024-05-17T11:54:26.540 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.230809.log: /var/log/ceph/ceph-client.admin.521378.log 2024-05-17T11:54:26.540 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374589.log 2024-05-17T11:54:26.540 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.521378.log: /var/log/ceph/ceph-client.admin.217007.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.231646.log.gz 2024-05-17T11:54:26.542 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508031.log 2024-05-17T11:54:26.542 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5/var/log/ceph/ceph-client.admin.374589.log: --verbose -- /var/log/ceph/ceph-client.admin.47138.log 2024-05-17T11:54:26.542 INFO:teuthology.orchestra.run.smithi131.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.429606.log.gz 2024-05-17T11:54:26.542 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474373.log 2024-05-17T11:54:26.543 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.508031.log: /var/log/ceph/ceph-client.admin.47138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474843.log 2024-05-17T11:54:26.543 INFO:teuthology.orchestra.run.smithi131.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.239104.log.gz 2024-05-17T11:54:26.543 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.474373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195458.log 2024-05-17T11:54:26.544 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562358.log 2024-05-17T11:54:26.545 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.474843.log: /var/log/ceph/ceph-client.admin.195458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442180.log 2024-05-17T11:54:26.545 INFO:teuthology.orchestra.run.smithi131.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.219171.log.gz 2024-05-17T11:54:26.545 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430387.log 2024-05-17T11:54:26.545 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.562358.log: /var/log/ceph/ceph-client.admin.442180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439618.log 2024-05-17T11:54:26.547 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420986.log 2024-05-17T11:54:26.547 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.430387.log: /var/log/ceph/ceph-client.admin.439618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257419.log 2024-05-17T11:54:26.547 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252728.log 2024-05-17T11:54:26.548 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.420986.log: /var/log/ceph/ceph-client.admin.257419.log: gzip -5 --verbose 90.0% -- /var/log/ceph/ceph-client.admin.136716.log -- replaced with /var/log/ceph/ceph-client.admin.125605.log.gz 2024-05-17T11:54:26.548 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:26.548 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45705.log 2024-05-17T11:54:26.549 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.252728.log: /var/log/ceph/ceph-client.admin.136716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490580.log 2024-05-17T11:54:26.549 INFO:teuthology.orchestra.run.smithi131.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.150272.log.gz 2024-05-17T11:54:26.550 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471592.log 2024-05-17T11:54:26.550 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.490580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230376.log 2024-05-17T11:54:26.551 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.471592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214703.log 2024-05-17T11:54:26.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.230376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152947.log 2024-05-17T11:54:26.552 INFO:teuthology.orchestra.run.smithi131.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47180.log.gz 2024-05-17T11:54:26.553 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.214703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560572.log 2024-05-17T11:54:26.553 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146750.log 2024-05-17T11:54:26.554 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.152947.log: /var/log/ceph/ceph-client.admin.560572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181714.log 2024-05-17T11:54:26.554 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.146750.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.261412.log.gz 2024-05-17T11:54:26.555 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561920.log 2024-05-17T11:54:26.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.181714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492381.log 2024-05-17T11:54:26.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.561920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43094.log 2024-05-17T11:54:26.557 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132885.log 2024-05-17T11:54:26.557 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.492381.log: /var/log/ceph/ceph-client.admin.43094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553780.log 2024-05-17T11:54:26.558 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.353889.log.gz 2024-05-17T11:54:26.558 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.132885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252719.log 2024-05-17T11:54:26.558 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551739.log 2024-05-17T11:54:26.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.553780.log: /var/log/ceph/ceph-client.admin.252719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230800.log 2024-05-17T11:54:26.560 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.551739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397007.log 2024-05-17T11:54:26.560 INFO:teuthology.orchestra.run.smithi131.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.191870.log.gz 2024-05-17T11:54:26.561 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.230800.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.193687.log.gz 2024-05-17T11:54:26.561 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259205.log 2024-05-17T11:54:26.561 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427869.log 2024-05-17T11:54:26.562 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.259205.log: /var/log/ceph/ceph-client.admin.397007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550364.log 2024-05-17T11:54:26.562 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.427869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430396.log 2024-05-17T11:54:26.563 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.550364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131191.log 2024-05-17T11:54:26.563 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.430396.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45503.log.gz 2024-05-17T11:54:26.564 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45507.log.gz 2024-05-17T11:54:26.564 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535345.log 2024-05-17T11:54:26.564 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.131191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553515.log 2024-05-17T11:54:26.565 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.535345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45164.log 2024-05-17T11:54:26.565 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471147.log 2024-05-17T11:54:26.567 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.553515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577496.log 2024-05-17T11:54:26.567 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.471147.log: /var/log/ceph/ceph-client.admin.45164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141594.log 2024-05-17T11:54:26.568 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.577496.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.392502.log.gz 2024-05-17T11:54:26.568 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183494.log 2024-05-17T11:54:26.569 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.577496.log.gz 2024-05-17T11:54:26.569 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.141594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471601.log 2024-05-17T11:54:26.569 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.183494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425163.log 2024-05-17T11:54:26.569 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45705.log.gz 2024-05-17T11:54:26.570 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469442.log 2024-05-17T11:54:26.570 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517726.log 2024-05-17T11:54:26.571 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543398.log 2024-05-17T11:54:26.571 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130777.log 2024-05-17T11:54:26.571 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479672.log 2024-05-17T11:54:26.572 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123426.log 2024-05-17T11:54:26.573 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206894.log 2024-05-17T11:54:26.573 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534496.log 2024-05-17T11:54:26.574 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257410.log 2024-05-17T11:54:26.574 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391232.log 2024-05-17T11:54:26.575 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530926.log 2024-05-17T11:54:26.576 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515543.log 2024-05-17T11:54:26.576 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130354.log 2024-05-17T11:54:26.577 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491883.log 2024-05-17T11:54:26.577 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397919.log 2024-05-17T11:54:26.578 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578162.log 2024-05-17T11:54:26.579 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48718.log 2024-05-17T11:54:26.581 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415530.log 2024-05-17T11:54:26.581 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521387.log 2024-05-17T11:54:26.581 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144219.log 2024-05-17T11:54:26.582 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366027.log 2024-05-17T11:54:26.584 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420995.log 2024-05-17T11:54:26.584 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213022.log 2024-05-17T11:54:26.584 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228225.log 2024-05-17T11:54:26.585 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227802.log 2024-05-17T11:54:26.585 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362511.log 2024-05-17T11:54:26.586 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455738.log 2024-05-17T11:54:26.586 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266497.log 2024-05-17T11:54:26.587 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384535.log 2024-05-17T11:54:26.587 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511487.log 2024-05-17T11:54:26.588 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261826.log 2024-05-17T11:54:26.588 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47802.log 2024-05-17T11:54:26.589 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124300.log 2024-05-17T11:54:26.589 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369443.log 2024-05-17T11:54:26.590 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142021.log 2024-05-17T11:54:26.590 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220863.log 2024-05-17T11:54:26.591 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565911.log 2024-05-17T11:54:26.591 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148102.log 2024-05-17T11:54:26.591 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158057.log 2024-05-17T11:54:26.592 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148954.log 2024-05-17T11:54:26.593 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535782.log 2024-05-17T11:54:26.593 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275990.log 2024-05-17T11:54:26.593 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573540.log 2024-05-17T11:54:26.594 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148963.log 2024-05-17T11:54:26.595 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253575.log 2024-05-17T11:54:26.595 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238267.log 2024-05-17T11:54:26.595 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175103.log 2024-05-17T11:54:26.596 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43926.log 2024-05-17T11:54:26.596 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516390.log 2024-05-17T11:54:26.597 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433990.log 2024-05-17T11:54:26.597 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359855.log 2024-05-17T11:54:26.598 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192322.log 2024-05-17T11:54:26.598 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570437.log 2024-05-17T11:54:26.599 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45957.log 2024-05-17T11:54:26.599 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46518.log 2024-05-17T11:54:26.600 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220440.log 2024-05-17T11:54:26.600 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242917.log 2024-05-17T11:54:26.601 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203087.log 2024-05-17T11:54:26.601 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121816.log 2024-05-17T11:54:26.602 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375016.log 2024-05-17T11:54:26.602 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541705.log 2024-05-17T11:54:26.603 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43348.log 2024-05-17T11:54:26.604 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192331.log 2024-05-17T11:54:26.604 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517272.log 2024-05-17T11:54:26.605 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45172.log 2024-05-17T11:54:26.605 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402300.log 2024-05-17T11:54:26.606 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501037.log 2024-05-17T11:54:26.606 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426999.log 2024-05-17T11:54:26.607 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441752.log 2024-05-17T11:54:26.607 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269586.log 2024-05-17T11:54:26.608 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438340.log 2024-05-17T11:54:26.609 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213436.log 2024-05-17T11:54:26.609 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186246.log 2024-05-17T11:54:26.609 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263518.log 2024-05-17T11:54:26.610 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138989.log 2024-05-17T11:54:26.611 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395164.log 2024-05-17T11:54:26.611 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390801.log 2024-05-17T11:54:26.611 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156663.log 2024-05-17T11:54:26.611 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500613.log 2024-05-17T11:54:26.612 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204779.log 2024-05-17T11:54:26.612 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550831.log 2024-05-17T11:54:26.613 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552159.log 2024-05-17T11:54:26.613 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386416.log 2024-05-17T11:54:26.614 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430290.log 2024-05-17T11:54:26.614 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131623.log 2024-05-17T11:54:26.615 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422717.log 2024-05-17T11:54:26.615 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-17T11:54:26.616 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258698.log 2024-05-17T11:54:26.616 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257838.log 2024-05-17T11:54:26.617 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246428.log 2024-05-17T11:54:26.617 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183927.log 2024-05-17T11:54:26.618 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535354.log 2024-05-17T11:54:26.619 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372823.log 2024-05-17T11:54:26.619 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385505.log 2024-05-17T11:54:26.619 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577641.log 2024-05-17T11:54:26.620 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43222.log 2024-05-17T11:54:26.621 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43498.log 2024-05-17T11:54:26.621 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519725.log 2024-05-17T11:54:26.621 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203519.log 2024-05-17T11:54:26.622 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401320.log 2024-05-17T11:54:26.622 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175526.log 2024-05-17T11:54:26.623 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138517.log 2024-05-17T11:54:26.623 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487201.log 2024-05-17T11:54:26.624 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573114.log 2024-05-17T11:54:26.624 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351764.log 2024-05-17T11:54:26.625 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577767.log 2024-05-17T11:54:26.625 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158903.log 2024-05-17T11:54:26.626 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433555.log 2024-05-17T11:54:26.626 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42550.log 2024-05-17T11:54:26.627 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234667.log 2024-05-17T11:54:26.627 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488668.log 2024-05-17T11:54:26.628 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247939.log 2024-05-17T11:54:26.628 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502830.log 2024-05-17T11:54:26.629 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190535.log 2024-05-17T11:54:26.629 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377568.log 2024-05-17T11:54:26.630 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557496.log 2024-05-17T11:54:26.630 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399285.log 2024-05-17T11:54:26.631 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484925.log 2024-05-17T11:54:26.631 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540867.log 2024-05-17T11:54:26.632 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369021.log 2024-05-17T11:54:26.632 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502398.log 2024-05-17T11:54:26.633 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448167.log 2024-05-17T11:54:26.633 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269577.log 2024-05-17T11:54:26.633 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361134.log 2024-05-17T11:54:26.634 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413790.log 2024-05-17T11:54:26.634 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278654.log 2024-05-17T11:54:26.635 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468605.log 2024-05-17T11:54:26.635 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512479.log 2024-05-17T11:54:26.636 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37187.log 2024-05-17T11:54:26.636 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537056.log 2024-05-17T11:54:26.637 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544283.log 2024-05-17T11:54:26.637 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125182.log 2024-05-17T11:54:26.638 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370287.log 2024-05-17T11:54:26.638 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563248.log 2024-05-17T11:54:26.639 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178513.log 2024-05-17T11:54:26.639 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353037.log 2024-05-17T11:54:26.640 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417299.log 2024-05-17T11:54:26.640 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398351.log 2024-05-17T11:54:26.641 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369856.log 2024-05-17T11:54:26.641 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184374.log 2024-05-17T11:54:26.642 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160353.log 2024-05-17T11:54:26.642 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418843.log 2024-05-17T11:54:26.643 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218285.log 2024-05-17T11:54:26.643 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537047.log 2024-05-17T11:54:26.644 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470711.log 2024-05-17T11:54:26.644 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573105.log 2024-05-17T11:54:26.645 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493771.log 2024-05-17T11:54:26.646 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436607.log 2024-05-17T11:54:26.646 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48558.log 2024-05-17T11:54:26.647 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245988.log 2024-05-17T11:54:26.648 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185329.log 2024-05-17T11:54:26.648 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373678.log 2024-05-17T11:54:26.649 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-17T11:54:26.649 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135004.log 2024-05-17T11:54:26.650 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259710.log 2024-05-17T11:54:26.651 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42738.log 2024-05-17T11:54:26.651 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365595.log 2024-05-17T11:54:26.652 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134163.log 2024-05-17T11:54:26.652 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204365.log 2024-05-17T11:54:26.653 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482737.log 2024-05-17T11:54:26.654 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392511.log 2024-05-17T11:54:26.654 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366441.log 2024-05-17T11:54:26.655 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251025.log 2024-05-17T11:54:26.655 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193678.log 2024-05-17T11:54:26.656 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179911.log 2024-05-17T11:54:26.656 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126873.log 2024-05-17T11:54:26.657 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542551.log 2024-05-17T11:54:26.658 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256991.log 2024-05-17T11:54:26.658 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152488.log 2024-05-17T11:54:26.659 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383561.log 2024-05-17T11:54:26.659 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560563.log 2024-05-17T11:54:26.660 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444764.log 2024-05-17T11:54:26.660 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434418.log 2024-05-17T11:54:26.661 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358996.log 2024-05-17T11:54:26.661 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382250.log 2024-05-17T11:54:26.662 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115130.log 2024-05-17T11:54:26.662 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416431.log 2024-05-17T11:54:26.663 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436193.log 2024-05-17T11:54:26.664 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540858.log 2024-05-17T11:54:26.665 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211226.log 2024-05-17T11:54:26.665 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443482.log 2024-05-17T11:54:26.666 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452289.log 2024-05-17T11:54:26.666 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539595.log 2024-05-17T11:54:26.667 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469019.log 2024-05-17T11:54:26.667 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569098.log 2024-05-17T11:54:26.668 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486199.log 2024-05-17T11:54:26.668 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490143.log 2024-05-17T11:54:26.669 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421432.log 2024-05-17T11:54:26.670 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416008.log 2024-05-17T11:54:26.670 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249737.log 2024-05-17T11:54:26.671 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577580.log 2024-05-17T11:54:26.672 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70074.log 2024-05-17T11:54:26.672 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146741.log 2024-05-17T11:54:26.673 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371968.log 2024-05-17T11:54:26.673 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201810.log 2024-05-17T11:54:26.674 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276952.log 2024-05-17T11:54:26.675 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577538.log 2024-05-17T11:54:26.675 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232978.log 2024-05-17T11:54:26.676 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208594.log 2024-05-17T11:54:26.677 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503684.log 2024-05-17T11:54:26.677 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151556.log 2024-05-17T11:54:26.678 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430679.log 2024-05-17T11:54:26.679 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446478.log 2024-05-17T11:54:26.679 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235093.log 2024-05-17T11:54:26.680 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45509.log 2024-05-17T11:54:26.680 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212567.log 2024-05-17T11:54:26.681 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495407.log 2024-05-17T11:54:26.682 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478273.log 2024-05-17T11:54:26.682 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354749.log 2024-05-17T11:54:26.684 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.425163.log: /var/log/ceph/ceph-client.admin.471601.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.397422.log.gz 2024-05-17T11:54:26.684 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.469442.log: /var/log/ceph/ceph-client.admin.543398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256563.log 2024-05-17T11:54:26.684 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.517726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557923.log 2024-05-17T11:54:26.720 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.479672.log: /var/log/ceph/ceph-client.admin.276952.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.136716.log.gz 2024-05-17T11:54:26.720 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211678.log 2024-05-17T11:54:26.720 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.430679.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.483592.log.gz 2024-05-17T11:54:26.720 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.534496.log: /var/log/ceph/ceph-client.admin.530926.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.455310.log.gz 2024-05-17T11:54:26.720 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.515543.log: /var/log/ceph/ceph-client.admin.557923.log: /var/log/ceph/ceph-client.admin.578162.log: /var/log/ceph/ceph-client.admin.491883.log: /var/log/ceph/ceph-client.admin.521387.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.147673.log.gz 2024-05-17T11:54:26.720 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.566357.log.gz 2024-05-17T11:54:26.720 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.511487.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.578162.log.gz 2024-05-17T11:54:26.721 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.505459.log.gz 2024-05-17T11:54:26.721 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose 85.0% -- -- replaced with /var/log/ceph/ceph-client.admin.391223.log.gz 2024-05-17T11:54:26.721 INFO:teuthology.orchestra.run.smithi131.stderr: /var/log/ceph/ceph-client.admin.187725.log 2024-05-17T11:54:26.721 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.565911.log: /var/log/ceph/ceph-client.admin.535782.log: 79.6%/var/log/ceph/ceph-client.admin.573540.log: -- replaced with /var/log/ceph/ceph-client.admin.521378.log.gz 2024-05-17T11:54:26.721 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.516390.log: /var/log/ceph/ceph-client.admin.570437.log: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.402760.log.gz 2024-05-17T11:54:26.721 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.274609.log.gz 2024-05-17T11:54:26.721 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.541705.log: /var/log/ceph/ceph-client.admin.517272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404208.log 2024-05-17T11:54:26.721 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.501037.log: /var/log/ceph/ceph-client.admin.500613.log: /var/log/ceph/ceph-client.admin.550831.log: /var/log/ceph/ceph-client.admin.552159.log: 90.2% 90.5% -- replaced with /var/log/ceph/ceph-client.admin.257419.log.gz 2024-05-17T11:54:26.722 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.252728.log.gz/var/log/ceph/ceph.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.236426.log.gz 2024-05-17T11:54:26.722 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3%/var/log/ceph/ceph-client.admin.535354.log: -- replaced with /var/log/ceph/ceph-client.admin.131191.log.gz 2024-05-17T11:54:26.722 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.195458.log.gz 2024-05-17T11:54:26.722 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.577641.log: /var/log/ceph/ceph-client.admin.519725.log: /var/log/ceph/ceph-client.admin.487201.log: gzip -5/var/log/ceph/ceph-client.admin.573114.log: /var/log/ceph/ceph-client.admin.577767.log: --verbose -- /var/log/ceph/ceph-client.admin.420112.log 2024-05-17T11:54:26.722 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:26.722 INFO:teuthology.orchestra.run.smithi131.stderr: 88.1%/var/log/ceph/ceph-client.admin.488668.log: -- replaced with /var/log/ceph/ceph-client.admin.577767.log.gz 2024-05-17T11:54:26.722 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509320.log 2024-05-17T11:54:26.723 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.502830.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.474843.log.gz 2024-05-17T11:54:26.723 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.557496.log: /var/log/ceph/ceph-client.admin.420112.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.397007.log.gz 2024-05-17T11:54:26.723 INFO:teuthology.orchestra.run.smithi131.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.577641.log.gz 2024-05-17T11:54:26.723 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.484925.log: /var/log/ceph/ceph-client.admin.502398.log: /var/log/ceph/ceph-client.admin.540867.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.490580.log.gz 2024-05-17T11:54:26.723 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.468605.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.500604.log.gz 2024-05-17T11:54:26.723 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.537056.log: /var/log/ceph/ceph-client.admin.512479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388144.log 2024-05-17T11:54:26.723 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.544283.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.228216.log.gz 2024-05-17T11:54:26.723 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.483160.log.gz 2024-05-17T11:54:26.723 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.563248.log: /var/log/ceph/ceph-client.admin.537047.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.180826.log.gz 2024-05-17T11:54:26.724 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.573105.log: /var/log/ceph/ceph-client.admin.470711.log: /var/log/ceph/ceph-client.admin.493771.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.352613.log.gz 2024-05-17T11:54:26.724 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.2.log: 81.6% 77.6% -- replaced with /var/log/ceph/ceph-client.admin.458209.log.gz 2024-05-17T11:54:26.724 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.430387.log.gz 2024-05-17T11:54:26.724 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% 80.8% -- replaced with /var/log/ceph/ceph-client.admin.230376.log.gz 2024-05-17T11:54:26.724 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.482737.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.454459.log.gz 2024-05-17T11:54:26.724 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.139406.log.gz 2024-05-17T11:54:26.724 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.230800.log.gz 89.9% -- replaced with /var/log/ceph/ceph-client.admin.230809.log.gz 2024-05-17T11:54:26.724 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.542551.log: 2024-05-17T11:54:26.725 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.560563.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.512920.log.gz 2024-05-17T11:54:26.725 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.515109.log.gz 2024-05-17T11:54:26.725 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.517717.log.gz 2024-05-17T11:54:26.725 INFO:teuthology.orchestra.run.smithi131.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.183494.log.gz 2024-05-17T11:54:26.725 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.540858.log: /var/log/ceph/ceph-client.admin.539595.log: /var/log/ceph/ceph-client.admin.469019.log: /var/log/ceph/ceph-client.admin.569098.log: /var/log/ceph/ceph-client.admin.486199.log: /var/log/ceph/ceph-client.admin.490143.log: /var/log/ceph/ceph-client.admin.509320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560126.log 2024-05-17T11:54:26.725 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.577580.log: 89.9% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.551739.log.gz 2024-05-17T11:54:26.725 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47138.log.gz 2024-05-17T11:54:26.725 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.503684.log: /var/log/ceph/ceph-client.admin.577538.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.550364.log.gz 2024-05-17T11:54:26.726 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.132885.log.gz 2024-05-17T11:54:26.726 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.230385.log.gz 2024-05-17T11:54:26.726 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130345.log 2024-05-17T11:54:26.726 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.577580.log.gz 2024-05-17T11:54:26.726 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.495407.log: /var/log/ceph/ceph-client.admin.478273.log: /var/log/ceph/ceph-client.admin.560126.log: 87.7%/var/log/ceph/ceph-client.admin.130777.log: -- replaced with /var/log/ceph/ceph-client.admin.577538.log.gz 2024-05-17T11:54:26.726 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.123426.log: /var/log/ceph/ceph-client.0.46518.log: /var/log/ceph/ceph-client.admin.384535.log: /var/log/ceph/ceph-client.admin.206894.log: /var/log/ceph/ceph-client.admin.366027.log: /var/log/ceph/ceph-client.admin.395164.log: /var/log/ceph/ceph-client.admin.48718.log: /var/log/ceph/ceph-client.admin.45172.log: /var/log/ceph/ceph-client.admin.390801.log: /var/log/ceph/ceph-client.admin.430290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248362.log 2024-05-17T11:54:26.726 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.257410.log: /var/log/ceph/ceph-client.admin.422717.log: /var/log/ceph/ceph-client.admin.228225.log: /var/log/ceph/ceph-client.admin.144219.log: /var/log/ceph/ceph-client.admin.246428.log: /var/log/ceph/ceph-client.admin.131623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400812.log 2024-05-17T11:54:26.726 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.385505.log: /var/log/ceph/ceph-client.admin.183927.log: /var/log/ceph/ceph-client.admin.204779.log: /var/log/ceph/ceph-client.admin.43222.log: /var/log/ceph/ceph-client.admin.366441.log: /var/log/ceph/ceph-client.admin.192322.log: /var/log/ceph/ceph-client.admin.227802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150281.log 2024-05-17T11:54:26.727 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.258698.log: /var/log/ceph/ceph-client.admin.383561.log: /var/log/ceph/ceph-client.admin.401320.log: /var/log/ceph/ceph-client.admin.257838.log: /var/log/ceph/ceph-client.admin.211226.log: /var/log/ceph/ceph-client.admin.138517.log: /var/log/ceph/ceph-client.admin.400812.log: /var/log/ceph/ceph-client.admin.369443.log: /var/log/ceph/ceph-client.admin.220440.log: /var/log/ceph/ceph-client.admin.48558.log: /var/log/ceph/ceph-client.admin.158903.log: /var/log/ceph/ceph-client.admin.234667.log: /var/log/ceph/ceph-client.admin.351764.log: /var/log/ceph/ceph-client.admin.433555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356443.log 2024-05-17T11:54:26.727 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.121816.log: /var/log/ceph/ceph-client.admin.158057.log: /var/log/ceph/ceph-client.admin.190535.log: /var/log/ceph/ceph-client.admin.247939.log: /var/log/ceph/ceph-client.admin.185329.log: /var/log/ceph/ceph-client.admin.399285.log: /var/log/ceph/ceph-client.admin.377568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263104.log 2024-05-17T11:54:26.727 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.232978.log: /var/log/ceph/ceph-client.admin.148963.log: /var/log/ceph/ceph-client.admin.156663.log: /var/log/ceph/ceph-client.admin.259710.log: /var/log/ceph/ceph-client.admin.369021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147248.log 2024-05-17T11:54:26.727 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.448167.log: /var/log/ceph/ceph-client.admin.269577.log: /var/log/ceph/ceph-client.admin.150281.log: /var/log/ceph/ceph-client.admin.361134.log: /var/log/ceph/ceph-client.admin.43498.log: /var/log/ceph/ceph-client.admin.204365.log: /var/log/ceph/ceph-client.admin.413790.log: /var/log/ceph/ceph-client.admin.37187.log: /var/log/ceph/ceph-client.admin.175103.log: /var/log/ceph/ceph-client.admin.370287.log: /var/log/ceph/ceph-client.admin.391232.log: /var/log/ceph/ceph-client.admin.130354.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30792.log 2024-05-17T11:54:26.727 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.178513.log: /var/log/ceph/ceph-client.admin.416431.log: /var/log/ceph/ceph-client.admin.433990.log: /var/log/ceph/ceph-client.admin.369856.log: /var/log/ceph/ceph-client.admin.417299.log: /var/log/ceph/ceph-client.admin.392511.log: /var/log/ceph/ceph-client.admin.218285.log: /var/log/ceph/ceph-client.admin.160353.log: /var/log/ceph/ceph-client.admin.397919.log: /var/log/ceph/ceph-client.admin.415530.log: /var/log/ceph/ceph-client.admin.256991.log: /var/log/ceph/ceph-client.admin.45957.log: /var/log/ceph/ceph-client.admin.365595.log: /var/log/ceph/ceph-client.admin.371968.log: /var/log/ceph/ceph-client.admin.251025.log: /var/log/ceph/ceph-client.admin.115130.log: /var/log/ceph/ceph-client.admin.213022.log: /var/log/ceph/ceph-client.admin.212567.log: /var/log/ceph/ceph-client.admin.134163.log: /var/log/ceph/ceph-client.admin.235093.log: gzip/var/log/ceph/ceph-client.admin.420995.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.552594.log 2024-05-17T11:54:26.727 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.179911.log: /var/log/ceph/ceph-client.admin.455738.log: /var/log/ceph/ceph-client.admin.266497.log: /var/log/ceph/ceph-client.admin.362511.log: /var/log/ceph/ceph-client.admin.193678.log: /var/log/ceph/ceph-client.admin.261826.log: /var/log/ceph/ceph-client.admin.47802.log: /var/log/ceph/ceph-client.admin.434418.log: /var/log/ceph/ceph-client.admin.142021.log: /var/log/ceph/ceph-client.admin.220863.log: /var/log/ceph/ceph-client.admin.126873.log: /var/log/ceph/ceph-client.admin.124300.log: /var/log/ceph/ceph-client.admin.148102.log: /var/log/ceph/ceph-client.admin.382250.log: /var/log/ceph/ceph-client.admin.148954.log: /var/log/ceph/ceph-client.admin.238267.log: /var/log/ceph/ceph-client.admin.253575.log: /var/log/ceph/ceph-client.admin.275990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479663.log 2024-05-17T11:54:26.727 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.152488.log: /var/log/ceph/ceph-client.admin.359855.log: /var/log/ceph/ceph-client.admin.43926.log: /var/log/ceph/ceph-client.admin.443482.log: /var/log/ceph/ceph-client.admin.375016.log: /var/log/ceph/ceph-client.admin.203087.log: /var/log/ceph/ceph-client.admin.444764.log: /var/log/ceph/ceph.tmp-client.admin.30792.log: /var/log/ceph/ceph-client.admin.242917.log: /var/log/ceph/ceph-client.admin.43348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561911.log 2024-05-17T11:54:26.728 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.192331.log: /var/log/ceph/ceph-client.admin.552594.log: /var/log/ceph/ceph-client.admin.402300.log: /var/log/ceph/ceph-client.admin.416008.log: /var/log/ceph/ceph-client.admin.479663.log: /var/log/ceph/ceph-client.admin.358996.log: /var/log/ceph/ceph-client.admin.146741.log: /var/log/ceph/ceph-client.admin.248362.log: /var/log/ceph/ceph-client.admin.426999.log: /var/log/ceph/ceph-client.admin.436193.log: 81.1%/var/log/ceph/ceph-client.admin.147248.log: 85.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.469019.log.gz 2024-05-17T11:54:26.728 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.386425.log 2024-05-17T11:54:26.728 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.208594.log: -- replaced with /var/log/ceph/ceph-client.admin.469442.log.gz 2024-05-17T11:54:26.728 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.201810.log: /var/log/ceph/ceph-client.admin.441752.log: /var/log/ceph/ceph-client.admin.421432.log: /var/log/ceph/ceph-client.admin.561911.log: /var/log/ceph/ceph-client.admin.446478.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.181714.log.gz 2024-05-17T11:54:26.728 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509311.log 2024-05-17T11:54:26.728 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.151556.log: /var/log/ceph/ceph-client.admin.269586.log: /var/log/ceph/ceph-client.admin.249737.log: /var/log/ceph/ceph-client.admin.45509.log: /var/log/ceph/ceph-client.admin.438340.log: /var/log/ceph/ceph-client.admin.70074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567704.log 2024-05-17T11:54:26.728 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.213436.log: /var/log/ceph/ceph-client.admin.263518.log: /var/log/ceph/ceph-client.admin.509311.log: /var/log/ceph/ceph-client.admin.186246.log: /var/log/ceph/ceph-client.admin.138989.log: /var/log/ceph/ceph-client.admin.386416.log: /var/log/ceph/ceph-client.admin.203519.log: /var/log/ceph/ceph-client.admin.372823.log: /var/log/ceph/ceph-client.admin.175526.log: /var/log/ceph/ceph-client.admin.42550.log: gzip/var/log/ceph/ceph-client.admin.278654.log: -5 --verbose/var/log/ceph/ceph-client.admin.125182.log: --/var/log/ceph/ceph-client.admin.398351.log: /var/log/ceph/ceph-client.admin.358568.log 2024-05-17T11:54:26.728 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.353037.log: /var/log/ceph/ceph-client.admin.184374.log: /var/log/ceph/ceph-client.admin.567704.log: /var/log/ceph/ceph-client.admin.418843.log: /var/log/ceph/ceph-client.admin.436607.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.361134.log.gz 2024-05-17T11:54:26.729 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.245988.log: /var/log/ceph/ceph-client.admin.135004.log: gzip/var/log/ceph/ceph-client.admin.452289.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.549445.log 2024-05-17T11:54:26.729 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.373678.log: /var/log/ceph/ceph-client.admin.42738.log: /var/log/ceph/ceph-client.admin.211678.log: /var/log/ceph/ceph-client.admin.356443.log: /var/log/ceph/ceph-client.admin.354749.log: /var/log/ceph/ceph-client.admin.388144.log: /var/log/ceph/ceph-client.admin.404208.log: /var/log/ceph/ceph-client.admin.187725.log: /var/log/ceph/ceph-client.admin.256563.log: /var/log/ceph/ceph-client.admin.263104.log: /var/log/ceph/ceph-client.admin.130345.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30792.log.gz 2024-05-17T11:54:26.729 INFO:teuthology.orchestra.run.smithi131.stderr:gzip 81.6% -- replaced with /var/log/ceph/ceph-client.admin.486199.log.gz 2024-05-17T11:54:26.729 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.134154.log 2024-05-17T11:54:26.729 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.374589.log.gz 2024-05-17T11:54:26.729 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.386425.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.455738.log.gz 2024-05-17T11:54:26.729 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.358568.log: /var/log/ceph/ceph-client.admin.549445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445619.log 2024-05-17T11:54:26.730 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.134154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578499.log 2024-05-17T11:54:26.730 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.445619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496254.log 2024-05-17T11:54:26.730 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.578499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364748.log 2024-05-17T11:54:26.730 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.496254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140738.log 2024-05-17T11:54:26.730 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.578499.log.gz 2024-05-17T11:54:26.730 INFO:teuthology.orchestra.run.smithi131.stderr:gzip/var/log/ceph/ceph-client.admin.364748.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.352196.log 2024-05-17T11:54:26.730 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.140738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492372.log 2024-05-17T11:54:26.730 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247073.log 2024-05-17T11:54:26.731 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.352196.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.515543.log.gz 2024-05-17T11:54:26.731 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.492372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120848.log 2024-05-17T11:54:26.731 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566366.log 2024-05-17T11:54:26.731 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.247073.log: /var/log/ceph/ceph-client.admin.120848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155712.log 2024-05-17T11:54:26.731 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.566366.log: gzip 85.7% -- replaced with /var/log/ceph/ceph-client.admin.141594.log.gz 2024-05-17T11:54:26.731 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.238258.log 2024-05-17T11:54:26.731 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.155712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377982.log 2024-05-17T11:54:26.731 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.238258.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-17T11:54:26.731 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.377982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367754.log 2024-05-17T11:54:26.732 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396555.log 2024-05-17T11:54:26.732 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.367754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207753.log 2024-05-17T11:54:26.732 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.396555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483583.log 2024-05-17T11:54:26.741 INFO:teuthology.orchestra.run.smithi131.stderr:gzip/var/log/ceph/ceph-client.admin.207753.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43180.log 2024-05-17T11:54:26.742 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.483583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195919.log 2024-05-17T11:54:26.742 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484006.log 2024-05-17T11:54:26.742 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213013.log 2024-05-17T11:54:26.742 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.195919.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.142445.log.gz 2024-05-17T11:54:26.742 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.484006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181262.log 2024-05-17T11:54:26.742 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.213013.log: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.152947.log.gz 2024-05-17T11:54:26.742 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353474.log 2024-05-17T11:54:26.743 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203942.log 2024-05-17T11:54:26.743 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.181262.log: /var/log/ceph/ceph-client.admin.353474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204788.log 2024-05-17T11:54:26.743 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.203942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430436.log 2024-05-17T11:54:26.743 INFO:teuthology.orchestra.run.smithi131.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.439609.log.gz 2024-05-17T11:54:26.743 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203510.log 2024-05-17T11:54:26.743 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.204788.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.440042.log.gz 2024-05-17T11:54:26.743 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.430436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526122.log 2024-05-17T11:54:26.743 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.439618.log.gz 2024-05-17T11:54:26.744 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498864.log 2024-05-17T11:54:26.744 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.203510.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.442180.log.gz 2024-05-17T11:54:26.744 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.526122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48638.log 2024-05-17T11:54:26.744 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376703.log 2024-05-17T11:54:26.744 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450320.log 2024-05-17T11:54:26.744 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481406.log 2024-05-17T11:54:26.744 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375855.log 2024-05-17T11:54:26.744 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569995.log 2024-05-17T11:54:26.745 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508040.log 2024-05-17T11:54:26.745 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210783.log 2024-05-17T11:54:26.745 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554023.log 2024-05-17T11:54:26.745 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517263.log 2024-05-17T11:54:26.745 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148093.log 2024-05-17T11:54:26.745 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136707.log 2024-05-17T11:54:26.745 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484438.log 2024-05-17T11:54:26.746 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234252.log 2024-05-17T11:54:26.746 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366897.log 2024-05-17T11:54:26.746 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578751.log 2024-05-17T11:54:26.749 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371977.log 2024-05-17T11:54:26.749 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486686.log 2024-05-17T11:54:26.749 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559670.log 2024-05-17T11:54:26.749 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384039.log 2024-05-17T11:54:26.749 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428754.log 2024-05-17T11:54:26.750 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566812.log 2024-05-17T11:54:26.750 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489100.log 2024-05-17T11:54:26.750 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572195.log 2024-05-17T11:54:26.750 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182175.log 2024-05-17T11:54:26.750 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436616.log 2024-05-17T11:54:26.750 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110328.log 2024-05-17T11:54:26.750 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135428.log 2024-05-17T11:54:26.751 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135013.log 2024-05-17T11:54:26.751 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364757.log 2024-05-17T11:54:26.752 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44529.log 2024-05-17T11:54:26.752 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179902.log 2024-05-17T11:54:26.752 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132461.log 2024-05-17T11:54:26.753 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47722.log 2024-05-17T11:54:26.753 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497602.log 2024-05-17T11:54:26.753 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.47016.log 2024-05-17T11:54:26.754 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177219.log 2024-05-17T11:54:26.754 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353465.log 2024-05-17T11:54:26.754 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47919.log 2024-05-17T11:54:26.755 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184830.log 2024-05-17T11:54:26.755 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545153.log 2024-05-17T11:54:26.755 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37084.log 2024-05-17T11:54:26.756 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494206.log 2024-05-17T11:54:26.756 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149420.log 2024-05-17T11:54:26.757 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426523.log 2024-05-17T11:54:26.758 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356015.log 2024-05-17T11:54:26.758 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388153.log 2024-05-17T11:54:26.759 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475713.log 2024-05-17T11:54:26.759 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47977.log 2024-05-17T11:54:26.760 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218708.log 2024-05-17T11:54:26.760 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395660.log 2024-05-17T11:54:26.761 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539163.log 2024-05-17T11:54:26.762 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228640.log 2024-05-17T11:54:26.762 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122570.log 2024-05-17T11:54:26.763 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185338.log 2024-05-17T11:54:26.763 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495830.log 2024-05-17T11:54:26.764 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538326.log 2024-05-17T11:54:26.765 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266940.log 2024-05-17T11:54:26.765 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449892.log 2024-05-17T11:54:26.766 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500190.log 2024-05-17T11:54:26.766 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371554.log 2024-05-17T11:54:26.767 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115553.log 2024-05-17T11:54:26.767 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423132.log 2024-05-17T11:54:26.768 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390370.log 2024-05-17T11:54:26.768 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506762.log 2024-05-17T11:54:26.769 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159478.log 2024-05-17T11:54:26.769 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358149.log 2024-05-17T11:54:26.770 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430445.log 2024-05-17T11:54:26.770 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253156.log 2024-05-17T11:54:26.771 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178091.log 2024-05-17T11:54:26.772 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561455.log 2024-05-17T11:54:26.772 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129491.log 2024-05-17T11:54:26.772 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439186.log 2024-05-17T11:54:26.773 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417724.log 2024-05-17T11:54:26.774 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487210.log 2024-05-17T11:54:26.774 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480516.log 2024-05-17T11:54:26.775 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217430.log 2024-05-17T11:54:26.775 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48138.log 2024-05-17T11:54:26.776 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249208.log 2024-05-17T11:54:26.776 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482271.log 2024-05-17T11:54:26.777 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151128.log 2024-05-17T11:54:26.777 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558792.log 2024-05-17T11:54:26.778 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244655.log 2024-05-17T11:54:26.778 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149850.log 2024-05-17T11:54:26.779 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452298.log 2024-05-17T11:54:26.779 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132894.log 2024-05-17T11:54:26.780 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262672.log 2024-05-17T11:54:26.780 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493780.log 2024-05-17T11:54:26.781 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358577.log 2024-05-17T11:54:26.781 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111248.log 2024-05-17T11:54:26.781 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219603.log 2024-05-17T11:54:26.782 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534097.log 2024-05-17T11:54:26.782 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536198.log 2024-05-17T11:54:26.783 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191414.log 2024-05-17T11:54:26.783 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209879.log 2024-05-17T11:54:26.784 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359433.log 2024-05-17T11:54:26.785 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44158.log 2024-05-17T11:54:26.785 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183918.log 2024-05-17T11:54:26.786 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226480.log 2024-05-17T11:54:26.786 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421864.log 2024-05-17T11:54:26.787 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511065.log 2024-05-17T11:54:26.787 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117312.log 2024-05-17T11:54:26.788 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351328.log 2024-05-17T11:54:26.788 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109832.log 2024-05-17T11:54:26.789 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275498.log 2024-05-17T11:54:26.789 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548093.log 2024-05-17T11:54:26.789 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198179.log 2024-05-17T11:54:26.790 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420558.log 2024-05-17T11:54:26.790 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188994.log 2024-05-17T11:54:26.791 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47560.log 2024-05-17T11:54:26.791 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217853.log 2024-05-17T11:54:26.792 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420121.log 2024-05-17T11:54:26.792 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258689.log 2024-05-17T11:54:26.793 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544719.log 2024-05-17T11:54:26.793 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217439.log 2024-05-17T11:54:26.794 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578331.log 2024-05-17T11:54:26.794 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-17T11:54:26.795 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132038.log 2024-05-17T11:54:26.795 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48760.log 2024-05-17T11:54:26.796 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43390.log 2024-05-17T11:54:26.796 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542128.log 2024-05-17T11:54:26.797 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478696.log 2024-05-17T11:54:26.797 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572683.log 2024-05-17T11:54:26.798 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527776.log 2024-05-17T11:54:26.798 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400297.log 2024-05-17T11:54:26.799 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482746.log 2024-05-17T11:54:26.799 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578583.log 2024-05-17T11:54:26.800 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426100.log 2024-05-17T11:54:26.800 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138036.log 2024-05-17T11:54:26.801 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254423.log 2024-05-17T11:54:26.801 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278240.log 2024-05-17T11:54:26.802 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473521.log 2024-05-17T11:54:26.802 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253999.log 2024-05-17T11:54:26.803 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437490.log 2024-05-17T11:54:26.803 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414655.log 2024-05-17T11:54:26.804 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360268.log 2024-05-17T11:54:26.804 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70031.log 2024-05-17T11:54:26.805 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245078.log 2024-05-17T11:54:26.805 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251881.log 2024-05-17T11:54:26.806 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397928.log 2024-05-17T11:54:26.806 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418220.log 2024-05-17T11:54:26.807 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49100.log 2024-05-17T11:54:26.808 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135437.log 2024-05-17T11:54:26.808 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357727.log 2024-05-17T11:54:26.808 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498025.log 2024-05-17T11:54:26.809 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529425.log 2024-05-17T11:54:26.810 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530935.log 2024-05-17T11:54:26.810 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276503.log 2024-05-17T11:54:26.811 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49494.log 2024-05-17T11:54:26.812 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443905.log 2024-05-17T11:54:26.812 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444773.log 2024-05-17T11:54:26.812 INFO:teuthology.orchestra.run.smithi131.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43094.log.gz 2024-05-17T11:54:26.812 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43138.log.gz 2024-05-17T11:54:26.813 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554885.log 2024-05-17T11:54:26.813 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471156.log 2024-05-17T11:54:26.814 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223055.log 2024-05-17T11:54:26.814 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365172.log 2024-05-17T11:54:26.815 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131614.log 2024-05-17T11:54:26.815 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232969.log 2024-05-17T11:54:26.816 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201353.log 2024-05-17T11:54:26.816 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251444.log 2024-05-17T11:54:26.817 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234676.log 2024-05-17T11:54:26.818 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367745.log 2024-05-17T11:54:26.818 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566803.log 2024-05-17T11:54:26.819 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382259.log 2024-05-17T11:54:26.819 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188148.log 2024-05-17T11:54:26.820 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174666.log 2024-05-17T11:54:26.821 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184839.log 2024-05-17T11:54:26.822 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399790.log 2024-05-17T11:54:26.822 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577412.log 2024-05-17T11:54:26.823 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110811.log 2024-05-17T11:54:26.823 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44655.log 2024-05-17T11:54:26.823 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131200.log 2024-05-17T11:54:26.824 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229934.log 2024-05-17T11:54:26.824 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369012.log 2024-05-17T11:54:26.824 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206480.log 2024-05-17T11:54:26.825 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193235.log 2024-05-17T11:54:26.825 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265651.log 2024-05-17T11:54:26.826 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175517.log 2024-05-17T11:54:26.827 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47434.log 2024-05-17T11:54:26.827 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194554.log 2024-05-17T11:54:26.828 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574471.log 2024-05-17T11:54:26.828 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414646.log 2024-05-17T11:54:26.828 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211235.log 2024-05-17T11:54:26.829 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115139.log 2024-05-17T11:54:26.829 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499710.log 2024-05-17T11:54:26.830 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44836.log 2024-05-17T11:54:26.830 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49241.log 2024-05-17T11:54:26.831 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441743.log 2024-05-17T11:54:26.831 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45169.log 2024-05-17T11:54:26.832 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248785.log 2024-05-17T11:54:26.832 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437499.log 2024-05-17T11:54:26.833 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255707.log 2024-05-17T11:54:26.834 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215135.log 2024-05-17T11:54:26.834 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532476.log 2024-05-17T11:54:26.835 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110820.log 2024-05-17T11:54:26.836 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42862.log 2024-05-17T11:54:26.836 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227379.log 2024-05-17T11:54:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109313.log 2024-05-17T11:54:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225964.log 2024-05-17T11:54:26.838 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235974.log 2024-05-17T11:54:26.839 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418852.log 2024-05-17T11:54:26.839 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243803.log 2024-05-17T11:54:26.840 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49536.log 2024-05-17T11:54:26.841 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460277.log 2024-05-17T11:54:26.841 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495416.log 2024-05-17T11:54:26.842 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109823.log 2024-05-17T11:54:26.842 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45162.log 2024-05-17T11:54:26.843 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481856.log 2024-05-17T11:54:26.843 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548966.log 2024-05-17T11:54:26.844 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156140.log 2024-05-17T11:54:26.845 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503251.log 2024-05-17T11:54:26.845 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453622.log 2024-05-17T11:54:26.846 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219594.log 2024-05-17T11:54:26.847 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195006.log 2024-05-17T11:54:26.847 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361125.log 2024-05-17T11:54:26.848 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-17T11:54:26.848 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232069.log 2024-05-17T11:54:26.849 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418229.log 2024-05-17T11:54:26.850 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208603.log 2024-05-17T11:54:26.850 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413799.log 2024-05-17T11:54:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390361.log 2024-05-17T11:54:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149841.log 2024-05-17T11:54:26.852 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364236.log 2024-05-17T11:54:26.853 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494790.log 2024-05-17T11:54:26.853 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189457.log 2024-05-17T11:54:26.854 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49195.log 2024-05-17T11:54:26.854 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578205.log 2024-05-17T11:54:26.855 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459854.log 2024-05-17T11:54:26.856 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351755.log 2024-05-17T11:54:26.856 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246437.log 2024-05-17T11:54:26.857 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419698.log 2024-05-17T11:54:26.858 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548516.log 2024-05-17T11:54:26.859 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496263.log 2024-05-17T11:54:26.859 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507601.log 2024-05-17T11:54:26.860 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556595.log 2024-05-17T11:54:26.860 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141167.log 2024-05-17T11:54:26.860 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426091.log 2024-05-17T11:54:26.861 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457921.log 2024-05-17T11:54:26.862 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178957.log 2024-05-17T11:54:26.863 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197718.log 2024-05-17T11:54:26.863 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404217.log 2024-05-17T11:54:26.863 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227793.log 2024-05-17T11:54:26.864 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377559.log 2024-05-17T11:54:26.865 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491002.log 2024-05-17T11:54:26.865 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564593.log 2024-05-17T11:54:26.866 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423562.log 2024-05-17T11:54:26.866 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221286.log 2024-05-17T11:54:26.867 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552168.log 2024-05-17T11:54:26.868 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210774.log 2024-05-17T11:54:26.868 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367323.log 2024-05-17T11:54:26.869 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191423.log 2024-05-17T11:54:26.870 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127300.log 2024-05-17T11:54:26.870 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111257.log 2024-05-17T11:54:26.871 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398789.log 2024-05-17T11:54:26.871 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416846.log 2024-05-17T11:54:26.872 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215981.log 2024-05-17T11:54:26.873 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235518.log 2024-05-17T11:54:26.873 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126019.log 2024-05-17T11:54:26.874 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577454.log 2024-05-17T11:54:26.875 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567695.log 2024-05-17T11:54:26.875 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130768.log 2024-05-17T11:54:26.875 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260566.log 2024-05-17T11:54:26.876 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45915.log 2024-05-17T11:54:26.877 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199092.log 2024-05-17T11:54:26.877 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121328.log 2024-05-17T11:54:26.878 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237731.log 2024-05-17T11:54:26.879 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137616.log 2024-05-17T11:54:26.880 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180835.log 2024-05-17T11:54:26.880 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434427.log 2024-05-17T11:54:26.880 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437036.log 2024-05-17T11:54:26.881 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357718.log 2024-05-17T11:54:26.882 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45165.log 2024-05-17T11:54:26.882 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438772.log 2024-05-17T11:54:26.883 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-17T11:54:26.883 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235983.log 2024-05-17T11:54:26.884 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225475.log 2024-05-17T11:54:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-17T11:54:26.885 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427426.log 2024-05-17T11:54:26.886 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399276.log 2024-05-17T11:54:26.886 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441307.log 2024-05-17T11:54:26.887 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497176.log 2024-05-17T11:54:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199544.log 2024-05-17T11:54:26.888 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198170.log 2024-05-17T11:54:26.889 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571737.log 2024-05-17T11:54:26.889 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49452.log 2024-05-17T11:54:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195467.log 2024-05-17T11:54:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121337.log 2024-05-17T11:54:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513840.log 2024-05-17T11:54:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379274.log 2024-05-17T11:54:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459004.log 2024-05-17T11:54:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425586.log 2024-05-17T11:54:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574024.log 2024-05-17T11:54:26.894 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135862.log 2024-05-17T11:54:26.895 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475258.log 2024-05-17T11:54:26.895 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552584.log 2024-05-17T11:54:26.896 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269129.log 2024-05-17T11:54:26.896 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440033.log 2024-05-17T11:54:26.897 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389929.log 2024-05-17T11:54:26.897 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147664.log 2024-05-17T11:54:26.898 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454891.log 2024-05-17T11:54:26.899 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457049.log 2024-05-17T11:54:26.899 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476147.log 2024-05-17T11:54:26.900 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123002.log 2024-05-17T11:54:26.901 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177228.log 2024-05-17T11:54:26.901 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487690.log 2024-05-17T11:54:26.902 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362000.log 2024-05-17T11:54:26.902 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571294.log 2024-05-17T11:54:26.903 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576853.log 2024-05-17T11:54:26.904 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178504.log 2024-05-17T11:54:26.904 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387687.log 2024-05-17T11:54:26.905 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250597.log 2024-05-17T11:54:26.905 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44833.log 2024-05-17T11:54:26.906 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158912.log 2024-05-17T11:54:26.907 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42992.log 2024-05-17T11:54:26.907 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532485.log 2024-05-17T11:54:26.907 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476138.log 2024-05-17T11:54:26.908 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377991.log 2024-05-17T11:54:26.909 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47476.log 2024-05-17T11:54:26.910 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178082.log 2024-05-17T11:54:26.910 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49283.log 2024-05-17T11:54:26.911 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267405.log 2024-05-17T11:54:26.911 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376712.log 2024-05-17T11:54:26.912 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147239.log 2024-05-17T11:54:26.912 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-17T11:54:26.913 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501028.log 2024-05-17T11:54:26.914 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468596.log 2024-05-17T11:54:26.914 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549902.log 2024-05-17T11:54:26.915 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558369.log 2024-05-17T11:54:26.915 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455319.log 2024-05-17T11:54:26.916 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420567.log 2024-05-17T11:54:26.917 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507176.log 2024-05-17T11:54:26.917 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442608.log 2024-05-17T11:54:26.918 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394691.log 2024-05-17T11:54:26.924 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414227.log 2024-05-17T11:54:26.925 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143338.log 2024-05-17T11:54:26.925 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152956.log 2024-05-17T11:54:26.925 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370278.log 2024-05-17T11:54:26.925 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469028.log 2024-05-17T11:54:26.925 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395651.log 2024-05-17T11:54:26.925 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492859.log 2024-05-17T11:54:26.926 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449055.log 2024-05-17T11:54:26.926 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247064.log 2024-05-17T11:54:26.926 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232545.log 2024-05-17T11:54:26.928 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126450.log 2024-05-17T11:54:26.928 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547173.log 2024-05-17T11:54:26.928 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482280.log 2024-05-17T11:54:26.928 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134587.log 2024-05-17T11:54:26.928 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433118.log 2024-05-17T11:54:26.928 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429186.log 2024-05-17T11:54:26.928 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231224.log 2024-05-17T11:54:26.929 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229520.log 2024-05-17T11:54:26.930 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392933.log 2024-05-17T11:54:26.930 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47350.log 2024-05-17T11:54:26.931 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48474.log 2024-05-17T11:54:26.931 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137607.log 2024-05-17T11:54:26.931 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186748.log 2024-05-17T11:54:26.932 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236849.log 2024-05-17T11:54:26.933 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176791.log 2024-05-17T11:54:26.933 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449469.log 2024-05-17T11:54:26.934 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206057.log 2024-05-17T11:54:26.935 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350913.log 2024-05-17T11:54:26.935 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489692.log 2024-05-17T11:54:26.936 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485339.log 2024-05-17T11:54:26.937 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213867.log 2024-05-17T11:54:26.938 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48972.log 2024-05-17T11:54:26.938 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506319.log 2024-05-17T11:54:26.939 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227370.log 2024-05-17T11:54:26.940 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108887.log 2024-05-17T11:54:26.941 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430670.log 2024-05-17T11:54:26.941 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393347.log 2024-05-17T11:54:26.942 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44837.log 2024-05-17T11:54:26.943 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514263.log 2024-05-17T11:54:26.943 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515534.log 2024-05-17T11:54:26.944 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508898.log 2024-05-17T11:54:26.945 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48180.log 2024-05-17T11:54:26.945 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157110.log 2024-05-17T11:54:26.946 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357304.log 2024-05-17T11:54:26.947 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494799.log 2024-05-17T11:54:26.947 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513176.log 2024-05-17T11:54:26.948 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220017.log 2024-05-17T11:54:26.949 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245510.log 2024-05-17T11:54:26.949 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207319.log 2024-05-17T11:54:26.950 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557505.log 2024-05-17T11:54:26.951 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225022.log 2024-05-17T11:54:26.951 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200901.log 2024-05-17T11:54:26.952 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49325.log 2024-05-17T11:54:26.953 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383106.log 2024-05-17T11:54:26.953 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212134.log 2024-05-17T11:54:26.954 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197727.log 2024-05-17T11:54:26.954 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128217.log 2024-05-17T11:54:26.955 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433127.log 2024-05-17T11:54:26.955 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159210.log 2024-05-17T11:54:26.956 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437917.log 2024-05-17T11:54:26.957 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456627.log 2024-05-17T11:54:26.957 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413303.log 2024-05-17T11:54:26.958 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433546.log 2024-05-17T11:54:26.959 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494215.log 2024-05-17T11:54:26.959 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422708.log 2024-05-17T11:54:26.960 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251016.log 2024-05-17T11:54:26.961 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355596.log 2024-05-17T11:54:26.962 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268253.log 2024-05-17T11:54:26.962 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369434.log 2024-05-17T11:54:26.963 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47392.log 2024-05-17T11:54:26.963 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393770.log 2024-05-17T11:54:26.964 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43306.log 2024-05-17T11:54:26.965 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192774.log 2024-05-17T11:54:26.965 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251453.log 2024-05-17T11:54:26.966 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537479.log 2024-05-17T11:54:26.967 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472036.log 2024-05-17T11:54:26.967 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474364.log 2024-05-17T11:54:26.968 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124750.log 2024-05-17T11:54:26.969 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278663.log 2024-05-17T11:54:26.969 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210322.log 2024-05-17T11:54:26.970 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473014.log 2024-05-17T11:54:26.971 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112153.log 2024-05-17T11:54:26.971 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433999.log 2024-05-17T11:54:26.972 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386849.log 2024-05-17T11:54:26.973 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207744.log 2024-05-17T11:54:26.973 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116455.log 2024-05-17T11:54:26.974 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510651.log 2024-05-17T11:54:26.974 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218699.log 2024-05-17T11:54:26.975 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373250.log 2024-05-17T11:54:26.976 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541714.log 2024-05-17T11:54:26.976 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262249.log 2024-05-17T11:54:26.977 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390792.log 2024-05-17T11:54:26.978 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543830.log 2024-05-17T11:54:26.978 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359846.log 2024-05-17T11:54:26.979 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45873.log 2024-05-17T11:54:26.980 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363400.log 2024-05-17T11:54:26.981 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181723.log 2024-05-17T11:54:26.981 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268677.log 2024-05-17T11:54:26.981 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226946.log 2024-05-17T11:54:26.982 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382683.log 2024-05-17T11:54:26.983 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578894.log 2024-05-17T11:54:26.983 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46640.log 2024-05-17T11:54:26.984 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189003.log 2024-05-17T11:54:26.985 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401311.log 2024-05-17T11:54:26.985 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565920.log 2024-05-17T11:54:26.986 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477849.log 2024-05-17T11:54:26.987 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265219.log 2024-05-17T11:54:26.987 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174675.log 2024-05-17T11:54:26.988 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237722.log 2024-05-17T11:54:26.988 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573531.log 2024-05-17T11:54:26.989 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472027.log 2024-05-17T11:54:26.989 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495839.log 2024-05-17T11:54:26.990 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223064.log 2024-05-17T11:54:26.991 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468133.log 2024-05-17T11:54:26.991 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415999.log 2024-05-17T11:54:26.992 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367332.log 2024-05-17T11:54:26.992 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443029.log 2024-05-17T11:54:26.993 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200448.log 2024-05-17T11:54:26.993 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260557.log 2024-05-17T11:54:26.994 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551307.log 2024-05-17T11:54:26.995 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542137.log 2024-05-17T11:54:26.995 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129918.log 2024-05-17T11:54:26.996 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110319.log 2024-05-17T11:54:26.996 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206471.log 2024-05-17T11:54:26.997 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545162.log 2024-05-17T11:54:26.998 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535773.log 2024-05-17T11:54:26.998 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264789.log 2024-05-17T11:54:26.999 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396998.log 2024-05-17T11:54:26.999 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116879.log 2024-05-17T11:54:27.000 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224123.log 2024-05-17T11:54:27.001 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536621.log 2024-05-17T11:54:27.001 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196362.log 2024-05-17T11:54:27.002 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379692.log 2024-05-17T11:54:27.002 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108464.log 2024-05-17T11:54:27.003 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186757.log 2024-05-17T11:54:27.003 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208169.log 2024-05-17T11:54:27.004 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274618.log 2024-05-17T11:54:27.004 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563703.log 2024-05-17T11:54:27.005 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534505.log 2024-05-17T11:54:27.005 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515959.log 2024-05-17T11:54:27.006 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430029.log 2024-05-17T11:54:27.007 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481415.log 2024-05-17T11:54:27.007 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109322.log 2024-05-17T11:54:27.008 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48096.log 2024-05-17T11:54:27.009 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538740.log 2024-05-17T11:54:27.009 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577370.log 2024-05-17T11:54:27.010 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47845.log 2024-05-17T11:54:27.011 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129927.log 2024-05-17T11:54:27.011 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179414.log 2024-05-17T11:54:27.012 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446056.log 2024-05-17T11:54:27.013 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277386.log 2024-05-17T11:54:27.013 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578078.log 2024-05-17T11:54:27.014 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244664.log 2024-05-17T11:54:27.014 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412873.log 2024-05-17T11:54:27.015 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236858.log 2024-05-17T11:54:27.015 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263941.log 2024-05-17T11:54:27.016 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189881.log 2024-05-17T11:54:27.017 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233819.log 2024-05-17T11:54:27.017 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553027.log 2024-05-17T11:54:27.018 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202664.log 2024-05-17T11:54:27.018 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125596.log 2024-05-17T11:54:27.019 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378414.log 2024-05-17T11:54:27.020 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44403.log 2024-05-17T11:54:27.020 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435334.log 2024-05-17T11:54:27.021 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478264.log 2024-05-17T11:54:27.022 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372814.log 2024-05-17T11:54:27.022 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237285.log 2024-05-17T11:54:27.023 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414218.log 2024-05-17T11:54:27.023 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496687.log 2024-05-17T11:54:27.024 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249217.log 2024-05-17T11:54:27.025 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350904.log 2024-05-17T11:54:27.025 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111681.log 2024-05-17T11:54:27.026 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175094.log 2024-05-17T11:54:27.026 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485774.log 2024-05-17T11:54:27.027 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232078.log 2024-05-17T11:54:27.028 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44835.log 2024-05-17T11:54:27.028 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432690.log 2024-05-17T11:54:27.029 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116032.log 2024-05-17T11:54:27.029 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424031.log 2024-05-17T11:54:27.030 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225955.log 2024-05-17T11:54:27.031 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196371.log 2024-05-17T11:54:27.031 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223652.log 2024-05-17T11:54:27.032 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-17T11:54:27.032 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441316.log 2024-05-17T11:54:27.033 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196823.log 2024-05-17T11:54:27.033 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469451.log 2024-05-17T11:54:27.034 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361562.log 2024-05-17T11:54:27.035 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45505.log 2024-05-17T11:54:27.035 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388590.log 2024-05-17T11:54:27.036 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543407.log 2024-05-17T11:54:27.037 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47308.log 2024-05-17T11:54:27.038 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224568.log 2024-05-17T11:54:27.038 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549436.log 2024-05-17T11:54:27.038 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190544.log 2024-05-17T11:54:27.039 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229943.log 2024-05-17T11:54:27.040 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458339.log 2024-05-17T11:54:27.040 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245501.log 2024-05-17T11:54:27.041 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546314.log 2024-05-17T11:54:27.041 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567258.log 2024-05-17T11:54:27.042 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399799.log 2024-05-17T11:54:27.043 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221295.log 2024-05-17T11:54:27.044 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155721.log 2024-05-17T11:54:27.044 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201362.log 2024-05-17T11:54:27.045 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400306.log 2024-05-17T11:54:27.045 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186237.log 2024-05-17T11:54:27.046 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501975.log 2024-05-17T11:54:27.046 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200457.log 2024-05-17T11:54:27.047 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473945.log 2024-05-17T11:54:27.047 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496678.log 2024-05-17T11:54:27.048 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449478.log 2024-05-17T11:54:27.049 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440466.log 2024-05-17T11:54:27.049 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578793.log 2024-05-17T11:54:27.050 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503693.log 2024-05-17T11:54:27.050 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132470.log 2024-05-17T11:54:27.051 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124309.log 2024-05-17T11:54:27.052 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568177.log 2024-05-17T11:54:27.052 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570860.log 2024-05-17T11:54:27.052 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429615.log 2024-05-17T11:54:27.053 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232554.log 2024-05-17T11:54:27.053 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277377.log 2024-05-17T11:54:27.054 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123886.log 2024-05-17T11:54:27.054 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182590.log 2024-05-17T11:54:27.055 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446469.log 2024-05-17T11:54:27.056 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250588.log 2024-05-17T11:54:27.056 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239995.log 2024-05-17T11:54:27.057 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214289.log 2024-05-17T11:54:27.057 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217862.log 2024-05-17T11:54:27.058 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401804.log 2024-05-17T11:54:27.059 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426990.log 2024-05-17T11:54:27.059 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183503.log 2024-05-17T11:54:27.060 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359424.log 2024-05-17T11:54:27.060 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498016.log 2024-05-17T11:54:27.061 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524492.log 2024-05-17T11:54:27.062 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277810.log 2024-05-17T11:54:27.062 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202237.log 2024-05-17T11:54:27.063 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256135.log 2024-05-17T11:54:27.063 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199996.log 2024-05-17T11:54:27.064 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133308.log 2024-05-17T11:54:27.065 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522920.log 2024-05-17T11:54:27.065 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386002.log 2024-05-17T11:54:27.066 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229064.log 2024-05-17T11:54:27.066 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514272.log 2024-05-17T11:54:27.067 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266065.log 2024-05-17T11:54:27.068 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211687.log 2024-05-17T11:54:27.068 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256126.log 2024-05-17T11:54:27.069 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548084.log 2024-05-17T11:54:27.069 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191879.log 2024-05-17T11:54:27.070 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193226.log 2024-05-17T11:54:27.070 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391655.log 2024-05-17T11:54:27.071 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571746.log 2024-05-17T11:54:27.071 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44834.log 2024-05-17T11:54:27.072 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542974.log 2024-05-17T11:54:27.072 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416855.log 2024-05-17T11:54:27.072 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45831.log 2024-05-17T11:54:27.073 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541281.log 2024-05-17T11:54:27.074 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387264.log 2024-05-17T11:54:27.074 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550840.log 2024-05-17T11:54:27.075 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508469.log 2024-05-17T11:54:27.075 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209018.log 2024-05-17T11:54:27.075 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368590.log 2024-05-17T11:54:27.076 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175940.log 2024-05-17T11:54:27.076 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544274.log 2024-05-17T11:54:27.077 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472525.log 2024-05-17T11:54:27.078 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133317.log 2024-05-17T11:54:27.079 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536207.log 2024-05-17T11:54:27.079 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498873.log 2024-05-17T11:54:27.080 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475722.log 2024-05-17T11:54:27.080 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545877.log 2024-05-17T11:54:27.081 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375007.log 2024-05-17T11:54:27.081 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391646.log 2024-05-17T11:54:27.082 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197275.log 2024-05-17T11:54:27.082 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256554.log 2024-05-17T11:54:27.083 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183051.log 2024-05-17T11:54:27.083 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357295.log 2024-05-17T11:54:27.084 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260980.log 2024-05-17T11:54:27.084 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364245.log 2024-05-17T11:54:27.085 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499287.log 2024-05-17T11:54:27.085 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209451.log 2024-05-17T11:54:27.085 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498450.log 2024-05-17T11:54:27.086 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267820.log 2024-05-17T11:54:27.087 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116464.log 2024-05-17T11:54:27.087 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500181.log 2024-05-17T11:54:27.088 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129500.log 2024-05-17T11:54:27.088 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382674.log 2024-05-17T11:54:27.089 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572692.log 2024-05-17T11:54:27.089 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510191.log 2024-05-17T11:54:27.089 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546740.log 2024-05-17T11:54:27.090 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401813.log 2024-05-17T11:54:27.090 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43264.log 2024-05-17T11:54:27.091 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215549.log 2024-05-17T11:54:27.092 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356452.log 2024-05-17T11:54:27.092 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252304.log 2024-05-17T11:54:27.092 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114424.log 2024-05-17T11:54:27.092 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515968.log 2024-05-17T11:54:27.093 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365604.log 2024-05-17T11:54:27.093 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182599.log 2024-05-17T11:54:27.094 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445191.log 2024-05-17T11:54:27.094 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235102.log 2024-05-17T11:54:27.095 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562812.log 2024-05-17T11:54:27.095 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48888.log 2024-05-17T11:54:27.096 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218276.log 2024-05-17T11:54:27.096 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266074.log 2024-05-17T11:54:27.097 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539586.log 2024-05-17T11:54:27.098 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238690.log 2024-05-17T11:54:27.098 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432271.log 2024-05-17T11:54:27.099 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446897.log 2024-05-17T11:54:27.100 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430300.log 2024-05-17T11:54:27.101 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206903.log 2024-05-17T11:54:27.101 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562803.log 2024-05-17T11:54:27.102 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449901.log 2024-05-17T11:54:27.103 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249746.log 2024-05-17T11:54:27.103 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538749.log 2024-05-17T11:54:27.104 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402291.log 2024-05-17T11:54:27.105 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206048.log 2024-05-17T11:54:27.105 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243812.log 2024-05-17T11:54:27.106 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427878.log 2024-05-17T11:54:27.106 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274182.log 2024-05-17T11:54:27.107 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554014.log 2024-05-17T11:54:27.107 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127754.log 2024-05-17T11:54:27.108 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529416.log 2024-05-17T11:54:27.108 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157642.log 2024-05-17T11:54:27.109 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551730.log 2024-05-17T11:54:27.109 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264374.log 2024-05-17T11:54:27.110 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139878.log 2024-05-17T11:54:27.111 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148536.log 2024-05-17T11:54:27.111 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387696.log 2024-05-17T11:54:27.112 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421441.log 2024-05-17T11:54:27.112 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576407.log 2024-05-17T11:54:27.113 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222143.log 2024-05-17T11:54:27.113 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126028.log 2024-05-17T11:54:27.114 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511074.log 2024-05-17T11:54:27.114 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558783.log 2024-05-17T11:54:27.115 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570428.log 2024-05-17T11:54:27.116 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557082.log 2024-05-17T11:54:27.116 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556172.log 2024-05-17T11:54:27.117 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222152.log 2024-05-17T11:54:27.117 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210331.log 2024-05-17T11:54:27.118 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578289.log 2024-05-17T11:54:27.118 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204356.log 2024-05-17T11:54:27.119 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253147.log 2024-05-17T11:54:27.119 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540018.log 2024-05-17T11:54:27.120 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378829.log 2024-05-17T11:54:27.121 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547669.log 2024-05-17T11:54:27.121 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113129.log 2024-05-17T11:54:27.122 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370709.log 2024-05-17T11:54:27.122 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44828.log 2024-05-17T11:54:27.123 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470288.log 2024-05-17T11:54:27.123 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360699.log 2024-05-17T11:54:27.124 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436184.log 2024-05-17T11:54:27.124 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201819.log 2024-05-17T11:54:27.125 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498441.log 2024-05-17T11:54:27.126 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443914.log 2024-05-17T11:54:27.126 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126864.log 2024-05-17T11:54:27.127 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459845.log 2024-05-17T11:54:27.127 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45160.log 2024-05-17T11:54:27.128 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248371.log 2024-05-17T11:54:27.128 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542983.log 2024-05-17T11:54:27.129 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444339.log 2024-05-17T11:54:27.130 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374111.log 2024-05-17T11:54:27.130 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419689.log 2024-05-17T11:54:27.131 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121807.log 2024-05-17T11:54:27.131 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362977.log 2024-05-17T11:54:27.132 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491435.log 2024-05-17T11:54:27.132 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183042.log 2024-05-17T11:54:27.133 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378405.log 2024-05-17T11:54:27.133 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578036.log 2024-05-17T11:54:27.134 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513849.log 2024-05-17T11:54:27.134 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422294.log 2024-05-17T11:54:27.135 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438349.log 2024-05-17T11:54:27.136 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45506.log 2024-05-17T11:54:27.136 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112661.log 2024-05-17T11:54:27.137 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111690.log 2024-05-17T11:54:27.137 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240446.log 2024-05-17T11:54:27.138 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383552.log 2024-05-17T11:54:27.138 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546305.log 2024-05-17T11:54:27.139 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235527.log 2024-05-17T11:54:27.139 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519715.log 2024-05-17T11:54:27.140 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376288.log 2024-05-17T11:54:27.141 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149411.log 2024-05-17T11:54:27.141 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554876.log 2024-05-17T11:54:27.142 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473005.log 2024-05-17T11:54:27.142 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116041.log 2024-05-17T11:54:27.143 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356867.log 2024-05-17T11:54:27.143 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44235.log 2024-05-17T11:54:27.144 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524501.log 2024-05-17T11:54:27.144 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578541.log 2024-05-17T11:54:27.145 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501487.log 2024-05-17T11:54:27.146 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507610.log 2024-05-17T11:54:27.146 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224577.log 2024-05-17T11:54:27.147 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578709.log 2024-05-17T11:54:27.147 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152028.log 2024-05-17T11:54:27.148 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239537.log 2024-05-17T11:54:27.148 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138045.log 2024-05-17T11:54:27.149 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216409.log 2024-05-17T11:54:27.150 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224114.log 2024-05-17T11:54:27.150 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424022.log 2024-05-17T11:54:27.151 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129064.log 2024-05-17T11:54:27.151 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457930.log 2024-05-17T11:54:27.152 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120857.log 2024-05-17T11:54:27.152 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49686.log 2024-05-17T11:54:27.153 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501496.log 2024-05-17T11:54:27.154 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491892.log 2024-05-17T11:54:27.154 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107854.log 2024-05-17T11:54:27.155 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205202.log 2024-05-17T11:54:27.155 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577328.log 2024-05-17T11:54:27.156 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213858.log 2024-05-17T11:54:27.156 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175949.log 2024-05-17T11:54:27.157 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139887.log 2024-05-17T11:54:27.158 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442599.log 2024-05-17T11:54:27.158 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479126.log 2024-05-17T11:54:27.159 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362968.log 2024-05-17T11:54:27.159 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136279.log 2024-05-17T11:54:27.160 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372400.log 2024-05-17T11:54:27.160 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215972.log 2024-05-17T11:54:27.161 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187734.log 2024-05-17T11:54:27.162 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541290.log 2024-05-17T11:54:27.162 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244236.log 2024-05-17T11:54:27.163 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185758.log 2024-05-17T11:54:27.163 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477840.log 2024-05-17T11:54:27.164 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443491.log 2024-05-17T11:54:27.164 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47518.log 2024-05-17T11:54:27.165 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435756.log 2024-05-17T11:54:27.165 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48390.log 2024-05-17T11:54:27.166 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578667.log 2024-05-17T11:54:27.166 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384526.log 2024-05-17T11:54:27.167 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572204.log 2024-05-17T11:54:27.168 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562367.log 2024-05-17T11:54:27.168 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438763.log 2024-05-17T11:54:27.169 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361553.log 2024-05-17T11:54:27.169 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447744.log 2024-05-17T11:54:27.170 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142030.log 2024-05-17T11:54:27.170 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129073.log 2024-05-17T11:54:27.171 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238681.log 2024-05-17T11:54:27.172 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356876.log 2024-05-17T11:54:27.172 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507185.log 2024-05-17T11:54:27.173 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114434.log 2024-05-17T11:54:27.173 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182166.log 2024-05-17T11:54:27.174 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236435.log 2024-05-17T11:54:27.174 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44613.log 2024-05-17T11:54:27.175 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506306.log 2024-05-17T11:54:27.175 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353046.log 2024-05-17T11:54:27.176 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275049.log 2024-05-17T11:54:27.177 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251872.log 2024-05-17T11:54:27.177 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540442.log 2024-05-17T11:54:27.178 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45789.log 2024-05-17T11:54:27.178 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198640.log 2024-05-17T11:54:27.179 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440457.log 2024-05-17T11:54:27.179 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158480.log 2024-05-17T11:54:27.180 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553015.log 2024-05-17T11:54:27.181 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366450.log 2024-05-17T11:54:27.181 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239986.log 2024-05-17T11:54:27.182 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225484.log 2024-05-17T11:54:27.182 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275507.log 2024-05-17T11:54:27.183 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373259.log 2024-05-17T11:54:27.183 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437045.log 2024-05-17T11:54:27.184 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202246.log 2024-05-17T11:54:27.184 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565476.log 2024-05-17T11:54:27.185 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537470.log 2024-05-17T11:54:27.186 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439195.log 2024-05-17T11:54:27.186 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48222.log 2024-05-17T11:54:27.187 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123435.log 2024-05-17T11:54:27.187 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45173.log 2024-05-17T11:54:27.188 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508889.log 2024-05-17T11:54:27.189 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398798.log 2024-05-17T11:54:27.189 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513412.log 2024-05-17T11:54:27.190 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239528.log 2024-05-17T11:54:27.191 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574462.log 2024-05-17T11:54:27.191 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366018.log 2024-05-17T11:54:27.192 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48348.log 2024-05-17T11:54:27.192 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259719.log 2024-05-17T11:54:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262681.log 2024-05-17T11:54:27.194 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402769.log 2024-05-17T11:54:27.194 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42820.log 2024-05-17T11:54:27.195 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480939.log 2024-05-17T11:54:27.195 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44445.log 2024-05-17T11:54:27.196 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245087.log 2024-05-17T11:54:27.197 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534919.log 2024-05-17T11:54:27.197 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188571.log 2024-05-17T11:54:27.198 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551298.log 2024-05-17T11:54:27.198 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571285.log 2024-05-17T11:54:27.199 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389014.log 2024-05-17T11:54:27.200 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514686.log 2024-05-17T11:54:27.200 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234243.log 2024-05-17T11:54:27.201 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486695.log 2024-05-17T11:54:27.201 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152019.log 2024-05-17T11:54:27.202 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159910.log 2024-05-17T11:54:27.203 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141603.log 2024-05-17T11:54:27.203 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42642.log 2024-05-17T11:54:27.204 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569560.log 2024-05-17T11:54:27.204 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574033.log 2024-05-17T11:54:27.205 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503260.log 2024-05-17T11:54:27.205 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425577.log 2024-05-17T11:54:27.206 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563257.log 2024-05-17T11:54:27.206 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48516.log 2024-05-17T11:54:27.207 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49014.log 2024-05-17T11:54:27.208 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48930.log 2024-05-17T11:54:27.208 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394213.log 2024-05-17T11:54:27.209 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194111.log 2024-05-17T11:54:27.209 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185767.log 2024-05-17T11:54:27.210 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489091.log 2024-05-17T11:54:27.211 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569569.log 2024-05-17T11:54:27.211 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256982.log 2024-05-17T11:54:27.212 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255698.log 2024-05-17T11:54:27.212 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352187.log 2024-05-17T11:54:27.213 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554442.log 2024-05-17T11:54:27.214 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143791.log 2024-05-17T11:54:27.214 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371545.log 2024-05-17T11:54:27.215 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480948.log 2024-05-17T11:54:27.215 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354326.log 2024-05-17T11:54:27.216 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480102.log 2024-05-17T11:54:27.216 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516834.log 2024-05-17T11:54:27.217 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179425.log 2024-05-17T11:54:27.218 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472516.log 2024-05-17T11:54:27.218 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49410.log 2024-05-17T11:54:27.219 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265228.log 2024-05-17T11:54:27.219 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49056.log 2024-05-17T11:54:27.220 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454046.log 2024-05-17T11:54:27.220 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379701.log 2024-05-17T11:54:27.221 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555736.log 2024-05-17T11:54:27.222 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392078.log 2024-05-17T11:54:27.222 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355163.log 2024-05-17T11:54:27.223 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548975.log 2024-05-17T11:54:27.223 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423141.log 2024-05-17T11:54:27.224 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139415.log 2024-05-17T11:54:27.225 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254432.log 2024-05-17T11:54:27.225 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516381.log 2024-05-17T11:54:27.226 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395173.log 2024-05-17T11:54:27.226 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258266.log 2024-05-17T11:54:27.227 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476566.log 2024-05-17T11:54:27.227 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42948.log 2024-05-17T11:54:27.228 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430348.log 2024-05-17T11:54:27.228 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553789.log 2024-05-17T11:54:27.229 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108455.log 2024-05-17T11:54:27.230 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429177.log 2024-05-17T11:54:27.231 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261403.log 2024-05-17T11:54:27.231 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497593.log 2024-05-17T11:54:27.232 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260989.log 2024-05-17T11:54:27.232 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247948.log 2024-05-17T11:54:27.233 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576844.log 2024-05-17T11:54:27.233 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44277.log 2024-05-17T11:54:27.234 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158489.log 2024-05-17T11:54:27.234 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415103.log 2024-05-17T11:54:27.235 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561009.log 2024-05-17T11:54:27.235 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352622.log 2024-05-17T11:54:27.236 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578457.log 2024-05-17T11:54:27.236 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512929.log 2024-05-17T11:54:27.237 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480093.log 2024-05-17T11:54:27.238 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46127.log 2024-05-17T11:54:27.238 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392924.log 2024-05-17T11:54:27.239 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457462.log 2024-05-17T11:54:27.239 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553524.log 2024-05-17T11:54:27.240 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366906.log 2024-05-17T11:54:27.241 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393779.log 2024-05-17T11:54:27.241 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578625.log 2024-05-17T11:54:27.242 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279081.log 2024-05-17T11:54:27.243 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133731.log 2024-05-17T11:54:27.243 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457471.log 2024-05-17T11:54:27.243 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394204.log 2024-05-17T11:54:27.244 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488179.log 2024-05-17T11:54:27.244 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219180.log 2024-05-17T11:54:27.245 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565030.log 2024-05-17T11:54:27.246 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263527.log 2024-05-17T11:54:27.246 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454468.log 2024-05-17T11:54:27.247 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259196.log 2024-05-17T11:54:27.247 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385018.log 2024-05-17T11:54:27.248 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264798.log 2024-05-17T11:54:27.249 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413312.log 2024-05-17T11:54:27.249 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387273.log 2024-05-17T11:54:27.250 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45388.log 2024-05-17T11:54:27.250 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156654.log 2024-05-17T11:54:27.251 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456190.log 2024-05-17T11:54:27.251 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396090.log 2024-05-17T11:54:27.252 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209027.log 2024-05-17T11:54:27.253 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195015.log 2024-05-17T11:54:27.253 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484015.log 2024-05-17T11:54:27.254 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455747.log 2024-05-17T11:54:27.254 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456199.log 2024-05-17T11:54:27.255 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242469.log 2024-05-17T11:54:27.255 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240437.log 2024-05-17T11:54:27.256 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255274.log 2024-05-17T11:54:27.257 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257847.log 2024-05-17T11:54:27.257 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388581.log 2024-05-17T11:54:27.258 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152497.log 2024-05-17T11:54:27.259 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508460.log 2024-05-17T11:54:27.259 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261835.log 2024-05-17T11:54:27.260 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510182.log 2024-05-17T11:54:27.260 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142454.log 2024-05-17T11:54:27.261 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49946.log 2024-05-17T11:54:27.261 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578854.log 2024-05-17T11:54:27.262 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550373.log 2024-05-17T11:54:27.262 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397431.log 2024-05-17T11:54:27.263 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421855.log 2024-05-17T11:54:27.264 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559661.log 2024-05-17T11:54:27.267 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243384.log/var/log/ceph/ceph-client.admin.498864.log: 2024-05-17T11:54:27.270 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396081.log 2024-05-17T11:54:27.270 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138980.log 2024-05-17T11:54:27.270 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476575.log 2024-05-17T11:54:27.271 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385514.log 2024-05-17T11:54:27.271 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426514.log 2024-05-17T11:54:27.271 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354317.log 2024-05-17T11:54:27.273 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205634.log 2024-05-17T11:54:27.273 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570869.log 2024-05-17T11:54:27.275 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188580.log 2024-05-17T11:54:27.277 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468124.log 2024-05-17T11:54:27.277 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480525.log 2024-05-17T11:54:27.278 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266488.log 2024-05-17T11:54:27.281 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417308.log 2024-05-17T11:54:27.282 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184383.log 2024-05-17T11:54:27.284 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558360.log 2024-05-17T11:54:27.286 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220872.log 2024-05-17T11:54:27.287 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428302.log 2024-05-17T11:54:27.288 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108878.log 2024-05-17T11:54:27.289 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477426.log 2024-05-17T11:54:27.289 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453613.log 2024-05-17T11:54:27.290 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205211.log 2024-05-17T11:54:27.291 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274191.log 2024-05-17T11:54:27.291 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254846.log 2024-05-17T11:54:27.292 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231233.log 2024-05-17T11:54:27.292 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458576.log 2024-05-17T11:54:27.293 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437926.log 2024-05-17T11:54:27.293 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117303.log 2024-05-17T11:54:27.294 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415094.log 2024-05-17T11:54:27.295 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577994.log 2024-05-17T11:54:27.295 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557073.log 2024-05-17T11:54:27.296 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445628.log 2024-05-17T11:54:27.297 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440894.log 2024-05-17T11:54:27.297 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487699.log 2024-05-17T11:54:27.298 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375431.log 2024-05-17T11:54:27.299 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123877.log 2024-05-17T11:54:27.299 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157633.log 2024-05-17T11:54:27.300 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107845.log 2024-05-17T11:54:27.300 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44829.log 2024-05-17T11:54:27.301 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212558.log 2024-05-17T11:54:27.301 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447753.log 2024-05-17T11:54:27.302 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220449.log 2024-05-17T11:54:27.303 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538317.log 2024-05-17T11:54:27.304 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226489.log 2024-05-17T11:54:27.304 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568633.log 2024-05-17T11:54:27.305 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354740.log 2024-05-17T11:54:27.305 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554451.log 2024-05-17T11:54:27.306 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458218.log 2024-05-17T11:54:27.306 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44571.log 2024-05-17T11:54:27.307 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576398.log 2024-05-17T11:54:27.308 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124759.log 2024-05-17T11:54:27.309 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512470.log 2024-05-17T11:54:27.309 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49620.log 2024-05-17T11:54:27.310 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505878.log 2024-05-17T11:54:27.311 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45389.log 2024-05-17T11:54:27.312 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200005.log 2024-05-17T11:54:27.312 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459423.log 2024-05-17T11:54:27.313 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386840.log 2024-05-17T11:54:27.313 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509735.log 2024-05-17T11:54:27.314 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279517.log 2024-05-17T11:54:27.315 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505887.log 2024-05-17T11:54:27.316 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128641.log 2024-05-17T11:54:27.316 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268668.log 2024-05-17T11:54:27.317 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415539.log 2024-05-17T11:54:27.318 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475267.log 2024-05-17T11:54:27.319 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44100.log 2024-05-17T11:54:27.319 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504541.log 2024-05-17T11:54:27.320 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127291.log 2024-05-17T11:54:27.321 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137136.log 2024-05-17T11:54:27.322 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559238.log 2024-05-17T11:54:27.322 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556163.log 2024-05-17T11:54:27.323 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209870.log 2024-05-17T11:54:27.323 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275999.log 2024-05-17T11:54:27.323 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202673.log 2024-05-17T11:54:27.324 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502821.log 2024-05-17T11:54:27.325 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353898.log 2024-05-17T11:54:27.325 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209442.log 2024-05-17T11:54:27.326 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506753.log 2024-05-17T11:54:27.327 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122561.log 2024-05-17T11:54:27.328 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491426.log 2024-05-17T11:54:27.328 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126441.log 2024-05-17T11:54:27.329 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148527.log 2024-05-17T11:54:27.330 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513185.log 2024-05-17T11:54:27.330 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207328.log 2024-05-17T11:54:27.331 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45508.log 2024-05-17T11:54:27.332 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372391.log 2024-05-17T11:54:27.332 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488677.log 2024-05-17T11:54:27.333 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115562.log 2024-05-17T11:54:27.334 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419276.log 2024-05-17T11:54:27.335 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133740.log 2024-05-17T11:54:27.336 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539172.log 2024-05-17T11:54:27.336 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446906.log 2024-05-17T11:54:27.337 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490571.log 2024-05-17T11:54:27.338 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499719.log 2024-05-17T11:54:27.339 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448632.log 2024-05-17T11:54:27.340 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237294.log 2024-05-17T11:54:27.341 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504971.log 2024-05-17T11:54:27.405 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.134587.log: /var/log/ceph/ceph-client.admin.481406.log: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.502398.log.gz 90.2% 2024-05-17T11:54:27.405 INFO:teuthology.orchestra.run.smithi131.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.203942.log.gz 2024-05-17T11:54:27.405 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.142021.log.gz 2024-05-17T11:54:27.405 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.238267.log.gz 2024-05-17T11:54:27.405 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.420995.log.gz 2024-05-17T11:54:27.405 INFO:teuthology.orchestra.run.smithi131.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.364748.log.gz 2024-05-17T11:54:27.406 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.421432.log.gz 2024-05-17T11:54:27.414 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% 84.3% 86.7% -- replaced with /var/log/ceph/ceph-client.admin.362511.log.gz 2024-05-17T11:54:27.414 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.181262.log.gz 2024-05-17T11:54:27.415 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.213436.log.gz -- replaced with /var/log/ceph/ceph-client.admin.278654.log.gz 77.6% -- replaced with /var/log/ceph/ceph-client.admin.436607.log.gz 2024-05-17T11:54:27.415 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.415 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.352196.log.gz 2024-05-17T11:54:27.415 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.415 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.211678.log.gz 2024-05-17T11:54:27.415 INFO:teuthology.orchestra.run.smithi131.stderr: 77.6% 85.2% -- replaced with /var/log/ceph/ceph-client.admin.418843.log.gz -- replaced with /var/log/ceph/ceph-client.admin.420986.log.gz 2024-05-17T11:54:27.415 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.415 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.552159.log.gz 2024-05-17T11:54:27.416 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.220863.log.gz 2024-05-17T11:54:27.416 INFO:teuthology.orchestra.run.smithi131.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.479663.log.gz 2024-05-17T11:54:27.416 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.115130.log.gz 2024-05-17T11:54:27.416 INFO:teuthology.orchestra.run.smithi131.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.130345.log.gz 2024-05-17T11:54:27.416 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.375016.log.gz 2024-05-17T11:54:27.416 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% 81.0% -- replaced with /var/log/ceph/ceph-client.admin.187725.log.gz 2024-05-17T11:54:27.416 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.420112.log.gz 2024-05-17T11:54:27.417 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.492372.log.gz 81.5% 2024-05-17T11:54:27.417 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.220440.log.gz 2024-05-17T11:54:27.417 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% 90.5% -- replaced with /var/log/ceph/ceph-client.admin.353474.log.gz 2024-05-17T11:54:27.417 INFO:teuthology.orchestra.run.smithi131.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.358568.log.gz 2024-05-17T11:54:27.417 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.573105.log.gz 2024-05-17T11:54:27.417 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.509311.log.gz 90.1% -- replaced with /var/log/ceph/ceph-client.admin.130354.log.gz 2024-05-17T11:54:27.417 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2%/var/log/ceph/ceph-client.admin.569995.log: -- replaced with /var/log/ceph/ceph-client.admin.207753.log.gz 2024-05-17T11:54:27.418 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.418 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.508040.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.540867.log.gz 2024-05-17T11:54:27.418 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.351764.log.gz 2024-05-17T11:54:27.418 INFO:teuthology.orchestra.run.smithi131.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.417299.log.gz 2024-05-17T11:54:27.418 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.537047.log.gz 2024-05-17T11:54:27.418 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.400812.log.gz 2024-05-17T11:54:27.418 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.554023.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.257838.log.gz 2024-05-17T11:54:27.418 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.509320.log.gz 2024-05-17T11:54:27.419 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.247939.log.gz 2024-05-17T11:54:27.419 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.436193.log.gz 2024-05-17T11:54:27.419 INFO:teuthology.orchestra.run.smithi131.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.385505.log.gz 84.1% -- replaced with /var/log/ceph/ceph-client.admin.438340.log.gz 2024-05-17T11:54:27.419 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.471601.log.gz 2024-05-17T11:54:27.419 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.147248.log.gz 2024-05-17T11:54:27.419 INFO:teuthology.orchestra.run.smithi131.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.248362.log.gz 2024-05-17T11:54:27.419 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.125182.log.gz 2024-05-17T11:54:27.419 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.419 INFO:teuthology.orchestra.run.smithi131.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.377982.log.gz 2024-05-17T11:54:27.420 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.204365.log.gz 2024-05-17T11:54:27.420 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43180.log.gz 2024-05-17T11:54:27.420 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-17T11:54:27.420 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.562358.log.gz 2024-05-17T11:54:27.420 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.517263.log: 88.3% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.383561.log.gz 2024-05-17T11:54:27.420 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42738.log.gz 2024-05-17T11:54:27.420 INFO:teuthology.orchestra.run.smithi131.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.398351.log.gz/var/log/ceph/ceph-client.admin.484438.log: 2024-05-17T11:54:27.420 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.578751.log: /var/log/ceph/ceph-client.admin.559670.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.384535.log.gz 2024-05-17T11:54:27.421 INFO:teuthology.orchestra.run.smithi131.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.43926.log.gz 2024-05-17T11:54:27.421 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.486686.log: /var/log/ceph/ceph-client.admin.566812.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.175526.log.gz 2024-05-17T11:54:27.421 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112144.log 2024-05-17T11:54:27.421 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.572195.log: /var/log/ceph/ceph-client.admin.504971.log: /var/log/ceph/ceph-client.admin.497602.log: /var/log/ceph/ceph-client.admin.545153.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.578751.log.gz 2024-05-17T11:54:27.421 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.494206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560117.log 2024-05-17T11:54:27.421 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.489100.log: /var/log/ceph/ceph-client.admin.475713.log: /var/log/ceph/ceph-client.admin.237294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359005.log 2024-05-17T11:54:27.421 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.539163.log: /var/log/ceph/ceph-client.admin.560117.log: /var/log/ceph/ceph-client.admin.495830.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.538326.log: /var/log/ceph/ceph-client.admin.128650.log 2024-05-17T11:54:27.421 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.500190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47656.log 2024-05-17T11:54:27.550 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.506762.log: /var/log/ceph/ceph-client.admin.430445.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.212567.log.gz 2024-05-17T11:54:27.550 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.128650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442171.log 2024-05-17T11:54:27.550 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.561455.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.498864.log.gz 2024-05-17T11:54:27.550 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.487210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140301.log 2024-05-17T11:54:27.551 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47656.log: /var/log/ceph/ceph-client.admin.480516.log: /var/log/ceph/ceph-client.admin.482271.log: /var/log/ceph/ceph-client.admin.442171.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.470711.log.gz 2024-05-17T11:54:27.551 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.558792.log: /var/log/ceph/ceph-client.admin.493780.log: /var/log/ceph/ceph-client.admin.534097.log: gzip -5/var/log/ceph/ceph-client.admin.536198.log: --verbose -- /var/log/ceph/ceph-client.admin.151547.log 2024-05-17T11:54:27.551 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.511065.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.502830.log.gz 2024-05-17T11:54:27.551 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.548093.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.500613.log.gz 2024-05-17T11:54:27.551 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.544719.log: /var/log/ceph/ceph-client.admin.578331.log: /var/log/ceph/ceph-client.admin.140301.log: /var/log/ceph/ceph-osd.3.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542560.log 2024-05-17T11:54:27.551 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.578331.log.gz 2024-05-17T11:54:27.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.542128.log: /var/log/ceph/ceph-client.admin.478696.log: /var/log/ceph/ceph-client.admin.151547.log: /var/log/ceph/ceph-client.admin.572683.log: /var/log/ceph/ceph-client.admin.527776.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.488668.log.gz 2024-05-17T11:54:27.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.482746.log: /var/log/ceph/ceph-client.admin.473521.log: /var/log/ceph/ceph-client.admin.578583.log: /var/log/ceph/ceph-client.admin.529425.log: /var/log/ceph/ceph-client.admin.498025.log: /var/log/ceph/ceph-client.admin.530935.log: /var/log/ceph/ceph-client.admin.554885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567249.log 2024-05-17T11:54:27.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.471156.log: /var/log/ceph/ceph-client.admin.566803.log: /var/log/ceph/ceph-client.admin.577412.log: /var/log/ceph/ceph-client.admin.574471.log: /var/log/ceph/ceph-client.admin.499710.log: /var/log/ceph/ceph-client.admin.532476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247516.log 2024-05-17T11:54:27.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.495416.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.578583.log.gz 2024-05-17T11:54:27.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.481856.log: /var/log/ceph/ceph-client.admin.542560.log: /var/log/ceph/ceph-client.admin.567249.log: gzip/var/log/ceph/ceph-client.admin.548966.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.448623.log 2024-05-17T11:54:27.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.503251.log: /var/log/ceph/ceph-mds.c.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.577412.log.gz/var/log/ceph/ceph-client.admin.494790.log: 2024-05-17T11:54:27.553 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.578205.log: /var/log/ceph/ceph-client.admin.548516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254008.log 2024-05-17T11:54:27.553 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.496263.log: /var/log/ceph/ceph-client.admin.507601.log: /var/log/ceph/ceph-client.admin.491002.log: /var/log/ceph/ceph-client.admin.556595.log: /var/log/ceph/ceph-client.admin.552168.log: /var/log/ceph/ceph-client.admin.564593.log: /var/log/ceph/ceph-client.admin.577454.log: /var/log/ceph/ceph-client.admin.567695.log: /var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-mgr.y.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.577454.log.gz 2024-05-17T11:54:27.553 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.497176.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.578205.log.gz 2024-05-17T11:54:27.553 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.571737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44832.log 2024-05-17T11:54:27.553 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.513840.log: /var/log/ceph/ceph-client.admin.574024.log: /var/log/ceph/ceph-client.admin.475258.log: /var/log/ceph/ceph-client.admin.552584.log: /var/log/ceph/ceph-client.admin.476147.log: /var/log/ceph/ceph-client.admin.487690.log: /var/log/ceph/ceph-client.admin.571294.log: /var/log/ceph/ceph-client.admin.576853.log: /var/log/ceph/ceph-client.admin.532485.log: gzip/var/log/ceph/ceph-client.admin.476138.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.544710.log 2024-05-17T11:54:27.553 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.501028.log: /var/log/ceph/ceph-client.admin.254008.log: /var/log/ceph/ceph-client.admin.468596.log: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.266497.log.gz 2024-05-17T11:54:27.553 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.549902.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.558369.log: -- /var/log/ceph/ceph-client.admin.45747.log 2024-05-17T11:54:27.553 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.507176.log: /var/log/ceph/ceph-client.admin.469028.log: /var/log/ceph/ceph-client.admin.544710.log: /var/log/ceph/ceph-client.admin.492859.log: /var/log/ceph/ceph-client.admin.547173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221729.log 2024-05-17T11:54:27.554 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.482280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547164.log 2024-05-17T11:54:27.554 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.386002.log: /var/log/ceph/ceph-client.admin.489692.log: /var/log/ceph/ceph-client.admin.485339.log: /var/log/ceph/ceph-client.admin.506319.log: /var/log/ceph/ceph-client.admin.196371.log: /var/log/ceph/ceph-client.admin.514263.log: /var/log/ceph/ceph-client.admin.515534.log: /var/log/ceph/ceph-client.admin.508898.log: /var/log/ceph/ceph-client.admin.494799.log: /var/log/ceph/ceph-client.admin.513176.log: gzip/var/log/ceph/ceph-client.admin.557505.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.484429.log 2024-05-17T11:54:27.554 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.494215.log: /var/log/ceph/ceph-client.admin.537479.log: /var/log/ceph/ceph-client.admin.472036.log: /var/log/ceph/ceph-client.admin.474364.log: /var/log/ceph/ceph-client.admin.473014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432699.log 2024-05-17T11:54:27.554 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.510651.log: /var/log/ceph/ceph-client.admin.541714.log: /var/log/ceph/ceph-client.admin.543830.log: /var/log/ceph/ceph-client.admin.484429.log: /var/log/ceph/ceph-client.admin.578894.log: /var/log/ceph/ceph-client.admin.565920.log: /var/log/ceph/ceph-client.admin.477849.log: /var/log/ceph/ceph-client.admin.573531.log: /var/log/ceph/ceph-client.admin.472027.log: /var/log/ceph/ceph-client.admin.547164.log: /var/log/ceph/ceph-client.admin.495839.log: /var/log/ceph/ceph-client.admin.468133.log: /var/log/ceph/ceph-client.admin.542137.log: /var/log/ceph/ceph-client.admin.551307.log: /var/log/ceph/ceph-client.admin.545162.log: /var/log/ceph/ceph-client.admin.535773.log: /var/log/ceph/ceph-client.admin.536621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116888.log 2024-05-17T11:54:27.554 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.563703.log: /var/log/ceph/ceph-client.admin.534505.log: /var/log/ceph/ceph-client.admin.515959.log: /var/log/ceph/ceph-client.admin.481415.log: 87.9%/var/log/ceph/ceph-client.admin.538740.log: -- replaced with /var/log/ceph/ceph-client.admin.578894.log.gz 2024-05-17T11:54:27.554 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.578078.log: /var/log/ceph/ceph-client.admin.577370.log: /var/log/ceph/ceph-client.admin.553027.log: /var/log/ceph/ceph-client.admin.478264.log: /var/log/ceph/ceph-client.admin.496687.log: /var/log/ceph/ceph-client.admin.485774.log: gzip -5 --verbose --/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.195910.log 89.4% 2024-05-17T11:54:27.554 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.578078.log.gz 2024-05-17T11:54:27.555 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.469451.log: /var/log/ceph/ceph-client.admin.432699.log: /var/log/ceph/ceph-client.admin.543407.log: /var/log/ceph/ceph-client.admin.549436.log: /var/log/ceph/ceph-client.admin.458339.log: /var/log/ceph/ceph-client.admin.546314.log: /var/log/ceph/ceph-client.admin.567258.log: /var/log/ceph/ceph-client.admin.501975.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.577370.log.gz 2024-05-17T11:54:27.555 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.473945.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.578793.log: --/var/log/ceph/ceph-client.admin.496678.log: /var/log/ceph/ceph-client.admin.540009.log 2024-05-17T11:54:27.555 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.503693.log: /var/log/ceph/ceph-client.admin.568177.log: /var/log/ceph/ceph-client.admin.195910.log: /var/log/ceph/ceph-client.admin.570860.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.578793.log.gz 2024-05-17T11:54:27.555 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.498016.log: /var/log/ceph/ceph-client.admin.524492.log: /var/log/ceph/ceph-client.admin.522920.log: /var/log/ceph/ceph-client.admin.514272.log: /var/log/ceph/ceph-client.admin.548084.log: /var/log/ceph/ceph-client.admin.571746.log: /var/log/ceph/ceph-client.admin.542974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548507.log 2024-05-17T11:54:27.555 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.550840.log: /var/log/ceph/ceph-client.admin.541281.log: /var/log/ceph/ceph-client.admin.508469.log: /var/log/ceph/ceph-client.admin.544274.log: /var/log/ceph/ceph-client.admin.540009.log: /var/log/ceph/ceph-client.admin.472525.log: /var/log/ceph/ceph-client.admin.536207.log: /var/log/ceph/ceph-client.admin.498873.log: /var/log/ceph/ceph-client.admin.475722.log: /var/log/ceph/ceph-client.admin.545877.log: /var/log/ceph/ceph-client.admin.499287.log: /var/log/ceph/ceph-client.admin.498450.log: /var/log/ceph/ceph-client.admin.500181.log: /var/log/ceph/ceph-client.admin.572692.log: /var/log/ceph/ceph-client.admin.510191.log: /var/log/ceph/ceph-client.admin.546740.log: /var/log/ceph/ceph-client.admin.515968.log: /var/log/ceph/ceph-client.admin.562812.log: /var/log/ceph/ceph-client.admin.539586.log: /var/log/ceph/ceph-client.admin.562803.log: /var/log/ceph/ceph-client.admin.538749.log: /var/log/ceph/ceph-client.admin.554014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527785.log 2024-05-17T11:54:27.555 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.529416.log: /var/log/ceph/ceph-client.admin.551730.log: /var/log/ceph/ceph-client.admin.576407.log: /var/log/ceph/ceph-client.admin.511074.log: /var/log/ceph/ceph-client.admin.558783.log: /var/log/ceph/ceph-client.admin.570428.log: /var/log/ceph/ceph-client.admin.557082.log: /var/log/ceph/ceph-client.admin.556172.log: /var/log/ceph/ceph-client.admin.540018.log: /var/log/ceph/ceph-client.admin.578289.log: /var/log/ceph/ceph-client.admin.548507.log: /var/log/ceph/ceph-client.admin.547669.log: /var/log/ceph/ceph-client.admin.470288.log: /var/log/ceph/ceph-client.admin.498441.log: gzip/var/log/ceph/ceph-client.admin.491435.log: /var/log/ceph/ceph-client.admin.542983.log: /var/log/ceph/ceph-client.admin.578036.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.252295.log 2024-05-17T11:54:27.555 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.513849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384048.log 2024-05-17T11:54:27.555 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.266488.log: /var/log/ceph/ceph-client.admin.205211.log: /var/log/ceph/ceph-client.admin.546305.log: /var/log/ceph/ceph-client.admin.254846.log: /var/log/ceph/ceph-client.admin.353898.log: /var/log/ceph/ceph-client.admin.446906.log: /var/log/ceph/ceph-client.admin.519715.log: /var/log/ceph/ceph-client.admin.554876.log: /var/log/ceph/ceph-client.admin.473005.log: /var/log/ceph/ceph-client.admin.524501.log: /var/log/ceph/ceph-client.admin.578541.log: /var/log/ceph/ceph-client.admin.458576.log: /var/log/ceph/ceph-client.admin.501487.log: /var/log/ceph/ceph-client.admin.507610.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.578541.log.gz 2024-05-17T11:54:27.555 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.578709.log: /var/log/ceph/ceph-client.admin.501496.log: /var/log/ceph/ceph-client.admin.491892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578936.log 2024-05-17T11:54:27.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.577328.log: /var/log/ceph/ceph-client.admin.479126.log: /var/log/ceph/ceph-client.admin.541290.log: /var/log/ceph/ceph-client.admin.477840.log: /var/log/ceph/ceph-client.admin.578667.log: /var/log/ceph/ceph-client.admin.572204.log: /var/log/ceph/ceph-client.admin.562367.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.578667.log.gz 2024-05-17T11:54:27.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.507185.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.578709.log.gz/var/log/ceph/ceph-client.admin.506306.log: 2024-05-17T11:54:27.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.540442.log: /var/log/ceph/ceph-client.admin.553015.log: /var/log/ceph/ceph-client.admin.565476.log: /var/log/ceph/ceph-client.admin.537470.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.577328.log.gz 2024-05-17T11:54:27.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.508889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233828.log 2024-05-17T11:54:27.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.513412.log: /var/log/ceph/ceph-client.admin.574462.log: /var/log/ceph/ceph-client.admin.480939.log: /var/log/ceph/ceph-client.admin.534919.log: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.561911.log.gz 2024-05-17T11:54:27.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.551298.log: /var/log/ceph/ceph-client.admin.571285.log: /var/log/ceph/ceph-client.admin.514686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275058.log 2024-05-17T11:54:27.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.486695.log: /var/log/ceph/ceph-client.admin.569560.log: /var/log/ceph/ceph-client.admin.574033.log: /var/log/ceph/ceph-client.admin.503260.log: /var/log/ceph/ceph-client.admin.563257.log: /var/log/ceph/ceph-client.admin.489091.log: /var/log/ceph/ceph-client.admin.578936.log: /var/log/ceph/ceph-client.admin.569569.log: /var/log/ceph/ceph-client.admin.554442.log: /var/log/ceph/ceph-client.admin.480948.log: /var/log/ceph/ceph-client.admin.480102.log: /var/log/ceph/ceph-client.admin.472516.log: /var/log/ceph/ceph-client.admin.516834.log: /var/log/ceph/ceph-client.admin.555736.log: /var/log/ceph/ceph-client.admin.548975.log: /var/log/ceph/ceph-client.admin.516381.log: /var/log/ceph/ceph-client.admin.476566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499296.log 2024-05-17T11:54:27.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.553789.log: /var/log/ceph/ceph-client.admin.497593.log: /var/log/ceph/ceph-client.admin.576844.log: /var/log/ceph/ceph-client.admin.561009.log: /var/log/ceph/ceph-client.admin.578457.log: /var/log/ceph/ceph-client.admin.512929.log: /var/log/ceph/ceph-client.admin.480093.log: /var/log/ceph/ceph-client.admin.553524.log: 88.2%/var/log/ceph/ceph-client.admin.578625.log: /var/log/ceph/ceph-client.admin.488179.log: /var/log/ceph/ceph-client.admin.565030.log: /var/log/ceph/ceph-client.admin.484015.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.576844.log.gz 2024-05-17T11:54:27.557 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.578936.log.gz 2024-05-17T11:54:27.557 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.508460.log: gzip -5/var/log/ceph/ceph-client.admin.510182.log: /var/log/ceph/ceph-client.admin.499296.log: --verbose -- /var/log/ceph/ceph-client.admin.473936.log 2024-05-17T11:54:27.557 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.578854.log: /var/log/ceph/ceph-client.admin.550373.log: /var/log/ceph/ceph-client.admin.210783.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.123426.log.gz 2024-05-17T11:54:27.557 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.234252.log: /var/log/ceph/ceph-client.admin.384039.log: /var/log/ceph/ceph-client.admin.428754.log: /var/log/ceph/ceph-client.admin.436616.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.578625.log.gz 2024-05-17T11:54:27.557 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351337.log 2024-05-17T11:54:27.557 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.135013.log: /var/log/ceph/ceph-client.admin.44529.log: /var/log/ceph/ceph-client.admin.376703.log: /var/log/ceph/ceph-client.admin.179902.log: /var/log/ceph/ceph-client.admin.473936.log: /var/log/ceph/ceph-client.admin.47722.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.578854.log.gz 2024-05-17T11:54:27.557 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.136707.log: /var/log/ceph/ceph-client.admin.177219.log: /var/log/ceph/ceph-client.admin.47919.log: /var/log/ceph/ceph-client.admin.184830.log: /var/log/ceph/ceph-client.admin.182175.log: /var/log/ceph/ceph-client.admin.426523.log: /var/log/ceph/ceph-client.admin.356015.log: /var/log/ceph/ceph-client.admin.218708.log: /var/log/ceph/ceph-client.admin.228640.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.371554.log: /var/log/ceph/ceph-client.admin.149420.log: /var/log/ceph/ceph-client.admin.225031.log 2024-05-17T11:54:27.557 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.159478.log: /var/log/ceph/ceph-client.admin.390370.log: /var/log/ceph/ceph-client.admin.388153.log: /var/log/ceph/ceph-client.admin.253156.log: /var/log/ceph/ceph-client.admin.439186.log: /var/log/ceph/ceph-client.admin.47977.log: /var/log/ceph/ceph-client.admin.217430.log: /var/log/ceph/ceph-client.admin.249208.log: /var/log/ceph/ceph-client.admin.395660.log: /var/log/ceph/ceph-client.admin.151128.log: /var/log/ceph/ceph-client.admin.110820.log: /var/log/ceph/ceph-client.admin.452298.log: /var/log/ceph/ceph-client.admin.185338.log: /var/log/ceph/ceph-client.admin.156140.log: /var/log/ceph/ceph-client.admin.262672.log: /var/log/ceph/ceph-client.admin.413799.log: /var/log/ceph/ceph-client.admin.111248.log: /var/log/ceph/ceph-client.admin.423132.log: /var/log/ceph/ceph-client.admin.127300.log: /var/log/ceph/ceph-client.admin.191414.log: /var/log/ceph/ceph-client.admin.199092.log: /var/log/ceph/ceph-client.admin.45165.log: /var/log/ceph/ceph-client.admin.359433.log: /var/log/ceph/ceph-client.admin.183918.log: /var/log/ceph/ceph-client.admin.177228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446047.log 2024-05-17T11:54:27.557 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44833.log: /var/log/ceph/ceph-client.admin.421864.log: /var/log/ceph/ceph-client.admin.117312.log: /var/log/ceph/ceph-client.admin.49283.log: /var/log/ceph/ceph-client.admin.109832.log: /var/log/ceph/ceph-client.admin.276503.log: /var/log/ceph/ceph-client.admin.152956.log: /var/log/ceph/ceph-client.admin.247064.log: /var/log/ceph/ceph-client.admin.420558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484916.log 2024-05-17T11:54:27.558 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42862.log: /var/log/ceph/ceph-client.admin.254423.log: /var/log/ceph/ceph-client.admin.49100.log: /var/log/ceph/ceph-client.admin.243803.log: /var/log/ceph/ceph-client.admin.357727.log: /var/log/ceph/ceph-client.admin.443905.log: /var/log/ceph/ceph-client.admin.131614.log: /var/log/ceph/ceph-client.admin.453622.log: /var/log/ceph/ceph-client.admin.234676.log: /var/log/ceph/ceph-client.admin.184839.log: /var/log/ceph/ceph-client.admin.399790.log: /var/log/ceph/ceph-client.admin.418229.log: /var/log/ceph/ceph-client.admin.44655.log: /var/log/ceph/ceph-client.admin.131200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276494.log 2024-05-17T11:54:27.558 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.149841.log: /var/log/ceph/ceph-client.admin.369012.log: /var/log/ceph/ceph-client.admin.206480.log: /var/log/ceph/ceph-client.admin.48638.log: /var/log/ceph/ceph-client.admin.459854.log: /var/log/ceph/ceph-client.admin.265651.log: /var/log/ceph/ceph-client.admin.47434.log: /var/log/ceph/ceph-client.admin.211235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140729.log 2024-05-17T11:54:27.558 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.246437.log: /var/log/ceph/ceph-client.admin.450320.log: /var/log/ceph/ceph-client.admin.49241.log: /var/log/ceph/ceph-client.admin.460277.log: /var/log/ceph/ceph-client.admin.375855.log: /var/log/ceph/ceph-client.admin.484916.log: /var/log/ceph/ceph-client.admin.109823.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.251025.log.gz 2024-05-17T11:54:27.558 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49195.log: /var/log/ceph/ceph-client.admin.197718.log: /var/log/ceph/ceph-client.admin.148093.log: /var/log/ceph/ceph-client.admin.180835.log: /var/log/ceph/ceph-client.admin.227793.log: /var/log/ceph/ceph-client.admin.427426.log: /var/log/ceph/ceph-client.admin.132894.log: /var/log/ceph/ceph-client.admin.423562.log: gzip/var/log/ceph/ceph-client.admin.269129.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49144.log 2024-05-17T11:54:27.558 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.178504.log: /var/log/ceph/ceph-client.admin.219603.log: /var/log/ceph/ceph-client.admin.42992.log: /var/log/ceph/ceph-client.admin.376712.log: /var/log/ceph/ceph-client.admin.367323.log: /var/log/ceph/ceph-client.admin.209879.log: /var/log/ceph/ceph-client.admin.126450.log: /var/log/ceph/ceph-client.admin.433118.log: /var/log/ceph/ceph-client.admin.449892.log: /var/log/ceph/ceph-client.admin.398789.log: gzip/var/log/ceph/ceph-client.admin.244655.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.389005.log 2024-05-17T11:54:27.558 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.226480.log: /var/log/ceph/ceph-client.admin.215981.log: /var/log/ceph/ceph-client.admin.188994.log: /var/log/ceph/ceph-client.admin.437036.log: /var/log/ceph/ceph-client.admin.258689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371131.log 2024-05-17T11:54:27.558 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.225475.log: /var/log/ceph/ceph-client.admin.217439.log: /var/log/ceph/ceph-client.admin.441307.log: /var/log/ceph/ceph-client.admin.400297.log: /var/log/ceph/ceph-client.admin.195467.log: /var/log/ceph/ceph-client.admin.389005.log: /var/log/ceph/ceph-client.admin.358577.log: /var/log/ceph/ceph-client.admin.138036.log: /var/log/ceph/ceph-client.admin.459004.log: /var/log/ceph/ceph-client.admin.44158.log: /var/log/ceph/ceph-client.admin.278240.log: /var/log/ceph/ceph-client.admin.351328.log: /var/log/ceph/ceph-client.admin.253999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48802.log 2024-05-17T11:54:27.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.414655.log: /var/log/ceph/ceph-client.admin.275498.log: /var/log/ceph/ceph-client.admin.366897.log: /var/log/ceph/ceph-client.admin.559661.log: /var/log/ceph/ceph-client.admin.251881.log: /var/log/ceph/ceph-client.admin.371131.log: /var/log/ceph/ceph-client.admin.198179.log: /var/log/ceph/ceph-client.admin.371977.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.135437.log: /var/log/ceph/ceph-client.admin.457040.log 2024-05-17T11:54:27.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47560.log: /var/log/ceph/ceph-client.admin.135428.log: 85.2%/var/log/ceph/ceph-client.admin.217853.log: -- replaced with /var/log/ceph/ceph-client.admin.206894.log.gz/var/log/ceph/ceph-client.admin.364757.log: 2024-05-17T11:54:27.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49494.log: /var/log/ceph/ceph-client.admin.420121.log: /var/log/ceph/ceph-client.admin.48760.log: /var/log/ceph/ceph-client.admin.132038.log: /var/log/ceph/ceph-client.admin.132461.log: /var/log/ceph/ceph-client.admin.444773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537903.log 2024-05-17T11:54:27.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43390.log: /var/log/ceph/ceph-client.admin.365172.log: /var/log/ceph/ceph-client.2.47016.log: /var/log/ceph/ceph-client.admin.426100.log: /var/log/ceph/ceph-client.admin.353465.log: /var/log/ceph/ceph-client.admin.232969.log: /var/log/ceph/ceph-client.admin.437490.log: /var/log/ceph/ceph-client.admin.122570.log: /var/log/ceph/ceph-client.admin.251444.log: /var/log/ceph/ceph-client.admin.360268.log: /var/log/ceph/ceph-client.admin.266940.log: /var/log/ceph/ceph-client.admin.367745.log: /var/log/ceph/ceph-client.admin.70031.log: /var/log/ceph/ceph-client.admin.397928.log: /var/log/ceph/ceph-client.admin.245078.log: /var/log/ceph/ceph-client.admin.115553.log: /var/log/ceph/ceph-client.admin.382259.log: /var/log/ceph/ceph-client.admin.418220.log: /var/log/ceph/ceph-client.admin.223055.log: /var/log/ceph/ceph-client.admin.201353.log: gzip/var/log/ceph/ceph-client.admin.123002.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.460268.log 2024-05-17T11:54:27.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.358149.log: /var/log/ceph/ceph-client.admin.110811.log: /var/log/ceph/ceph-client.admin.188148.log: /var/log/ceph/ceph-client.admin.178091.log: /var/log/ceph/ceph-client.admin.387687.log: /var/log/ceph/ceph-client.admin.229934.log: /var/log/ceph/ceph-client.admin.193235.log: /var/log/ceph/ceph-client.admin.175517.log: /var/log/ceph/ceph-client.admin.417724.log: /var/log/ceph/ceph-client.admin.194554.log: /var/log/ceph/ceph-client.admin.48138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48264.log 2024-05-17T11:54:27.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45169.log: /var/log/ceph/ceph-client.admin.149850.log: /var/log/ceph/ceph-client.admin.437499.log: /var/log/ceph/ceph-client.admin.174666.log: /var/log/ceph/ceph-client.admin.215135.log: /var/log/ceph/ceph-client.admin.414646.log: /var/log/ceph/ceph-client.admin.109313.log: /var/log/ceph/ceph-client.admin.115139.log: /var/log/ceph/ceph-client.admin.235974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476994.log 2024-05-17T11:54:27.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44836.log: /var/log/ceph/ceph-client.admin.351755.log: /var/log/ceph/ceph-client.admin.537903.log: /var/log/ceph/ceph-client.admin.441743.log: /var/log/ceph/ceph-client.admin.426091.log: /var/log/ceph/ceph-client.admin.195006.log: /var/log/ceph/ceph-client.admin.248785.log: /var/log/ceph/ceph-client.admin.457921.log: /var/log/ceph/ceph-client.admin.404217.log: /var/log/ceph/ceph-client.admin.255707.log: /var/log/ceph/ceph-client.admin.37084.log: /var/log/ceph/ceph-client.admin.129491.log: /var/log/ceph/ceph-client.admin.221286.log: /var/log/ceph/ceph-client.admin.141167.log: /var/log/ceph/ceph-client.admin.110328.log: /var/log/ceph/ceph-client.admin.227379.log: /var/log/ceph/ceph-client.admin.191423.log: /var/log/ceph/ceph-client.admin.225964.log: /var/log/ceph/ceph-client.admin.416846.log: /var/log/ceph/ceph-client.admin.418852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48432.log 2024-05-17T11:54:27.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49536.log: /var/log/ceph/ceph-client.admin.126019.log: /var/log/ceph/ceph-client.admin.45162.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.573540.log.gz 2024-05-17T11:54:27.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.260566.log: /var/log/ceph/ceph-client.admin.219594.log: /var/log/ceph/ceph-client.admin.121328.log: /var/log/ceph/ceph-client.admin.361125.log: /var/log/ceph/ceph-client.admin.237731.log: /var/log/ceph/ceph-client.admin.232069.log: /var/log/ceph/ceph-client.admin.357718.log: /var/log/ceph/ceph-client.admin.208603.log: /var/log/ceph/ceph-client.admin.476994.log: /var/log/ceph/ceph-client.admin.235983.log: /var/log/ceph/ceph-client.admin.390361.log: gzip -5/var/log/ceph/ceph-client.admin.199544.log: --verbose -- /var/log/ceph/ceph-client.admin.228649.log 2024-05-17T11:54:27.560 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.364236.log: /var/log/ceph/ceph-client.admin.49452.log: /var/log/ceph/ceph-client.admin.189457.log: /var/log/ceph/ceph-client.admin.379274.log: /var/log/ceph/ceph-client.admin.419698.log: /var/log/ceph/ceph-client.admin.135862.log: /var/log/ceph/ceph-client.admin.178957.log: /var/log/ceph/ceph-client.admin.389929.log: /var/log/ceph/ceph-client.admin.210774.log: /var/log/ceph/ceph-client.admin.377559.log: /var/log/ceph/ceph-client.admin.454891.log: /var/log/ceph/ceph-client.admin.476575.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48718.log.gz 2024-05-17T11:54:27.560 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.111257.log: /var/log/ceph/ceph-client.admin.235518.log: /var/log/ceph/ceph-client.admin.362000.log: gzip/var/log/ceph/ceph-client.admin.130768.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.229511.log 2024-05-17T11:54:27.560 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45915.log: /var/log/ceph/ceph-client.admin.250597.log: /var/log/ceph/ceph-client.admin.137616.log: /var/log/ceph/ceph-client.admin.434427.log: /var/log/ceph/ceph-client.admin.158912.log: /var/log/ceph/ceph-client.admin.438772.log: /var/log/ceph/ceph-client.admin.399276.log: /var/log/ceph/ceph-client.admin.377991.log: /var/log/ceph/ceph-client.admin.198170.log: /var/log/ceph/ceph-client.admin.121337.log: /var/log/ceph/ceph-client.admin.267405.log: /var/log/ceph/ceph-client.admin.178082.log: /var/log/ceph/ceph-client.admin.425586.log: /var/log/ceph/ceph-client.admin.440033.log: /var/log/ceph/ceph-client.admin.147239.log: /var/log/ceph/ceph-client.admin.455319.log: /var/log/ceph/ceph-client.admin.457049.log: /var/log/ceph/ceph-client.admin.147664.log: gzip/var/log/ceph/ceph-client.admin.394691.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48306.log 2024-05-17T11:54:27.560 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.143338.log: /var/log/ceph/ceph-client.admin.420567.log: /var/log/ceph/ceph-client.admin.47476.log: 89.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-17T11:54:27.560 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.370278.log: /var/log/ceph/ceph-client.admin.395651.log: /var/log/ceph/ceph-client.admin.442608.log: /var/log/ceph/ceph-client.admin.414227.log: /var/log/ceph/ceph-client.admin.449055.log: /var/log/ceph/ceph-client.admin.232545.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.429186.log: /var/log/ceph/ceph-client.admin.215126.log 2024-05-17T11:54:27.560 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.570437.log.gz 2024-05-17T11:54:27.560 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.366027.log.gz 2024-05-17T11:54:27.560 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48306.log: -- replaced with /var/log/ceph/ceph-client.admin.246428.log.gz 2024-05-17T11:54:27.560 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.526122.log.gz 2024-05-17T11:54:27.561 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.204788.log.gz 2024-05-17T11:54:27.561 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.535354.log.gz 2024-05-17T11:54:27.561 INFO:teuthology.orchestra.run.smithi131.stderr: 84.2% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.541705.log.gz -- replaced with /var/log/ceph/ceph-client.admin.535782.log.gz 2024-05-17T11:54:27.561 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.561 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.422717.log.gz 2024-05-17T11:54:27.561 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.570869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128226.log 2024-05-17T11:54:27.561 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.468124.log: /var/log/ceph/ceph-client.admin.215126.log: /var/log/ceph/ceph-client.admin.480525.log: /var/log/ceph/ceph-client.admin.558360.log: /var/log/ceph/ceph-client.admin.477426.log: /var/log/ceph/ceph-client.admin.577994.log: /var/log/ceph/ceph-client.admin.487699.log: /var/log/ceph/ceph-client.admin.557073.log: /var/log/ceph/ceph-client.admin.538317.log: /var/log/ceph/ceph-client.admin.568633.log: /var/log/ceph/ceph-client.admin.554451.log: /var/log/ceph/ceph-client.admin.458218.log: /var/log/ceph/ceph-client.admin.576398.log: /var/log/ceph/ceph-client.admin.505878.log: /var/log/ceph/ceph-client.admin.512470.log: /var/log/ceph/ceph-client.admin.509735.log: /var/log/ceph/ceph-client.admin.505887.log: /var/log/ceph/ceph-client.admin.475267.log: /var/log/ceph/ceph-client.admin.504541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564139.log 2024-05-17T11:54:27.561 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.556163.log: /var/log/ceph/ceph-client.admin.559238.log: /var/log/ceph/ceph-client.admin.502821.log: /var/log/ceph/ceph-client.admin.491426.log: /var/log/ceph/ceph-client.admin.506753.log: /var/log/ceph/ceph-client.admin.513185.log: /var/log/ceph/ceph-client.admin.488677.log: /var/log/ceph/ceph-client.admin.539172.log: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.576398.log.gz 2024-05-17T11:54:27.561 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.490571.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.577994.log.gz 2024-05-17T11:54:27.562 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.499719.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.386425.log.gz 2024-05-17T11:54:27.562 INFO:teuthology.orchestra.run.smithi131.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.540433.log.gz 2024-05-17T11:54:27.562 INFO:teuthology.orchestra.run.smithi131.stderr: 93.0% 85.3% -- replaced with /var/log/ceph/ceph-client.admin.203510.log.gz 2024-05-17T11:54:27.562 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.470720.log.gz 90.0% -- replaced with /var/log/ceph/ceph-client.admin.212143.log.gz 2024-05-17T11:54:27.562 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.562 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.213022.log.gz 85.2% 2024-05-17T11:54:27.562 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.234667.log.gz 2024-05-17T11:54:27.563 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486208.log 2024-05-17T11:54:27.563 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.359855.log.gz 2024-05-17T11:54:27.563 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.208594.log.gz 2024-05-17T11:54:27.563 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.358996.log.gz 2024-05-17T11:54:27.563 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% 82.1% -- replaced with /var/log/ceph/ceph-client.admin.203087.log.gz 2024-05-17T11:54:27.563 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43498.log.gz 2024-05-17T11:54:27.563 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43348.log.gz 2024-05-17T11:54:27.563 INFO:teuthology.orchestra.run.smithi131.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.471592.log.gz 2024-05-17T11:54:27.564 INFO:teuthology.orchestra.run.smithi131.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44319.log.gz 2024-05-17T11:54:27.564 INFO:teuthology.orchestra.run.smithi131.stderr: 78.2% 81.5% -- replaced with /var/log/ceph/ceph-client.admin.508031.log.gz 78.3% 2024-05-17T11:54:27.564 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.214280.log.gz 2024-05-17T11:54:27.564 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.200910.log.gz 2024-05-17T11:54:27.564 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.495407.log.gz 2024-05-17T11:54:27.564 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.444764.log.gz 2024-05-17T11:54:27.564 INFO:teuthology.orchestra.run.smithi131.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.497167.log.gz 2024-05-17T11:54:27.564 INFO:teuthology.orchestra.run.smithi131.stderr:gzip 90.2% -- replaced with /var/log/ceph/ceph-client.admin.218285.log.gz 2024-05-17T11:54:27.564 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.203519.log.gz 2024-05-17T11:54:27.564 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.564139.log: -5 80.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.563248.log.gz 2024-05-17T11:54:27.565 INFO:teuthology.orchestra.run.smithi131.stderr: /var/log/ceph/ceph-client.admin.244227.log 2024-05-17T11:54:27.565 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.511487.log.gz 2024-05-17T11:54:27.565 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.263104.log.gz 2024-05-17T11:54:27.565 INFO:teuthology.orchestra.run.smithi131.stderr: 84.4% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.468605.log.gz 2024-05-17T11:54:27.565 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.555312.log.gz 2024-05-17T11:54:27.565 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70074.log.gz 2024-05-17T11:54:27.565 INFO:teuthology.orchestra.run.smithi131.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.388144.log.gz 2024-05-17T11:54:27.565 INFO:teuthology.orchestra.run.smithi131.stderr: 92.1%/var/log/ceph/ceph-client.admin.486208.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47802.log.gz 2024-05-17T11:54:27.565 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.567704.log.gz 2024-05-17T11:54:27.566 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% 82.0% -- replaced with /var/log/ceph/ceph-client.admin.445619.log.gz 2024-05-17T11:54:27.566 INFO:teuthology.orchestra.run.smithi131.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.135004.log.gz 2024-05-17T11:54:27.566 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.373678.log.gz 2024-05-17T11:54:27.566 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45171.log 2024-05-17T11:54:27.566 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43222.log.gz 2024-05-17T11:54:27.566 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.228225.log.gz 2024-05-17T11:54:27.566 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.354749.log.gz 2024-05-17T11:54:27.566 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.390801.log.gz 2024-05-17T11:54:27.567 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522929.log 2024-05-17T11:54:27.567 INFO:teuthology.orchestra.run.smithi131.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.242917.log.gz 2024-05-17T11:54:27.567 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.0.46518.log.gz 2024-05-17T11:54:27.567 INFO:teuthology.orchestra.run.smithi131.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.492381.log.gz 2024-05-17T11:54:27.567 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.140738.log.gz 2024-05-17T11:54:27.567 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45171.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.430436.log.gz 2024-05-17T11:54:27.567 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.534496.log.gz 2024-05-17T11:54:27.567 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45957.log.gz 2024-05-17T11:54:27.568 INFO:teuthology.orchestra.run.smithi131.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.134154.log.gz 2024-05-17T11:54:27.568 INFO:teuthology.orchestra.run.smithi131.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.204779.log.gz 2024-05-17T11:54:27.568 INFO:teuthology.orchestra.run.smithi131.stderr:gzip 82.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.132047.log -- replaced with /var/log/ceph/ceph-client.admin.253575.log.gz 2024-05-17T11:54:27.568 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.568 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.150281.log.gz 2024-05-17T11:54:27.568 INFO:teuthology.orchestra.run.smithi131.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.491883.log.gz 2024-05-17T11:54:27.569 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.490143.log.gz 2024-05-17T11:54:27.569 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.478273.log.gz 2024-05-17T11:54:27.569 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% 84.3% -- replaced with /var/log/ceph/ceph-client.admin.261826.log.gz 2024-05-17T11:54:27.569 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.269577.log.gz 2024-05-17T11:54:27.569 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.368599.log 2024-05-17T11:54:27.569 INFO:teuthology.orchestra.run.smithi131.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.542551.log.gz 2024-05-17T11:54:27.569 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.471147.log.gz/var/log/ceph/ceph-client.admin.132047.log: 2024-05-17T11:54:27.569 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.522929.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.158057.log.gz 2024-05-17T11:54:27.569 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.263518.log.gz 2024-05-17T11:54:27.570 INFO:teuthology.orchestra.run.smithi131.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.553780.log.gz 2024-05-17T11:54:27.570 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.367754.log.gz 2024-05-17T11:54:27.570 INFO:teuthology.orchestra.run.smithi131.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.152488.log.gz 2024-05-17T11:54:27.570 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.369443.log.gz 2024-05-17T11:54:27.570 INFO:teuthology.orchestra.run.smithi131.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.190535.log.gz 2024-05-17T11:54:27.570 INFO:teuthology.orchestra.run.smithi131.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.427869.log.gz 2024-05-17T11:54:27.570 INFO:teuthology.orchestra.run.smithi131.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.185329.log.gz 2024-05-17T11:54:27.571 INFO:teuthology.orchestra.run.smithi131.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.247073.log.gz 2024-05-17T11:54:27.571 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375864.log 2024-05-17T11:54:27.571 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% 84.0% -- replaced with /var/log/ceph/ceph-client.admin.404208.log.gz 2024-05-17T11:54:27.571 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.452289.log.gz 2024-05-17T11:54:27.571 INFO:teuthology.orchestra.run.smithi131.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.192322.log.gz 2024-05-17T11:54:27.571 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.130777.log.gz 2024-05-17T11:54:27.571 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.356443.log.gz 2024-05-17T11:54:27.571 INFO:teuthology.orchestra.run.smithi131.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48558.log.gz 2024-05-17T11:54:27.571 INFO:teuthology.orchestra.run.smithi131.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.193678.log.gz 2024-05-17T11:54:27.572 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.493771.log.gz 2024-05-17T11:54:27.572 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45164.log.gz 2024-05-17T11:54:27.572 INFO:teuthology.orchestra.run.smithi131.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.259710.log.gz 2024-05-17T11:54:27.572 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356024.log 2024-05-17T11:54:27.572 INFO:teuthology.orchestra.run.smithi131.stderr: 80.4% 82.1% -- replaced with /var/log/ceph/ceph-client.admin.535345.log.gz 2024-05-17T11:54:27.572 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.368599.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.370287.log.gz 2024-05-17T11:54:27.572 INFO:teuthology.orchestra.run.smithi131.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.482737.log.gz 2024-05-17T11:54:27.572 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.148954.log.gz 2024-05-17T11:54:27.573 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.375864.log: gzip 80.8% -5 --verbose -- /var/log/ceph/ceph-client.admin.545886.log 2024-05-17T11:54:27.573 INFO:teuthology.orchestra.run.smithi131.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.413790.log.gz 2024-05-17T11:54:27.573 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.557923.log.gz 2024-05-17T11:54:27.573 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.416431.log.gz 2024-05-17T11:54:27.573 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.138989.log.gz 2024-05-17T11:54:27.573 INFO:teuthology.orchestra.run.smithi131.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.543398.log.gz 2024-05-17T11:54:27.573 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.356024.log: 81.8% 78.9% -- replaced with /var/log/ceph/ceph-client.admin.483583.log.gz 2024-05-17T11:54:27.573 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.235093.log.gz 2024-05-17T11:54:27.574 INFO:teuthology.orchestra.run.smithi131.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.120848.log.gz 2024-05-17T11:54:27.574 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.392511.log.gz 2024-05-17T11:54:27.574 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.131623.log.gz 2024-05-17T11:54:27.574 INFO:teuthology.orchestra.run.smithi131.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.395164.log.gz 2024-05-17T11:54:27.574 INFO:teuthology.orchestra.run.smithi131.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.434418.log.gz 2024-05-17T11:54:27.574 INFO:teuthology.orchestra.run.smithi131.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.249737.log.gz 2024-05-17T11:54:27.574 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.391232.log.gz 2024-05-17T11:54:27.574 INFO:teuthology.orchestra.run.smithi131.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.396555.log.gz 2024-05-17T11:54:27.574 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.433555.log.gz 2024-05-17T11:54:27.575 INFO:teuthology.orchestra.run.smithi131.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.530926.log.gz 2024-05-17T11:54:27.575 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.484006.log.gz 2024-05-17T11:54:27.575 INFO:teuthology.orchestra.run.smithi131.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.386416.log.gz 2024-05-17T11:54:27.575 INFO:teuthology.orchestra.run.smithi131.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.201810.log.gz 2024-05-17T11:54:27.575 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.276952.log.gz 2024-05-17T11:54:27.575 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% 85.4% -- replaced with /var/log/ceph/ceph-client.admin.565911.log.gz 2024-05-17T11:54:27.575 INFO:teuthology.orchestra.run.smithi131.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.550831.log.gz 2024-05-17T11:54:27.576 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.433990.log.gz 2024-05-17T11:54:27.576 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.425163.log.gz 2024-05-17T11:54:27.576 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534088.log 2024-05-17T11:54:27.576 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.479672.log.gz 2024-05-17T11:54:27.576 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.377568.log.gz 2024-05-17T11:54:27.576 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.441752.log.gz 2024-05-17T11:54:27.576 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.257410.log.gz 2024-05-17T11:54:27.576 INFO:teuthology.orchestra.run.smithi131.stderr: 88.0% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45172.log.gz 2024-05-17T11:54:27.577 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.252719.log.gz 2024-05-17T11:54:27.577 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45509.log.gz 2024-05-17T11:54:27.577 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.545886.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.443482.log.gz 2024-05-17T11:54:27.577 INFO:teuthology.orchestra.run.smithi131.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.487201.log.gz 2024-05-17T11:54:27.577 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.430290.log.gz 2024-05-17T11:54:27.577 INFO:teuthology.orchestra.run.smithi131.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.503684.log.gz 2024-05-17T11:54:27.578 INFO:teuthology.orchestra.run.smithi131.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.238258.log.gz 2024-05-17T11:54:27.578 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.256563.log.gz 2024-05-17T11:54:27.578 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.484925.log.gz 2024-05-17T11:54:27.578 INFO:teuthology.orchestra.run.smithi131.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.214703.log.gz 2024-05-17T11:54:27.578 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142923.log 2024-05-17T11:54:27.578 INFO:teuthology.orchestra.run.smithi131.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.190996.log.gz 2024-05-17T11:54:27.578 INFO:teuthology.orchestra.run.smithi131.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.217007.log.gz 2024-05-17T11:54:27.578 INFO:teuthology.orchestra.run.smithi131.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.397919.log.gz 2024-05-17T11:54:27.579 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.124300.log.gz 2024-05-17T11:54:27.579 INFO:teuthology.orchestra.run.smithi131.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.256991.log.gz 2024-05-17T11:54:27.579 INFO:teuthology.orchestra.run.smithi131.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.366441.log.gz 2024-05-17T11:54:27.579 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.369021.log.gz 2024-05-17T11:54:27.579 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% 79.9% -- replaced with /var/log/ceph/ceph-client.admin.553515.log.gz -- replaced with /var/log/ceph/ceph-client.admin.184374.log.gz 2024-05-17T11:54:27.579 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.579 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.569098.log.gz 2024-05-17T11:54:27.579 INFO:teuthology.orchestra.run.smithi131.stderr: 92.7% 81.5% -- replaced with /var/log/ceph/ceph-client.admin.146741.log.gz 2024-05-17T11:54:27.579 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.539595.log.gz 2024-05-17T11:54:27.580 INFO:teuthology.orchestra.run.smithi131.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.369856.log.gz 2024-05-17T11:54:27.580 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177656.log 2024-05-17T11:54:27.580 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.534088.log: 81.2% 77.9% -- replaced with /var/log/ceph/ceph-client.admin.353037.log.gz 2024-05-17T11:54:27.580 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.155712.log.gz 2024-05-17T11:54:27.580 INFO:teuthology.orchestra.run.smithi131.stderr: 80.3% 81.8% -- replaced with /var/log/ceph/ceph-client.admin.371968.log.gz 2024-05-17T11:54:27.580 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.232978.log.gz 2024-05-17T11:54:27.580 INFO:teuthology.orchestra.run.smithi131.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.213013.log.gz 2024-05-17T11:54:27.580 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.227802.log.gz 2024-05-17T11:54:27.581 INFO:teuthology.orchestra.run.smithi131.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.158903.log.gz 2024-05-17T11:54:27.581 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.540858.log.gz 2024-05-17T11:54:27.581 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% 90.3% -- replaced with /var/log/ceph/ceph-client.admin.175103.log.gz 2024-05-17T11:54:27.581 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.211226.log.gz 2024-05-17T11:54:27.581 INFO:teuthology.orchestra.run.smithi131.stderr: 89.3%/var/log/ceph/ceph-client.admin.142923.log: -- replaced with /var/log/ceph/ceph-client.admin.37187.log.gz 2024-05-17T11:54:27.581 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.365595.log.gz 2024-05-17T11:54:27.581 INFO:teuthology.orchestra.run.smithi131.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.573114.log.gz 2024-05-17T11:54:27.581 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.160353.log.gz 2024-05-17T11:54:27.582 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.382250.log.gz 2024-05-17T11:54:27.582 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.148102.log.gz 2024-05-17T11:54:27.582 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233394.log 2024-05-17T11:54:27.582 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.544283.log.gz 2024-05-17T11:54:27.582 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.426999.log.gz 2024-05-17T11:54:27.582 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42550.log.gz 2024-05-17T11:54:27.582 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.537056.log.gz 2024-05-17T11:54:27.583 INFO:teuthology.orchestra.run.smithi131.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.448167.log.gz 2024-05-17T11:54:27.583 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.416008.log.gz 2024-05-17T11:54:27.583 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.134163.log.gz 2024-05-17T11:54:27.583 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.415530.log.gz 2024-05-17T11:54:27.583 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137145.log 2024-05-17T11:54:27.583 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.126873.log.gz 2024-05-17T11:54:27.583 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.275990.log.gz 2024-05-17T11:54:27.583 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.177656.log: 90.1%/var/log/ceph/ceph-client.admin.112144.log: /var/log/ceph/ceph-client.admin.359005.log: /var/log/ceph/ceph-client.admin.231224.log: -- replaced with /var/log/ceph/ceph-client.admin.446478.log.gz 2024-05-17T11:54:27.584 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.47350.log: /var/log/ceph/ceph-client.admin.392933.log: /var/log/ceph/ceph-client.admin.229520.log: /var/log/ceph/ceph-client.admin.186748.log: /var/log/ceph/ceph-client.admin.48474.log: /var/log/ceph/ceph-client.admin.137607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360277.log 2024-05-17T11:54:27.584 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.367332.log: /var/log/ceph/ceph-client.admin.176791.log: /var/log/ceph/ceph-client.admin.236849.log: /var/log/ceph/ceph-client.admin.449469.log: /var/log/ceph/ceph-client.admin.224568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43432.log 2024-05-17T11:54:27.584 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.206471.log: /var/log/ceph/ceph-client.admin.206057.log: /var/log/ceph/ceph-client.admin.350913.log: /var/log/ceph/ceph-client.admin.429615.log: /var/log/ceph/ceph-client.admin.190544.log: /var/log/ceph/ceph-client.admin.48972.log: /var/log/ceph/ceph-client.admin.214289.log: /var/log/ceph/ceph-client.admin.155721.log: /var/log/ceph/ceph-client.admin.48096.log: /var/log/ceph/ceph-client.admin.440466.log: /var/log/ceph/ceph-client.admin.449478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363823.log 2024-05-17T11:54:27.584 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.368590.log: /var/log/ceph/ceph-client.admin.227370.log: /var/log/ceph/ceph-client.admin.400306.log: /var/log/ceph/ceph-client.admin.132470.log: /var/log/ceph/ceph-client.admin.129927.log: /var/log/ceph/ceph-client.admin.124309.log: /var/log/ceph/ceph-client.admin.218276.log: /var/log/ceph/ceph-client.admin.277377.log: /var/log/ceph/ceph-client.admin.183503.log: /var/log/ceph/ceph-client.admin.430670.log: /var/log/ceph/ceph-client.admin.402291.log: /var/log/ceph/ceph-client.admin.250588.log: /var/log/ceph/ceph-client.admin.263941.log: /var/log/ceph/ceph-client.admin.256135.log: /var/log/ceph/ceph-client.admin.182590.log: /var/log/ceph/ceph-client.admin.362977.log: /var/log/ceph/ceph-client.admin.44837.log: /var/log/ceph/ceph-client.admin.229064.log: /var/log/ceph/ceph-client.admin.435334.log: /var/log/ceph/ceph-client.admin.243812.log: /var/log/ceph/ceph-client.admin.211687.log: /var/log/ceph/ceph-client.admin.191879.log: /var/log/ceph/ceph-client.admin.256126.log: /var/log/ceph/ceph-client.admin.193226.log: /var/log/ceph/ceph-client.admin.391655.log: /var/log/ceph/ceph-client.admin.44834.log: /var/log/ceph/ceph-client.admin.416855.log: /var/log/ceph/ceph-client.admin.274182.log: /var/log/ceph/ceph-client.admin.202237.log: /var/log/ceph/ceph-client.admin.175940.log: /var/log/ceph/ceph-client.admin.387264.log: /var/log/ceph/ceph-client.admin.375007.log: /var/log/ceph/ceph-client.admin.357304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192783.log 2024-05-17T11:54:27.584 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.197275.log: /var/log/ceph/ceph-client.admin.391646.log: /var/log/ceph/ceph-client.admin.199996.log: /var/log/ceph/ceph-client.admin.127754.log: /var/log/ceph/ceph-client.admin.256554.log: /var/log/ceph/ceph-client.admin.114424.log: /var/log/ceph/ceph-client.admin.183051.log: /var/log/ceph/ceph-client.admin.245510.log: /var/log/ceph/ceph-client.admin.357295.log: gzip -5/var/log/ceph/ceph-client.admin.260980.log: --verbose -- /var/log/ceph/ceph-client.admin.488188.log 2024-05-17T11:54:27.584 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.266065.log: /var/log/ceph/ceph-client.admin.363823.log: /var/log/ceph/ceph-client.admin.157642.log: /var/log/ceph/ceph-client.admin.48888.log: /var/log/ceph/ceph-client.admin.108887.log: /var/log/ceph/ceph-client.admin.364245.log: /var/log/ceph/ceph-client.admin.209451.log: /var/log/ceph/ceph-client.admin.209018.log: /var/log/ceph/ceph-client.admin.200901.log: /var/log/ceph/ceph-client.admin.129500.log: /var/log/ceph/ceph-client.admin.116464.log: /var/log/ceph/ceph-client.admin.382674.log: /var/log/ceph/ceph-client.admin.43264.log: /var/log/ceph/ceph-client.admin.393347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125173.log 2024-05-17T11:54:27.584 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.266074.log: /var/log/ceph/ceph-client.admin.215549.log: /var/log/ceph/ceph-client.admin.264374.log: /var/log/ceph/ceph-client.admin.356452.log: /var/log/ceph/ceph-client.admin.133317.log: /var/log/ceph/ceph-client.admin.383106.log: /var/log/ceph/ceph-client.admin.252304.log: /var/log/ceph/ceph-client.admin.365604.log: /var/log/ceph/ceph-client.admin.157110.log: /var/log/ceph/ceph-client.admin.238690.log: /var/log/ceph/ceph-client.admin.148536.log: gzip/var/log/ceph/ceph-client.admin.235102.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.458567.log 2024-05-17T11:54:27.584 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.182599.log: /var/log/ceph/ceph-client.admin.488188.log: /var/log/ceph/ceph-client.admin.197727.log: /var/log/ceph/ceph-client.admin.225022.log: /var/log/ceph/ceph-client.admin.207319.log: /var/log/ceph/ceph-client.admin.446897.log: /var/log/ceph/ceph-client.admin.220017.log: /var/log/ceph/ceph-client.admin.421441.log: /var/log/ceph/ceph-client.admin.433127.log: /var/log/ceph/ceph-client.admin.128217.log: /var/log/ceph/ceph-client.admin.212134.log: /var/log/ceph/ceph-client.admin.206903.log: /var/log/ceph/ceph-client.admin.456627.log: /var/log/ceph/ceph-client.admin.159210.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.576853.log.gz 2024-05-17T11:54:27.585 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49325.log: /var/log/ceph/ceph-client.admin.222143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547660.log 2024-05-17T11:54:27.585 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.437917.log: /var/log/ceph/ceph-client.admin.422708.log: /var/log/ceph/ceph-client.admin.433546.log: /var/log/ceph/ceph-client.admin.449901.log: /var/log/ceph/ceph-client.admin.393770.log: /var/log/ceph/ceph-client.admin.355596.log: /var/log/ceph/ceph-client.admin.369434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432262.log 2024-05-17T11:54:27.585 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.204356.log: /var/log/ceph/ceph-client.admin.124750.log: /var/log/ceph/ceph-client.admin.370709.log: /var/log/ceph/ceph-client.admin.210331.log: /var/log/ceph/ceph-client.admin.413303.log: /var/log/ceph/ceph-client.admin.206048.log: /var/log/ceph/ceph-client.admin.547660.log: /var/log/ceph/ceph-client.admin.192774.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.561920.log.gz 2024-05-17T11:54:27.585 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.436184.log: /var/log/ceph/ceph-client.admin.183042.log: /var/log/ceph/ceph-client.admin.422294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578247.log 2024-05-17T11:54:27.585 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.251016.log: /var/log/ceph/ceph-client.admin.386849.log: /var/log/ceph/ceph-client.admin.112153.log: /var/log/ceph/ceph-client.admin.45506.log: /var/log/ceph/ceph-client.admin.210322.log: /var/log/ceph/ceph-client.admin.427878.log: /var/log/ceph/ceph-client.admin.121807.log: /var/log/ceph/ceph-client.admin.373250.log: gzip/var/log/ceph/ceph-client.admin.116455.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.394700.log 2024-05-17T11:54:27.585 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.268253.log: /var/log/ceph/ceph-client.admin.126864.log: /var/log/ceph/ceph-client.admin.45160.log: /var/log/ceph/ceph-client.admin.578247.log: /var/log/ceph/ceph-client.admin.139878.log: /var/log/ceph/ceph-client.admin.262249.log: /var/log/ceph/ceph-client.admin.181723.log: /var/log/ceph/ceph-client.admin.374111.log: /var/log/ceph/ceph-client.admin.226946.log: /var/log/ceph/ceph-client.admin.45873.log: /var/log/ceph/ceph-client.admin.237722.log: /var/log/ceph/ceph-client.admin.47392.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.578247.log.gz 2024-05-17T11:54:27.585 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.253147.log: /var/log/ceph/ceph-client.admin.174675.log: /var/log/ceph/ceph-client.admin.189003.log: /var/log/ceph/ceph-client.admin.265219.log: /var/log/ceph/ceph-client.admin.415999.log: /var/log/ceph/ceph-client.admin.443029.log: /var/log/ceph/ceph-client.admin.223064.log: /var/log/ceph/ceph-client.admin.113129.log: /var/log/ceph/ceph-client.admin.110319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264365.log 2024-05-17T11:54:27.585 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43306.log: /var/log/ceph/ceph-client.admin.129918.log: /var/log/ceph/ceph-client.admin.200448.log: /var/log/ceph/ceph-client.admin.116879.log: /var/log/ceph/ceph-client.admin.260557.log: /var/log/ceph/ceph-client.admin.396998.log: /var/log/ceph/ceph-client.admin.264789.log: /var/log/ceph/ceph-client.admin.44828.log: /var/log/ceph/ceph-client.admin.224123.log: /var/log/ceph/ceph-client.admin.196362.log: /var/log/ceph/ceph-client.admin.251453.log: /var/log/ceph/ceph-client.admin.379692.log: /var/log/ceph/ceph-client.admin.430029.log: /var/log/ceph/ceph-client.admin.274618.log: /var/log/ceph/ceph-client.admin.186757.log: /var/log/ceph/ceph-client.admin.208169.log: /var/log/ceph/ceph-client.admin.108464.log: /var/log/ceph/ceph-client.admin.109322.log: /var/log/ceph/ceph-client.admin.360699.log: /var/log/ceph/ceph-client.admin.47845.log: /var/log/ceph/ceph-client.admin.278663.log: /var/log/ceph/ceph-client.admin.412873.log: /var/log/ceph/ceph-client.admin.236858.log: /var/log/ceph/ceph-client.admin.179414.log: /var/log/ceph/ceph-client.admin.277386.log: gzip -5/var/log/ceph/ceph-client.admin.248371.log: --verbose -- /var/log/ceph/ceph-client.admin.448176.log 2024-05-17T11:54:27.586 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.244664.log: /var/log/ceph/ceph-client.admin.433999.log: /var/log/ceph/ceph-client.admin.189881.log: /var/log/ceph/ceph-client.admin.202664.log: /var/log/ceph/ceph-client.admin.237285.log: /var/log/ceph/ceph-client.admin.414218.log: /var/log/ceph/ceph-client.admin.444339.log: /var/log/ceph/ceph-client.admin.378414.log: /var/log/ceph/ceph-client.admin.44403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215558.log 2024-05-17T11:54:27.586 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.125596.log: /var/log/ceph/ceph-client.admin.207744.log: /var/log/ceph/ceph-client.admin.448176.log: /var/log/ceph/ceph-client.admin.350904.log: /var/log/ceph/ceph-client.admin.111681.log: /var/log/ceph/ceph-client.admin.419689.log: /var/log/ceph/ceph-client.admin.363400.log: /var/log/ceph/ceph-client.admin.268677.log: /var/log/ceph/ceph-client.admin.175094.log: /var/log/ceph/ceph-client.admin.390792.log: /var/log/ceph/ceph-client.admin.218699.log: /var/log/ceph/ceph-client.admin.359846.log: /var/log/ceph/ceph-client.admin.46640.log: gzip -5/var/log/ceph/ceph-client.admin.382683.log: --verbose -- /var/log/ceph/ceph-client.admin.473512.log 2024-05-17T11:54:27.586 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.378405.log: /var/log/ceph/ceph-client.admin.232078.log: /var/log/ceph/ceph-client.admin.372814.log: /var/log/ceph/ceph-client.admin.249217.log: /var/log/ceph/ceph-client.admin.401311.log: /var/log/ceph/ceph-client.admin.446056.log: /var/log/ceph/ceph-client.admin.233819.log: /var/log/ceph/ceph-client.admin.225955.log: /var/log/ceph/ceph-client.admin.116032.log: /var/log/ceph/ceph-client.admin.44835.log: /var/log/ceph/ceph-client.admin.446469.log: /var/log/ceph/ceph-client.admin.112661.log: /var/log/ceph/ceph-client.admin.123886.log: /var/log/ceph/ceph-client.admin.45505.log: /var/log/ceph/ceph-client.admin.232554.log: /var/log/ceph/ceph-client.admin.399799.log: /var/log/ceph/ceph-client.admin.213867.log: /var/log/ceph/ceph-client.admin.239995.log: /var/log/ceph/ceph-client.admin.432690.log: /var/log/ceph/ceph-client.admin.45831.log: gzip -5/var/log/ceph/ceph-client.admin.267820.log: --verbose -- /var/log/ceph/ceph-client.admin.42904.log 2024-05-17T11:54:27.587 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.217862.log: /var/log/ceph/ceph-client.admin.359424.log: /var/log/ceph/ceph-client.admin.445191.log: /var/log/ceph/ceph-client.admin.401813.log: /var/log/ceph/ceph-client.admin.426990.log: /var/log/ceph/ceph-client.admin.424031.log: /var/log/ceph/ceph-client.admin.249746.log: /var/log/ceph/ceph-client.admin.430300.log: /var/log/ceph/ceph-client.admin.432271.log: /var/log/ceph/ceph-client.admin.387696.log: /var/log/ceph/ceph-client.admin.126028.log: /var/log/ceph/ceph-client.admin.441316.log: gzip/var/log/ceph/ceph-client.admin.223652.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.369865.log 2024-05-17T11:54:27.587 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42904.log: /var/log/ceph/ceph-client.admin.196823.log: /var/log/ceph/ceph-client.admin.201819.log: /var/log/ceph/ceph-client.admin.361562.log: /var/log/ceph/ceph-client.admin.222152.log: /var/log/ceph/ceph-client.admin.378829.log: /var/log/ceph/ceph-client.admin.459845.log: /var/log/ceph/ceph-client.admin.388590.log: /var/log/ceph/ceph-client.admin.47308.log: /var/log/ceph/ceph-client.admin.443914.log: /var/log/ceph/ceph-client.admin.229943.log: /var/log/ceph/ceph-client.admin.438349.log: /var/log/ceph/ceph-client.admin.473512.log: /var/log/ceph/ceph-client.admin.245501.log: /var/log/ceph/ceph-client.admin.48180.log: /var/log/ceph/ceph-client.admin.221295.log: /var/log/ceph/ceph-client.admin.201362.log: /var/log/ceph/ceph-client.admin.186237.log: /var/log/ceph/ceph-client.admin.401804.log: /var/log/ceph/ceph-client.admin.200457.log: /var/log/ceph/ceph-client.admin.133308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513421.log 2024-05-17T11:54:27.587 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.277810.log: /var/log/ceph/ceph-client.admin.111690.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.578036.log.gz 2024-05-17T11:54:27.587 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.383552.log: /var/log/ceph/ceph-client.admin.129064.log: /var/log/ceph/ceph-client.admin.215972.log: /var/log/ceph/ceph-client.admin.138045.log: /var/log/ceph/ceph-client.admin.376288.log: /var/log/ceph/ceph-client.admin.235527.log: /var/log/ceph/ceph-client.admin.435756.log: /var/log/ceph/ceph-client.admin.187734.log: /var/log/ceph/ceph-client.admin.240446.log: /var/log/ceph/ceph-client.admin.438763.log: /var/log/ceph/ceph-client.admin.447744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543821.log 2024-05-17T11:54:27.588 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.372400.log: 87.6%/var/log/ceph/ceph-client.admin.116041.log: /var/log/ceph/ceph-client.admin.149411.log: /var/log/ceph/ceph-client.admin.513421.log: -- replaced with /var/log/ceph/ceph-client.admin.578289.log.gz 2024-05-17T11:54:27.588 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.129073.log: /var/log/ceph/ceph-client.admin.44235.log: /var/log/ceph/ceph-client.admin.356867.log: /var/log/ceph/ceph-client.admin.356876.log: /var/log/ceph/ceph-client.admin.48930.log: /var/log/ceph/ceph-client.admin.198640.log: /var/log/ceph/ceph-client.admin.114434.log: /var/log/ceph/ceph-client.admin.224577.log: /var/log/ceph/ceph-client.admin.239537.log: /var/log/ceph/ceph-client.admin.216409.log: /var/log/ceph/ceph-client.admin.424022.log: /var/log/ceph/ceph-client.admin.158480.log: /var/log/ceph/ceph-client.admin.457930.log: /var/log/ceph/ceph-client.admin.352187.log: /var/log/ceph/ceph-client.admin.49686.log: /var/log/ceph/ceph-client.admin.138980.log: /var/log/ceph/ceph-client.admin.385514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511496.log 2024-05-17T11:54:27.588 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.205202.log: /var/log/ceph/ceph-client.admin.392078.log: /var/log/ceph/ceph-client.admin.366450.log: /var/log/ceph/ceph-client.admin.426514.log: /var/log/ceph/ceph-client.admin.354317.log: /var/log/ceph/ceph-client.admin.224114.log: /var/log/ceph/ceph-client.admin.220872.log: /var/log/ceph/ceph-client.admin.417308.log: /var/log/ceph/ceph-client.admin.48222.log: /var/log/ceph/ceph-client.admin.139415.log: /var/log/ceph/ceph-client.admin.543821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181271.log 2024-05-17T11:54:27.588 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.511496.log: /var/log/ceph/ceph-client.admin.274191.log: /var/log/ceph/ceph-client.admin.213858.log: /var/log/ceph/ceph-client.admin.139887.log: /var/log/ceph/ceph-client.admin.148527.log: /var/log/ceph/ceph-client.admin.120857.log: /var/log/ceph/ceph-client.admin.207328.log: /var/log/ceph/ceph-client.admin.45173.log: /var/log/ceph/ceph-client.admin.42948.log: /var/log/ceph/ceph-client.admin.372391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445200.log 2024-05-17T11:54:27.588 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.247516.log: /var/log/ceph/ceph-client.admin.117303.log: /var/log/ceph/ceph-client.admin.448623.log: /var/log/ceph/ceph-client.admin.107854.log: /var/log/ceph/ceph-client.admin.44832.log: /var/log/ceph/ceph-client.admin.398798.log: /var/log/ceph/ceph-client.admin.45747.log: /var/log/ceph/ceph-client.admin.221729.log: /var/log/ceph/ceph-client.admin.175949.log: /var/log/ceph/ceph-client.admin.445628.log: /var/log/ceph/ceph-client.admin.375431.log: /var/log/ceph/ceph-client.admin.136279.log: /var/log/ceph/ceph-client.admin.447753.log: /var/log/ceph/ceph-client.admin.44829.log: /var/log/ceph/ceph-client.admin.44277.log: /var/log/ceph/ceph-client.admin.239528.log: /var/log/ceph/ceph-client.admin.442599.log: /var/log/ceph/ceph-client.admin.124759.log: /var/log/ceph/ceph-client.admin.157633.log: /var/log/ceph/ceph-client.admin.44571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557932.log 2024-05-17T11:54:27.588 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.415103.log: /var/log/ceph/ceph-client.admin.45389.log: /var/log/ceph/ceph-client.admin.366018.log: /var/log/ceph/ceph-client.admin.49620.log: /var/log/ceph/ceph-client.admin.244236.log: /var/log/ceph/ceph-client.admin.362968.log: /var/log/ceph/ceph-client.admin.209442.log: /var/log/ceph/ceph-client.admin.459423.log: /var/log/ceph/ceph-client.admin.268668.log: /var/log/ceph/ceph-client.admin.259719.log: gzip/var/log/ceph/ceph-client.admin.352622.log: /var/log/ceph/ceph-client.admin.126441.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.458995.log 2024-05-17T11:54:27.588 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45508.log: /var/log/ceph/ceph-client.admin.47518.log: /var/log/ceph/ceph-client.admin.557932.log: /var/log/ceph/ceph-client.admin.185758.log: /var/log/ceph/ceph-client.admin.448632.log: /var/log/ceph/ceph-client.admin.419276.log: /var/log/ceph/ceph-client.admin.122561.log: /var/log/ceph/ceph-client.admin.402769.log: /var/log/ceph/ceph-client.admin.387273.log: /var/log/ceph/ceph-client.admin.116888.log: /var/log/ceph/ceph-client.admin.48390.log: /var/log/ceph/ceph-client.admin.443491.log: /var/log/ceph/ceph-client.admin.361553.log: /var/log/ceph/ceph-client.admin.384526.log: /var/log/ceph/ceph-client.admin.245087.log: /var/log/ceph/ceph-client.admin.242469.log: /var/log/ceph/ceph-client.admin.439195.log: /var/log/ceph/ceph-client.admin.238681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243375.log 2024-05-17T11:54:27.588 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.142030.log: /var/log/ceph/ceph-client.admin.236435.log: /var/log/ceph/ceph-client.admin.188571.log: /var/log/ceph/ceph-client.admin.184383.log: /var/log/ceph/ceph-client.admin.258266.log: /var/log/ceph/ceph-client.admin.182166.log: /var/log/ceph/ceph-client.admin.44613.log: /var/log/ceph/ceph-client.admin.353046.log: /var/log/ceph/ceph-client.admin.45789.log: /var/log/ceph/ceph-client.admin.108878.log: /var/log/ceph/ceph-client.admin.159910.log: /var/log/ceph/ceph-client.admin.429177.log: /var/log/ceph/ceph-client.admin.251872.log: /var/log/ceph/ceph-client.admin.458995.log: /var/log/ceph/ceph-client.admin.440457.log: /var/log/ceph/ceph-client.admin.275049.log: /var/log/ceph/ceph-client.admin.225484.log: /var/log/ceph/ceph-client.admin.247948.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-17T11:54:27.589 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42642.log: /var/log/ceph/ceph-client.admin.46127.log: /var/log/ceph/ceph-client.admin.373259.log: /var/log/ceph/ceph-client.admin.239986.log: /var/log/ceph/ceph-client.admin.275507.log: /var/log/ceph/ceph-client.admin.425577.log: /var/log/ceph/ceph-client.admin.437045.log: /var/log/ceph/ceph-client.admin.366906.log: /var/log/ceph/ceph-client.admin.202246.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.576407.log.gz 2024-05-17T11:54:27.589 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.260989.log: /var/log/ceph/ceph-client.admin.158489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365181.log 2024-05-17T11:54:27.589 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.123435.log: /var/log/ceph/ceph-client.admin.48516.log: /var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.392924.log: /var/log/ceph/ceph-client.admin.133731.log: /var/log/ceph/ceph-client.admin.430348.log: /var/log/ceph/ceph-client.admin.108455.log: /var/log/ceph/ceph-client.admin.254432.log: /var/log/ceph/ceph-client.admin.457462.log: /var/log/ceph/ceph-client.admin.423141.log: /var/log/ceph/ceph-client.admin.261403.log: /var/log/ceph/ceph-client.admin.395173.log: /var/log/ceph/ceph-client.admin.355163.log: /var/log/ceph/ceph-client.admin.394204.log: gzip/var/log/ceph/ceph-client.admin.393779.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.489701.log 2024-05-17T11:54:27.589 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.379701.log: /var/log/ceph/ceph-client.admin.265228.log: /var/log/ceph/ceph-client.admin.49410.log: /var/log/ceph/ceph-client.admin.421855.log: /var/log/ceph/ceph-client.admin.454046.log: /var/log/ceph/ceph-client.admin.49056.log: /var/log/ceph/ceph-client.admin.179425.log: /var/log/ceph/ceph-client.admin.219180.log: /var/log/ceph/ceph-client.admin.279081.log: /var/log/ceph/ceph-client.admin.354326.log: /var/log/ceph/ceph-client.admin.255698.log: /var/log/ceph/ceph-client.admin.256982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447321.log 2024-05-17T11:54:27.589 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.231233.log: /var/log/ceph/ceph-client.admin.185767.log: /var/log/ceph/ceph-client.admin.457471.log: /var/log/ceph/ceph-client.admin.143791.log: /var/log/ceph/ceph-client.admin.489701.log: /var/log/ceph/ceph-client.admin.263527.log: /var/log/ceph/ceph-client.admin.194111.log: /var/log/ceph/ceph-client.admin.371545.log: /var/log/ceph/ceph-client.admin.394213.log: /var/log/ceph/ceph-client.admin.49014.log: /var/log/ceph/ceph-client.admin.437926.log: /var/log/ceph/ceph-client.admin.454468.log: /var/log/ceph/ceph-client.admin.259196.log: /var/log/ceph/ceph-client.admin.152019.log: /var/log/ceph/ceph-client.admin.234243.log: /var/log/ceph/ceph-client.admin.141603.log: /var/log/ceph/ceph-client.admin.389014.log: /var/log/ceph/ceph-client.admin.440894.log: /var/log/ceph/ceph-client.admin.44445.log: /var/log/ceph/ceph-client.admin.385018.log: /var/log/ceph/ceph-client.admin.262681.log: /var/log/ceph/ceph-client.admin.48348.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.264798.log: /var/log/ceph/ceph-client.admin.255283.log 2024-05-17T11:54:27.589 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42820.log: /var/log/ceph/ceph-client.admin.45388.log: /var/log/ceph/ceph-client.admin.456190.log: /var/log/ceph/ceph-client.admin.123877.log: /var/log/ceph/ceph-client.admin.413312.log: /var/log/ceph/ceph-client.admin.240437.log: /var/log/ceph/ceph-client.admin.209027.log: /var/log/ceph/ceph-client.admin.156654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36820.log 2024-05-17T11:54:27.589 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.456199.log: /var/log/ceph/ceph-client.admin.261835.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.496254.log.gz 2024-05-17T11:54:27.589 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.152497.log: /var/log/ceph/ceph-client.admin.107845.log: /var/log/ceph/ceph-client.admin.257847.log: /var/log/ceph/ceph-client.admin.397431.log: /var/log/ceph/ceph-client.admin.142454.log: /var/log/ceph/ceph-client.admin.396090.log: /var/log/ceph/ceph-client.admin.188580.log: /var/log/ceph/ceph-client.admin.243384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143347.log 2024-05-17T11:54:27.590 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.205634.log: /var/log/ceph/ceph-client.admin.396081.log: /var/log/ceph/ceph-client.admin.212558.log: /var/log/ceph/ceph-client.admin.453613.log: /var/log/ceph/ceph-client.admin.36820.log: /var/log/ceph/ceph-client.admin.195015.log: /var/log/ceph/ceph-client.admin.415094.log: /var/log/ceph/ceph-client.admin.279517.log: /var/log/ceph/ceph-client.admin.386840.log: /var/log/ceph/ceph-client.admin.200005.log: /var/log/ceph/ceph-client.admin.226489.log: /var/log/ceph/ceph-client.admin.220449.log: /var/log/ceph/ceph-client.admin.128641.log: /var/log/ceph/ceph-client.admin.455747.log: /var/log/ceph/ceph-client.admin.415539.log: /var/log/ceph/ceph-client.admin.527785.log: /var/log/ceph/ceph-client.admin.209870.log: /var/log/ceph/ceph-client.admin.137136.log: /var/log/ceph/ceph-client.admin.44100.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.354740.log: -- /var/log/ceph/ceph-client.admin.470297.log 2024-05-17T11:54:27.590 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.255274.log: /var/log/ceph/ceph-client.admin.152028.log: /var/log/ceph/ceph-client.admin.127291.log: /var/log/ceph/ceph-client.admin.275999.log: /var/log/ceph/ceph-client.admin.388581.log: /var/log/ceph/ceph-client.admin.133740.log: /var/log/ceph/ceph-client.admin.115562.log: /var/log/ceph/ceph-client.0.49946.log: /var/log/ceph/ceph-client.admin.202673.log: /var/log/ceph/ceph-client.admin.428302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491011.log 2024-05-17T11:54:27.590 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.233828.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.578457.log.gz 2024-05-17T11:54:27.590 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.276494.log: /var/log/ceph/ceph-client.admin.243375.log: /var/log/ceph/ceph-client.admin.252295.log: /var/log/ceph/ceph-client.admin.275058.log: /var/log/ceph/ceph-client.admin.49144.log: /var/log/ceph/ceph-client.admin.48432.log: /var/log/ceph/ceph-client.admin.48264.log: /var/log/ceph/ceph-client.admin.140729.log: /var/log/ceph/ceph-client.admin.228649.log: /var/log/ceph/ceph-client.admin.244227.log: /var/log/ceph/ceph-client.admin.137145.log: /var/log/ceph/ceph-client.admin.351337.log: /var/log/ceph/ceph-client.admin.255283.log: /var/log/ceph/ceph-client.admin.458567.log: /var/log/ceph/ceph-client.admin.143347.log: /var/log/ceph/ceph-client.admin.229511.log: /var/log/ceph/ceph-client.admin.447321.log: /var/log/ceph/ceph-client.admin.384048.log: /var/log/ceph/ceph-client.admin.446047.log: /var/log/ceph/ceph-client.admin.264365.log: /var/log/ceph/ceph-client.admin.369865.log: /var/log/ceph/ceph-client.admin.48802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127763.log 2024-05-17T11:54:27.590 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.225031.log: /var/log/ceph/ceph-client.admin.470297.log: /var/log/ceph/ceph-client.admin.128226.log: /var/log/ceph/ceph-client.admin.457040.log: /var/log/ceph/ceph-client.admin.460268.log: /var/log/ceph/ceph-client.admin.365181.log: /var/log/ceph/ceph-client.admin.233394.log: /var/log/ceph/ceph-client.admin.360277.log: /var/log/ceph/ceph-client.admin.43432.log: /var/log/ceph/ceph-client.admin.125173.log: /var/log/ceph/ceph-client.admin.192783.log: /var/log/ceph/ceph-client.admin.432262.log: /var/log/ceph/ceph-client.admin.394700.log: /var/log/ceph/ceph-client.admin.215558.log: /var/log/ceph/ceph-client.admin.491011.log: /var/log/ceph/ceph-client.admin.181271.log: /var/log/ceph/ceph-client.admin.445200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221720.log 2024-05-17T11:54:27.590 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.127763.log: -- /var/log/ceph/ceph-client.admin.378838.log 2024-05-17T11:54:27.590 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.221720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561018.log 2024-05-17T11:54:27.590 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.378838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377134.log 2024-05-17T11:54:27.591 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.557496.log.gz 2024-05-17T11:54:27.591 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.561018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258275.log 2024-05-17T11:54:27.591 INFO:teuthology.orchestra.run.smithi131.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.560563.log.gz 2024-05-17T11:54:27.591 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.377134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122993.log 2024-05-17T11:54:27.591 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.258275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248794.log 2024-05-17T11:54:27.591 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.122993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425154.log 2024-05-17T11:54:27.591 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.248794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48054.log 2024-05-17T11:54:27.591 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.425154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216418.log 2024-05-17T11:54:27.592 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159487.log 2024-05-17T11:54:27.592 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262258.log/var/log/ceph/ceph-client.admin.216418.log: 2024-05-17T11:54:27.592 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.159487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389938.log 2024-05-17T11:54:27.592 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374102.log 2024-05-17T11:54:27.592 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.262258.log: /var/log/ceph/ceph-client.admin.389938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412882.log 2024-05-17T11:54:27.592 INFO:teuthology.orchestra.run.smithi131.stderr:gzip/var/log/ceph/ceph-client.admin.374102.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.417733.log 2024-05-17T11:54:27.592 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.552594.log.gz 2024-05-17T11:54:27.592 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.412882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502407.log 2024-05-17T11:54:27.592 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.417733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430339.log 2024-05-17T11:54:27.593 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.502407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493292.log 2024-05-17T11:54:27.593 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483169.log 2024-05-17T11:54:27.593 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.430339.log: /var/log/ceph/ceph-client.admin.493292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250169.log 2024-05-17T11:54:27.593 INFO:teuthology.orchestra.run.smithi131.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.560126.log.gz 2024-05-17T11:54:27.593 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.483169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392087.log 2024-05-17T11:54:27.593 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.250169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534928.log 2024-05-17T11:54:27.593 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.392087.log: /var/log/ceph/ceph-client.admin.427417.log 2024-05-17T11:54:27.593 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.534928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196814.log 2024-05-17T11:54:27.594 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.427417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511919.log 2024-05-17T11:54:27.594 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.196814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450329.log 2024-05-17T11:54:27.594 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.511919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189466.log 2024-05-17T11:54:27.594 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267829.log 2024-05-17T11:54:27.594 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.189466.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.450329.log: -- /var/log/ceph/ceph-client.admin.242926.log 2024-05-17T11:54:27.594 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.267829.log: 92.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.560572.log.gz 2024-05-17T11:54:27.594 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.561465.log 2024-05-17T11:54:27.594 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.242926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242478.log 2024-05-17T11:54:27.595 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.561465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239113.log 2024-05-17T11:54:27.595 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.242478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435325.log 2024-05-17T11:54:27.595 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.239113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143782.log 2024-05-17T11:54:27.595 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.435325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263095.log 2024-05-17T11:54:27.595 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.143782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158066.log 2024-05-17T11:54:27.595 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458330.log 2024-05-17T11:54:27.595 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.263095.log: /var/log/ceph/ceph-client.admin.158066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578120.log 2024-05-17T11:54:27.595 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197266.log 2024-05-17T11:54:27.595 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.578120.log: /var/log/ceph/ceph-client.admin.458330.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.578120.log.gz 2024-05-17T11:54:27.596 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177647.log 2024-05-17T11:54:27.596 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.197266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428763.log 2024-05-17T11:54:27.596 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362520.log 2024-05-17T11:54:27.596 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.428763.log: /var/log/ceph/ceph-client.admin.177647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363814.log 2024-05-17T11:54:27.596 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.362520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422285.log 2024-05-17T11:54:27.596 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578373.log 2024-05-17T11:54:27.596 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.363814.log: /var/log/ceph/ceph-client.admin.422285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222566.log 2024-05-17T11:54:27.623 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.578373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136288.log 2024-05-17T11:54:27.623 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222575.log 2024-05-17T11:54:27.624 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.222566.log: /var/log/ceph/ceph-client.admin.136288.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.578373.log.gz 2024-05-17T11:54:27.624 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393356.log 2024-05-17T11:54:27.624 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.222575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214712.log 2024-05-17T11:54:27.624 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501984.log 2024-05-17T11:54:27.625 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.393356.log: /var/log/ceph/ceph-client.admin.214712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577950.log 2024-05-17T11:54:27.625 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424454.log 2024-05-17T11:54:27.625 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.501984.log: /var/log/ceph/ceph-client.admin.577950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135853.log 2024-05-17T11:54:27.625 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.512479.log.gz 2024-05-17T11:54:27.626 INFO:teuthology.orchestra.run.smithi131.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.577950.log.gz 2024-05-17T11:54:27.626 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.424454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226955.log 2024-05-17T11:54:27.626 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% 80.4% -- replaced with /var/log/ceph/ceph-client.admin.572195.log.gz 2024-05-17T11:54:27.627 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.564139.log.gz 84.2% -- replaced with /var/log/ceph/ceph-client.admin.517263.log.gz 2024-05-17T11:54:27.627 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.627 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.135853.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.205202.log.gz 2024-05-17T11:54:27.627 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% 92.1% -- replaced with /var/log/ceph/ceph-client.admin.148963.log.gz 2024-05-17T11:54:27.627 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.536198.log.gz 2024-05-17T11:54:27.627 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194102.log 2024-05-17T11:54:27.628 INFO:teuthology.orchestra.run.smithi131.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.489692.log.gz 2024-05-17T11:54:27.628 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48846.log 2024-05-17T11:54:27.628 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.226955.log: /var/log/ceph/ceph-client.admin.194102.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.262258.log.gz 2024-05-17T11:54:27.628 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398342.log 2024-05-17T11:54:27.629 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.48846.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.504971.log.gz 2024-05-17T11:54:27.629 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.489701.log.gz 2024-05-17T11:54:27.629 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368176.log 2024-05-17T11:54:27.629 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.398342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229073.log 2024-05-17T11:54:27.629 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250160.log 2024-05-17T11:54:27.630 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.368176.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.229073.log: /var/log/ceph/ceph-client.admin.440885.log 2024-05-17T11:54:27.630 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.250160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113138.log 2024-05-17T11:54:27.630 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.440885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504117.log 2024-05-17T11:54:27.631 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.113138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269120.log 2024-05-17T11:54:27.631 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.504117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374580.log 2024-05-17T11:54:27.631 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435765.log 2024-05-17T11:54:27.631 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.269120.log: /var/log/ceph/ceph-client.admin.374580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358140.log 2024-05-17T11:54:27.632 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.435765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140310.log 2024-05-17T11:54:27.632 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.358140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279090.log 2024-05-17T11:54:27.632 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.140310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479117.log 2024-05-17T11:54:27.632 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.279090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485783.log 2024-05-17T11:54:27.632 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.479117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385993.log 2024-05-17T11:54:27.632 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.485783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49578.log 2024-05-17T11:54:27.633 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.385993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504531.log 2024-05-17T11:54:27.633 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549911.log 2024-05-17T11:54:27.633 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.504531.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.566366.log.gz 2024-05-17T11:54:27.633 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504962.log 2024-05-17T11:54:27.633 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141158.log 2024-05-17T11:54:27.633 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.549911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459432.log 2024-05-17T11:54:27.633 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.504962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485348.log 2024-05-17T11:54:27.633 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.141158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537894.log 2024-05-17T11:54:27.634 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.459432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428293.log 2024-05-17T11:54:27.634 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.485348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253584.log 2024-05-17T11:54:27.634 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.537894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563694.log 2024-05-17T11:54:27.634 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.428293.log: /var/log/ceph/ceph-client.admin.253584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555745.log 2024-05-17T11:54:27.634 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245979.log 2024-05-17T11:54:27.634 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.563694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198649.log 2024-05-17T11:54:27.634 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.555745.log: /var/log/ceph/ceph-client.admin.245979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254855.log 2024-05-17T11:54:27.635 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268244.log 2024-05-17T11:54:27.635 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.198649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379265.log 2024-05-17T11:54:27.635 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.254855.log: /var/log/ceph/ceph-client.admin.268244.log: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.183927.log.gz 2024-05-17T11:54:27.635 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564584.log 2024-05-17T11:54:27.635 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203933.log 2024-05-17T11:54:27.635 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.379265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178966.log 2024-05-17T11:54:27.635 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.564584.log: /var/log/ceph/ceph-client.admin.203933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199101.log 2024-05-17T11:54:27.635 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.178966.log: --/var/log/ceph/ceph-client.admin.199101.log: /var/log/ceph/ceph-client.admin.176368.log 2024-05-17T11:54:27.635 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371122.log 2024-05-17T11:54:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.176368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400821.log 2024-05-17T11:54:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.371122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555321.log 2024-05-17T11:54:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.400821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456618.log 2024-05-17T11:54:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.555321.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.192331.log.gz 2024-05-17T11:54:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578415.log 2024-05-17T11:54:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267396.log 2024-05-17T11:54:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.456618.log: /var/log/ceph/ceph-client.admin.578415.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.578415.log.gz 2024-05-17T11:54:27.636 INFO:teuthology.orchestra.run.smithi131.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.501037.log.gz 2024-05-17T11:54:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199553.log 2024-05-17T11:54:27.637 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.267396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144210.log 2024-05-17T11:54:27.637 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389474.log 2024-05-17T11:54:27.637 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.199553.log: /var/log/ceph/ceph-client.admin.144210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279508.log 2024-05-17T11:54:27.637 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217016.log 2024-05-17T11:54:27.637 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.389474.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.156663.log.gz 2024-05-17T11:54:27.637 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.175940.log.gz 2024-05-17T11:54:27.637 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.279508.log: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.175094.log.gz 2024-05-17T11:54:27.637 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565485.log 2024-05-17T11:54:27.637 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.175949.log.gz 2024-05-17T11:54:27.638 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.217016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474834.log 2024-05-17T11:54:27.638 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247525.log 2024-05-17T11:54:27.638 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.565485.log: /var/log/ceph/ceph-client.admin.474834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568168.log 2024-05-17T11:54:27.638 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.247525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564148.log 2024-05-17T11:54:27.638 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.568168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516843.log 2024-05-17T11:54:27.638 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370700.log 2024-05-17T11:54:27.638 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.564148.log: /var/log/ceph/ceph-client.admin.516843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363391.log 2024-05-17T11:54:27.639 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.370700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260134.log 2024-05-17T11:54:27.639 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490152.log 2024-05-17T11:54:27.639 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.363391.log: /var/log/ceph/ceph-client.admin.260134.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.377134.log.gz 2024-05-17T11:54:27.639 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565039.log 2024-05-17T11:54:27.639 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.490152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416422.log 2024-05-17T11:54:27.639 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559247.log 2024-05-17T11:54:27.639 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.565039.log: /var/log/ceph/ceph-client.admin.416422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176800.log 2024-05-17T11:54:27.639 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.559247.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.378405.log.gz 81.0% -- replaced with /var/log/ceph/ceph-client.admin.378829.log.gz 2024-05-17T11:54:27.639 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469874.log 2024-05-17T11:54:27.640 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.378414.log.gz 2024-05-17T11:54:27.640 INFO:teuthology.orchestra.run.smithi131.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.378838.log.gz 2024-05-17T11:54:27.640 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.640 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.176800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49367.log 2024-05-17T11:54:27.640 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.469874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157119.log 2024-05-17T11:54:27.640 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477003.log 2024-05-17T11:54:27.640 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.157119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150705.log 2024-05-17T11:54:27.641 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.477003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355172.log 2024-05-17T11:54:27.641 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.150705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112652.log 2024-05-17T11:54:27.650 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.355172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373687.log 2024-05-17T11:54:27.650 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.112652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263950.log 2024-05-17T11:54:27.651 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.373687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360690.log 2024-05-17T11:54:27.651 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.263950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150696.log 2024-05-17T11:54:27.651 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447330.log 2024-05-17T11:54:27.651 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.360690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504108.log 2024-05-17T11:54:27.651 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.150696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159901.log 2024-05-17T11:54:27.651 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.447330.log: /var/log/ceph/ceph-client.admin.504108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368167.log 2024-05-17T11:54:27.651 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569107.log 2024-05-17T11:54:27.651 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.159901.log: /var/log/ceph/ceph-client.admin.368167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419267.log 2024-05-17T11:54:27.652 INFO:teuthology.orchestra.run.smithi131.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.486686.log.gz 2024-05-17T11:54:27.652 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208178.log 2024-05-17T11:54:27.652 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.569107.log: /var/log/ceph/ceph-client.admin.419267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570004.log 2024-05-17T11:54:27.652 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188157.log 2024-05-17T11:54:27.652 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.208178.log: /var/log/ceph/ceph-client.admin.570004.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.486695.log.gz 2024-05-17T11:54:27.652 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568642.log 2024-05-17T11:54:27.652 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.188157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514695.log 2024-05-17T11:54:27.653 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376279.log 2024-05-17T11:54:27.653 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.568642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434846.log 2024-05-17T11:54:27.653 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.514695.log: /var/log/ceph/ceph-client.admin.376279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577286.log 2024-05-17T11:54:27.653 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.434846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423571.log 2024-05-17T11:54:27.653 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.577286.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.577286.log.gz 2024-05-17T11:54:27.653 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266949.log 2024-05-17T11:54:27.653 INFO:teuthology.orchestra.run.smithi131.stderr: 79.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355586.log -- replaced with /var/log/ceph/ceph-client.admin.481406.log.gz 2024-05-17T11:54:27.653 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.654 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.480939.log.gz 2024-05-17T11:54:27.654 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.423571.log: /var/log/ceph/ceph-client.admin.266949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220026.log 2024-05-17T11:54:27.654 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.355586.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.480525.log.gz 2024-05-17T11:54:27.654 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577725.log 2024-05-17T11:54:27.654 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375440.log 2024-05-17T11:54:27.654 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.220026.log: /var/log/ceph/ceph-client.admin.577725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505450.log 2024-05-17T11:54:27.654 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151119.log 2024-05-17T11:54:27.655 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.505450.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.577725.log.gz 2024-05-17T11:54:27.655 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.375440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481847.log 2024-05-17T11:54:27.655 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.151119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260143.log 2024-05-17T11:54:27.655 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.481847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114702.log 2024-05-17T11:54:27.655 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526131.log 2024-05-17T11:54:27.655 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.260143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546749.log 2024-05-17T11:54:27.655 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.114702.log: /var/log/ceph/ceph-client.admin.526131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265642.log 2024-05-17T11:54:27.655 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277801.log 2024-05-17T11:54:27.656 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.546749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454882.log 2024-05-17T11:54:27.656 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.265642.log: /var/log/ceph/ceph-client.admin.277801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556586.log 2024-05-17T11:54:27.656 INFO:teuthology.orchestra.run.smithi131.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.517272.log.gz 2024-05-17T11:54:27.656 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477417.log 2024-05-17T11:54:27.656 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.454882.log: /var/log/ceph/ceph-client.admin.556586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396564.log 2024-05-17T11:54:27.659 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430038.log 2024-05-17T11:54:27.659 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.477417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213445.log 2024-05-17T11:54:27.659 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.396564.log: /var/log/ceph/ceph-client.admin.430038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509744.log 2024-05-17T11:54:27.659 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.213445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45999.log 2024-05-17T11:54:27.660 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.195919.log.gz 2024-05-17T11:54:27.660 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.509744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231655.log 2024-05-17T11:54:27.660 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510642.log 2024-05-17T11:54:27.660 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.231655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389465.log 2024-05-17T11:54:27.660 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.510642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189890.log 2024-05-17T11:54:27.660 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276961.log 2024-05-17T11:54:27.661 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.389465.log: /var/log/ceph/ceph-client.admin.189890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536630.log 2024-05-17T11:54:27.662 INFO:teuthology.orchestra.run.smithi131.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.569995.log.gz 2024-05-17T11:54:27.662 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278231.log 2024-05-17T11:54:27.662 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.276961.log: /var/log/ceph/ceph-client.admin.536630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493283.log 2024-05-17T11:54:27.662 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176377.log 2024-05-17T11:54:27.663 INFO:teuthology.orchestra.run.smithi131.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.569569.log.gz 2024-05-17T11:54:27.663 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.278231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443038.log 2024-05-17T11:54:27.663 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.493283.log: /var/log/ceph/ceph-client.admin.176377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377143.log 2024-05-17T11:54:27.663 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469865.log 2024-05-17T11:54:27.664 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.443038.log: /var/log/ceph/ceph-client.admin.377143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138508.log 2024-05-17T11:54:27.664 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190987.log 2024-05-17T11:54:27.665 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.469865.log: /var/log/ceph/ceph-client.admin.138508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44487.log 2024-05-17T11:54:27.666 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194563.log 2024-05-17T11:54:27.667 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.190987.log: /var/log/ceph/ceph-client.admin.44487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515118.log 2024-05-17T11:54:27.667 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361991.log 2024-05-17T11:54:27.668 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.194563.log: /var/log/ceph/ceph-client.admin.515118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159219.log 2024-05-17T11:54:27.669 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233403.log 2024-05-17T11:54:27.670 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.361991.log: /var/log/ceph/ceph-client.admin.159219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492868.log 2024-05-17T11:54:27.693 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424445.log 2024-05-17T11:54:27.694 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.233403.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.430339.log.gz 2024-05-17T11:54:27.694 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.492868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383097.log 2024-05-17T11:54:27.694 INFO:teuthology.orchestra.run.smithi131.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.560117.log.gz 2024-05-17T11:54:27.695 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.559661.log.gz 2024-05-17T11:54:27.695 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223661.log 2024-05-17T11:54:27.695 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.424445.log: /var/log/ceph/ceph-client.admin.383097.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.393356.log.gz 81.9% 83.5% -- replaced with /var/log/ceph/ceph-client.admin.539163.log.gz -- replaced with /var/log/ceph/ceph-client.admin.538317.log.gz 2024-05-17T11:54:27.695 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.696 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.696 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134578.log 2024-05-17T11:54:27.696 INFO:teuthology.orchestra.run.smithi131.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.538740.log.gz 2024-05-17T11:54:27.697 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.223661.log: /var/log/ceph/ceph-client.admin.134578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478687.log 2024-05-17T11:54:27.697 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.540442.log.gz 2024-05-17T11:54:27.697 INFO:teuthology.orchestra.run.smithi131.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.547660.log.gz 2024-05-17T11:54:27.697 INFO:teuthology.orchestra.run.smithi131.stderr: 79.0% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.538749.log.gz -- replaced with /var/log/ceph/ceph-client.admin.554014.log.gz 2024-05-17T11:54:27.697 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.698 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.494206.log.gz 2024-05-17T11:54:27.698 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.538326.log.gz 2024-05-17T11:54:27.698 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205625.log 2024-05-17T11:54:27.699 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.559247.log.gz 2024-05-17T11:54:27.699 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.548084.log.gz 2024-05-17T11:54:27.699 INFO:teuthology.orchestra.run.smithi131.stderr: 77.8%/var/log/ceph/ceph-client.admin.478687.log: -- replaced with /var/log/ceph/ceph-client.admin.542974.log.gz 2024-05-17T11:54:27.699 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385027.log 2024-05-17T11:54:27.700 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.548093.log.gz 2024-05-17T11:54:27.700 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.205625.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.554023.log.gz 84.3% -- replaced with /var/log/ceph/ceph-client.admin.544710.log.gz 2024-05-17T11:54:27.700 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.700 INFO:teuthology.orchestra.run.smithi131.stderr:gzip 81.7% -- replaced with /var/log/ceph/ceph-client.admin.419267.log.gz 2024-05-17T11:54:27.701 INFO:teuthology.orchestra.run.smithi131.stderr: -5 89.5% -- replaced with /var/log/ceph/ceph-client.admin.547669.log.gz 2024-05-17T11:54:27.701 INFO:teuthology.orchestra.run.smithi131.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.440885.log.gz 2024-05-17T11:54:27.701 INFO:teuthology.orchestra.run.smithi131.stderr: --verbose -- /var/log/ceph/ceph-client.admin.114693.log 2024-05-17T11:54:27.702 INFO:teuthology.orchestra.run.smithi131.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.545153.log.gz 2024-05-17T11:54:27.702 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.385027.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.424445.log.gz 2024-05-17T11:54:27.702 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.544719.log.gz 2024-05-17T11:54:27.702 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142914.log 2024-05-17T11:54:27.703 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.542983.log.gz 2024-05-17T11:54:27.703 INFO:teuthology.orchestra.run.smithi131.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.442171.log.gz 2024-05-17T11:54:27.703 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.114693.log: /var/log/ceph/ceph-client.admin.142914.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.497593.log.gz 2024-05-17T11:54:27.703 INFO:teuthology.orchestra.run.smithi131.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.564584.log.gz 2024-05-17T11:54:27.703 INFO:teuthology.orchestra.run.smithi131.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.498016.log.gz 2024-05-17T11:54:27.704 INFO:teuthology.orchestra.run.smithi131.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.479117.log.gz 2024-05-17T11:54:27.704 INFO:teuthology.orchestra.run.smithi131.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.141158.log.gz 2024-05-17T11:54:27.704 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48846.log.gz 2024-05-17T11:54:27.704 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.497602.log.gz 2024-05-17T11:54:27.704 INFO:teuthology.orchestra.run.smithi131.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.135853.log.gz 2024-05-17T11:54:27.704 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.205625.log.gz 2024-05-17T11:54:27.704 INFO:teuthology.orchestra.run.smithi131.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.159910.log.gz 2024-05-17T11:54:27.705 INFO:teuthology.orchestra.run.smithi131.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.278231.log.gz 2024-05-17T11:54:27.705 INFO:teuthology.orchestra.run.smithi131.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.260134.log.gz 2024-05-17T11:54:27.705 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.276961.log.gz 2024-05-17T11:54:27.705 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.358140.log.gz 2024-05-17T11:54:27.705 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.360690.log.gz 2024-05-17T11:54:27.705 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.194102.log.gz 2024-05-17T11:54:27.705 INFO:teuthology.orchestra.run.smithi131.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.151547.log.gz 2024-05-17T11:54:27.705 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.233403.log.gz 2024-05-17T11:54:27.706 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.260143.log.gz 2024-05-17T11:54:27.706 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.513840.log.gz 2024-05-17T11:54:27.706 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.226955.log.gz 2024-05-17T11:54:27.706 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.475258.log.gz 2024-05-17T11:54:27.706 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49578.log.gz 2024-05-17T11:54:27.706 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.476138.log.gz 2024-05-17T11:54:27.706 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.476147.log.gz 2024-05-17T11:54:27.706 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.134587.log.gz 2024-05-17T11:54:27.707 INFO:teuthology.orchestra.run.smithi131.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.501028.log.gz 2024-05-17T11:54:27.707 INFO:teuthology.orchestra.run.smithi131.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.505450.log.gz 2024-05-17T11:54:27.707 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.500190.log.gz 2024-05-17T11:54:27.708 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.385027.log.gz 2024-05-17T11:54:27.708 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.386002.log.gz 2024-05-17T11:54:27.708 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.508898.log.gz 2024-05-17T11:54:27.708 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.473014.log.gz 2024-05-17T11:54:27.708 INFO:teuthology.orchestra.run.smithi131.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.372823.log.gz 2024-05-17T11:54:27.708 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.557505.log.gz 2024-05-17T11:54:27.709 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.469028.log.gz 2024-05-17T11:54:27.716 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% 89.6% -- replaced with /var/log/ceph/ceph-client.admin.541714.log.gz -- replaced with /var/log/ceph/ceph-client.admin.543830.log.gz 2024-05-17T11:54:27.716 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:27.716 INFO:teuthology.orchestra.run.smithi131.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.513176.log.gz 2024-05-17T11:54:27.731 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.497176.log.gz 2024-05-17T11:54:27.741 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.151556.log.gz 2024-05-17T11:54:27.743 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.549902.log.gz 2024-05-17T11:54:27.754 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.552168.log.gz 2024-05-17T11:54:27.754 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.570860.log.gz 2024-05-17T11:54:27.778 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.473521.log.gz 2024-05-17T11:54:27.780 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.477417.log.gz 2024-05-17T11:54:27.781 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.478687.log.gz 2024-05-17T11:54:27.782 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.478696.log.gz 2024-05-17T11:54:27.782 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.477003.log.gz 2024-05-17T11:54:27.785 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.510651.log.gz 2024-05-17T11:54:27.789 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.551307.log.gz 2024-05-17T11:54:27.793 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.484429.log.gz 2024-05-17T11:54:27.796 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.485339.log.gz 2024-05-17T11:54:27.796 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.485774.log.gz 2024-05-17T11:54:27.798 INFO:teuthology.orchestra.run.smithi131.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.514263.log.gz 2024-05-17T11:54:27.799 INFO:teuthology.orchestra.run.smithi131.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.515959.log.gz 2024-05-17T11:54:27.800 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.514272.log.gz 2024-05-17T11:54:27.801 INFO:teuthology.orchestra.run.smithi131.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.536207.log.gz 2024-05-17T11:54:27.802 INFO:teuthology.orchestra.run.smithi131.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.536621.log.gz 2024-05-17T11:54:27.803 INFO:teuthology.orchestra.run.smithi131.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.571737.log.gz 2024-05-17T11:54:27.803 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.389474.log.gz 2024-05-17T11:54:27.805 INFO:teuthology.orchestra.run.smithi131.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.474364.log.gz 2024-05-17T11:54:27.805 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.558369.log.gz 2024-05-17T11:54:27.806 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.477849.log.gz 2024-05-17T11:54:27.808 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.503693.log.gz 2024-05-17T11:54:27.809 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.432699.log.gz 2024-05-17T11:54:27.810 INFO:teuthology.orchestra.run.smithi131.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.472027.log.gz 2024-05-17T11:54:27.811 INFO:teuthology.orchestra.run.smithi131.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.473005.log.gz 2024-05-17T11:54:27.812 INFO:teuthology.orchestra.run.smithi131.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.458339.log.gz 2024-05-17T11:54:27.812 INFO:teuthology.orchestra.run.smithi131.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.499287.log.gz 2024-05-17T11:54:27.813 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.496687.log.gz 2024-05-17T11:54:27.817 INFO:teuthology.orchestra.run.smithi131.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.266949.log.gz 2024-05-17T11:54:27.824 INFO:teuthology.orchestra.run.smithi131.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.468596.log.gz 2024-05-17T11:54:27.826 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.178513.log.gz 2024-05-17T11:54:27.850 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.522920.log.gz 2024-05-17T11:54:27.851 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.534505.log.gz 2024-05-17T11:54:27.852 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.539586.log.gz 2024-05-17T11:54:27.853 INFO:teuthology.orchestra.run.smithi131.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.540009.log.gz 2024-05-17T11:54:27.853 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.540018.log.gz 2024-05-17T11:54:27.855 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.469451.log.gz 2024-05-17T11:54:27.855 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.254846.log.gz 2024-05-17T11:54:27.863 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.542137.log.gz 2024-05-17T11:54:27.873 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.546740.log.gz 2024-05-17T11:54:27.873 INFO:teuthology.orchestra.run.smithi131.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.545886.log.gz 2024-05-17T11:54:27.874 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.547164.log.gz 2024-05-17T11:54:27.875 INFO:teuthology.orchestra.run.smithi131.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.548507.log.gz 2024-05-17T11:54:27.876 INFO:teuthology.orchestra.run.smithi131.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.562803.log.gz 2024-05-17T11:54:27.876 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.546749.log.gz 2024-05-17T11:54:27.876 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.573531.log.gz 2024-05-17T11:54:27.877 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.495830.log.gz 2024-05-17T11:54:27.878 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.570428.log.gz 2024-05-17T11:54:27.879 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.495416.log.gz 2024-05-17T11:54:27.879 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.495839.log.gz 2024-05-17T11:54:27.884 INFO:teuthology.orchestra.run.smithi131.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.487690.log.gz 2024-05-17T11:54:27.884 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.487210.log.gz 2024-05-17T11:54:27.884 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.484438.log.gz 2024-05-17T11:54:27.885 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.492859.log.gz 2024-05-17T11:54:27.887 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.492868.log.gz 2024-05-17T11:54:27.888 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.565920.log.gz 2024-05-17T11:54:27.888 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.205211.log.gz 2024-05-17T11:54:27.890 INFO:teuthology.orchestra.run.smithi131.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.564593.log.gz 2024-05-17T11:54:27.890 INFO:teuthology.orchestra.run.smithi131.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.549436.log.gz 2024-05-17T11:54:27.894 INFO:teuthology.orchestra.run.smithi131.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.507601.log.gz 2024-05-17T11:54:27.895 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.508460.log.gz 2024-05-17T11:54:27.895 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.195910.log.gz 2024-05-17T11:54:27.896 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.507185.log.gz 2024-05-17T11:54:27.896 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.508040.log.gz 2024-05-17T11:54:27.897 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.508469.log.gz 2024-05-17T11:54:27.898 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.515968.log.gz 2024-05-17T11:54:27.898 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.500181.log.gz 2024-05-17T11:54:27.898 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.565476.log.gz 2024-05-17T11:54:27.898 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.513849.log.gz 2024-05-17T11:54:27.899 INFO:teuthology.orchestra.run.smithi131.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.501487.log.gz 2024-05-17T11:54:27.928 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.555745.log.gz 2024-05-17T11:54:27.940 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.446906.log.gz 2024-05-17T11:54:27.943 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.529416.log.gz 2024-05-17T11:54:27.944 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.519715.log.gz 2024-05-17T11:54:27.944 INFO:teuthology.orchestra.run.smithi131.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.472516.log.gz 2024-05-17T11:54:27.945 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.498441.log.gz 2024-05-17T11:54:27.954 INFO:teuthology.orchestra.run.smithi131.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.512929.log.gz 2024-05-17T11:54:27.958 INFO:teuthology.orchestra.run.smithi131.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.353898.log.gz 2024-05-17T11:54:27.962 INFO:teuthology.orchestra.run.smithi131.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.537470.log.gz 2024-05-17T11:54:27.962 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.458576.log.gz 2024-05-17T11:54:27.962 INFO:teuthology.orchestra.run.smithi131.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.554876.log.gz 2024-05-17T11:54:27.965 INFO:teuthology.orchestra.run.smithi131.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.558783.log.gz 2024-05-17T11:54:27.970 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.491892.log.gz 2024-05-17T11:54:27.971 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.571294.log.gz 2024-05-17T11:54:27.992 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.511074.log.gz 2024-05-17T11:54:27.995 INFO:teuthology.orchestra.run.smithi131.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.266488.log.gz 2024-05-17T11:54:28.003 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.470288.log.gz 2024-05-17T11:54:28.008 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.498450.log.gz 2024-05-17T11:54:28.009 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.396564.log.gz 2024-05-17T11:54:28.016 INFO:teuthology.orchestra.run.smithi131.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.480093.log.gz 2024-05-17T11:54:28.016 INFO:teuthology.orchestra.run.smithi131.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.571285.log.gz 2024-05-17T11:54:28.016 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.480102.log.gz 2024-05-17T11:54:28.017 INFO:teuthology.orchestra.run.smithi131.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.574462.log.gz 90.0% 2024-05-17T11:54:28.017 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.574033.log.gz 2024-05-17T11:54:28.019 INFO:teuthology.orchestra.run.smithi131.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.568177.log.gz 2024-05-17T11:54:28.020 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.551730.log.gz 2024-05-17T11:54:28.025 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44529.log.gz 2024-05-17T11:54:28.033 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.563703.log.gz 2024-05-17T11:54:28.034 INFO:teuthology.orchestra.run.smithi131.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42862.log.gz 2024-05-17T11:54:28.040 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.135013.log.gz 2024-05-17T11:54:28.041 INFO:teuthology.orchestra.run.smithi131.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.191414.log.gz 2024-05-17T11:54:28.047 INFO:teuthology.orchestra.run.smithi131.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.177219.log.gz 2024-05-17T11:54:28.052 INFO:teuthology.orchestra.run.smithi131.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.535773.log.gz 2024-05-17T11:54:28.054 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.553015.log.gz 2024-05-17T11:54:28.056 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.484015.log.gz 2024-05-17T11:54:28.056 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.553027.log.gz 2024-05-17T11:54:28.057 INFO:teuthology.orchestra.run.smithi131.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.513412.log.gz 2024-05-17T11:54:28.057 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.514686.log.gz 2024-05-17T11:54:28.057 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.572692.log.gz 2024-05-17T11:54:28.057 INFO:teuthology.orchestra.run.smithi131.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.516834.log.gz 2024-05-17T11:54:28.057 INFO:teuthology.orchestra.run.smithi131.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.565030.log.gz 2024-05-17T11:54:28.057 INFO:teuthology.orchestra.run.smithi131.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.534919.log.gz 2024-05-17T11:54:28.058 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.473936.log.gz 2024-05-17T11:54:28.058 INFO:teuthology.orchestra.run.smithi131.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.476566.log.gz 2024-05-17T11:54:28.060 INFO:teuthology.orchestra.run.smithi131.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.384039.log.gz 2024-05-17T11:54:28.060 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.395660.log.gz 2024-05-17T11:54:28.066 INFO:teuthology.orchestra.run.smithi131.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.508889.log.gz 2024-05-17T11:54:28.070 INFO:teuthology.orchestra.run.smithi131.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.179902.log.gz 2024-05-17T11:54:28.073 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.234252.log.gz 2024-05-17T11:54:28.080 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.554442.log.gz 2024-05-17T11:54:28.090 INFO:teuthology.orchestra.run.smithi131.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.551298.log.gz 2024-05-17T11:54:28.095 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.390370.log.gz 2024-05-17T11:54:28.095 INFO:teuthology.orchestra.run.smithi131.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.481415.log.gz 2024-05-17T11:54:28.096 INFO:teuthology.orchestra.run.smithi131.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.156140.log.gz 2024-05-17T11:54:28.097 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44833.log.gz 2024-05-17T11:54:28.097 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.253156.log.gz 2024-05-17T11:54:28.123 INFO:teuthology.orchestra.run.smithi131.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.420558.log.gz 2024-05-17T11:54:28.124 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.421864.log.gz 2024-05-17T11:54:28.124 INFO:teuthology.orchestra.run.smithi131.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.423132.log.gz 2024-05-17T11:54:28.126 INFO:teuthology.orchestra.run.smithi131.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45165.log.gz 2024-05-17T11:54:28.131 INFO:teuthology.orchestra.run.smithi131.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.562812.log.gz 2024-05-17T11:54:28.138 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.151128.log.gz 2024-05-17T11:54:28.140 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47919.log.gz 2024-05-17T11:54:28.140 INFO:teuthology.orchestra.run.smithi131.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47722.log.gz 2024-05-17T11:54:28.141 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49100.log.gz 2024-05-17T11:54:28.141 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49283.log.gz 2024-05-17T11:54:28.142 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.399790.log.gz 2024-05-17T11:54:28.143 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.217430.log.gz 2024-05-17T11:54:28.144 INFO:teuthology.orchestra.run.smithi131.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.262672.log.gz 2024-05-17T11:54:28.145 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.265651.log.gz 2024-05-17T11:54:28.145 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.357727.log.gz 2024-05-17T11:54:28.147 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.359433.log.gz 2024-05-17T11:54:28.148 INFO:teuthology.orchestra.run.smithi131.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.503260.log.gz 2024-05-17T11:54:28.155 INFO:teuthology.orchestra.run.smithi131.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.201819.log.gz 2024-05-17T11:54:28.157 INFO:teuthology.orchestra.run.smithi131.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.553524.log.gz 2024-05-17T11:54:28.163 INFO:teuthology.orchestra.run.smithi131.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.148093.log.gz 2024-05-17T11:54:28.167 INFO:teuthology.orchestra.run.smithi131.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.356015.log.gz 2024-05-17T11:54:28.168 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.159478.log.gz 2024-05-17T11:54:28.171 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.177228.log.gz 2024-05-17T11:54:28.171 INFO:teuthology.orchestra.run.smithi131.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.247064.log.gz 2024-05-17T11:54:28.172 INFO:teuthology.orchestra.run.smithi131.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.199092.log.gz 2024-05-17T11:54:28.174 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.183918.log.gz 2024-05-17T11:54:28.174 INFO:teuthology.orchestra.run.smithi131.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.184830.log.gz 2024-05-17T11:54:28.176 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.484916.log.gz 2024-05-17T11:54:28.176 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.185338.log.gz 2024-05-17T11:54:28.176 INFO:teuthology.orchestra.run.smithi131.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.111248.log.gz 2024-05-17T11:54:28.180 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.228640.log.gz 2024-05-17T11:54:28.194 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.369012.log.gz 2024-05-17T11:54:28.196 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.371554.log.gz 2024-05-17T11:54:28.201 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.439186.log.gz 2024-05-17T11:54:28.203 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.149420.log.gz 2024-05-17T11:54:28.207 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.388153.log.gz 2024-05-17T11:54:28.208 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44655.log.gz 2024-05-17T11:54:28.213 INFO:teuthology.orchestra.run.smithi131.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.423562.log.gz 2024-05-17T11:54:28.213 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.459854.log.gz 2024-05-17T11:54:28.218 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.210783.log.gz 2024-05-17T11:54:28.225 INFO:teuthology.orchestra.run.smithi131.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.546314.log.gz 2024-05-17T11:54:28.227 INFO:teuthology.orchestra.run.smithi131.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.491435.log.gz 2024-05-17T11:54:28.227 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42992.log.gz 2024-05-17T11:54:28.228 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.453622.log.gz 2024-05-17T11:54:28.237 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.375855.log.gz 2024-05-17T11:54:28.244 INFO:teuthology.orchestra.run.smithi131.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48638.log.gz 2024-05-17T11:54:28.245 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48760.log.gz 2024-05-17T11:54:28.245 INFO:teuthology.orchestra.run.smithi131.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.562367.log.gz 2024-05-17T11:54:28.245 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.132894.log.gz 2024-05-17T11:54:28.246 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47560.log.gz 2024-05-17T11:54:28.247 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49241.log.gz 2024-05-17T11:54:28.247 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49195.log.gz 2024-05-17T11:54:28.247 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.206480.log.gz 2024-05-17T11:54:28.249 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.400297.log.gz 2024-05-17T11:54:28.249 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.217439.log.gz 2024-05-17T11:54:28.255 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49494.log.gz 2024-05-17T11:54:28.260 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.234676.log.gz 2024-05-17T11:54:28.260 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47434.log.gz 2024-05-17T11:54:28.261 INFO:teuthology.orchestra.run.smithi131.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.376712.log.gz 2024-05-17T11:54:28.265 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.371977.log.gz 2024-05-17T11:54:28.265 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.109823.log.gz 2024-05-17T11:54:28.267 INFO:teuthology.orchestra.run.smithi131.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.227793.log.gz 2024-05-17T11:54:28.268 INFO:teuthology.orchestra.run.smithi131.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.367323.log.gz 2024-05-17T11:54:28.270 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.131200.log.gz 2024-05-17T11:54:28.271 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.178504.log.gz 2024-05-17T11:54:28.272 INFO:teuthology.orchestra.run.smithi131.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.351328.log.gz 2024-05-17T11:54:28.273 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.197718.log.gz 2024-05-17T11:54:28.279 INFO:teuthology.orchestra.run.smithi131.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.444773.log.gz 2024-05-17T11:54:28.280 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.437036.log.gz 2024-05-17T11:54:28.284 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.215981.log.gz 2024-05-17T11:54:28.290 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.353465.log.gz 2024-05-17T11:54:28.294 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.459004.log.gz 2024-05-17T11:54:28.299 INFO:teuthology.orchestra.run.smithi131.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.450320.log.gz 2024-05-17T11:54:28.313 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.253999.log.gz 2024-05-17T11:54:28.317 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.149841.log.gz 2024-05-17T11:54:28.332 INFO:teuthology.orchestra.run.smithi131.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.437490.log.gz 2024-05-17T11:54:28.333 INFO:teuthology.orchestra.run.smithi131.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.441307.log.gz 2024-05-17T11:54:28.334 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.426100.log.gz 2024-05-17T11:54:28.336 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.510191.log.gz 2024-05-17T11:54:28.342 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.553789.log.gz 2024-05-17T11:54:28.352 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.2.47016.log.gz 2024-05-17T11:54:28.364 INFO:teuthology.orchestra.run.smithi131.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.545877.log.gz 2024-05-17T11:54:28.375 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.258689.log.gz 2024-05-17T11:54:28.397 INFO:teuthology.orchestra.run.smithi131.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43390.log.gz 2024-05-17T11:54:28.400 INFO:teuthology.orchestra.run.smithi131.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.135428.log.gz 2024-05-17T11:54:28.401 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.135437.log.gz 2024-05-17T11:54:28.403 INFO:teuthology.orchestra.run.smithi131.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.275498.log.gz 2024-05-17T11:54:28.404 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.232969.log.gz 2024-05-17T11:54:28.404 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.360268.log.gz 2024-05-17T11:54:28.404 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.358149.log.gz 2024-05-17T11:54:28.405 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.215135.log.gz 2024-05-17T11:54:28.405 INFO:teuthology.orchestra.run.smithi131.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.269129.log.gz 2024-05-17T11:54:28.408 INFO:teuthology.orchestra.run.smithi131.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44158.log.gz 2024-05-17T11:54:28.416 INFO:teuthology.orchestra.run.smithi131.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.365172.log.gz 2024-05-17T11:54:28.416 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.364757.log.gz 2024-05-17T11:54:28.416 INFO:teuthology.orchestra.run.smithi131.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.366897.log.gz 2024-05-17T11:54:28.417 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.371131.log.gz 2024-05-17T11:54:28.417 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.109313.log.gz 2024-05-17T11:54:28.419 INFO:teuthology.orchestra.run.smithi131.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.223055.log.gz 2024-05-17T11:54:28.419 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.115553.log.gz 2024-05-17T11:54:28.420 INFO:teuthology.orchestra.run.smithi131.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.248785.log.gz 2024-05-17T11:54:28.421 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.227379.log.gz 2024-05-17T11:54:28.421 INFO:teuthology.orchestra.run.smithi131.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.351755.log.gz 2024-05-17T11:54:28.422 INFO:teuthology.orchestra.run.smithi131.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.188148.log.gz 2024-05-17T11:54:28.422 INFO:teuthology.orchestra.run.smithi131.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.194554.log.gz 2024-05-17T11:54:28.431 INFO:teuthology.orchestra.run.smithi131.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.387687.log.gz 2024-05-17T11:54:28.431 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.389005.log.gz 2024-05-17T11:54:28.434 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.414646.log.gz 2024-05-17T11:54:28.437 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.382259.log.gz 2024-05-17T11:54:28.465 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.255707.log.gz 2024-05-17T11:54:28.467 INFO:teuthology.orchestra.run.smithi131.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.225475.log.gz 2024-05-17T11:54:28.468 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.251444.log.gz 2024-05-17T11:54:28.470 INFO:teuthology.orchestra.run.smithi131.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.542128.log.gz 2024-05-17T11:54:28.471 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.251881.log.gz 2024-05-17T11:54:28.471 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.537903.log.gz 2024-05-17T11:54:28.477 INFO:teuthology.orchestra.run.smithi131.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.127300.log.gz 2024-05-17T11:54:28.479 INFO:teuthology.orchestra.run.smithi131.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45162.log.gz 2024-05-17T11:54:28.480 INFO:teuthology.orchestra.run.smithi131.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45169.log.gz 2024-05-17T11:54:28.480 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.417724.log.gz 2024-05-17T11:54:28.480 INFO:teuthology.orchestra.run.smithi131.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.426091.log.gz 2024-05-17T11:54:28.482 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.437499.log.gz 2024-05-17T11:54:28.489 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.481856.log.gz 2024-05-17T11:54:28.493 INFO:teuthology.orchestra.run.smithi131.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.416846.log.gz 2024-05-17T11:54:28.504 INFO:teuthology.orchestra.run.smithi131.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.184839.log.gz 2024-05-17T11:54:28.507 INFO:teuthology.orchestra.run.smithi131.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48138.log.gz 2024-05-17T11:54:28.509 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.358577.log.gz 2024-05-17T11:54:28.510 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.115139.log.gz 2024-05-17T11:54:28.513 INFO:teuthology.orchestra.run.smithi131.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37084.log.gz 2024-05-17T11:54:28.517 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.174666.log.gz 2024-05-17T11:54:28.520 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.245078.log.gz 2024-05-17T11:54:28.522 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.208603.log.gz 2024-05-17T11:54:28.523 INFO:teuthology.orchestra.run.smithi131.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.210774.log.gz 2024-05-17T11:54:28.523 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.267405.log.gz 2024-05-17T11:54:28.524 INFO:teuthology.orchestra.run.smithi131.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.357718.log.gz 2024-05-17T11:54:28.525 INFO:teuthology.orchestra.run.smithi131.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.235518.log.gz 2024-05-17T11:54:28.525 INFO:teuthology.orchestra.run.smithi131.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.235974.log.gz 2024-05-17T11:54:28.526 INFO:teuthology.orchestra.run.smithi131.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.377559.log.gz 2024-05-17T11:54:28.535 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.361125.log.gz 2024-05-17T11:54:28.542 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.379274.log.gz 2024-05-17T11:54:28.543 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.217853.log.gz 2024-05-17T11:54:28.544 INFO:teuthology.orchestra.run.smithi131.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.219594.log.gz 2024-05-17T11:54:28.547 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.229934.log.gz 2024-05-17T11:54:28.550 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.198170.log.gz 2024-05-17T11:54:28.550 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.201353.log.gz 2024-05-17T11:54:28.550 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.178091.log.gz 2024-05-17T11:54:28.552 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.129491.log.gz 2024-05-17T11:54:28.552 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.130768.log.gz 2024-05-17T11:54:28.553 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.476994.log.gz 2024-05-17T11:54:28.553 INFO:teuthology.orchestra.run.smithi131.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.476575.log.gz 2024-05-17T11:54:28.554 INFO:teuthology.orchestra.run.smithi131.stderr: 76.4% -- replaced with /var/log/ceph/ceph-client.admin.147239.log.gz 2024-05-17T11:54:28.557 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.364236.log.gz 2024-05-17T11:54:28.557 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.399276.log.gz 2024-05-17T11:54:28.559 INFO:teuthology.orchestra.run.smithi131.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.110811.log.gz 2024-05-17T11:54:28.567 INFO:teuthology.orchestra.run.smithi131.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.189457.log.gz 2024-05-17T11:54:28.573 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.250597.log.gz 2024-05-17T11:54:28.583 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.454891.log.gz 2024-05-17T11:54:28.600 INFO:teuthology.orchestra.run.smithi131.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.559238.log.gz 2024-05-17T11:54:28.602 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.486208.log.gz 2024-05-17T11:54:28.604 INFO:teuthology.orchestra.run.smithi131.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49452.log.gz 2024-05-17T11:54:28.605 INFO:teuthology.orchestra.run.smithi131.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.554885.log.gz 2024-05-17T11:54:28.627 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.215126.log.gz 2024-05-17T11:54:28.627 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.232069.log.gz 2024-05-17T11:54:28.628 INFO:teuthology.orchestra.run.smithi131.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.232545.log.gz 2024-05-17T11:54:28.628 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.135862.log.gz 2024-05-17T11:54:28.638 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.377991.log.gz 2024-05-17T11:54:28.638 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45915.log.gz 2024-05-17T11:54:28.642 INFO:teuthology.orchestra.run.smithi131.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.430445.log.gz 2024-05-17T11:54:28.642 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.178957.log.gz 2024-05-17T11:54:28.642 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.177656.log.gz 2024-05-17T11:54:28.645 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.434427.log.gz 2024-05-17T11:54:28.646 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.455319.log.gz 2024-05-17T11:54:28.646 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.558360.log.gz 2024-05-17T11:54:28.646 INFO:teuthology.orchestra.run.smithi131.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.126019.log.gz 2024-05-17T11:54:28.646 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.491426.log.gz 2024-05-17T11:54:28.647 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% 90.3% -- replaced with /var/log/ceph/ceph-client.admin.504541.log.gz -- replaced with /var/log/ceph/ceph-client.admin.506753.log.gz 2024-05-17T11:54:28.647 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:28.648 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.477426.log.gz 2024-05-17T11:54:28.649 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.505887.log.gz 2024-05-17T11:54:28.655 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.211235.log.gz 2024-05-17T11:54:28.655 INFO:teuthology.orchestra.run.smithi131.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.121328.log.gz 2024-05-17T11:54:28.657 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.414227.log.gz 2024-05-17T11:54:28.662 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.122570.log.gz 2024-05-17T11:54:28.692 INFO:teuthology.orchestra.run.smithi131.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.539172.log.gz 2024-05-17T11:54:28.692 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.554451.log.gz 2024-05-17T11:54:28.706 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.487699.log.gz 2024-05-17T11:54:28.709 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.389929.log.gz 2024-05-17T11:54:28.709 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.390361.log.gz 2024-05-17T11:54:28.726 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.438772.log.gz 2024-05-17T11:54:28.728 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.132038.log.gz 2024-05-17T11:54:28.729 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.138036.log.gz 2024-05-17T11:54:28.730 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.137616.log.gz 2024-05-17T11:54:28.734 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47476.log.gz 2024-05-17T11:54:28.734 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.132047.log.gz 2024-05-17T11:54:28.735 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48096.log.gz 2024-05-17T11:54:28.738 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.142923.log.gz 2024-05-17T11:54:28.739 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.442608.log.gz 2024-05-17T11:54:28.739 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.206057.log.gz 2024-05-17T11:54:28.742 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48972.log.gz 2024-05-17T11:54:28.743 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.112144.log.gz 2024-05-17T11:54:28.744 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.375864.log.gz 2024-05-17T11:54:28.745 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.370278.log.gz 2024-05-17T11:54:28.745 INFO:teuthology.orchestra.run.smithi131.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.147664.log.gz 2024-05-17T11:54:28.746 INFO:teuthology.orchestra.run.smithi131.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.227370.log.gz 2024-05-17T11:54:28.754 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.182590.log.gz 2024-05-17T11:54:28.756 INFO:teuthology.orchestra.run.smithi131.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48474.log.gz 2024-05-17T11:54:28.756 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48306.log.gz 2024-05-17T11:54:28.757 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.183503.log.gz 2024-05-17T11:54:28.760 INFO:teuthology.orchestra.run.smithi131.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.186748.log.gz 2024-05-17T11:54:28.760 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.490571.log.gz 2024-05-17T11:54:28.761 INFO:teuthology.orchestra.run.smithi131.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.502821.log.gz 2024-05-17T11:54:28.765 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.505878.log.gz 2024-05-17T11:54:28.766 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.391655.log.gz 2024-05-17T11:54:28.766 INFO:teuthology.orchestra.run.smithi131.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.229064.log.gz 2024-05-17T11:54:28.766 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.395651.log.gz 2024-05-17T11:54:28.766 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.392933.log.gz 2024-05-17T11:54:28.770 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.570869.log.gz 2024-05-17T11:54:28.774 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.350913.log.gz 2024-05-17T11:54:28.782 INFO:teuthology.orchestra.run.smithi131.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.236849.log.gz 2024-05-17T11:54:28.782 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.449478.log.gz 2024-05-17T11:54:28.790 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.430670.log.gz 2024-05-17T11:54:28.790 INFO:teuthology.orchestra.run.smithi131.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.468124.log.gz 2024-05-17T11:54:28.791 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.418852.log.gz 2024-05-17T11:54:28.793 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.440466.log.gz 2024-05-17T11:54:28.795 INFO:teuthology.orchestra.run.smithi131.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.414655.log.gz 2024-05-17T11:54:28.803 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.114424.log.gz 2024-05-17T11:54:28.803 INFO:teuthology.orchestra.run.smithi131.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.137607.log.gz 2024-05-17T11:54:28.804 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47350.log.gz 2024-05-17T11:54:28.810 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.229520.log.gz 2024-05-17T11:54:28.818 INFO:teuthology.orchestra.run.smithi131.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.277377.log.gz 2024-05-17T11:54:28.822 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.263941.log.gz 2024-05-17T11:54:28.825 INFO:teuthology.orchestra.run.smithi131.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.402291.log.gz 2024-05-17T11:54:28.825 INFO:teuthology.orchestra.run.smithi131.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.357295.log.gz 2024-05-17T11:54:28.826 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.429615.log.gz 2024-05-17T11:54:28.827 INFO:teuthology.orchestra.run.smithi131.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.375007.log.gz 2024-05-17T11:54:28.827 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.359005.log.gz 2024-05-17T11:54:28.832 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.367332.log.gz 2024-05-17T11:54:28.832 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.365604.log.gz 2024-05-17T11:54:28.834 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.129500.log.gz 2024-05-17T11:54:28.835 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.214289.log.gz 2024-05-17T11:54:28.835 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.368590.log.gz 2024-05-17T11:54:28.835 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.129927.log.gz 2024-05-17T11:54:28.839 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.132470.log.gz 2024-05-17T11:54:28.842 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.176791.log.gz 2024-05-17T11:54:28.843 INFO:teuthology.orchestra.run.smithi131.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.193226.log.gz 2024-05-17T11:54:28.854 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.243812.log.gz 2024-05-17T11:54:28.856 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.356024.log.gz 2024-05-17T11:54:28.856 INFO:teuthology.orchestra.run.smithi131.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.391646.log.gz 2024-05-17T11:54:28.858 INFO:teuthology.orchestra.run.smithi131.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.393347.log.gz 2024-05-17T11:54:28.858 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.449469.log.gz 2024-05-17T11:54:28.860 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.382674.log.gz 2024-05-17T11:54:28.861 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.157642.log.gz 2024-05-17T11:54:28.872 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.231224.log.gz 2024-05-17T11:54:28.881 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.225022.log.gz 2024-05-17T11:54:28.882 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.252304.log.gz 2024-05-17T11:54:28.882 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.256126.log.gz 2024-05-17T11:54:28.883 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.274182.log.gz 2024-05-17T11:54:28.906 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.155721.log.gz 2024-05-17T11:54:28.913 INFO:teuthology.orchestra.run.smithi131.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.387264.log.gz 2024-05-17T11:54:28.915 INFO:teuthology.orchestra.run.smithi131.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44834.log.gz 2024-05-17T11:54:28.930 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.422294.log.gz 2024-05-17T11:54:28.934 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.183051.log.gz 2024-05-17T11:54:28.956 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.256554.log.gz 2024-05-17T11:54:28.962 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48888.log.gz 2024-05-17T11:54:28.969 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.128217.log.gz 2024-05-17T11:54:28.970 INFO:teuthology.orchestra.run.smithi131.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45506.log.gz 2024-05-17T11:54:28.970 INFO:teuthology.orchestra.run.smithi131.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.127754.log.gz 2024-05-17T11:54:28.973 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.207319.log.gz 2024-05-17T11:54:28.973 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.141167.log.gz 2024-05-17T11:54:28.973 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.206903.log.gz 2024-05-17T11:54:28.974 INFO:teuthology.orchestra.run.smithi131.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.209018.log.gz 2024-05-17T11:54:28.975 INFO:teuthology.orchestra.run.smithi150.stderr: 94.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-17T11:54:28.976 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.215549.log.gz 2024-05-17T11:54:28.977 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.266065.log.gz 2024-05-17T11:54:28.978 INFO:teuthology.orchestra.run.smithi131.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.433546.log.gz 2024-05-17T11:54:28.980 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.266074.log.gz 2024-05-17T11:54:28.981 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.357304.log.gz 2024-05-17T11:54:28.981 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.373250.log.gz 2024-05-17T11:54:28.983 INFO:teuthology.orchestra.run.smithi131.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.369434.log.gz 2024-05-17T11:54:28.983 INFO:teuthology.orchestra.run.smithi131.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.183042.log.gz 2024-05-17T11:54:28.984 INFO:teuthology.orchestra.run.smithi131.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.192774.log.gz 2024-05-17T11:54:28.984 INFO:teuthology.orchestra.run.smithi131.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.199996.log.gz 2024-05-17T11:54:28.985 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.190544.log.gz 2024-05-17T11:54:28.987 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.202237.log.gz 2024-05-17T11:54:28.993 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.413303.log.gz 2024-05-17T11:54:28.993 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.456627.log.gz 2024-05-17T11:54:28.995 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.449901.log.gz 2024-05-17T11:54:28.995 INFO:teuthology.orchestra.run.smithi131.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.211687.log.gz 2024-05-17T11:54:28.997 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.446897.log.gz 2024-05-17T11:54:29.001 INFO:teuthology.orchestra.run.smithi131.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.237722.log.gz 2024-05-17T11:54:29.001 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.238690.log.gz 2024-05-17T11:54:29.002 INFO:teuthology.orchestra.run.smithi131.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.251016.log.gz 2024-05-17T11:54:29.035 INFO:teuthology.orchestra.run.smithi131.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.555736.log.gz 2024-05-17T11:54:29.035 INFO:teuthology.orchestra.run.smithi131.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.556163.log.gz 2024-05-17T11:54:29.036 INFO:teuthology.orchestra.run.smithi131.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.557073.log.gz 2024-05-17T11:54:29.038 INFO:teuthology.orchestra.run.smithi131.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.561009.log.gz 2024-05-17T11:54:29.038 INFO:teuthology.orchestra.run.smithi131.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.568633.log.gz 2024-05-17T11:54:29.038 INFO:teuthology.orchestra.run.smithi131.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.557082.log.gz 2024-05-17T11:54:29.039 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.488188.log.gz 2024-05-17T11:54:29.039 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49325.log.gz 2024-05-17T11:54:29.040 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.210322.log.gz 2024-05-17T11:54:29.040 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.220017.log.gz 2024-05-17T11:54:29.040 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.235102.log.gz 2024-05-17T11:54:29.041 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.350904.log.gz 2024-05-17T11:54:29.042 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.427878.log.gz 2024-05-17T11:54:29.043 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.433999.log.gz 2024-05-17T11:54:29.055 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.244664.log.gz 2024-05-17T11:54:29.059 INFO:teuthology.orchestra.run.smithi131.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.264374.log.gz 2024-05-17T11:54:29.061 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.260557.log.gz 2024-05-17T11:54:29.062 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.226946.log.gz 2024-05-17T11:54:29.063 INFO:teuthology.orchestra.run.smithi131.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.159210.log.gz 2024-05-17T11:54:29.068 INFO:teuthology.orchestra.run.smithi131.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.179414.log.gz 2024-05-17T11:54:29.068 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.202664.log.gz 2024-05-17T11:54:29.068 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.200448.log.gz 2024-05-17T11:54:29.070 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.204356.log.gz 2024-05-17T11:54:29.070 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.412873.log.gz 2024-05-17T11:54:29.076 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45171.log.gz 2024-05-17T11:54:29.076 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.210331.log.gz 2024-05-17T11:54:29.079 INFO:teuthology.orchestra.run.smithi131.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.436184.log.gz 2024-05-17T11:54:29.089 INFO:teuthology.orchestra.run.smithi131.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.121807.log.gz 2024-05-17T11:54:29.089 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.237285.log.gz 2024-05-17T11:54:29.090 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.113129.log.gz 2024-05-17T11:54:29.092 INFO:teuthology.orchestra.run.smithi131.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.253147.log.gz 2024-05-17T11:54:29.093 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.116464.log.gz 2024-05-17T11:54:29.099 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44828.log.gz 2024-05-17T11:54:29.109 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.422708.log.gz 2024-05-17T11:54:29.110 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.421441.log.gz 2024-05-17T11:54:29.110 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.443029.log.gz 2024-05-17T11:54:29.114 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.157110.log.gz 2024-05-17T11:54:29.116 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.265219.log.gz 2024-05-17T11:54:29.118 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.197275.log.gz 2024-05-17T11:54:29.129 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47392.log.gz 2024-05-17T11:54:29.136 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.207744.log.gz 2024-05-17T11:54:29.142 INFO:teuthology.orchestra.run.smithi131.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.475267.log.gz 2024-05-17T11:54:29.143 INFO:teuthology.orchestra.run.smithi131.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.218699.log.gz 2024-05-17T11:54:29.143 INFO:teuthology.orchestra.run.smithi131.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45160.log.gz 2024-05-17T11:54:29.145 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.232554.log.gz 2024-05-17T11:54:29.146 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.110319.log.gz 90.2% 2024-05-17T11:54:29.146 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108464.log.gz 2024-05-17T11:54:29.146 INFO:teuthology.orchestra.run.smithi131.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.359424.log.gz 2024-05-17T11:54:29.148 INFO:teuthology.orchestra.run.smithi131.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.401311.log.gz 2024-05-17T11:54:29.150 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.432690.log.gz 2024-05-17T11:54:29.151 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.129918.log.gz 2024-05-17T11:54:29.151 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.432271.log.gz 2024-05-17T11:54:29.152 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.433127.log.gz 2024-05-17T11:54:29.154 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.208169.log.gz 2024-05-17T11:54:29.157 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.111681.log.gz 2024-05-17T11:54:29.157 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.189881.log.gz 2024-05-17T11:54:29.158 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.248371.log.gz 2024-05-17T11:54:29.159 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.196362.log.gz 2024-05-17T11:54:29.160 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43306.log.gz 2024-05-17T11:54:29.161 INFO:teuthology.orchestra.run.smithi131.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.390792.log.gz 2024-05-17T11:54:29.169 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.125596.log.gz 2024-05-17T11:54:29.174 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.382683.log.gz 2024-05-17T11:54:29.209 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.415999.log.gz 2024-05-17T11:54:29.210 INFO:teuthology.orchestra.run.smithi131.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.225955.log.gz 2024-05-17T11:54:29.213 INFO:teuthology.orchestra.run.smithi131.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.446469.log.gz 2024-05-17T11:54:29.214 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.446056.log.gz 2024-05-17T11:54:29.217 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.249746.log.gz 2024-05-17T11:54:29.229 INFO:teuthology.orchestra.run.smithi131.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.223652.log.gz 2024-05-17T11:54:29.230 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.233819.log.gz 2024-05-17T11:54:29.245 INFO:teuthology.orchestra.run.smithi131.stderr: 87.5% 80.8% -- replaced with /var/log/ceph/ceph-client.admin.44835.log.gz -- replaced with /var/log/ceph/ceph-client.admin.419689.log.gz 2024-05-17T11:54:29.245 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:29.245 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.424031.log.gz 2024-05-17T11:54:29.247 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.441316.log.gz 2024-05-17T11:54:29.278 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45831.log.gz 2024-05-17T11:54:29.282 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.126028.log.gz 2024-05-17T11:54:29.283 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.217862.log.gz 2024-05-17T11:54:29.286 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.267820.log.gz 2024-05-17T11:54:29.287 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.401813.log.gz 2024-05-17T11:54:29.287 INFO:teuthology.orchestra.run.smithi131.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.359846.log.gz 2024-05-17T11:54:29.287 INFO:teuthology.orchestra.run.smithi131.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.356867.log.gz 2024-05-17T11:54:29.287 INFO:teuthology.orchestra.run.smithi131.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.372814.log.gz 2024-05-17T11:54:29.288 INFO:teuthology.orchestra.run.smithi131.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.116032.log.gz 2024-05-17T11:54:29.288 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.363400.log.gz 2024-05-17T11:54:29.301 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.174675.log.gz 2024-05-17T11:54:29.303 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.459845.log.gz 2024-05-17T11:54:29.306 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.221295.log.gz 2024-05-17T11:54:29.314 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.383552.log.gz 2024-05-17T11:54:29.315 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.229943.log.gz 2024-05-17T11:54:29.320 INFO:teuthology.orchestra.run.smithi131.stderr: 76.5% -- replaced with /var/log/ceph/ceph-client.admin.426990.log.gz 2024-05-17T11:54:29.325 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.379692.log.gz 2024-05-17T11:54:29.337 INFO:teuthology.orchestra.run.smithi131.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45505.log.gz 2024-05-17T11:54:29.354 INFO:teuthology.orchestra.run.smithi131.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.235983.log.gz 2024-05-17T11:54:29.360 INFO:teuthology.orchestra.run.smithi131.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.124750.log.gz 2024-05-17T11:54:29.391 INFO:teuthology.orchestra.run.smithi131.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.424022.log.gz 2024-05-17T11:54:29.392 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.417308.log.gz 2024-05-17T11:54:29.442 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.513421.log.gz 2024-05-17T11:54:29.444 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.473512.log.gz 2024-05-17T11:54:29.452 INFO:teuthology.orchestra.run.smithi131.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.448176.log.gz 2024-05-17T11:54:29.453 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.443914.log.gz 2024-05-17T11:54:29.453 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.139887.log.gz 2024-05-17T11:54:29.454 INFO:teuthology.orchestra.run.smithi131.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47308.log.gz 2024-05-17T11:54:29.456 INFO:teuthology.orchestra.run.smithi131.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49686.log.gz 2024-05-17T11:54:29.457 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.196823.log.gz 2024-05-17T11:54:29.459 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45389.log.gz 2024-05-17T11:54:29.459 INFO:teuthology.orchestra.run.smithi131.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42904.log.gz 2024-05-17T11:54:29.460 INFO:teuthology.orchestra.run.smithi131.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48180.log.gz 2024-05-17T11:54:29.460 INFO:teuthology.orchestra.run.smithi131.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.133308.log.gz 2024-05-17T11:54:29.461 INFO:teuthology.orchestra.run.smithi131.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.401804.log.gz 2024-05-17T11:54:29.461 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.207328.log.gz 2024-05-17T11:54:29.463 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.200457.log.gz 2024-05-17T11:54:29.463 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.376288.log.gz 2024-05-17T11:54:29.463 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48222.log.gz 2024-05-17T11:54:29.469 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.354317.log.gz 2024-05-17T11:54:29.469 INFO:teuthology.orchestra.run.smithi131.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.198640.log.gz 2024-05-17T11:54:29.470 INFO:teuthology.orchestra.run.smithi131.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.182599.log.gz 2024-05-17T11:54:29.516 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.398798.log.gz 2024-05-17T11:54:29.560 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.511496.log.gz 2024-05-17T11:54:29.563 INFO:teuthology.orchestra.run.smithi131.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.372391.log.gz 2024-05-17T11:54:29.569 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.181723.log.gz 2024-05-17T11:54:29.571 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.352187.log.gz 2024-05-17T11:54:29.575 INFO:teuthology.orchestra.run.smithi131.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.438763.log.gz 2024-05-17T11:54:29.577 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.438349.log.gz 2024-05-17T11:54:29.596 INFO:teuthology.orchestra.run.smithi131.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.236858.log.gz 2024-05-17T11:54:29.596 INFO:teuthology.orchestra.run.smithi131.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.374111.log.gz 2024-05-17T11:54:29.598 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.224577.log.gz 2024-05-17T11:54:29.614 INFO:teuthology.orchestra.run.smithi131.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.426514.log.gz 2024-05-17T11:54:29.615 INFO:teuthology.orchestra.run.smithi131.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.366450.log.gz 2024-05-17T11:54:29.616 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44277.log.gz 2024-05-17T11:54:29.619 INFO:teuthology.orchestra.run.smithi131.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45173.log.gz 2024-05-17T11:54:29.627 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42948.log.gz 2024-05-17T11:54:29.629 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.224123.log.gz 2024-05-17T11:54:29.629 INFO:teuthology.orchestra.run.smithi131.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.274618.log.gz 2024-05-17T11:54:29.641 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.138980.log.gz 2024-05-17T11:54:29.642 INFO:teuthology.orchestra.run.smithi131.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.129064.log.gz 2024-05-17T11:54:29.643 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.129073.log.gz 2024-05-17T11:54:29.644 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47518.log.gz 2024-05-17T11:54:29.644 INFO:teuthology.orchestra.run.smithi131.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49620.log.gz 2024-05-17T11:54:29.645 INFO:teuthology.orchestra.run.smithi131.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45747.log.gz 2024-05-17T11:54:29.645 INFO:teuthology.orchestra.run.smithi131.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.126441.log.gz 2024-05-17T11:54:29.645 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.209442.log.gz 2024-05-17T11:54:29.646 INFO:teuthology.orchestra.run.smithi131.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.361553.log.gz 2024-05-17T11:54:29.646 INFO:teuthology.orchestra.run.smithi131.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.239528.log.gz 2024-05-17T11:54:29.652 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.352622.log.gz 2024-05-17T11:54:29.652 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.366018.log.gz 2024-05-17T11:54:29.652 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.443491.log.gz 2024-05-17T11:54:29.657 INFO:teuthology.orchestra.run.smithi131.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.213858.log.gz 2024-05-17T11:54:29.661 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.360699.log.gz 2024-05-17T11:54:29.661 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.375431.log.gz 2024-05-17T11:54:29.663 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.224114.log.gz 2024-05-17T11:54:29.663 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.458995.log.gz 2024-05-17T11:54:29.664 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.459423.log.gz 2024-05-17T11:54:29.666 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.188571.log.gz 2024-05-17T11:54:29.668 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.392924.log.gz 2024-05-17T11:54:29.671 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.245087.log.gz 2024-05-17T11:54:29.674 INFO:teuthology.orchestra.run.smithi131.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.353046.log.gz 2024-05-17T11:54:29.675 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.395173.log.gz 2024-05-17T11:54:29.675 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.448632.log.gz 2024-05-17T11:54:29.675 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.366906.log.gz 2024-05-17T11:54:29.692 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.251872.log.gz 2024-05-17T11:54:29.693 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.236435.log.gz 2024-05-17T11:54:29.727 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.419276.log.gz 2024-05-17T11:54:29.729 INFO:teuthology.orchestra.run.smithi131.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.423141.log.gz 2024-05-17T11:54:29.731 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.425577.log.gz 2024-05-17T11:54:29.732 INFO:teuthology.orchestra.run.smithi131.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.444339.log.gz 2024-05-17T11:54:29.734 INFO:teuthology.orchestra.run.smithi131.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.440457.log.gz 2024-05-17T11:54:29.735 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.437926.log.gz 2024-05-17T11:54:29.736 INFO:teuthology.orchestra.run.smithi131.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.364245.log.gz 2024-05-17T11:54:29.736 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.454046.log.gz 2024-05-17T11:54:29.741 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49410.log.gz 2024-05-17T11:54:29.742 INFO:teuthology.orchestra.run.smithi131.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.133731.log.gz 2024-05-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.122561.log.gz 2024-05-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi131.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.152019.log.gz 2024-05-17T11:54:29.755 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.231233.log.gz 2024-05-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.108455.log.gz 2024-05-17T11:54:29.775 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.201362.log.gz 2024-05-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi131.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.261403.log.gz 2024-05-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.260989.log.gz 2024-05-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi131.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.371545.log.gz 2024-05-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.263527.log.gz 2024-05-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.355163.log.gz 2024-05-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.116888.log.gz 2024-05-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi131.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.457462.log.gz 2024-05-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.265228.log.gz 2024-05-17T11:54:29.794 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.394204.log.gz 2024-05-17T11:54:29.795 INFO:teuthology.orchestra.run.smithi131.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.396081.log.gz 2024-05-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.394213.log.gz 2024-05-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.387273.log.gz 2024-05-17T11:54:29.817 INFO:teuthology.orchestra.run.smithi131.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.157633.log.gz 2024-05-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.158480.log.gz 2024-05-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.158489.log.gz 2024-05-17T11:54:29.837 INFO:teuthology.orchestra.run.smithi131.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.202246.log.gz 2024-05-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44445.log.gz 2024-05-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi131.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.421855.log.gz 2024-05-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.453613.log.gz 2024-05-17T11:54:29.849 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.440894.log.gz 2024-05-17T11:54:29.889 INFO:teuthology.orchestra.run.smithi131.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.275507.log.gz 2024-05-17T11:54:29.894 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.194111.log.gz 2024-05-17T11:54:29.897 INFO:teuthology.orchestra.run.smithi131.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48348.log.gz 2024-05-17T11:54:29.897 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48516.log.gz 2024-05-17T11:54:29.899 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.141603.log.gz 2024-05-17T11:54:29.900 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49014.log.gz 87.8% 2024-05-17T11:54:29.900 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49056.log.gz 2024-05-17T11:54:29.902 INFO:teuthology.orchestra.run.smithi131.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.123435.log.gz 2024-05-17T11:54:29.903 INFO:teuthology.orchestra.run.smithi131.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.123877.log.gz 2024-05-17T11:54:29.904 INFO:teuthology.orchestra.run.smithi131.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45388.log.gz 2024-05-17T11:54:29.905 INFO:teuthology.orchestra.run.smithi131.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.212558.log.gz 2024-05-17T11:54:29.905 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.205634.log.gz 2024-05-17T11:54:29.906 INFO:teuthology.orchestra.run.smithi131.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.240437.log.gz 2024-05-17T11:54:29.907 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.133740.log.gz 2024-05-17T11:54:29.909 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.137136.log.gz 2024-05-17T11:54:29.910 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.261835.log.gz 2024-05-17T11:54:29.911 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.369865.log.gz 2024-05-17T11:54:29.912 INFO:teuthology.orchestra.run.smithi131.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.354740.log.gz 2024-05-17T11:54:29.913 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.360277.log.gz 2024-05-17T11:54:29.913 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.264798.log.gz 2024-05-17T11:54:29.914 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.188580.log.gz 2024-05-17T11:54:29.914 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.202673.log.gz 2024-05-17T11:54:29.918 INFO:teuthology.orchestra.run.smithi131.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.393779.log.gz 2024-05-17T11:54:29.951 INFO:teuthology.orchestra.run.smithi131.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.491011.log.gz 2024-05-17T11:54:29.953 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.460268.log.gz 2024-05-17T11:54:29.965 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.252295.log.gz 2024-05-17T11:54:29.965 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.255274.log.gz 2024-05-17T11:54:29.967 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.128641.log.gz 2024-05-17T11:54:29.976 INFO:teuthology.orchestra.run.smithi131.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.527776.log.gz 2024-05-17T11:54:30.006 INFO:teuthology.orchestra.run.smithi131.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.256982.log.gz 2024-05-17T11:54:30.006 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.255283.log.gz 2024-05-17T11:54:30.007 INFO:teuthology.orchestra.run.smithi131.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.258266.log.gz 2024-05-17T11:54:30.008 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48432.log.gz 2024-05-17T11:54:30.009 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.140729.log.gz 2024-05-17T11:54:30.015 INFO:teuthology.orchestra.run.smithi131.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49144.log.gz 2024-05-17T11:54:30.016 INFO:teuthology.orchestra.run.smithi131.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.127291.log.gz 2024-05-17T11:54:30.017 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36820.log.gz 2024-05-17T11:54:30.018 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.229511.log.gz 2024-05-17T11:54:30.020 INFO:teuthology.orchestra.run.smithi131.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.195015.log.gz 2024-05-17T11:54:30.022 INFO:teuthology.orchestra.run.smithi131.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.363814.log.gz 2024-05-17T11:54:30.023 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.365181.log.gz 2024-05-17T11:54:30.024 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.351337.log.gz 2024-05-17T11:54:30.025 INFO:teuthology.orchestra.run.smithi131.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.238681.log.gz 2024-05-17T11:54:30.027 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48802.log.gz 2024-05-17T11:54:30.028 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.264365.log.gz 2024-05-17T11:54:30.030 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.228649.log.gz 2024-05-17T11:54:30.030 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.233828.log.gz 2024-05-17T11:54:30.030 INFO:teuthology.orchestra.run.smithi131.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.196814.log.gz 2024-05-17T11:54:30.031 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.248794.log.gz 2024-05-17T11:54:30.031 INFO:teuthology.orchestra.run.smithi131.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.458567.log.gz 2024-05-17T11:54:30.032 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.189466.log.gz 2024-05-17T11:54:30.034 INFO:teuthology.orchestra.run.smithi131.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42820.log.gz 2024-05-17T11:54:30.042 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.184383.log.gz 2024-05-17T11:54:30.046 INFO:teuthology.orchestra.run.smithi131.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.457930.log.gz 2024-05-17T11:54:30.053 INFO:teuthology.orchestra.run.smithi150.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-17T11:54:30.070 INFO:teuthology.orchestra.run.smithi131.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.143782.log.gz 2024-05-17T11:54:30.146 INFO:teuthology.orchestra.run.smithi131.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.561455.log.gz 2024-05-17T11:54:30.146 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.566803.log.gz 2024-05-17T11:54:30.160 INFO:teuthology.orchestra.run.smithi131.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.425154.log.gz 2024-05-17T11:54:30.169 INFO:teuthology.orchestra.run.smithi150.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-17T11:54:30.177 INFO:teuthology.orchestra.run.smithi131.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.455747.log.gz 2024-05-17T11:54:30.178 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.439195.log.gz 2024-05-17T11:54:30.180 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48054.log.gz 2024-05-17T11:54:30.180 INFO:teuthology.orchestra.run.smithi131.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.122993.log.gz 2024-05-17T11:54:30.181 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.136288.log.gz 2024-05-17T11:54:30.181 INFO:teuthology.orchestra.run.smithi131.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.427417.log.gz 2024-05-17T11:54:30.182 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.263095.log.gz 2024-05-17T11:54:30.183 INFO:teuthology.orchestra.run.smithi131.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43432.log.gz 2024-05-17T11:54:30.184 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.279081.log.gz 2024-05-17T11:54:30.184 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.371122.log.gz 2024-05-17T11:54:30.185 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.267829.log.gz 2024-05-17T11:54:30.190 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.222566.log.gz 2024-05-17T11:54:30.191 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.158066.log.gz 2024-05-17T11:54:30.194 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.128650.log.gz 2024-05-17T11:54:30.197 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.483169.log.gz 2024-05-17T11:54:30.222 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.445200.log.gz 2024-05-17T11:54:30.223 INFO:teuthology.orchestra.run.smithi131.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.415103.log.gz 2024-05-17T11:54:30.224 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.511065.log.gz 2024-05-17T11:54:30.227 INFO:teuthology.orchestra.run.smithi131.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.503251.log.gz 2024-05-17T11:54:30.227 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.502407.log.gz 2024-05-17T11:54:30.228 INFO:teuthology.orchestra.run.smithi131.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.504962.log.gz 2024-05-17T11:54:30.233 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.250169.log.gz 2024-05-17T11:54:30.234 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.458330.log.gz 2024-05-17T11:54:30.298 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.548966.log.gz 2024-05-17T11:54:30.302 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.493292.log.gz 2024-05-17T11:54:30.308 INFO:teuthology.orchestra.run.smithi131.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.557932.log.gz 2024-05-17T11:54:30.309 INFO:teuthology.orchestra.run.smithi131.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.494790.log.gz 2024-05-17T11:54:30.325 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.485783.log.gz 2024-05-17T11:54:30.333 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.422285.log.gz 2024-05-17T11:54:30.333 INFO:teuthology.orchestra.run.smithi131.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.435325.log.gz 2024-05-17T11:54:30.357 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.499710.log.gz 2024-05-17T11:54:30.363 INFO:teuthology.orchestra.run.smithi131.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.275999.log.gz 2024-05-17T11:54:30.376 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.140301.log.gz 2024-05-17T11:54:30.379 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.140310.log.gz 2024-05-17T11:54:30.384 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.150705.log.gz 2024-05-17T11:54:30.387 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.279090.log.gz 2024-05-17T11:54:30.387 INFO:teuthology.orchestra.run.smithi131.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.561018.log.gz 2024-05-17T11:54:30.391 INFO:teuthology.orchestra.run.smithi131.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.379265.log.gz 2024-05-17T11:54:30.400 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.459432.log.gz 2024-05-17T11:54:30.401 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.482746.log.gz 2024-05-17T11:54:30.406 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.435765.log.gz 2024-05-17T11:54:30.407 INFO:teuthology.orchestra.run.smithi131.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.181271.log.gz 2024-05-17T11:54:30.409 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.214712.log.gz 2024-05-17T11:54:30.415 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.566812.log.gz 2024-05-17T11:54:30.415 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.504117.log.gz 2024-05-17T11:54:30.420 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.192783.log.gz 2024-05-17T11:54:30.422 INFO:teuthology.orchestra.run.smithi131.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.456199.log.gz 2024-05-17T11:54:30.424 INFO:teuthology.orchestra.run.smithi131.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.250160.log.gz 2024-05-17T11:54:30.432 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.490152.log.gz 2024-05-17T11:54:30.442 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.355172.log.gz 2024-05-17T11:54:30.444 INFO:teuthology.orchestra.run.smithi131.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.474834.log.gz 2024-05-17T11:54:30.457 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.447330.log.gz 2024-05-17T11:54:30.541 INFO:teuthology.orchestra.run.smithi131.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.568168.log.gz 2024-05-17T11:54:30.544 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.401320.log.gz 2024-05-17T11:54:30.549 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49367.log.gz 2024-05-17T11:54:30.551 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.370700.log.gz 2024-05-17T11:54:30.551 INFO:teuthology.orchestra.run.smithi131.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.144210.log.gz 2024-05-17T11:54:30.552 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.373687.log.gz 2024-05-17T11:54:30.555 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.247525.log.gz 2024-05-17T11:54:30.556 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.203933.log.gz 2024-05-17T11:54:30.557 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.456618.log.gz 2024-05-17T11:54:30.559 INFO:teuthology.orchestra.run.smithi131.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.399799.log.gz 2024-05-17T11:54:30.564 INFO:teuthology.orchestra.run.smithi131.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.485348.log.gz 2024-05-17T11:54:30.567 INFO:teuthology.orchestra.run.smithi131.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.475713.log.gz 2024-05-17T11:54:30.573 INFO:teuthology.orchestra.run.smithi131.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.548516.log.gz 2024-05-17T11:54:30.574 INFO:teuthology.orchestra.run.smithi131.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.275058.log.gz 2024-05-17T11:54:30.585 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.243375.log.gz 2024-05-17T11:54:30.587 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.176368.log.gz 2024-05-17T11:54:30.588 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.176800.log.gz 2024-05-17T11:54:30.590 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.112652.log.gz 2024-05-17T11:54:30.593 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.368176.log.gz 2024-05-17T11:54:30.605 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.198649.log.gz 2024-05-17T11:54:30.618 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.515118.log.gz 2024-05-17T11:54:30.619 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.516843.log.gz 2024-05-17T11:54:30.650 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.469874.log.gz 2024-05-17T11:54:30.653 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.496263.log.gz 2024-05-17T11:54:30.661 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.564148.log.gz 2024-05-17T11:54:30.669 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.151119.log.gz 2024-05-17T11:54:30.681 INFO:teuthology.orchestra.run.smithi131.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.134578.log.gz 2024-05-17T11:54:30.710 INFO:teuthology.orchestra.run.smithi131.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.265642.log.gz 2024-05-17T11:54:30.745 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.176377.log.gz 2024-05-17T11:54:30.749 INFO:teuthology.orchestra.run.smithi131.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.355586.log.gz 2024-05-17T11:54:30.751 INFO:teuthology.orchestra.run.smithi131.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.159901.log.gz 2024-05-17T11:54:30.756 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.208178.log.gz 2024-05-17T11:54:30.757 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.504108.log.gz 2024-05-17T11:54:30.758 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.231655.log.gz 2024-05-17T11:54:30.760 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.434846.log.gz 2024-05-17T11:54:30.761 INFO:teuthology.orchestra.run.smithi131.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.263950.log.gz 2024-05-17T11:54:30.771 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.375440.log.gz 2024-05-17T11:54:30.773 INFO:teuthology.orchestra.run.smithi131.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45999.log.gz 2024-05-17T11:54:30.802 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.254008.log.gz 2024-05-17T11:54:30.803 INFO:teuthology.orchestra.run.smithi131.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.565039.log.gz 2024-05-17T11:54:30.859 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.542560.log.gz 2024-05-17T11:54:30.892 INFO:teuthology.orchestra.run.smithi131.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.544274.log.gz 2024-05-17T11:54:30.893 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.493283.log.gz 2024-05-17T11:54:30.907 INFO:teuthology.orchestra.run.smithi131.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.225031.log.gz 2024-05-17T11:54:30.960 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.556586.log.gz 2024-05-17T11:54:30.962 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.556172.log.gz 2024-05-17T11:54:30.978 INFO:teuthology.orchestra.run.smithi131.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.142914.log.gz 2024-05-17T11:54:30.986 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.220026.log.gz 2024-05-17T11:54:30.987 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.188994.log.gz 2024-05-17T11:54:31.000 INFO:teuthology.orchestra.run.smithi131.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.178966.log.gz 2024-05-17T11:54:31.003 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.491002.log.gz 2024-05-17T11:54:31.004 INFO:teuthology.orchestra.run.smithi131.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.428302.log.gz 2024-05-17T11:54:31.004 INFO:teuthology.orchestra.run.smithi131.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.481847.log.gz 2024-05-17T11:54:31.007 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.567695.log.gz 2024-05-17T11:54:31.020 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.114702.log.gz 2024-05-17T11:54:31.030 INFO:teuthology.orchestra.run.smithi131.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.524492.log.gz 2024-05-17T11:54:31.033 INFO:teuthology.orchestra.run.smithi131.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.501975.log.gz 2024-05-17T11:54:31.067 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.254423.log.gz 2024-05-17T11:54:31.072 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.472525.log.gz 2024-05-17T11:54:31.074 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.498025.log.gz 2024-05-17T11:54:31.074 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.499296.log.gz 2024-05-17T11:54:31.075 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.509735.log.gz 2024-05-17T11:54:31.133 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.488179.log.gz 2024-05-17T11:54:31.145 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.516381.log.gz 2024-05-17T11:54:31.162 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.537479.log.gz 2024-05-17T11:54:31.162 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.534928.log.gz 2024-05-17T11:54:31.204 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.226480.log.gz 2024-05-17T11:54:31.219 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.383097.log.gz 2024-05-17T11:54:31.220 INFO:teuthology.orchestra.run.smithi131.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.385993.log.gz 2024-05-17T11:54:31.271 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47977.log.gz 2024-05-17T11:54:31.280 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.126450.log.gz 2024-05-17T11:54:31.283 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.489091.log.gz 2024-05-17T11:54:31.284 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.143338.log.gz 2024-05-17T11:54:31.285 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.488677.log.gz 2024-05-17T11:54:31.287 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.457921.log.gz 2024-05-17T11:54:31.287 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.278240.log.gz 2024-05-17T11:54:31.288 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.457049.log.gz 2024-05-17T11:54:31.343 INFO:teuthology.orchestra.run.smithi131.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.534088.log.gz 2024-05-17T11:54:31.356 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.449892.log.gz 2024-05-17T11:54:31.357 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.449055.log.gz 2024-05-17T11:54:31.359 INFO:teuthology.orchestra.run.smithi131.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.394691.log.gz 2024-05-17T11:54:31.378 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.131614.log.gz 2024-05-17T11:54:31.381 INFO:teuthology.orchestra.run.smithi131.stderr: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.212134.log.gz 2024-05-17T11:54:31.387 INFO:teuthology.orchestra.run.smithi131.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.400821.log.gz 2024-05-17T11:54:31.391 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.397928.log.gz 2024-05-17T11:54:31.391 INFO:teuthology.orchestra.run.smithi131.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.159219.log.gz 2024-05-17T11:54:31.427 INFO:teuthology.orchestra.run.smithi131.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.180835.log.gz 2024-05-17T11:54:31.429 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.475722.log.gz 2024-05-17T11:54:31.431 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.268253.log.gz 2024-05-17T11:54:31.434 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43264.log.gz 2024-05-17T11:54:31.437 INFO:teuthology.orchestra.run.smithi131.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.376703.log.gz 2024-05-17T11:54:31.440 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.377143.log.gz 2024-05-17T11:54:31.441 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.368599.log.gz 2024-05-17T11:54:31.442 INFO:teuthology.orchestra.run.smithi131.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.433118.log.gz 2024-05-17T11:54:31.444 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.244655.log.gz 2024-05-17T11:54:31.444 INFO:teuthology.orchestra.run.smithi131.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.199544.log.gz 2024-05-17T11:54:31.445 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.178082.log.gz 2024-05-17T11:54:31.447 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.209451.log.gz 2024-05-17T11:54:31.458 INFO:teuthology.orchestra.run.smithi131.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.563257.log.gz 2024-05-17T11:54:31.458 INFO:teuthology.orchestra.run.smithi131.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.556595.log.gz 2024-05-17T11:54:31.458 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.193235.log.gz 2024-05-17T11:54:31.465 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.393770.log.gz 2024-05-17T11:54:31.466 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.363823.log.gz 2024-05-17T11:54:31.474 INFO:teuthology.orchestra.run.smithi131.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.116879.log.gz 2024-05-17T11:54:31.474 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.116041.log.gz 2024-05-17T11:54:31.484 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.355596.log.gz 2024-05-17T11:54:31.510 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.396998.log.gz 2024-05-17T11:54:31.511 INFO:teuthology.orchestra.run.smithi131.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.445191.log.gz 2024-05-17T11:54:31.535 INFO:teuthology.orchestra.run.smithi131.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.567258.log.gz 2024-05-17T11:54:31.541 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.126864.log.gz 2024-05-17T11:54:31.557 INFO:teuthology.orchestra.run.smithi131.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.191879.log.gz 2024-05-17T11:54:31.560 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.191423.log.gz 2024-05-17T11:54:31.568 INFO:teuthology.orchestra.run.smithi131.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.565485.log.gz 2024-05-17T11:54:31.569 INFO:teuthology.orchestra.run.smithi131.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.260980.log.gz 2024-05-17T11:54:31.570 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.435756.log.gz 2024-05-17T11:54:31.572 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.356452.log.gz 2024-05-17T11:54:31.574 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.356876.log.gz 2024-05-17T11:54:31.578 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.245501.log.gz 2024-05-17T11:54:31.582 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.222152.log.gz 2024-05-17T11:54:31.586 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.117303.log.gz 2024-05-17T11:54:31.588 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70031.log.gz 2024-05-17T11:54:31.592 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.215972.log.gz 2024-05-17T11:54:31.592 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.213867.log.gz 2024-05-17T11:54:31.596 INFO:teuthology.orchestra.run.smithi131.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.108887.log.gz 2024-05-17T11:54:31.599 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44403.log.gz 2024-05-17T11:54:31.600 INFO:teuthology.orchestra.run.smithi131.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44571.log.gz 2024-05-17T11:54:31.602 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.418220.log.gz 2024-05-17T11:54:31.603 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.420121.log.gz 2024-05-17T11:54:31.605 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.420567.log.gz 2024-05-17T11:54:31.608 INFO:teuthology.orchestra.run.smithi131.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.513185.log.gz 2024-05-17T11:54:31.614 INFO:teuthology.orchestra.run.smithi131.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.268668.log.gz 2024-05-17T11:54:31.616 INFO:teuthology.orchestra.run.smithi131.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46640.log.gz 2024-05-17T11:54:31.617 INFO:teuthology.orchestra.run.smithi131.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.396090.log.gz 2024-05-17T11:54:31.619 INFO:teuthology.orchestra.run.smithi131.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.441743.log.gz 2024-05-17T11:54:31.626 INFO:teuthology.orchestra.run.smithi131.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.443905.log.gz 2024-05-17T11:54:31.628 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45508.log.gz 2024-05-17T11:54:31.629 INFO:teuthology.orchestra.run.smithi131.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.247516.log.gz 2024-05-17T11:54:31.639 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.222143.log.gz 2024-05-17T11:54:31.642 INFO:teuthology.orchestra.run.smithi131.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.182166.log.gz 2024-05-17T11:54:31.660 INFO:teuthology.orchestra.run.smithi131.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.186237.log.gz 2024-05-17T11:54:31.664 INFO:teuthology.orchestra.run.smithi131.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.447744.log.gz 2024-05-17T11:54:31.664 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.448623.log.gz 2024-05-17T11:54:31.674 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.385514.log.gz 2024-05-17T11:54:31.688 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.386849.log.gz 2024-05-17T11:54:31.691 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.388590.log.gz 2024-05-17T11:54:31.692 INFO:teuthology.orchestra.run.smithi131.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.275049.log.gz 2024-05-17T11:54:31.693 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.274191.log.gz 2024-05-17T11:54:31.708 INFO:teuthology.orchestra.run.smithi131.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.543821.log.gz 2024-05-17T11:54:31.738 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.220872.log.gz 2024-05-17T11:54:31.740 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44100.log.gz 2024-05-17T11:54:31.742 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44829.log.gz 2024-05-17T11:54:31.750 INFO:teuthology.orchestra.run.smithi131.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.512470.log.gz 2024-05-17T11:54:31.762 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.423571.log.gz 2024-05-17T11:54:31.762 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.149850.log.gz 2024-05-17T11:54:31.762 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47845.log.gz 2024-05-17T11:54:31.763 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.215558.log.gz 2024-05-17T11:54:31.764 INFO:teuthology.orchestra.run.smithi131.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.242469.log.gz 2024-05-17T11:54:31.782 INFO:teuthology.orchestra.run.smithi131.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.429177.log.gz 2024-05-17T11:54:31.785 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.278663.log.gz 2024-05-17T11:54:31.787 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.148527.log.gz 2024-05-17T11:54:31.788 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.370709.log.gz 2024-05-17T11:54:31.789 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.185758.log.gz 2024-05-17T11:54:31.793 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.373259.log.gz 2024-05-17T11:54:31.796 INFO:teuthology.orchestra.run.smithi131.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.550840.log.gz 2024-05-17T11:54:31.807 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.142030.log.gz 2024-05-17T11:54:31.810 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.124759.log.gz 2024-05-17T11:54:31.811 INFO:teuthology.orchestra.run.smithi131.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.149411.log.gz 2024-05-17T11:54:31.818 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.447753.log.gz 2024-05-17T11:54:31.832 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.384526.log.gz 2024-05-17T11:54:31.833 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.392078.log.gz 2024-05-17T11:54:31.862 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.259719.log.gz 2024-05-17T11:54:31.995 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.254432.log.gz 2024-05-17T11:54:31.995 INFO:teuthology.orchestra.run.smithi131.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.268677.log.gz 2024-05-17T11:54:31.996 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44832.log.gz 2024-05-17T11:54:31.996 INFO:teuthology.orchestra.run.smithi131.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.402769.log.gz 2024-05-17T11:54:31.996 INFO:teuthology.orchestra.run.smithi131.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.123002.log.gz 2024-05-17T11:54:31.996 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48930.log.gz 2024-05-17T11:54:31.996 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.108878.log.gz 2024-05-17T11:54:31.996 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48390.log.gz 2024-05-17T11:54:31.996 INFO:teuthology.orchestra.run.smithi131.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.209870.log.gz 2024-05-17T11:54:31.996 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.239113.log.gz 2024-05-17T11:54:31.997 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.368167.log.gz 2024-05-17T11:54:31.997 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.457040.log.gz 2024-05-17T11:54:31.997 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.159487.log.gz 2024-05-17T11:54:31.997 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.262681.log.gz 2024-05-17T11:54:31.997 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.209027.log.gz 2024-05-17T11:54:31.997 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.392087.log.gz 2024-05-17T11:54:31.998 INFO:teuthology.orchestra.run.smithi131.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.276494.log.gz 2024-05-17T11:54:31.999 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.384048.log.gz 2024-05-17T11:54:32.029 INFO:teuthology.orchestra.run.smithi131.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.572683.log.gz 2024-05-17T11:54:32.061 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.125173.log.gz 2024-05-17T11:54:32.069 INFO:teuthology.orchestra.run.smithi131.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46127.log.gz 2024-05-17T11:54:32.074 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.200005.log.gz 2024-05-17T11:54:32.082 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47656.log.gz 2024-05-17T11:54:32.083 INFO:teuthology.orchestra.run.smithi131.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.415094.log.gz 2024-05-17T11:54:32.087 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.386840.log.gz 2024-05-17T11:54:32.088 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.269120.log.gz 2024-05-17T11:54:32.093 INFO:teuthology.orchestra.run.smithi131.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.259196.log.gz 2024-05-17T11:54:32.102 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.374102.log.gz 2024-05-17T11:54:32.102 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.243384.log.gz 2024-05-17T11:54:32.108 INFO:teuthology.orchestra.run.smithi131.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.354326.log.gz 2024-05-17T11:54:32.114 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.457471.log.gz 2024-05-17T11:54:32.114 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.428293.log.gz 2024-05-17T11:54:32.131 INFO:teuthology.orchestra.run.smithi131.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.235527.log.gz 2024-05-17T11:54:32.221 INFO:teuthology.orchestra.run.smithi131.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.255698.log.gz 2024-05-17T11:54:32.225 INFO:teuthology.orchestra.run.smithi131.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.257847.log.gz 2024-05-17T11:54:32.239 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.496678.log.gz 2024-05-17T11:54:32.246 INFO:teuthology.orchestra.run.smithi131.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.185767.log.gz 2024-05-17T11:54:32.250 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.277801.log.gz 2024-05-17T11:54:32.254 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.447321.log.gz 2024-05-17T11:54:32.269 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.504531.log.gz 2024-05-17T11:54:33.553 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.107845.log.gz 2024-05-17T11:54:33.556 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.268244.log.gz 2024-05-17T11:54:33.556 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.196371.log.gz 2024-05-17T11:54:33.556 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.532476.log.gz 2024-05-17T11:54:33.556 INFO:teuthology.orchestra.run.smithi131.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.138508.log.gz 2024-05-17T11:54:33.556 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45873.log.gz 2024-05-17T11:54:33.556 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45789.log.gz 2024-05-17T11:54:33.557 INFO:teuthology.orchestra.run.smithi131.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.454882.log.gz 2024-05-17T11:54:33.557 INFO:teuthology.orchestra.run.smithi131.stderr: 77.6% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.143791.log.gz 2024-05-17T11:54:33.557 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.239537.log.gz -- replaced with /var/log/ceph/ceph-client.admin.221720.log.gz 2024-05-17T11:54:33.557 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.510642.log.gz 2024-05-17T11:54:33.557 INFO:teuthology.orchestra.run.smithi131.stderr: 80.3% 83.9% -- replaced with /var/log/ceph/ceph-client.admin.567249.log.gz 2024-05-17T11:54:33.557 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.233394.log.gz 2024-05-17T11:54:33.557 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.188157.log.gz 2024-05-17T11:54:33.557 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.245979.log.gz 90.2% -- replaced with /var/log/ceph/ceph-client.admin.472036.log.gz 2024-05-17T11:54:33.558 INFO:teuthology.orchestra.run.smithi131.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.150696.log.gz 2024-05-17T11:54:33.558 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.507176.log.gz 2024-05-17T11:54:33.558 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:33.558 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:33.558 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% 78.5% -- replaced with /var/log/ceph/ceph-client.admin.199101.log.gz -- replaced with /var/log/ceph/ceph-client.admin.249208.log.gz 2024-05-17T11:54:33.558 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:33.559 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% 90.0% 85.2% -- replaced with /var/log/ceph/ceph-client.admin.478264.log.gz 2024-05-17T11:54:33.567 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.570004.log.gz 2024-05-17T11:54:33.567 INFO:teuthology.orchestra.run.smithi131.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.471156.log.gz 2024-05-17T11:54:33.567 INFO:teuthology.orchestra.run.smithi131.stderr: 91.9% 95.1% -- replaced with /var/log/ceph/ceph-client.admin.443038.log.gz 2024-05-17T11:54:33.567 INFO:teuthology.orchestra.run.smithi131.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.568642.log.gz 2024-05-17T11:54:33.567 INFO:teuthology.orchestra.run.smithi131.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.416422.log.gz 2024-05-17T11:54:33.567 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.458218.log.gz 2024-05-17T11:54:33.567 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.543407.log.gz 2024-05-17T11:54:33.568 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.219603.log.gz 90.0% 2024-05-17T11:54:33.568 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.123886.log.gz 2024-05-17T11:54:33.568 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.412882.log.gz 90.3% 2024-05-17T11:54:33.568 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.220449.log.gz -- replaced with /var/log/ceph/ceph-client.admin.429186.log.gz 2024-05-17T11:54:33.568 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:33.568 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.221729.log.gz 2024-05-17T11:54:33.568 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49536.log.gz 2024-05-17T11:54:33.569 INFO:teuthology.orchestra.run.smithi131.stderr: 92.8% 79.6% -- replaced with /var/log/ceph/ceph-client.admin.547173.log.gz 2024-05-17T11:54:33.569 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.206048.log.gz 2024-05-17T11:54:33.569 INFO:teuthology.orchestra.run.smithi131.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.474373.log.gz 2024-05-17T11:54:33.569 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.224568.log.gz 2024-05-17T11:54:33.569 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.260566.log.gz 2024-05-17T11:54:33.569 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.473945.log.gz 2024-05-17T11:54:33.569 INFO:teuthology.orchestra.run.smithi131.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.569560.log.gz 2024-05-17T11:54:33.570 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.277386.log.gz 2024-05-17T11:54:33.570 INFO:teuthology.orchestra.run.smithi131.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44613.log.gz 2024-05-17T11:54:33.570 INFO:teuthology.orchestra.run.smithi131.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.157119.log.gz 2024-05-17T11:54:33.570 INFO:teuthology.orchestra.run.smithi131.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.482280.log.gz 2024-05-17T11:54:33.570 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% 80.8% -- replaced with /var/log/ceph/ceph-client.admin.456190.log.gz 81.5% 2024-05-17T11:54:33.570 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.116455.log.gz 2024-05-17T11:54:33.571 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.510182.log.gz 2024-05-17T11:54:33.571 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.541290.log.gz 2024-05-17T11:54:33.571 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.445628.log.gz 2024-05-17T11:54:33.571 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.498873.log.gz 2024-05-17T11:54:33.571 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.428763.log.gz 2024-05-17T11:54:33.571 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42642.log.gz 2024-05-17T11:54:33.571 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% 93.4% 80.8% -- replaced with /var/log/ceph/ceph-client.admin.197727.log.gz 2024-05-17T11:54:33.571 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.398342.log.gz 2024-05-17T11:54:33.572 INFO:teuthology.orchestra.run.smithi131.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.136279.log.gz 2024-05-17T11:54:33.572 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.574024.log.gz 93.2% -- replaced with /var/log/ceph/ceph-client.admin.152028.log.gz 2024-05-17T11:54:33.572 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:33.572 INFO:teuthology.orchestra.run.smithi131.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.446047.log.gz 2024-05-17T11:54:33.572 INFO:teuthology.orchestra.run.smithi131.stderr: 92.4% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48264.log.gz 2024-05-17T11:54:33.572 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.389938.log.gz 81.3% 2024-05-17T11:54:33.573 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.221286.log.gz 2024-05-17T11:54:33.573 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.258275.log.gz 2024-05-17T11:54:33.573 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.277810.log.gz 2024-05-17T11:54:33.573 INFO:teuthology.orchestra.run.smithi131.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.374580.log.gz 2024-05-17T11:54:33.573 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.372400.log.gz 2024-05-17T11:54:33.573 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.389014.log.gz 2024-05-17T11:54:33.573 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.217016.log.gz 2024-05-17T11:54:33.573 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.477840.log.gz 2024-05-17T11:54:33.574 INFO:teuthology.orchestra.run.smithi131.stderr: 94.2% 77.9% -- replaced with /var/log/ceph/ceph-client.admin.416855.log.gz -- replaced with /var/log/ceph/ceph-client.admin.389465.log.gz 2024-05-17T11:54:33.574 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:33.574 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.376279.log.gz 2024-05-17T11:54:33.574 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.440033.log.gz 2024-05-17T11:54:33.574 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.362968.log.gz 2024-05-17T11:54:33.574 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.515534.log.gz 2024-05-17T11:54:33.574 INFO:teuthology.orchestra.run.smithi131.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.363391.log.gz 2024-05-17T11:54:33.574 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.199553.log.gz 2024-05-17T11:54:33.575 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.362977.log.gz 2024-05-17T11:54:33.575 INFO:teuthology.orchestra.run.smithi131.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.552584.log.gz 2024-05-17T11:54:33.575 INFO:teuthology.orchestra.run.smithi131.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.279508.log.gz 90.2% 2024-05-17T11:54:33.575 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.514695.log.gz 2024-05-17T11:54:33.575 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.432262.log.gz 2024-05-17T11:54:33.575 INFO:teuthology.orchestra.run.smithi131.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.132461.log.gz 2024-05-17T11:54:33.575 INFO:teuthology.orchestra.run.smithi131.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.482271.log.gz 2024-05-17T11:54:33.575 INFO:teuthology.orchestra.run.smithi131.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.177647.log.gz 2024-05-17T11:54:33.576 INFO:teuthology.orchestra.run.smithi131.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.442599.log.gz 2024-05-17T11:54:33.576 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.469865.log.gz 2024-05-17T11:54:33.694 INFO:teuthology.orchestra.run.smithi131.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.555321.log.gz 2024-05-17T11:54:33.765 INFO:teuthology.orchestra.run.smithi131.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.383106.log.gz 2024-05-17T11:54:33.811 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.419698.log.gz 2024-05-17T11:54:33.839 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.209879.log.gz 2024-05-17T11:54:33.874 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.536630.log.gz 2024-05-17T11:54:33.895 INFO:teuthology.orchestra.run.smithi131.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.262249.log.gz 2024-05-17T11:54:33.915 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.430029.log.gz 2024-05-17T11:54:33.918 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.243803.log.gz 2024-05-17T11:54:33.921 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.436616.log.gz 2024-05-17T11:54:33.924 INFO:teuthology.orchestra.run.smithi131.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.136707.log.gz 2024-05-17T11:54:33.934 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.128226.log.gz 2024-05-17T11:54:33.943 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.182175.log.gz 2024-05-17T11:54:33.975 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.175517.log.gz 2024-05-17T11:54:34.022 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44235.log.gz 2024-05-17T11:54:34.039 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.254855.log.gz 2024-05-17T11:54:34.053 INFO:teuthology.orchestra.run.smithi131.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.244227.log.gz 2024-05-17T11:54:34.056 INFO:teuthology.orchestra.run.smithi131.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.569107.log.gz 2024-05-17T11:54:34.059 INFO:teuthology.orchestra.run.smithi131.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44837.log.gz 2024-05-17T11:54:34.090 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.213445.log.gz 2024-05-17T11:54:34.223 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.133317.log.gz 2024-05-17T11:54:34.246 INFO:teuthology.orchestra.run.smithi131.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.234243.log.gz 2024-05-17T11:54:34.311 INFO:teuthology.orchestra.run.smithi131.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.266940.log.gz 2024-05-17T11:54:34.319 INFO:teuthology.orchestra.run.smithi131.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.493780.log.gz 2024-05-17T11:54:34.319 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.385018.log.gz 2024-05-17T11:54:34.329 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.563694.log.gz 2024-05-17T11:54:34.421 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.413799.log.gz 2024-05-17T11:54:34.439 INFO:teuthology.orchestra.run.smithi131.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.388581.log.gz 2024-05-17T11:54:34.441 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.414218.log.gz 2024-05-17T11:54:34.521 INFO:teuthology.orchestra.run.smithi131.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.399285.log.gz 2024-05-17T11:54:34.537 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.216409.log.gz 2024-05-17T11:54:34.551 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.506762.log.gz 2024-05-17T11:54:34.591 INFO:teuthology.orchestra.run.smithi131.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.437917.log.gz 2024-05-17T11:54:34.649 INFO:teuthology.orchestra.run.smithi131.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.494799.log.gz 2024-05-17T11:54:34.654 INFO:teuthology.orchestra.run.smithi131.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.400306.log.gz 2024-05-17T11:54:34.659 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.218276.log.gz 2024-05-17T11:54:34.679 INFO:teuthology.orchestra.run.smithi131.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.232078.log.gz 2024-05-17T11:54:34.722 INFO:teuthology.orchestra.run.smithi131.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44836.log.gz 2024-05-17T11:54:34.744 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.198179.log.gz 2024-05-17T11:54:34.754 INFO:teuthology.orchestra.run.smithi131.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.139878.log.gz 2024-05-17T11:54:34.763 INFO:teuthology.orchestra.run.smithi131.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.242478.log.gz 2024-05-17T11:54:34.770 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.187734.log.gz 2024-05-17T11:54:34.779 INFO:teuthology.orchestra.run.smithi131.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.494215.log.gz 2024-05-17T11:54:34.788 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.247948.log.gz 2024-05-17T11:54:34.917 INFO:teuthology.orchestra.run.smithi131.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.250588.log.gz 2024-05-17T11:54:34.993 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.507610.log.gz 2024-05-17T11:54:35.020 INFO:teuthology.orchestra.run.smithi131.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.239995.log.gz 2024-05-17T11:54:35.037 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.195467.log.gz 2024-05-17T11:54:35.221 INFO:teuthology.orchestra.run.smithi131.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.561465.log.gz 2024-05-17T11:54:35.242 INFO:teuthology.orchestra.run.smithi131.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.200901.log.gz 2024-05-17T11:54:35.338 INFO:teuthology.orchestra.run.smithi131.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.148536.log.gz 2024-05-17T11:54:35.366 INFO:teuthology.orchestra.run.smithi131.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.480948.log.gz 2024-05-17T11:54:35.389 INFO:teuthology.orchestra.run.smithi131.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.546305.log.gz 2024-05-17T11:54:35.531 INFO:teuthology.orchestra.run.smithi131.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.541281.log.gz 2024-05-17T11:54:35.579 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.480516.log.gz 2024-05-17T11:54:35.610 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.267396.log.gz 2024-05-17T11:54:35.623 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.264789.log.gz 2024-05-17T11:54:35.634 INFO:teuthology.orchestra.run.smithi131.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.559670.log.gz 2024-05-17T11:54:35.641 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.367745.log.gz 2024-05-17T11:54:35.662 INFO:teuthology.orchestra.run.smithi131.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.558792.log.gz 2024-05-17T11:54:35.733 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.413312.log.gz 2024-05-17T11:54:35.798 INFO:teuthology.orchestra.run.smithi131.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.516390.log.gz 2024-05-17T11:54:35.849 INFO:teuthology.orchestra.run.smithi131.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.229073.log.gz 2024-05-17T11:54:35.859 INFO:teuthology.orchestra.run.smithi131.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.479126.log.gz 2024-05-17T11:54:35.870 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.253584.log.gz 2024-05-17T11:54:36.000 INFO:teuthology.orchestra.run.smithi131.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.195006.log.gz 2024-05-17T11:54:36.008 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.501984.log.gz 2024-05-17T11:54:36.141 INFO:teuthology.orchestra.run.smithi131.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.499719.log.gz 2024-05-17T11:54:36.186 INFO:teuthology.orchestra.run.smithi131.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.435334.log.gz 2024-05-17T11:54:36.227 INFO:teuthology.orchestra.run.smithi131.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.158912.log.gz 2024-05-17T11:54:36.248 INFO:teuthology.orchestra.run.smithi131.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44487.log.gz 2024-05-17T11:54:36.264 INFO:teuthology.orchestra.run.smithi131.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.428754.log.gz 2024-05-17T11:54:36.433 INFO:teuthology.orchestra.run.smithi131.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.152497.log.gz 2024-05-17T11:54:36.506 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.398789.log.gz 2024-05-17T11:54:36.520 INFO:teuthology.orchestra.run.smithi131.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.430348.log.gz 2024-05-17T11:54:36.526 INFO:teuthology.orchestra.run.smithi131.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.418229.log.gz 2024-05-17T11:54:36.686 INFO:teuthology.orchestra.run.smithi131.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.216418.log.gz 2024-05-17T11:54:36.699 INFO:teuthology.orchestra.run.smithi131.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.437045.log.gz 2024-05-17T11:54:36.838 INFO:teuthology.orchestra.run.smithi150.stderr: 95.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-17T11:54:36.870 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.194563.log.gz 2024-05-17T11:54:36.891 INFO:teuthology.orchestra.run.smithi131.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.189003.log.gz 2024-05-17T11:54:36.951 INFO:teuthology.orchestra.run.smithi131.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.430679.log.gz 2024-05-17T11:54:37.044 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.251453.log.gz 2024-05-17T11:54:37.050 INFO:teuthology.orchestra.run.smithi131.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.197266.log.gz 2024-05-17T11:54:37.177 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.454468.log.gz 2024-05-17T11:54:38.208 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% 80.6% -- replaced with /var/log/ceph/ceph-client.admin.190987.log.gz 2024-05-17T11:54:38.209 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.501496.log.gz 2024-05-17T11:54:38.209 INFO:teuthology.orchestra.run.smithi131.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.402300.log.gz 2024-05-17T11:54:38.439 INFO:teuthology.orchestra.run.smithi131.stderr: 80.9% 85.1% -- replaced with /var/log/ceph/ceph-client.admin.206471.log.gz 2024-05-17T11:54:38.439 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.361991.log.gz 2024-05-17T11:54:38.440 INFO:teuthology.orchestra.run.smithi131.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.430396.log.gz 2024-05-17T11:54:38.441 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% 85.5% -- replaced with /var/log/ceph/ceph-client.admin.537894.log.gz 2024-05-17T11:54:38.442 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.506319.log.gz 2024-05-17T11:54:38.442 INFO:teuthology.orchestra.run.smithi131.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.156654.log.gz 2024-05-17T11:54:38.442 INFO:teuthology.orchestra.run.smithi131.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.109322.log.gz 2024-05-17T11:54:38.442 INFO:teuthology.orchestra.run.smithi131.stderr: 93.6% 90.4% -- replaced with /var/log/ceph/ceph-client.admin.256135.log.gz 2024-05-17T11:54:38.442 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.225964.log.gz 91.6% -- replaced with /var/log/ceph/ceph-client.admin.237294.log.gz 2024-05-17T11:54:38.442 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T11:54:38.442 INFO:teuthology.orchestra.run.smithi131.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.218708.log.gz 2024-05-17T11:54:38.620 INFO:teuthology.orchestra.run.smithi131.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.225484.log.gz 2024-05-17T11:54:38.818 INFO:teuthology.orchestra.run.smithi131.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.430038.log.gz 2024-05-17T11:54:38.834 INFO:teuthology.orchestra.run.smithi131.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.107854.log.gz 2024-05-17T11:54:39.235 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.244236.log.gz 2024-05-17T11:54:39.576 INFO:teuthology.orchestra.run.smithi131.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.219180.log.gz 2024-05-17T11:54:39.606 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.186246.log.gz 2024-05-17T11:54:40.024 INFO:teuthology.orchestra.run.smithi131.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.239986.log.gz 2024-05-17T11:54:40.267 INFO:teuthology.orchestra.run.smithi131.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.0.49946.log.gz 2024-05-17T11:54:40.551 INFO:teuthology.orchestra.run.smithi131.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.114693.log.gz 2024-05-17T11:54:40.811 INFO:teuthology.orchestra.run.smithi131.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.470297.log.gz 2024-05-17T11:54:43.558 INFO:teuthology.orchestra.run.smithi131.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.430300.log.gz 2024-05-17T11:54:43.706 INFO:teuthology.orchestra.run.smithi131.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.121816.log.gz 2024-05-17T11:54:43.743 INFO:teuthology.orchestra.run.smithi131.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.506306.log.gz 2024-05-17T11:54:48.503 INFO:teuthology.orchestra.run.smithi131.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.111690.log.gz 2024-05-17T11:54:48.899 INFO:teuthology.orchestra.run.smithi131.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.415539.log.gz 2024-05-17T11:54:50.832 INFO:teuthology.orchestra.run.smithi131.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.425586.log.gz 2024-05-17T11:54:58.257 INFO:teuthology.orchestra.run.smithi131.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.417733.log.gz 2024-05-17T11:54:59.074 INFO:teuthology.orchestra.run.smithi131.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.258698.log.gz 2024-05-17T11:55:02.814 INFO:teuthology.orchestra.run.smithi131.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.246437.log.gz 2024-05-17T11:55:05.038 INFO:teuthology.orchestra.run.smithi131.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.223661.log.gz 2024-05-17T11:55:06.793 INFO:teuthology.orchestra.run.smithi150.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-17T11:55:07.222 INFO:teuthology.orchestra.run.smithi131.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.admin.124309.log.gz 2024-05-17T11:55:09.317 INFO:teuthology.orchestra.run.smithi131.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.143347.log.gz 2024-05-17T11:55:10.264 INFO:teuthology.orchestra.run.smithi131.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.138045.log.gz 2024-05-17T11:55:10.342 INFO:teuthology.orchestra.run.smithi131.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.245510.log.gz 2024-05-17T11:55:10.591 INFO:teuthology.orchestra.run.smithi131.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-17T11:55:10.923 INFO:teuthology.orchestra.run.smithi131.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.137145.log.gz 2024-05-17T11:55:13.504 INFO:teuthology.orchestra.run.smithi131.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.112661.log.gz 2024-05-17T11:55:13.594 INFO:teuthology.orchestra.run.smithi131.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.138517.log.gz 2024-05-17T11:55:14.769 INFO:teuthology.orchestra.run.smithi131.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.245988.log.gz 2024-05-17T11:55:15.780 INFO:teuthology.orchestra.run.smithi131.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.121337.log.gz 2024-05-17T11:55:16.180 INFO:teuthology.orchestra.run.smithi131.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.226489.log.gz 2024-05-17T11:55:16.348 INFO:teuthology.orchestra.run.smithi131.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.120857.log.gz 2024-05-17T11:55:17.359 INFO:teuthology.orchestra.run.smithi131.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.387696.log.gz 2024-05-17T11:55:19.812 INFO:teuthology.orchestra.run.smithi131.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.394700.log.gz 2024-05-17T11:55:19.986 INFO:teuthology.orchestra.run.smithi131.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.489100.log.gz 2024-05-17T11:55:20.251 INFO:teuthology.orchestra.run.smithi131.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.139415.log.gz 2024-05-17T11:55:20.948 INFO:teuthology.orchestra.run.smithi131.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.276503.log.gz 2024-05-17T11:55:21.387 INFO:teuthology.orchestra.run.smithi131.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.434855.log.gz 2024-05-17T11:55:22.116 INFO:teuthology.orchestra.run.smithi131.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.362520.log.gz 2024-05-17T11:55:22.395 INFO:teuthology.orchestra.run.smithi131.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.115562.log.gz 2024-05-17T11:55:22.728 INFO:teuthology.orchestra.run.smithi131.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.362000.log.gz 2024-05-17T11:55:23.431 INFO:teuthology.orchestra.run.smithi131.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.110820.log.gz 2024-05-17T11:55:24.997 INFO:teuthology.orchestra.run.smithi131.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.549911.log.gz 2024-05-17T11:55:25.807 INFO:teuthology.orchestra.run.smithi131.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.571746.log.gz 2024-05-17T11:55:26.370 INFO:teuthology.orchestra.run.smithi131.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.361562.log.gz 2024-05-17T11:55:28.072 INFO:teuthology.orchestra.run.smithi131.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.468133.log.gz 2024-05-17T11:55:28.368 INFO:teuthology.orchestra.run.smithi131.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.549445.log.gz 2024-05-17T11:55:30.712 INFO:teuthology.orchestra.run.smithi131.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.admin.117312.log.gz 2024-05-17T11:55:31.582 INFO:teuthology.orchestra.run.smithi131.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.111257.log.gz 2024-05-17T11:55:33.757 INFO:teuthology.orchestra.run.smithi131.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.548975.log.gz 2024-05-17T11:55:34.608 INFO:teuthology.orchestra.run.smithi131.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.222575.log.gz 2024-05-17T11:55:34.611 INFO:teuthology.orchestra.run.smithi131.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.424454.log.gz 2024-05-17T11:55:36.348 INFO:teuthology.orchestra.run.smithi131.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.242926.log.gz 2024-05-17T11:55:37.223 INFO:teuthology.orchestra.run.smithi131.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.550373.log.gz 2024-05-17T11:55:37.234 INFO:teuthology.orchestra.run.smithi150.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-17T11:55:37.692 INFO:teuthology.orchestra.run.smithi150.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-17T11:55:44.046 INFO:teuthology.orchestra.run.smithi150.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-17T11:55:51.545 INFO:teuthology.orchestra.run.smithi131.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.426523.log.gz 2024-05-17T11:55:53.636 INFO:teuthology.orchestra.run.smithi131.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.511919.log.gz 2024-05-17T11:55:59.382 INFO:teuthology.orchestra.run.smithi131.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.240446.log.gz 2024-05-17T11:56:20.283 INFO:teuthology.orchestra.run.smithi131.stderr: 97.7% -- replaced with /var/log/ceph/ceph-client.admin.509744.log.gz 2024-05-17T11:57:01.894 INFO:teuthology.orchestra.run.smithi131.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.249217.log.gz 2024-05-17T11:57:19.751 INFO:teuthology.orchestra.run.smithi131.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.114434.log.gz 2024-05-17T11:57:43.634 INFO:teuthology.orchestra.run.smithi150.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-17T11:57:44.280 INFO:teuthology.orchestra.run.smithi131.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.179425.log.gz 2024-05-17T11:57:52.147 INFO:teuthology.orchestra.run.smithi131.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.146750.log.gz 2024-05-17T11:58:04.644 INFO:teuthology.orchestra.run.smithi150.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-17T11:58:04.646 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-05-17T11:58:04.646 INFO:teuthology.orchestra.run.smithi150.stderr:real 3m38.211s 2024-05-17T11:58:04.646 INFO:teuthology.orchestra.run.smithi150.stderr:user 4m35.496s 2024-05-17T11:58:04.646 INFO:teuthology.orchestra.run.smithi150.stderr:sys 0m11.405s 2024-05-17T11:58:14.947 INFO:teuthology.orchestra.run.smithi131.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.127763.log.gz 2024-05-17T11:58:20.849 INFO:teuthology.orchestra.run.smithi131.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.379701.log.gz 2024-05-17T11:59:52.556 INFO:teuthology.orchestra.run.smithi131.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.179911.log.gz 2024-05-17T11:59:57.233 INFO:teuthology.orchestra.run.smithi131.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.223064.log.gz 2024-05-17T12:01:09.842 INFO:teuthology.orchestra.run.smithi131.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-17T12:01:18.588 INFO:teuthology.orchestra.run.smithi131.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.156149.log.gz 2024-05-17T12:01:23.615 INFO:teuthology.orchestra.run.smithi131.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.397431.log.gz 2024-05-17T12:01:24.673 INFO:teuthology.orchestra.run.smithi131.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.142454.log.gz 2024-05-17T12:02:42.062 INFO:teuthology.orchestra.run.smithi131.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.189890.log.gz 2024-05-17T12:04:03.758 INFO:teuthology.orchestra.run.smithi131.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.109832.log.gz 2024-05-17T12:05:05.570 INFO:teuthology.orchestra.run.smithi131.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.160362.log.gz 2024-05-17T12:06:11.188 INFO:teuthology.orchestra.run.smithi131.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.427426.log.gz 2024-05-17T12:06:31.008 INFO:teuthology.orchestra.run.smithi131.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.572204.log.gz 2024-05-17T12:07:01.604 INFO:teuthology.orchestra.run.smithi131.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.112153.log.gz 2024-05-17T12:09:15.473 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.534097.log.gz 2024-05-17T12:11:57.148 INFO:teuthology.orchestra.run.smithi131.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.259205.log.gz 2024-05-17T12:13:09.952 INFO:teuthology.orchestra.run.smithi131.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.113138.log.gz 2024-05-17T12:13:27.666 INFO:teuthology.orchestra.run.smithi131.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.404217.log.gz 2024-05-17T12:13:54.234 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.110328.log.gz 2024-05-17T12:14:39.562 INFO:teuthology.orchestra.run.smithi131.stderr: 90.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-17T12:18:47.076 INFO:teuthology.orchestra.run.smithi131.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.237731.log.gz 2024-05-17T12:21:38.237 INFO:teuthology.orchestra.run.smithi131.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.521387.log.gz 2024-05-17T12:22:08.358 INFO:teuthology.orchestra.run.smithi131.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.522929.log.gz 2024-05-17T12:22:19.187 INFO:teuthology.orchestra.run.smithi131.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.532485.log.gz 2024-05-17T12:22:24.529 INFO:teuthology.orchestra.run.smithi131.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.529425.log.gz 2024-05-17T12:22:34.468 INFO:teuthology.orchestra.run.smithi131.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.530935.log.gz 2024-05-17T12:23:01.915 INFO:teuthology.orchestra.run.smithi131.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.527785.log.gz 2024-05-17T12:23:02.613 INFO:teuthology.orchestra.run.smithi131.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.526131.log.gz 2024-05-17T12:23:53.147 INFO:teuthology.orchestra.run.smithi131.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.519725.log.gz 2024-05-17T12:24:15.219 INFO:teuthology.orchestra.run.smithi131.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.524501.log.gz 2024-05-17T12:24:16.185 INFO:teuthology.orchestra.run.smithi131.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-17T12:24:40.768 INFO:teuthology.orchestra.run.smithi131.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.517726.log.gz 2024-05-17T12:26:51.301 INFO:teuthology.orchestra.run.smithi131.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.279517.log.gz 2024-05-17T12:27:36.271 INFO:teuthology.orchestra.run.smithi131.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-17T12:29:30.378 INFO:teuthology.orchestra.run.smithi131.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-17T12:29:53.427 INFO:teuthology.orchestra.run.smithi131.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.186757.log.gz 2024-05-17T12:32:35.657 INFO:teuthology.orchestra.run.smithi131.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.460277.log.gz 2024-05-17T12:43:19.572 INFO:teuthology.orchestra.run.smithi131.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.450329.log.gz 2024-05-17T12:44:58.300 INFO:teuthology.orchestra.run.smithi131.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.452298.log.gz 2024-05-17T12:46:37.155 INFO:teuthology.orchestra.run.smithi131.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.269586.log.gz 2024-05-17T12:51:46.295 INFO:teuthology.orchestra.run.smithi131.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.152956.log.gz 2024-05-17T12:52:02.460 INFO:teuthology.orchestra.run.smithi131.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-17T12:58:09.034 INFO:teuthology.orchestra.run.smithi131.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-17T13:21:21.103 INFO:teuthology.orchestra.run.smithi131.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.144219.log.gz 2024-05-17T13:49:14.527 INFO:teuthology.orchestra.run.smithi131.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.574471.log.gz 2024-05-17T13:54:33.689 INFO:teuthology.orchestra.run.smithi131.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.545162.log.gz 2024-05-17T13:54:33.693 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-17T13:54:33.693 INFO:teuthology.orchestra.run.smithi131.stderr:real 120m7.224s 2024-05-17T13:54:33.693 INFO:teuthology.orchestra.run.smithi131.stderr:user 82m37.906s 2024-05-17T13:54:33.693 INFO:teuthology.orchestra.run.smithi131.stderr:sys 3m33.701s 2024-05-17T13:54:33.694 INFO:tasks.ceph:Archiving logs... 2024-05-17T13:54:33.696 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314/remote/smithi131/log 2024-05-17T13:54:33.697 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-17T14:09:54.909 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314/remote/smithi150/log 2024-05-17T14:09:54.933 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-17T14:17:56.594 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-17T14:17:56.606 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-17T14:17:56.607 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-17T14:17:56.611 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-17T14:17:57.006 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-17T14:17:57.017 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-17T14:17:57.017 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-17T14:17:57.021 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-17T14:17:57.036 INFO:teuthology.orchestra.run.smithi150.stderr:bash: line 1: ntpq: command not found 2024-05-17T14:17:57.050 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2024-05-17T14:17:57.059 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-17T14:17:57.060 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-05-17T14:17:57.060 INFO:teuthology.orchestra.run.smithi150.stdout:^* hv01.front.sepia.ceph.com 3 7 377 99 +878us[ +849us] +/- 40ms 2024-05-17T14:17:57.060 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 41 -929us[ -929us] +/- 55ms 2024-05-17T14:17:57.060 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -305us[ -305us] +/- 71ms 2024-05-17T14:17:57.060 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-17T14:17:57.089 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-17T14:17:57.089 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-05-17T14:17:57.089 INFO:teuthology.orchestra.run.smithi131.stdout:^* hv01.front.sepia.ceph.com 3 8 377 94 +933us[ +967us] +/- 40ms 2024-05-17T14:17:57.089 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 166 -916us[ -882us] +/- 53ms 2024-05-17T14:17:57.089 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 95 -208us[ -173us] +/- 71ms 2024-05-17T14:17:57.089 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-17T14:17:57.091 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-17T14:17:57.101 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-17T14:17:57.102 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-17T14:17:57.122 DEBUG:teuthology.orchestra.run.smithi131:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-17T14:17:57.529 DEBUG:teuthology.orchestra.run.smithi150:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-17T14:17:57.649 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-17T14:17:57.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T14:17:57.723 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-17T14:17:57.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T14:17:57.753 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-17T14:17:57.766 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-17T14:17:57.789 INFO:teuthology.task.internal:Duration was 36990.639624 seconds 2024-05-17T14:17:57.790 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-17T14:17:57.822 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-17T14:17:57.823 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-17T14:17:57.826 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-17T14:17:57.885 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-17T14:17:57.954 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-17T14:17:58.365 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-17T14:17:58.366 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2024-05-17T14:17:58.366 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-17T14:17:58.415 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2024-05-17T14:17:58.416 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-17T14:17:58.440 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-17T14:17:58.440 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-17T14:17:58.444 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-17T14:17:58.508 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-17T14:17:58.509 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-17T14:17:58.512 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-17T14:17:58.975 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-17T14:17:58.986 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-17T14:17:58.986 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-17T14:17:59.030 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-17T14:17:59.057 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-17T14:17:59.070 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-17T14:17:59.074 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-17T14:17:59.134 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2024-05-17T14:17:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2024-05-17T14:17:59.200 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-17T14:17:59.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T14:17:59.232 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-17T14:17:59.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T14:17:59.247 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-17T14:17:59.259 INFO:teuthology.task.internal:Transferring archived files... 2024-05-17T14:17:59.261 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314/remote/smithi131 2024-05-17T14:17:59.261 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-17T14:17:59.335 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314/remote/smithi150 2024-05-17T14:17:59.335 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-17T14:17:59.371 INFO:teuthology.task.internal:Removing archive directory... 2024-05-17T14:17:59.371 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-17T14:17:59.374 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-17T14:17:59.420 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-17T14:17:59.432 INFO:teuthology.task.internal:Not uploading archives. 2024-05-17T14:17:59.433 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-17T14:17:59.457 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-17T14:17:59.457 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-17T14:17:59.461 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-17T14:17:59.476 INFO:teuthology.orchestra.run.smithi150.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 17 14:17 /home/ubuntu/cephtest 2024-05-17T14:17:59.493 INFO:teuthology.orchestra.run.smithi131.stdout: 262165 4 drwxr-xr-x 3 ubuntu ubuntu 4096 May 17 14:17 /home/ubuntu/cephtest 2024-05-17T14:17:59.493 INFO:teuthology.orchestra.run.smithi131.stdout: 406795 4 d--------- 2 ubuntu ubuntu 4096 May 17 04:10 /home/ubuntu/cephtest/mnt.0 2024-05-17T14:17:59.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-17T14:17:59.494 INFO:teuthology.orchestra.run.smithi131.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-05-17T14:17:59.495 INFO:teuthology.orchestra.run.smithi131.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-05-17T14:17:59.495 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a4b16c58a5d7aa60dee491f6f096b7509e2f1269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_a4b16c58a5d7aa60dee491f6f096b7509e2f1269/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_a4b16c58a5d7aa60dee491f6f096b7509e2f1269/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_a4b16c58a5d7aa60dee491f6f096b7509e2f1269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_a4b16c58a5d7aa60dee491f6f096b7509e2f1269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-05-17T14:17:59.505 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-17T14:17:59.515 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-17T14:17:59.540 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi131 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-05-17T14:17:59.541 INFO:teuthology.nuke:Checking targets against current locks 2024-05-17T14:17:59.571 DEBUG:teuthology.nuke:shortname: smithi131 2024-05-17T14:17:59.572 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-17T14:17:59.596 DEBUG:teuthology.nuke:shortname: smithi150 2024-05-17T14:17:59.596 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-17T14:17:59.600 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-17 03:52:24.092500', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAkIeqZ1Lq+daB3VrsbZWGFG0yv1p3lA/7jEN4fpSRsQ2tORlS7kVKCTHJS8TKhXfEIHIcG4tAJtoVCa5QZEhXg='} 2024-05-17T14:17:59.619 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-17_03:38:57-fs-wip-pdonnell-testing-20240517.012458-debug-distro-default-smithi/7710314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-17 03:52:24.091004', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM6yn5RL+r1O16cW28dKB5TWHXawrJIKtOenu0T7S4UXj6VUgotAElcjDcyz1EwxKBm1bmglO2DaBRTw6HsXMO0='} 2024-05-17T14:17:59.648 INFO:teuthology.orchestra.console.smithi131:Power off 2024-05-17T14:17:59.649 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-17T14:17:59.666 INFO:teuthology.orchestra.console.smithi150:Power off 2024-05-17T14:17:59.667 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-17T14:17:59.677 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2024-05-17T14:17:59.678 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-17T14:17:59.691 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off 2024-05-17T14:17:59.691 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-17T14:17:59.705 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-05-17T14:17:59.714 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-05-17T14:18:03.706 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-17T14:18:03.715 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-17T14:18:03.817 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-05-17T14:18:03.826 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-05-17T14:18:07.818 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-17T14:18:07.827 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-17T14:18:07.929 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2024-05-17T14:18:07.936 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-05-17T14:18:08.031 INFO:teuthology.orchestra.console.smithi131:Power off completed 2024-05-17T14:18:11.938 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-17T14:18:12.050 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-05-17T14:18:12.151 INFO:teuthology.orchestra.console.smithi150:Power off completed 2024-05-17T14:18:12.255 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} duration: 36990.639623880386 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9d882c244a86454f8d89ed4ddd7fed48 status: fail success: false 2024-05-17T14:18:12.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-17T14:18:12.340 INFO:teuthology.run:FAIL